2023-10-17T05:50:52.031 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-17T05:50:52.032 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_dparmar@teuthology --name dparmar-2023-10-17_05:37:11-fs:functional-wip-63105-distro-default-smithi --archive /home/teuthworker/archive/dparmar-2023-10-17_05:37:11-fs:functional-wip-63105-distro-default-smithi/7431046 --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} -- /home/teuthworker/archive/dparmar-2023-10-17_05:37:11-fs:functional-wip-63105-distro-default-smithi/7431046/orig.config.yaml 2023-10-17T05:50:52.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T05:50:52.173 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dparmar-2023-10-17_05:37:11-fs:functional-wip-63105-distro-default-smithi/7431046 branch: wip-63105 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} email: null first_in_suite: false job_id: '7431046' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: dparmar-2023-10-17_05:37:11-fs:functional-wip-63105-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-63105 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - but it is still running - slow request - MDS_CLIENT_LATE_RELEASE - t responding to mclientcaps - file system flag refuse_client_session is set - Degraded data redundancy - MDS_CLIENTS_LAGGY - Reduced data availability sha1: 6f3e6b48891b9b50415c0822b6b870797fcda16d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6f3e6b48891b9b50415c0822b6b870797fcda16d kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-63105 sha1: 3aa759a2d032371ce26212d0251f10b9c2613685 owner: scheduled_dparmar@teuthology priority: 55 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6930 sha1: 6f3e6b48891b9b50415c0822b6b870797fcda16d sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-63105 suite_path: /home/teuthworker/src/github.com_dparmar18_ceph_3aa759a2d032371ce26212d0251f10b9c2613685/qa suite_relpath: qa suite_repo: https://github.com/dparmar18/ceph suite_sha1: 3aa759a2d032371ce26212d0251f10b9c2613685 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi125.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi184.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_client_recovery teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-17_05:37:11 tube: smithi user: dparmar verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-17T05:50:52.174 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_dparmar18_ceph_3aa759a2d032371ce26212d0251f10b9c2613685/qa; will attempt to use it 2023-10-17T05:50:52.175 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_dparmar18_ceph_3aa759a2d032371ce26212d0251f10b9c2613685/qa/tasks 2023-10-17T05:50:52.175 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-17T05:50:52.177 INFO:teuthology.task.internal:Checking packages... 2023-10-17T05:50:52.200 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '6f3e6b48891b9b50415c0822b6b870797fcda16d' 2023-10-17T05:50:52.200 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-17T05:50:52.201 INFO:teuthology.packaging:ref: None 2023-10-17T05:50:52.201 INFO:teuthology.packaging:tag: None 2023-10-17T05:50:52.201 INFO:teuthology.packaging:branch: wip-63105 2023-10-17T05:50:52.202 INFO:teuthology.packaging:sha1: 6f3e6b48891b9b50415c0822b6b870797fcda16d 2023-10-17T05:50:52.202 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-63105 2023-10-17T05:50:52.367 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5610-g6f3e6b48-1focal 2023-10-17T05:50:52.367 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-17T05:50:52.374 INFO:teuthology.task.internal:no buildpackages task found 2023-10-17T05:50:52.374 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-17T05:50:52.380 INFO:teuthology.task.internal:Saving configuration 2023-10-17T05:50:52.395 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-17T05:50:52.401 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-17T05:50:52.426 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-17_05:37:11-fs:functional-wip-63105-distro-default-smithi/7431046', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-17 05:44:44.311115', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-17T05:50:52.452 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-17_05:37:11-fs:functional-wip-63105-distro-default-smithi/7431046', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-17 05:44:44.312597', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-17T05:50:52.452 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-17T05:50:52.459 INFO:teuthology.task.internal:roles: ubuntu@smithi125.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-17T05:50:52.459 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-17T05:50:52.459 INFO:teuthology.run_tasks:Running task console_log... 2023-10-17T05:50:52.523 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f03905b5af0>, signals=[15]) 2023-10-17T05:50:52.524 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-17T05:50:52.531 INFO:teuthology.task.internal:Opening connections... 2023-10-17T05:50:52.531 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi125.front.sepia.ceph.com 2023-10-17T05:50:52.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T05:50:52.583 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2023-10-17T05:50:52.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T05:50:52.628 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-17T05:50:52.634 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2023-10-17T05:50:52.662 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2023-10-17T05:50:52.662 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-10-17T05:50:52.711 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Ubuntu" 2023-10-17T05:50:52.711 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-17T05:50:52.712 INFO:teuthology.orchestra.run.smithi125.stdout:ID=ubuntu 2023-10-17T05:50:52.712 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE=debian 2023-10-17T05:50:52.712 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-17T05:50:52.712 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="20.04" 2023-10-17T05:50:52.712 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-17T05:50:52.713 INFO:teuthology.orchestra.run.smithi125.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-17T05:50:52.713 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-17T05:50:52.713 INFO:teuthology.orchestra.run.smithi125.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-17T05:50:52.713 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_CODENAME=focal 2023-10-17T05:50:52.714 INFO:teuthology.orchestra.run.smithi125.stdout:UBUNTU_CODENAME=focal 2023-10-17T05:50:52.714 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-10-17T05:50:52.739 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2023-10-17T05:50:52.746 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2023-10-17T05:50:52.746 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-10-17T05:50:52.796 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Ubuntu" 2023-10-17T05:50:52.796 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-17T05:50:52.796 INFO:teuthology.orchestra.run.smithi184.stdout:ID=ubuntu 2023-10-17T05:50:52.797 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE=debian 2023-10-17T05:50:52.797 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-17T05:50:52.797 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="20.04" 2023-10-17T05:50:52.797 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-17T05:50:52.797 INFO:teuthology.orchestra.run.smithi184.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-17T05:50:52.798 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-17T05:50:52.798 INFO:teuthology.orchestra.run.smithi184.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-17T05:50:52.798 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_CODENAME=focal 2023-10-17T05:50:52.798 INFO:teuthology.orchestra.run.smithi184.stdout:UBUNTU_CODENAME=focal 2023-10-17T05:50:52.799 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-10-17T05:50:52.821 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-17T05:50:52.831 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-17T05:50:52.837 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-17T05:50:52.838 DEBUG:teuthology.orchestra.run.smithi125:> test '!' -e /home/ubuntu/cephtest 2023-10-17T05:50:52.840 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2023-10-17T05:50:52.846 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-17T05:50:52.852 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-17T05:50:52.853 DEBUG:teuthology.orchestra.run.smithi125:> test -z $(ls -A /var/lib/ceph) 2023-10-17T05:50:52.887 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2023-10-17T05:50:52.907 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-17T05:50:52.960 INFO:teuthology.run_tasks:Running task kernel... 2023-10-17T05:50:52.974 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-10-17T05:50:52.975 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-10-17T05:50:52.975 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-10-17T05:50:52.976 DEBUG:teuthology.orchestra.run.smithi125:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-17T05:50:52.977 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-17T05:50:52.981 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-17T05:50:52.982 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-10-17T05:50:52.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-17T05:50:52.987 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-10-17T05:50:53.144 DEBUG:teuthology.task.kernel:sha1 for client.0 is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-17T05:50:53.144 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-17T05:50:53.144 DEBUG:teuthology.orchestra.run.smithi125:> uname -r 2023-10-17T05:50:53.151 INFO:teuthology.orchestra.run.smithi125.stdout:5.4.0-124-generic 2023-10-17T05:50:53.152 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-17T05:50:53.152 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-17T05:50:53.153 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-10-17T05:50:53.153 DEBUG:teuthology.orchestra.run.smithi125:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-10-17T05:50:53.168 DEBUG:teuthology.task.kernel:sha1 for client.1 is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-17T05:50:53.168 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-17T05:50:53.169 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2023-10-17T05:50:53.176 INFO:teuthology.orchestra.run.smithi184.stdout:5.4.0-124-generic 2023-10-17T05:50:53.176 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-17T05:50:53.177 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-17T05:50:53.177 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-10-17T05:50:53.177 DEBUG:teuthology.orchestra.run.smithi184:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-10-17T05:50:53.198 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-10-17T05:50:53.217 INFO:teuthology.orchestra.run.smithi125.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-10-17T05:50:53.317 INFO:teuthology.orchestra.run.smithi184.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-10-17T05:50:53.319 DEBUG:teuthology.orchestra.run.smithi184:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-10-17T05:50:53.349 DEBUG:teuthology.orchestra.run.smithi184:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-10-17T05:50:53.352 INFO:teuthology.orchestra.run.smithi125.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-10-17T05:50:53.354 DEBUG:teuthology.orchestra.run.smithi125:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-10-17T05:50:53.389 DEBUG:teuthology.orchestra.run.smithi125:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-10-17T05:50:53.404 DEBUG:teuthology.orchestra.run.smithi125:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-10-17T05:50:53.410 DEBUG:teuthology.orchestra.run.smithi184:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-10-17T05:51:46.296 INFO:teuthology.orchestra.run.smithi125.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-10-17T05:51:46.297 INFO:teuthology.orchestra.run.smithi125.stderr: * [new branch] main -> origin/main 2023-10-17T05:51:46.355 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20190312 -> 20190312 2023-10-17T05:51:46.355 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20190416 -> 20190416 2023-10-17T05:51:46.355 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20190514 -> 20190514 2023-10-17T05:51:46.355 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20190618 -> 20190618 2023-10-17T05:51:46.356 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20190717 -> 20190717 2023-10-17T05:51:46.356 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20190815 -> 20190815 2023-10-17T05:51:46.356 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20190923 -> 20190923 2023-10-17T05:51:46.356 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20191022 -> 20191022 2023-10-17T05:51:46.356 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20191215 -> 20191215 2023-10-17T05:51:46.357 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20200122 -> 20200122 2023-10-17T05:51:46.357 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20200316 -> 20200316 2023-10-17T05:51:46.357 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20200421 -> 20200421 2023-10-17T05:51:46.357 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20200519 -> 20200519 2023-10-17T05:51:46.357 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20200619 -> 20200619 2023-10-17T05:51:46.358 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20200721 -> 20200721 2023-10-17T05:51:46.358 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20200817 -> 20200817 2023-10-17T05:51:46.359 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20200918 -> 20200918 2023-10-17T05:51:46.359 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20201022 -> 20201022 2023-10-17T05:51:46.360 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20201118 -> 20201118 2023-10-17T05:51:46.360 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20201218 -> 20201218 2023-10-17T05:51:46.360 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20210208 -> 20210208 2023-10-17T05:51:46.360 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20210315 -> 20210315 2023-10-17T05:51:46.360 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20210511 -> 20210511 2023-10-17T05:51:46.361 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20210716 -> 20210716 2023-10-17T05:51:46.361 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20210818 -> 20210818 2023-10-17T05:51:46.361 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20210919 -> 20210919 2023-10-17T05:51:46.363 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20211027 -> 20211027 2023-10-17T05:51:46.364 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20211216 -> 20211216 2023-10-17T05:51:46.364 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20220209 -> 20220209 2023-10-17T05:51:46.364 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20220310 -> 20220310 2023-10-17T05:51:46.364 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20220411 -> 20220411 2023-10-17T05:51:46.364 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20220509 -> 20220509 2023-10-17T05:51:46.365 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20220610 -> 20220610 2023-10-17T05:51:46.365 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20220708 -> 20220708 2023-10-17T05:51:46.365 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20220815 -> 20220815 2023-10-17T05:51:46.365 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20220913 -> 20220913 2023-10-17T05:51:46.365 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20221012 -> 20221012 2023-10-17T05:51:46.366 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20221109 -> 20221109 2023-10-17T05:51:46.366 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20221214 -> 20221214 2023-10-17T05:51:46.366 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20230117 -> 20230117 2023-10-17T05:51:46.366 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20230210 -> 20230210 2023-10-17T05:51:46.366 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20230310 -> 20230310 2023-10-17T05:51:46.367 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20230404 -> 20230404 2023-10-17T05:51:46.367 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20230515 -> 20230515 2023-10-17T05:51:46.367 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20230625 -> 20230625 2023-10-17T05:51:46.367 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20230804 -> 20230804 2023-10-17T05:51:46.367 INFO:teuthology.orchestra.run.smithi125.stderr: * [new tag] 20230919 -> 20230919 2023-10-17T05:51:46.622 INFO:teuthology.orchestra.run.smithi184.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-10-17T05:51:46.622 INFO:teuthology.orchestra.run.smithi184.stderr: * [new branch] main -> origin/main 2023-10-17T05:51:46.674 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20190312 -> 20190312 2023-10-17T05:51:46.674 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20190416 -> 20190416 2023-10-17T05:51:46.674 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20190514 -> 20190514 2023-10-17T05:51:46.675 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20190618 -> 20190618 2023-10-17T05:51:46.675 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20190717 -> 20190717 2023-10-17T05:51:46.675 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20190815 -> 20190815 2023-10-17T05:51:46.675 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20190923 -> 20190923 2023-10-17T05:51:46.676 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20191022 -> 20191022 2023-10-17T05:51:46.676 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20191215 -> 20191215 2023-10-17T05:51:46.676 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20200122 -> 20200122 2023-10-17T05:51:46.677 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20200316 -> 20200316 2023-10-17T05:51:46.677 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20200421 -> 20200421 2023-10-17T05:51:46.677 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20200519 -> 20200519 2023-10-17T05:51:46.677 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20200619 -> 20200619 2023-10-17T05:51:46.677 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20200721 -> 20200721 2023-10-17T05:51:46.678 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20200817 -> 20200817 2023-10-17T05:51:46.678 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20200918 -> 20200918 2023-10-17T05:51:46.679 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20201022 -> 20201022 2023-10-17T05:51:46.679 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20201118 -> 20201118 2023-10-17T05:51:46.679 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20201218 -> 20201218 2023-10-17T05:51:46.680 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20210208 -> 20210208 2023-10-17T05:51:46.680 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20210315 -> 20210315 2023-10-17T05:51:46.681 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20210511 -> 20210511 2023-10-17T05:51:46.681 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20210716 -> 20210716 2023-10-17T05:51:46.681 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20210818 -> 20210818 2023-10-17T05:51:46.685 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20210919 -> 20210919 2023-10-17T05:51:46.685 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20211027 -> 20211027 2023-10-17T05:51:46.685 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20211216 -> 20211216 2023-10-17T05:51:46.685 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20220209 -> 20220209 2023-10-17T05:51:46.686 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20220310 -> 20220310 2023-10-17T05:51:46.686 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20220411 -> 20220411 2023-10-17T05:51:46.686 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20220509 -> 20220509 2023-10-17T05:51:46.686 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20220610 -> 20220610 2023-10-17T05:51:46.686 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20220708 -> 20220708 2023-10-17T05:51:46.687 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20220815 -> 20220815 2023-10-17T05:51:46.687 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20220913 -> 20220913 2023-10-17T05:51:46.687 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20221012 -> 20221012 2023-10-17T05:51:46.687 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20221109 -> 20221109 2023-10-17T05:51:46.688 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20221214 -> 20221214 2023-10-17T05:51:46.688 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20230117 -> 20230117 2023-10-17T05:51:46.688 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20230210 -> 20230210 2023-10-17T05:51:46.688 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20230310 -> 20230310 2023-10-17T05:51:46.688 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20230404 -> 20230404 2023-10-17T05:51:46.689 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20230515 -> 20230515 2023-10-17T05:51:46.689 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20230625 -> 20230625 2023-10-17T05:51:46.689 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20230804 -> 20230804 2023-10-17T05:51:46.689 INFO:teuthology.orchestra.run.smithi184.stderr: * [new tag] 20230919 -> 20230919 2023-10-17T05:51:50.042 INFO:teuthology.orchestra.run.smithi125.stderr:Updating files: 51% (1637/3161) Updating files: 52% (1644/3161) Updating files: 53% (1676/3161) Updating files: 54% (1707/3161) Updating files: 55% (1739/3161) Updating files: 56% (1771/3161) Updating files: 57% (1802/3161) Updating files: 58% (1834/3161) Updating files: 59% (1865/3161) Updating files: 60% (1897/3161) Updating files: 61% (1929/3161) Updating files: 62% (1960/3161) Updating files: 63% (1992/3161) Updating files: 64% (2024/3161) Updating files: 65% (2055/3161) Updating files: 66% (2087/3161) Updating files: 66% (2107/3161) Updating files: 67% (2118/3161) Updating files: 68% (2150/3161) Updating files: 69% (2182/3161) Updating files: 70% (2213/3161) Updating files: 71% (2245/3161) Updating files: 72% (2276/3161) Updating files: 73% (2308/3161) Updating files: 74% (2340/3161) Updating files: 75% (2371/3161) Updating files: 76% (2403/3161) Updating files: 77% (2434/3161) Updating files: 78% (2466/3161) Updating files: 79% (2498/3161) Updating files: 80% (2529/3161) Updating files: 81% (2561/3161) Updating files: 81% (2590/3161) Updating files: 82% (2593/3161) Updating files: 83% (2624/3161) Updating files: 84% (2656/3161) Updating files: 85% (2687/3161) Updating files: 86% (2719/3161) Updating files: 87% (2751/3161) Updating files: 88% (2782/3161) Updating files: 89% (2814/3161) Updating files: 90% (2845/3161) Updating files: 91% (2877/3161) Updating files: 92% (2909/3161) Updating files: 93% (2940/3161) Updating files: 94% (2972/3161) Updating files: 95% (3003/3161) Updating files: 96% (3035/3161) Updating files: 97% (3067/3161) Updating files: 98% (3098/3161) Updating files: 99% (3130/3161) Updating files: 100% (3161/3161) Updating files: 100% (3161/3161), done. 2023-10-17T05:51:50.047 INFO:teuthology.orchestra.run.smithi125.stdout:HEAD is now at 63e8aa40 Merge branch 'main' into 'main' 2023-10-17T05:51:50.063 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.0... 2023-10-17T05:51:50.063 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-17T05:51:50.362 INFO:teuthology.orchestra.run.smithi184.stderr:Updating files: 51% (1632/3161) Updating files: 52% (1644/3161) Updating files: 53% (1676/3161) Updating files: 54% (1707/3161) Updating files: 55% (1739/3161) Updating files: 56% (1771/3161) Updating files: 57% (1802/3161) Updating files: 58% (1834/3161) Updating files: 59% (1865/3161) Updating files: 60% (1897/3161) Updating files: 61% (1929/3161) Updating files: 62% (1960/3161) Updating files: 63% (1992/3161) Updating files: 64% (2024/3161) Updating files: 65% (2055/3161) Updating files: 66% (2087/3161) Updating files: 66% (2107/3161) Updating files: 67% (2118/3161) Updating files: 68% (2150/3161) Updating files: 69% (2182/3161) Updating files: 70% (2213/3161) Updating files: 71% (2245/3161) Updating files: 72% (2276/3161) Updating files: 73% (2308/3161) Updating files: 74% (2340/3161) Updating files: 75% (2371/3161) Updating files: 76% (2403/3161) Updating files: 77% (2434/3161) Updating files: 78% (2466/3161) Updating files: 79% (2498/3161) Updating files: 80% (2529/3161) Updating files: 81% (2561/3161) Updating files: 81% (2590/3161) Updating files: 82% (2593/3161) Updating files: 83% (2624/3161) Updating files: 84% (2656/3161) Updating files: 85% (2687/3161) Updating files: 86% (2719/3161) Updating files: 87% (2751/3161) Updating files: 88% (2782/3161) Updating files: 89% (2814/3161) Updating files: 90% (2845/3161) Updating files: 91% (2877/3161) Updating files: 92% (2909/3161) Updating files: 93% (2940/3161) Updating files: 94% (2972/3161) Updating files: 95% (3003/3161) Updating files: 96% (3035/3161) Updating files: 97% (3067/3161) Updating files: 98% (3098/3161) Updating files: 99% (3130/3161) Updating files: 100% (3161/3161) Updating files: 100% (3161/3161), done. 2023-10-17T05:51:50.366 INFO:teuthology.orchestra.run.smithi184.stdout:HEAD is now at 63e8aa40 Merge branch 'main' into 'main' 2023-10-17T05:51:50.383 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.1... 2023-10-17T05:51:50.383 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-17T05:51:50.390 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/ 2023-10-17T05:51:50.390 DEBUG:teuthology.orchestra.run.smithi125:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-rc5-g47672119149b_6.6.0-rc5-g47672119149b-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/ --input-file=- 2023-10-17T05:51:50.393 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi125.front.sepia.ceph.com to complete... 2023-10-17T05:51:50.520 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/ 2023-10-17T05:51:50.521 DEBUG:teuthology.orchestra.run.smithi184:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-rc5-g47672119149b_6.6.0-rc5-g47672119149b-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/ --input-file=- 2023-10-17T05:51:50.523 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi184.front.sepia.ceph.com to complete... 2023-10-17T05:51:53.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17 05:51:53 URL:https://4.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/linux-image-6.6.0-rc5-g47672119149b_6.6.0-rc5-g47672119149b-1_amd64.deb [38904644/38904644] -> "/tmp/linux-image.deb" [1] 2023-10-17T05:51:53.059 INFO:teuthology.orchestra.run.smithi125.stderr:FINISHED --2023-10-17 05:51:53-- 2023-10-17T05:51:53.059 INFO:teuthology.orchestra.run.smithi125.stderr:Total wall clock time: 2.6s 2023-10-17T05:51:53.059 INFO:teuthology.orchestra.run.smithi125.stderr:Downloaded: 1 files, 37M in 2.3s (15.9 MB/s) 2023-10-17T05:51:53.060 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.0... 2023-10-17T05:51:53.060 DEBUG:teuthology.orchestra.run.smithi125:> sudo dpkg -i /tmp/linux-image.deb 2023-10-17T05:51:53.334 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package linux-image-6.6.0-rc5-g47672119149b. 2023-10-17T05:51:53.707 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17 05:51:53 URL:https://4.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/linux-image-6.6.0-rc5-g47672119149b_6.6.0-rc5-g47672119149b-1_amd64.deb [38904644/38904644] -> "/tmp/linux-image.deb" [1] 2023-10-17T05:51:53.708 INFO:teuthology.orchestra.run.smithi184.stderr:FINISHED --2023-10-17 05:51:53-- 2023-10-17T05:51:53.708 INFO:teuthology.orchestra.run.smithi184.stderr:Total wall clock time: 3.2s 2023-10-17T05:51:53.708 INFO:teuthology.orchestra.run.smithi184.stderr:Downloaded: 1 files, 37M in 2.9s (13.0 MB/s) 2023-10-17T05:51:53.709 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.1... 2023-10-17T05:51:53.710 DEBUG:teuthology.orchestra.run.smithi184:> sudo dpkg -i /tmp/linux-image.deb 2023-10-17T05:51:53.995 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package linux-image-6.6.0-rc5-g47672119149b. 2023-10-17T05:51:55.101 INFO:teuthology.orchestra.run.smithi125.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-10-17T05:51:55.106 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-10-17T05:51:55.308 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking linux-image-6.6.0-rc5-g47672119149b (6.6.0-rc5-g47672119149b-1) ... 2023-10-17T05:51:55.736 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-10-17T05:51:55.741 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-10-17T05:51:55.934 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking linux-image-6.6.0-rc5-g47672119149b (6.6.0-rc5-g47672119149b-1) ... 2023-10-17T05:51:58.342 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up linux-image-6.6.0-rc5-g47672119149b (6.6.0-rc5-g47672119149b-1) ... 2023-10-17T05:51:58.489 INFO:teuthology.orchestra.run.smithi125.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-17T05:51:59.071 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up linux-image-6.6.0-rc5-g47672119149b (6.6.0-rc5-g47672119149b-1) ... 2023-10-17T05:51:59.209 INFO:teuthology.orchestra.run.smithi184.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-17T05:52:23.455 INFO:teuthology.orchestra.run.smithi125.stderr:Sourcing file `/etc/default/grub' 2023-10-17T05:52:23.462 INFO:teuthology.orchestra.run.smithi125.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-17T05:52:23.499 INFO:teuthology.orchestra.run.smithi125.stderr:Generating grub configuration file ... 2023-10-17T05:52:23.883 INFO:teuthology.orchestra.run.smithi125.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-17T05:52:23.901 INFO:teuthology.orchestra.run.smithi125.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-17T05:52:24.307 INFO:teuthology.orchestra.run.smithi125.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-17T05:52:24.320 INFO:teuthology.orchestra.run.smithi125.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-17T05:52:24.799 INFO:teuthology.orchestra.run.smithi184.stderr:Sourcing file `/etc/default/grub' 2023-10-17T05:52:24.811 INFO:teuthology.orchestra.run.smithi184.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-17T05:52:24.838 INFO:teuthology.orchestra.run.smithi184.stderr:Generating grub configuration file ... 2023-10-17T05:52:25.186 INFO:teuthology.orchestra.run.smithi184.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-17T05:52:25.210 INFO:teuthology.orchestra.run.smithi184.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-17T05:52:25.639 INFO:teuthology.orchestra.run.smithi184.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-17T05:52:25.651 INFO:teuthology.orchestra.run.smithi184.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-17T05:52:26.368 INFO:teuthology.orchestra.run.smithi125.stderr:done 2023-10-17T05:52:26.569 DEBUG:teuthology.orchestra.run.smithi125:> dpkg-deb -c /tmp/linux-image.deb 2023-10-17T05:52:26.578 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./ 2023-10-17T05:52:26.579 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./boot/ 2023-10-17T05:52:26.579 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 4415097 2023-10-10 19:59 ./boot/System.map-6.6.0-rc5-g47672119149b 2023-10-17T05:52:26.593 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 169298 2023-10-10 19:59 ./boot/config-6.6.0-rc5-g47672119149b 2023-10-17T05:52:26.594 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11352928 2023-10-10 19:59 ./boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-17T05:52:26.618 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/ 2023-10-17T05:52:26.619 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/ 2023-10-17T05:52:26.619 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/postinst.d/ 2023-10-17T05:52:26.619 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/postrm.d/ 2023-10-17T05:52:26.619 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/preinst.d/ 2023-10-17T05:52:26.619 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/prerm.d/ 2023-10-17T05:52:26.620 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/ 2023-10-17T05:52:26.620 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/ 2023-10-17T05:52:26.620 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/ 2023-10-17T05:52:26.620 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/ 2023-10-17T05:52:26.620 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/ 2023-10-17T05:52:26.621 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/ 2023-10-17T05:52:26.621 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ 2023-10-17T05:52:26.621 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 490233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/aesni-intel.ko 2023-10-17T05:52:26.621 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-17T05:52:26.621 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-17T05:52:26.622 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-17T05:52:26.622 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 93113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-17T05:52:26.622 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 106729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-17T05:52:26.622 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 152241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-17T05:52:26.623 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-17T05:52:26.623 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-17T05:52:26.623 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 83889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-17T05:52:26.623 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-17T05:52:26.623 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-17T05:52:26.624 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-17T05:52:26.624 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-17T05:52:26.624 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-17T05:52:26.624 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-17T05:52:26.624 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 58585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-17T05:52:26.625 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-17T05:52:26.625 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-17T05:52:26.625 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-17T05:52:26.625 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/ 2023-10-17T05:52:26.625 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/ 2023-10-17T05:52:26.626 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/ 2023-10-17T05:52:26.626 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-17T05:52:26.626 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpuid.ko 2023-10-17T05:52:26.626 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/msr.ko 2023-10-17T05:52:26.626 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/ 2023-10-17T05:52:26.627 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 353761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-17T05:52:26.627 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 881713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-17T05:52:26.692 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 2276817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-17T05:52:26.692 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ 2023-10-17T05:52:26.692 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/af_alg.ko 2023-10-17T05:52:26.692 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/algif_hash.ko 2023-10-17T05:52:26.693 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/algif_skcipher.ko 2023-10-17T05:52:26.693 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-17T05:52:26.693 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-17T05:52:26.693 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-17T05:52:26.693 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/asymmetric_keys/ 2023-10-17T05:52:26.694 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-10-17T05:52:26.694 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/ 2023-10-17T05:52:26.694 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-17T05:52:26.694 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-17T05:52:26.695 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-17T05:52:26.695 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-17T05:52:26.695 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-17T05:52:26.695 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-17T05:52:26.696 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-17T05:52:26.696 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-17T05:52:26.696 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-17T05:52:26.696 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-17T05:52:26.696 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-17T05:52:26.697 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-17T05:52:26.697 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-17T05:52:26.697 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-17T05:52:26.697 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-17T05:52:26.698 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-17T05:52:26.698 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-17T05:52:26.698 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-17T05:52:26.698 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cryptd.ko 2023-10-17T05:52:26.699 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-17T05:52:26.699 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_simd.ko 2023-10-17T05:52:26.699 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-17T05:52:26.699 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-17T05:52:26.700 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-17T05:52:26.700 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-17T05:52:26.700 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-17T05:52:26.700 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-17T05:52:26.700 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-17T05:52:26.700 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-17T05:52:26.701 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lrw.ko 2023-10-17T05:52:26.701 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-17T05:52:26.701 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-17T05:52:26.701 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-17T05:52:26.702 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-17T05:52:26.702 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-17T05:52:26.702 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-17T05:52:26.702 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-17T05:52:26.702 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-17T05:52:26.703 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-17T05:52:26.703 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 149193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-17T05:52:26.703 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-17T05:52:26.703 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-17T05:52:26.703 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-17T05:52:26.704 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-17T05:52:26.704 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-17T05:52:26.704 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-17T05:52:26.704 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-17T05:52:26.704 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xts.ko 2023-10-17T05:52:26.705 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-17T05:52:26.705 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ 2023-10-17T05:52:26.705 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ 2023-10-17T05:52:26.705 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_extlog.ko 2023-10-17T05:52:26.705 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-17T05:52:26.706 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-17T05:52:26.706 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/apei/ 2023-10-17T05:52:26.706 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/apei/einj.ko 2023-10-17T05:52:26.706 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-17T05:52:26.707 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-17T05:52:26.707 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-17T05:52:26.707 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-17T05:52:26.707 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 103025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-17T05:52:26.707 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ 2023-10-17T05:52:26.708 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-17T05:52:26.708 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 88865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci.ko 2023-10-17T05:52:26.708 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-17T05:52:26.708 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 88289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci.ko 2023-10-17T05:52:26.708 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-17T05:52:26.709 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-17T05:52:26.709 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-17T05:52:26.709 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-17T05:52:26.709 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-17T05:52:26.709 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-17T05:52:26.710 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-17T05:52:26.710 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-17T05:52:26.710 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-17T05:52:26.710 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-17T05:52:26.710 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-17T05:52:26.711 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-17T05:52:26.711 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-17T05:52:26.711 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-17T05:52:26.711 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-17T05:52:26.711 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-17T05:52:26.712 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-17T05:52:26.712 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-17T05:52:26.712 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_legacy.ko 2023-10-17T05:52:26.712 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-17T05:52:26.712 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-17T05:52:26.713 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-17T05:52:26.713 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-17T05:52:26.713 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-17T05:52:26.713 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-17T05:52:26.714 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-17T05:52:26.714 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-17T05:52:26.714 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-17T05:52:26.714 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-17T05:52:26.714 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-17T05:52:26.715 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-17T05:52:26.715 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-17T05:52:26.715 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_radisys.ko 2023-10-17T05:52:26.715 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-17T05:52:26.715 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rz1000.ko 2023-10-17T05:52:26.716 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-17T05:52:26.716 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-17T05:52:26.716 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-17T05:52:26.716 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-17T05:52:26.716 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-17T05:52:26.717 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-17T05:52:26.717 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-17T05:52:26.717 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-17T05:52:26.717 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 83345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-17T05:52:26.717 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 70393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-17T05:52:26.718 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-17T05:52:26.718 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-17T05:52:26.718 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-17T05:52:26.718 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-17T05:52:26.718 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-17T05:52:26.719 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-17T05:52:26.719 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-17T05:52:26.719 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-17T05:52:26.719 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-17T05:52:26.719 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-17T05:52:26.720 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ 2023-10-17T05:52:26.720 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-17T05:52:26.720 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/ 2023-10-17T05:52:26.720 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 124473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-17T05:52:26.720 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/ 2023-10-17T05:52:26.721 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/ 2023-10-17T05:52:26.721 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 113665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-17T05:52:26.721 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/ 2023-10-17T05:52:26.721 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 965585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-17T05:52:26.721 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 173225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-17T05:52:26.722 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/ 2023-10-17T05:52:26.722 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 94297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-17T05:52:26.722 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 115793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-17T05:52:26.722 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/ 2023-10-17T05:52:26.722 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 110449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-17T05:52:26.723 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 98193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-17T05:52:26.723 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 263769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-17T05:52:26.723 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/ 2023-10-17T05:52:26.723 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 98145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-17T05:52:26.724 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/ 2023-10-17T05:52:26.724 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 60217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-17T05:52:26.724 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ 2023-10-17T05:52:26.724 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/applicom.ko 2023-10-17T05:52:26.724 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-17T05:52:26.724 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/ 2023-10-17T05:52:26.725 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-17T05:52:26.725 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-17T05:52:26.725 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-17T05:52:26.725 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-17T05:52:26.725 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-17T05:52:26.726 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ 2023-10-17T05:52:26.726 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-17T05:52:26.726 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 148601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-17T05:52:26.726 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-17T05:52:26.726 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 139313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-17T05:52:26.727 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 70921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-17T05:52:26.727 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-17T05:52:26.727 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-17T05:52:26.727 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/ 2023-10-17T05:52:26.727 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 84097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-17T05:52:26.728 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/nvram.ko 2023-10-17T05:52:26.728 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-17T05:52:26.728 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-17T05:52:26.728 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/ 2023-10-17T05:52:26.728 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-17T05:52:26.728 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-10-17T05:52:26.729 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-10-17T05:52:26.729 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-10-17T05:52:26.729 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-17T05:52:26.729 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-17T05:52:26.729 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-10-17T05:52:26.730 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/ 2023-10-17T05:52:26.730 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_class.ko 2023-10-17T05:52:26.730 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_core.ko 2023-10-17T05:52:26.730 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-10-17T05:52:26.730 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/ 2023-10-17T05:52:26.731 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-palmas.ko 2023-10-17T05:52:26.731 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-si5351.ko 2023-10-17T05:52:26.731 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-twl6040.ko 2023-10-17T05:52:26.731 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-wm831x.ko 2023-10-17T05:52:26.731 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/ 2023-10-17T05:52:26.732 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-17T05:52:26.732 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-17T05:52:26.732 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-17T05:52:26.732 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ 2023-10-17T05:52:26.732 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ 2023-10-17T05:52:26.732 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 70801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-17T05:52:26.733 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 243025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-17T05:52:26.733 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/ 2023-10-17T05:52:26.733 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/ 2023-10-17T05:52:26.733 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/ 2023-10-17T05:52:26.733 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 438761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-17T05:52:26.734 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-10-17T05:52:26.734 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-17T05:52:26.734 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-17T05:52:26.734 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-17T05:52:26.734 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/ 2023-10-17T05:52:26.735 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 68857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-17T05:52:26.735 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/ 2023-10-17T05:52:26.735 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-17T05:52:26.735 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ 2023-10-17T05:52:26.735 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/ 2023-10-17T05:52:26.736 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-17T05:52:26.736 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ 2023-10-17T05:52:26.736 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 122569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-17T05:52:26.736 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ 2023-10-17T05:52:26.736 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 79953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-17T05:52:26.737 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-17T05:52:26.737 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 63617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-17T05:52:26.737 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-17T05:52:26.737 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-17T05:52:26.737 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-17T05:52:26.738 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-17T05:52:26.738 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-17T05:52:26.738 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 52041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-17T05:52:26.738 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-17T05:52:26.738 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-17T05:52:26.739 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 56825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-17T05:52:26.739 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-17T05:52:26.739 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/ 2023-10-17T05:52:26.739 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-gpio.ko 2023-10-17T05:52:26.739 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max14577.ko 2023-10-17T05:52:26.740 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max77693.ko 2023-10-17T05:52:26.740 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max8997.ko 2023-10-17T05:52:26.740 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-palmas.ko 2023-10-17T05:52:26.740 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-rt8973a.ko 2023-10-17T05:52:26.740 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-sm5502.ko 2023-10-17T05:52:26.740 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/ 2023-10-17T05:52:26.741 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/dmi-sysfs.ko 2023-10-17T05:52:26.741 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/efi/ 2023-10-17T05:52:26.741 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/efi/efi-pstore.ko 2023-10-17T05:52:26.741 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-17T05:52:26.741 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/ 2023-10-17T05:52:26.742 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-adp5520.ko 2023-10-17T05:52:26.742 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-amd8111.ko 2023-10-17T05:52:26.742 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-arizona.ko 2023-10-17T05:52:26.742 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-da9052.ko 2023-10-17T05:52:26.743 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-da9055.ko 2023-10-17T05:52:26.743 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-dln2.ko 2023-10-17T05:52:26.743 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 77849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-f7188x.ko 2023-10-17T05:52:26.743 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-generic.ko 2023-10-17T05:52:26.743 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-17T05:52:26.743 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-10-17T05:52:26.744 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-kempld.ko 2023-10-17T05:52:26.744 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-lp3943.ko 2023-10-17T05:52:26.744 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max7300.ko 2023-10-17T05:52:26.744 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max730x.ko 2023-10-17T05:52:26.744 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max732x.ko 2023-10-17T05:52:26.745 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-10-17T05:52:26.745 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-pca953x.ko 2023-10-17T05:52:26.745 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-pcf857x.ko 2023-10-17T05:52:26.745 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-rdc321x.ko 2023-10-17T05:52:26.746 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-sch.ko 2023-10-17T05:52:26.746 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-sch311x.ko 2023-10-17T05:52:26.746 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-tps65912.ko 2023-10-17T05:52:26.746 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-twl4030.ko 2023-10-17T05:52:26.746 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-twl6040.ko 2023-10-17T05:52:26.747 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-17T05:52:26.747 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-vx855.ko 2023-10-17T05:52:26.747 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm831x.ko 2023-10-17T05:52:26.747 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm8350.ko 2023-10-17T05:52:26.747 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm8994.ko 2023-10-17T05:52:26.748 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/ 2023-10-17T05:52:26.748 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-a4tech.ko 2023-10-17T05:52:26.748 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-apple.ko 2023-10-17T05:52:26.748 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-17T05:52:26.749 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-17T05:52:26.749 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-17T05:52:26.749 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-belkin.ko 2023-10-17T05:52:26.749 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cherry.ko 2023-10-17T05:52:26.749 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-chicony.ko 2023-10-17T05:52:26.750 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 60649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cp2112.ko 2023-10-17T05:52:26.750 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cypress.ko 2023-10-17T05:52:26.750 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-17T05:52:26.750 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-17T05:52:26.750 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-17T05:52:26.751 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-17T05:52:26.751 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ezkey.ko 2023-10-17T05:52:26.751 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-17T05:52:26.751 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-generic.ko 2023-10-17T05:52:26.752 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-17T05:52:26.752 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-17T05:52:26.752 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-17T05:52:26.752 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-17T05:52:26.752 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-17T05:52:26.753 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-17T05:52:26.753 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-17T05:52:26.753 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kensington.ko 2023-10-17T05:52:26.753 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-17T05:52:26.753 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-17T05:52:26.754 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-17T05:52:26.754 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-17T05:52:26.754 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-17T05:52:26.754 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lg-g15.ko 2023-10-17T05:52:26.754 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 58185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-17T05:52:26.755 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 101369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-17T05:52:26.755 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 80993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech.ko 2023-10-17T05:52:26.755 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-magicmouse.ko 2023-10-17T05:52:26.755 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-microsoft.ko 2023-10-17T05:52:26.755 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-monterey.ko 2023-10-17T05:52:26.756 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-17T05:52:26.756 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ntrig.ko 2023-10-17T05:52:26.756 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-17T05:52:26.756 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-17T05:52:26.756 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-17T05:52:26.757 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 72937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-17T05:52:26.757 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-17T05:52:26.757 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-17T05:52:26.757 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-17T05:52:26.757 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-17T05:52:26.758 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-17T05:52:26.758 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-17T05:52:26.758 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-17T05:52:26.758 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-17T05:52:26.758 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-17T05:52:26.759 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-17T05:52:26.759 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-17T05:52:26.759 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-17T05:52:26.759 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-17T05:52:26.760 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-17T05:52:26.760 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-17T05:52:26.760 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-17T05:52:26.760 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-17T05:52:26.760 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-17T05:52:26.761 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-17T05:52:26.761 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-17T05:52:26.761 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-17T05:52:26.761 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-17T05:52:26.761 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-17T05:52:26.762 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-17T05:52:26.762 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-17T05:52:26.762 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-17T05:52:26.762 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-17T05:52:26.762 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-17T05:52:26.763 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-17T05:52:26.763 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 71073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-17T05:52:26.763 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-17T05:52:26.763 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 143473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-17T05:52:26.763 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-17T05:52:26.764 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-17T05:52:26.764 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-17T05:52:26.764 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 267825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid.ko 2023-10-17T05:52:26.764 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-17T05:52:26.764 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/ 2023-10-17T05:52:26.765 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 125721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbhid.ko 2023-10-17T05:52:26.765 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbkbd.ko 2023-10-17T05:52:26.765 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbmouse.ko 2023-10-17T05:52:26.765 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 217873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-17T05:52:26.765 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/ 2023-10-17T05:52:26.766 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 64201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-17T05:52:26.766 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 89625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-17T05:52:26.766 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 305465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-17T05:52:26.766 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ 2023-10-17T05:52:26.767 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 66521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-17T05:52:26.767 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 61393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-17T05:52:26.767 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-17T05:52:26.767 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-17T05:52:26.767 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-17T05:52:26.768 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-17T05:52:26.768 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-17T05:52:26.768 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 97977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-17T05:52:26.768 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-17T05:52:26.769 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 45553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-17T05:52:26.769 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-17T05:52:26.769 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-17T05:52:26.769 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-17T05:52:26.769 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-17T05:52:26.770 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 74433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-17T05:52:26.770 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-17T05:52:26.770 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 67929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-17T05:52:26.770 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-17T05:52:26.770 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-17T05:52:26.771 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 55265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-17T05:52:26.771 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-17T05:52:26.771 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 58617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-17T05:52:26.771 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-17T05:52:26.771 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-17T05:52:26.772 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-17T05:52:26.772 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/da9052-hwmon.ko 2023-10-17T05:52:26.772 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/da9055-hwmon.ko 2023-10-17T05:52:26.772 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-17T05:52:26.773 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 99601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-17T05:52:26.773 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-17T05:52:26.773 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-17T05:52:26.773 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-17T05:52:26.773 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc2103.ko 2023-10-17T05:52:26.773 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-17T05:52:26.774 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 66985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-17T05:52:26.774 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 94457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-17T05:52:26.774 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-17T05:52:26.774 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-17T05:52:26.774 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 55449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-17T05:52:26.775 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-17T05:52:26.775 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-17T05:52:26.775 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 46801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-17T05:52:26.775 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 45529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-17T05:52:26.775 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hih6130.ko 2023-10-17T05:52:26.776 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-17T05:52:26.776 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-17T05:52:26.776 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-17T05:52:26.776 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-17T05:52:26.776 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-17T05:52:26.777 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-17T05:52:26.777 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-17T05:52:26.777 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 130449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-17T05:52:26.777 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/jc42.ko 2023-10-17T05:52:26.777 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-17T05:52:26.778 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-17T05:52:26.778 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-17T05:52:26.778 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 48601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-17T05:52:26.778 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-17T05:52:26.778 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-17T05:52:26.778 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-17T05:52:26.779 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-17T05:52:26.779 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-17T05:52:26.779 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-17T05:52:26.779 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 72833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-17T05:52:26.779 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 46153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-17T05:52:26.780 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-17T05:52:26.780 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-17T05:52:26.780 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 108841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-17T05:52:26.780 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-17T05:52:26.780 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-17T05:52:26.781 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-17T05:52:26.781 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-17T05:52:26.781 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-17T05:52:26.781 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-17T05:52:26.781 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-17T05:52:26.782 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-17T05:52:26.782 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-17T05:52:26.782 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-17T05:52:26.782 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-17T05:52:26.783 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-17T05:52:26.783 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-17T05:52:26.783 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-17T05:52:26.783 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-17T05:52:26.783 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-17T05:52:26.784 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-17T05:52:26.784 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mc13783-adc.ko 2023-10-17T05:52:26.784 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-17T05:52:26.784 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-10-17T05:52:26.785 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-17T05:52:26.785 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 119817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-17T05:52:26.785 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 60705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-17T05:52:26.785 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 59737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-17T05:52:26.785 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 82337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-17T05:52:26.785 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-17T05:52:26.786 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-17T05:52:26.786 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ 2023-10-17T05:52:26.786 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-17T05:52:26.786 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-17T05:52:26.786 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-17T05:52:26.787 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-17T05:52:26.787 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-17T05:52:26.787 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-17T05:52:26.787 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-17T05:52:26.787 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 82577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-17T05:52:26.788 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-17T05:52:26.788 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-17T05:52:26.788 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-17T05:52:26.788 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-17T05:52:26.788 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-17T05:52:26.789 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-17T05:52:26.789 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-17T05:52:26.789 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-17T05:52:26.789 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-17T05:52:26.789 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-17T05:52:26.789 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-17T05:52:26.790 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-17T05:52:26.790 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-17T05:52:26.790 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-17T05:52:26.790 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-17T05:52:26.790 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-17T05:52:26.791 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-17T05:52:26.791 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-17T05:52:26.791 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-17T05:52:26.791 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-17T05:52:26.791 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-17T05:52:26.792 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-17T05:52:26.792 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 52457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-17T05:52:26.792 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-17T05:52:26.792 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 57513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-17T05:52:26.792 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 78873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-17T05:52:26.793 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 71345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-17T05:52:26.793 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 63289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-17T05:52:26.793 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 71321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-17T05:52:26.793 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 101473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-17T05:52:26.793 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 119505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-17T05:52:26.794 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-17T05:52:26.794 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-17T05:52:26.794 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-10-17T05:52:26.794 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-10-17T05:52:26.794 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/ 2023-10-17T05:52:26.794 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/ 2023-10-17T05:52:26.795 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-17T05:52:26.795 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-17T05:52:26.795 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/ 2023-10-17T05:52:26.795 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-10-17T05:52:26.795 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-10-17T05:52:26.796 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-10-17T05:52:26.796 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-17T05:52:26.796 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-17T05:52:26.796 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-17T05:52:26.796 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-10-17T05:52:26.797 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 6929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-17T05:52:26.797 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-10-17T05:52:26.797 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-17T05:52:26.797 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-17T05:52:26.797 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-17T05:52:26.798 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-17T05:52:26.798 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-10-17T05:52:26.798 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-10-17T05:52:26.798 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 62817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-17T05:52:26.798 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-17T05:52:26.799 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-17T05:52:26.799 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-10-17T05:52:26.799 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-17T05:52:26.799 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-17T05:52:26.799 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-10-17T05:52:26.800 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-17T05:52:26.800 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-17T05:52:26.800 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-17T05:52:26.800 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-10-17T05:52:26.800 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-17T05:52:26.801 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-17T05:52:26.801 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-10-17T05:52:26.801 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-10-17T05:52:26.801 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-17T05:52:26.801 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-10-17T05:52:26.802 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-17T05:52:26.802 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-17T05:52:26.802 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-17T05:52:26.802 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-17T05:52:26.802 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-10-17T05:52:26.803 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-17T05:52:26.803 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-17T05:52:26.803 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-17T05:52:26.803 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/ 2023-10-17T05:52:26.803 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-10-17T05:52:26.804 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-10-17T05:52:26.804 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-10-17T05:52:26.804 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ 2023-10-17T05:52:26.804 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ 2023-10-17T05:52:26.804 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 273609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-17T05:52:26.805 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 879969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-17T05:52:26.805 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 69337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-17T05:52:26.805 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 324217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-17T05:52:26.805 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 97985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-17T05:52:26.805 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 282273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-17T05:52:26.806 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 66201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-17T05:52:26.806 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ 2023-10-17T05:52:26.806 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/ 2023-10-17T05:52:26.806 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 493073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-17T05:52:26.806 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/ 2023-10-17T05:52:26.807 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 419737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-17T05:52:26.807 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/ 2023-10-17T05:52:26.807 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 739025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-17T05:52:26.807 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ 2023-10-17T05:52:26.807 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 296625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-17T05:52:26.808 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ocrdma/ 2023-10-17T05:52:26.808 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 153697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-10-17T05:52:26.808 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/usnic/ 2023-10-17T05:52:26.808 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 168969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-10-17T05:52:26.808 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ 2023-10-17T05:52:26.809 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ 2023-10-17T05:52:26.809 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 263081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-17T05:52:26.809 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ 2023-10-17T05:52:26.809 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 100241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-17T05:52:26.809 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ 2023-10-17T05:52:26.810 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 111425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-17T05:52:26.810 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ 2023-10-17T05:52:26.810 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 128753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-17T05:52:26.810 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ 2023-10-17T05:52:26.810 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 129529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-17T05:52:26.811 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/ 2023-10-17T05:52:26.811 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/evbug.ko 2023-10-17T05:52:26.811 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/ff-memless.ko 2023-10-17T05:52:26.811 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/ 2023-10-17T05:52:26.811 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-17T05:52:26.812 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-17T05:52:26.812 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-17T05:52:26.812 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-17T05:52:26.812 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/ 2023-10-17T05:52:26.812 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-10-17T05:52:26.813 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-10-17T05:52:26.813 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-10-17T05:52:26.813 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-10-17T05:52:26.813 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-17T05:52:26.813 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-10-17T05:52:26.813 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lkkbd.ko 2023-10-17T05:52:26.814 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lm8323.ko 2023-10-17T05:52:26.814 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lm8333.ko 2023-10-17T05:52:26.814 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-10-17T05:52:26.814 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-10-17T05:52:26.815 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-10-17T05:52:26.815 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-10-17T05:52:26.815 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/newtonkbd.ko 2023-10-17T05:52:26.815 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-10-17T05:52:26.815 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/qt1070.ko 2023-10-17T05:52:26.815 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/qt2160.ko 2023-10-17T05:52:26.816 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-10-17T05:52:26.816 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/stowaway.ko 2023-10-17T05:52:26.816 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/sunkbd.ko 2023-10-17T05:52:26.816 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-10-17T05:52:26.817 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-10-17T05:52:26.817 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-10-17T05:52:26.817 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/xtkbd.ko 2023-10-17T05:52:26.817 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/matrix-keymap.ko 2023-10-17T05:52:26.817 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/ 2023-10-17T05:52:26.817 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-17T05:52:26.818 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-17T05:52:26.818 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 123681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-17T05:52:26.818 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 89449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-17T05:52:26.818 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/gpio_mouse.ko 2023-10-17T05:52:26.818 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 335977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/psmouse.ko 2023-10-17T05:52:26.819 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-17T05:52:26.819 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-17T05:52:26.819 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-17T05:52:26.819 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-17T05:52:26.819 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/ 2023-10-17T05:52:26.820 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 109873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-17T05:52:26.820 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ 2023-10-17T05:52:26.820 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-17T05:52:26.820 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-17T05:52:26.820 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ct82c710.ko 2023-10-17T05:52:26.820 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-17T05:52:26.821 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/parkbd.ko 2023-10-17T05:52:26.821 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/pcips2.ko 2023-10-17T05:52:26.821 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ps2mult.ko 2023-10-17T05:52:26.821 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-17T05:52:26.821 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serport.ko 2023-10-17T05:52:26.822 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-17T05:52:26.822 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/ 2023-10-17T05:52:26.822 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/ 2023-10-17T05:52:26.822 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-17T05:52:26.823 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/ 2023-10-17T05:52:26.823 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-88pm860x.ko 2023-10-17T05:52:26.823 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-adp5520.ko 2023-10-17T05:52:26.823 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 59753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-bd2802.ko 2023-10-17T05:52:26.823 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-17T05:52:26.824 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-da903x.ko 2023-10-17T05:52:26.824 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-da9052.ko 2023-10-17T05:52:26.824 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-gpio.ko 2023-10-17T05:52:26.824 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-17T05:52:26.824 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3533.ko 2023-10-17T05:52:26.824 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm355x.ko 2023-10-17T05:52:26.825 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3642.ko 2023-10-17T05:52:26.825 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-17T05:52:26.825 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp8788.ko 2023-10-17T05:52:26.825 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-max8997.ko 2023-10-17T05:52:26.825 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-mc13783.ko 2023-10-17T05:52:26.826 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-menf21bmc.ko 2023-10-17T05:52:26.826 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca9532.ko 2023-10-17T05:52:26.826 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca955x.ko 2023-10-17T05:52:26.826 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca963x.ko 2023-10-17T05:52:26.826 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-17T05:52:26.827 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-tca6507.ko 2023-10-17T05:52:26.827 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-wm831x-status.ko 2023-10-17T05:52:26.827 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-wm8350.ko 2023-10-17T05:52:26.827 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ 2023-10-17T05:52:26.827 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-17T05:52:26.828 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-17T05:52:26.828 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-17T05:52:26.828 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-17T05:52:26.828 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-17T05:52:26.828 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-17T05:52:26.829 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-17T05:52:26.829 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-17T05:52:26.829 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/ 2023-10-17T05:52:26.829 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/ 2023-10-17T05:52:26.829 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 654969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-17T05:52:26.830 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-17T05:52:26.830 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 89601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bufio.ko 2023-10-17T05:52:26.830 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-17T05:52:26.830 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 156009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-17T05:52:26.830 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 106897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-17T05:52:26.831 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-17T05:52:26.831 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-era.ko 2023-10-17T05:52:26.831 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-17T05:52:26.831 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-17T05:52:26.831 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log.ko 2023-10-17T05:52:26.832 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-mirror.ko 2023-10-17T05:52:26.832 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 78033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-17T05:52:26.832 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-17T05:52:26.832 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 70825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-17T05:52:26.832 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-region-hash.ko 2023-10-17T05:52:26.833 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-17T05:52:26.833 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-17T05:52:26.833 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 109593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-snapshot.ko 2023-10-17T05:52:26.833 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-17T05:52:26.833 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 181865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-17T05:52:26.834 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-17T05:52:26.834 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-zero.ko 2023-10-17T05:52:26.834 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-17T05:52:26.834 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-17T05:52:26.834 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-17T05:52:26.835 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/ 2023-10-17T05:52:26.835 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 199937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-17T05:52:26.835 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-17T05:52:26.835 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 113073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-17T05:52:26.835 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 158681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-17T05:52:26.836 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 395721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-17T05:52:26.836 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/ 2023-10-17T05:52:26.836 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/ 2023-10-17T05:52:26.836 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 178137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-17T05:52:26.836 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 63385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-17T05:52:26.837 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-17T05:52:26.837 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-17T05:52:26.837 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 123321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-17T05:52:26.837 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 79041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-17T05:52:26.837 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-17T05:52:26.838 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/ 2023-10-17T05:52:26.838 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm800.ko 2023-10-17T05:52:26.838 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm805.ko 2023-10-17T05:52:26.838 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm80x.ko 2023-10-17T05:52:26.838 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/arizona-i2c.ko 2023-10-17T05:52:26.838 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 123721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/arizona.ko 2023-10-17T05:52:26.839 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/bcm590xx.ko 2023-10-17T05:52:26.839 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/cros_ec_dev.ko 2023-10-17T05:52:26.839 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/dln2.ko 2023-10-17T05:52:26.839 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/janz-cmodio.ko 2023-10-17T05:52:26.839 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/kempld-core.ko 2023-10-17T05:52:26.840 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lm3533-core.ko 2023-10-17T05:52:26.840 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-10-17T05:52:26.840 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lp3943.ko 2023-10-17T05:52:26.840 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-17T05:52:26.840 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-17T05:52:26.841 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/max8907.ko 2023-10-17T05:52:26.841 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mc13xxx-core.ko 2023-10-17T05:52:26.841 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-10-17T05:52:26.841 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/menf21bmc.ko 2023-10-17T05:52:26.841 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633-adc.ko 2023-10-17T05:52:26.841 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633-gpio.ko 2023-10-17T05:52:26.842 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633.ko 2023-10-17T05:52:26.842 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-10-17T05:52:26.842 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/retu-mfd.ko 2023-10-17T05:52:26.842 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 80425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/si476x-core.ko 2023-10-17T05:52:26.842 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 48457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-17T05:52:26.843 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-10-17T05:52:26.843 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/tps65010.ko 2023-10-17T05:52:26.843 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/tps6507x.ko 2023-10-17T05:52:26.843 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-17T05:52:26.843 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-17T05:52:26.844 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-17T05:52:26.844 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wm8994.ko 2023-10-17T05:52:26.844 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ 2023-10-17T05:52:26.844 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-10-17T05:52:26.844 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 48489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ad525x_dpot.ko 2023-10-17T05:52:26.845 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/ 2023-10-17T05:52:26.845 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 46585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-17T05:52:26.845 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-17T05:52:26.845 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-17T05:52:26.845 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 45593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-17T05:52:26.846 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/ 2023-10-17T05:52:26.846 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-10-17T05:52:26.846 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/core.ko 2023-10-17T05:52:26.846 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/ 2023-10-17T05:52:26.847 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-17T05:52:26.847 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ds1682.ko 2023-10-17T05:52:26.847 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/dummy-irq.ko 2023-10-17T05:52:26.847 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/echo/ 2023-10-17T05:52:26.847 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/echo/echo.ko 2023-10-17T05:52:26.848 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/ 2023-10-17T05:52:26.848 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-17T05:52:26.848 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-17T05:52:26.848 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-17T05:52:26.848 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-17T05:52:26.849 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-17T05:52:26.849 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/genwqe/ 2023-10-17T05:52:26.849 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 152201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-10-17T05:52:26.849 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hmc6352.ko 2023-10-17T05:52:26.849 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-17T05:52:26.850 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ibmasm/ 2023-10-17T05:52:26.850 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 72129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-10-17T05:52:26.850 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ics932s401.ko 2023-10-17T05:52:26.850 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-17T05:52:26.850 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-17T05:52:26.851 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/ 2023-10-17T05:52:26.851 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-17T05:52:26.851 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-17T05:52:26.851 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/ 2023-10-17T05:52:26.851 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 125209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-17T05:52:26.852 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 56521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-17T05:52:26.852 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 310113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-17T05:52:26.852 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/phantom.ko 2023-10-17T05:52:26.852 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ti-st/ 2023-10-17T05:52:26.852 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 74265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ti-st/st_drv.ko 2023-10-17T05:52:26.853 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-17T05:52:26.853 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-17T05:52:26.853 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-17T05:52:26.853 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 48697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-17T05:52:26.853 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/ 2023-10-17T05:52:26.854 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 183609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-17T05:52:26.854 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ 2023-10-17T05:52:26.854 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/ 2023-10-17T05:52:26.854 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 490129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-17T05:52:26.854 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/ 2023-10-17T05:52:26.855 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/ 2023-10-17T05:52:26.855 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 106033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-17T05:52:26.855 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-17T05:52:26.855 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-17T05:52:26.855 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/ 2023-10-17T05:52:26.855 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 453737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-17T05:52:26.856 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-17T05:52:26.856 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-17T05:52:26.856 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ 2023-10-17T05:52:26.856 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/ 2023-10-17T05:52:26.856 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 45785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-17T05:52:26.857 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-17T05:52:26.857 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 130553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-17T05:52:26.857 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 68849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-17T05:52:26.857 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ 2023-10-17T05:52:26.857 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-17T05:52:26.858 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 59689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-17T05:52:26.858 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-17T05:52:26.858 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 99113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-17T05:52:26.858 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/ 2023-10-17T05:52:26.858 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-17T05:52:26.859 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/ 2023-10-17T05:52:26.859 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 69201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-17T05:52:26.859 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/ 2023-10-17T05:52:26.859 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 59585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-17T05:52:26.859 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/ 2023-10-17T05:52:26.859 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-17T05:52:26.860 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/ 2023-10-17T05:52:26.860 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-17T05:52:26.860 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-17T05:52:26.860 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 87297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-17T05:52:26.860 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/ 2023-10-17T05:52:26.861 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/ 2023-10-17T05:52:26.861 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 97337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-17T05:52:26.861 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-10-17T05:52:26.861 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 104673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-17T05:52:26.861 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-10-17T05:52:26.862 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 90257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-17T05:52:26.862 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/ 2023-10-17T05:52:26.862 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 81569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-17T05:52:26.862 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 69729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-17T05:52:26.862 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/ 2023-10-17T05:52:26.862 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 78401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-17T05:52:26.863 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 176761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-17T05:52:26.863 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-10-17T05:52:26.863 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1421497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-17T05:52:26.990 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 128569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-17T05:52:26.990 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/ 2023-10-17T05:52:26.990 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 132089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-17T05:52:26.991 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 312081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-17T05:52:26.991 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/ 2023-10-17T05:52:26.991 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/ 2023-10-17T05:52:26.991 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 323513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-17T05:52:26.991 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/ 2023-10-17T05:52:26.992 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-10-17T05:52:26.992 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 193497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-17T05:52:26.992 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-10-17T05:52:26.992 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 347417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-17T05:52:26.992 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-10-17T05:52:26.992 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1044433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-17T05:52:26.993 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-10-17T05:52:26.993 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 166193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-17T05:52:26.993 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-10-17T05:52:26.993 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-17T05:52:26.993 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/ 2023-10-17T05:52:26.994 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/ 2023-10-17T05:52:26.994 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 204345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-17T05:52:26.994 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/ 2023-10-17T05:52:26.994 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/ 2023-10-17T05:52:26.994 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 69449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-17T05:52:26.995 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 61489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-17T05:52:26.995 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 141225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-17T05:52:26.995 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-17T05:52:26.995 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 62817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-17T05:52:26.996 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-17T05:52:26.996 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/ 2023-10-17T05:52:26.996 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 60873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-17T05:52:26.996 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 62833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-17T05:52:26.996 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 45721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-17T05:52:26.996 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ec_bhf.ko 2023-10-17T05:52:26.997 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/ 2023-10-17T05:52:26.997 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/ 2023-10-17T05:52:26.997 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 281137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-17T05:52:26.997 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-17T05:52:26.997 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-17T05:52:26.998 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fujitsu/ 2023-10-17T05:52:26.998 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 45345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-10-17T05:52:26.998 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ 2023-10-17T05:52:26.998 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 90465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-17T05:52:26.999 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/ 2023-10-17T05:52:26.999 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 295577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-17T05:52:26.999 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/ 2023-10-17T05:52:26.999 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 584497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-17T05:52:26.999 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/ 2023-10-17T05:52:27.000 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 246209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-17T05:52:27.000 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/ 2023-10-17T05:52:27.000 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 925697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-17T05:52:27.000 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/ 2023-10-17T05:52:27.001 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 302849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-17T05:52:27.001 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/ 2023-10-17T05:52:27.001 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 514681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-17T05:52:27.001 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/ 2023-10-17T05:52:27.001 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 93593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-17T05:52:27.002 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-10-17T05:52:27.002 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 734305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-17T05:52:27.002 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-10-17T05:52:27.002 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 151769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-17T05:52:27.002 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 86921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-17T05:52:27.003 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/ 2023-10-17T05:52:27.003 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-17T05:52:27.003 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 102289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-17T05:52:27.003 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 122649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-17T05:52:27.003 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/ 2023-10-17T05:52:27.004 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-10-17T05:52:27.004 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 727601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-17T05:52:27.004 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 278937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-17T05:52:27.004 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-10-17T05:52:27.004 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-10-17T05:52:27.004 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1113993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-17T05:52:27.005 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ 2023-10-17T05:52:27.005 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-10-17T05:52:27.005 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-10-17T05:52:27.005 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-10-17T05:52:27.005 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 95665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-17T05:52:27.006 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/ 2023-10-17T05:52:27.006 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-10-17T05:52:27.006 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 108649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-17T05:52:27.006 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ 2023-10-17T05:52:27.006 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 73441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-17T05:52:27.007 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-17T05:52:27.007 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/ 2023-10-17T05:52:27.007 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 150905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-17T05:52:27.007 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/ 2023-10-17T05:52:27.007 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 136721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-17T05:52:27.007 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/ 2023-10-17T05:52:27.008 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-17T05:52:27.008 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 43145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-17T05:52:27.008 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/ 2023-10-17T05:52:27.008 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-10-17T05:52:27.008 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 227897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-17T05:52:27.009 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 87081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-17T05:52:27.009 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-10-17T05:52:27.009 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 672049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-17T05:52:27.009 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/ 2023-10-17T05:52:27.009 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 43017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-17T05:52:27.009 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/ 2023-10-17T05:52:27.010 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 67385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-17T05:52:27.010 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 83985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-17T05:52:27.010 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-17T05:52:27.010 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 189801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-17T05:52:27.010 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/ 2023-10-17T05:52:27.011 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-10-17T05:52:27.011 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 104241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-10-17T05:52:27.011 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/ 2023-10-17T05:52:27.011 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1053921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-17T05:52:27.011 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/ 2023-10-17T05:52:27.012 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-17T05:52:27.012 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/ 2023-10-17T05:52:27.012 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-17T05:52:27.012 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 63337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-17T05:52:27.012 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/ 2023-10-17T05:52:27.013 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 61601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-17T05:52:27.013 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 67193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-17T05:52:27.013 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 73409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-17T05:52:27.013 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 68177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-17T05:52:27.013 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/ 2023-10-17T05:52:27.013 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-10-17T05:52:27.014 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-10-17T05:52:27.014 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-17T05:52:27.014 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-10-17T05:52:27.014 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 486961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-17T05:52:27.014 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/ 2023-10-17T05:52:27.015 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 103337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-17T05:52:27.015 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 166161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-17T05:52:27.015 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 66329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-17T05:52:27.015 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 78801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-17T05:52:27.016 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/ 2023-10-17T05:52:27.016 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-17T05:52:27.016 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/ 2023-10-17T05:52:27.016 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 86529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-17T05:52:27.016 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/ 2023-10-17T05:52:27.017 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 80273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-17T05:52:27.017 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 83633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-17T05:52:27.017 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/ 2023-10-17T05:52:27.017 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 46241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-17T05:52:27.017 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-17T05:52:27.017 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/ 2023-10-17T05:52:27.018 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 60057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-17T05:52:27.018 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/ 2023-10-17T05:52:27.018 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/defxx.ko 2023-10-17T05:52:27.018 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/skfp/ 2023-10-17T05:52:27.018 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 216985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/skfp/skfp.ko 2023-10-17T05:52:27.019 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 77345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-17T05:52:27.019 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/ 2023-10-17T05:52:27.019 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 235521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-17T05:52:27.019 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/ 2023-10-17T05:52:27.019 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-17T05:52:27.020 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-17T05:52:27.020 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ 2023-10-17T05:52:27.020 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 83769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-17T05:52:27.020 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 62209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-17T05:52:27.020 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-17T05:52:27.021 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/ 2023-10-17T05:52:27.021 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-17T05:52:27.021 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-17T05:52:27.021 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-gpio.ko 2023-10-17T05:52:27.021 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-17T05:52:27.022 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-17T05:52:27.022 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-17T05:52:27.022 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 43953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-17T05:52:27.022 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-17T05:52:27.022 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/ 2023-10-17T05:52:27.023 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-17T05:52:27.023 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-17T05:52:27.023 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ 2023-10-17T05:52:27.023 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-17T05:52:27.023 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-17T05:52:27.024 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-17T05:52:27.024 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-17T05:52:27.024 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-17T05:52:27.024 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-17T05:52:27.024 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-17T05:52:27.025 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-17T05:52:27.025 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-17T05:52:27.025 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-17T05:52:27.025 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 82049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-17T05:52:27.025 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 76177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-17T05:52:27.026 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-17T05:52:27.026 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 97857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-17T05:52:27.026 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-17T05:52:27.026 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-17T05:52:27.027 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-17T05:52:27.027 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-17T05:52:27.027 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-17T05:52:27.027 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/plip/ 2023-10-17T05:52:27.027 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 43569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/plip/plip.ko 2023-10-17T05:52:27.028 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ 2023-10-17T05:52:27.028 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-17T05:52:27.028 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-17T05:52:27.028 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-17T05:52:27.028 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-17T05:52:27.029 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-17T05:52:27.029 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-17T05:52:27.029 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-17T05:52:27.029 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-17T05:52:27.029 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sb1000.ko 2023-10-17T05:52:27.030 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/ 2023-10-17T05:52:27.030 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-17T05:52:27.030 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-17T05:52:27.030 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 64385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-17T05:52:27.030 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/ 2023-10-17T05:52:27.031 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 106169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-17T05:52:27.031 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-17T05:52:27.031 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-17T05:52:27.031 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-17T05:52:27.031 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-17T05:52:27.032 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-17T05:52:27.032 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 87017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-17T05:52:27.032 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/ 2023-10-17T05:52:27.032 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 144297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-17T05:52:27.032 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/ 2023-10-17T05:52:27.033 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 297329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-17T05:52:27.033 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/ 2023-10-17T05:52:27.033 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 144649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-17T05:52:27.033 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ 2023-10-17T05:52:27.033 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-17T05:52:27.034 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/ 2023-10-17T05:52:27.034 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/ 2023-10-17T05:52:27.034 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 264937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-17T05:52:27.034 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 102209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-17T05:52:27.035 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/ 2023-10-17T05:52:27.035 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 133841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-17T05:52:27.035 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-17T05:52:27.035 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 84465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-17T05:52:27.035 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-17T05:52:27.036 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/ 2023-10-17T05:52:27.036 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/ 2023-10-17T05:52:27.036 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-17T05:52:27.036 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-10-17T05:52:27.036 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-10-17T05:52:27.037 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pci-stub.ko 2023-10-17T05:52:27.037 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 46529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-17T05:52:27.037 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/ 2023-10-17T05:52:27.037 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-17T05:52:27.037 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 145809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia.ko 2023-10-17T05:52:27.038 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 62137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia_core.ko 2023-10-17T05:52:27.038 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-10-17T05:52:27.038 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-17T05:52:27.038 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 112889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-17T05:52:27.038 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/ 2023-10-17T05:52:27.039 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/broadcom/ 2023-10-17T05:52:27.039 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-10-17T05:52:27.039 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/samsung/ 2023-10-17T05:52:27.039 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-10-17T05:52:27.039 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/ 2023-10-17T05:52:27.040 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/ 2023-10-17T05:52:27.040 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 70153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-17T05:52:27.040 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/ 2023-10-17T05:52:27.040 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/ 2023-10-17T05:52:27.040 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-10-17T05:52:27.041 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec.ko 2023-10-17T05:52:27.041 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-10-17T05:52:27.041 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-10-17T05:52:27.041 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-10-17T05:52:27.041 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-10-17T05:52:27.042 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-10-17T05:52:27.042 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/ 2023-10-17T05:52:27.042 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 67097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-17T05:52:27.042 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-17T05:52:27.042 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-17T05:52:27.043 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 59665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-17T05:52:27.043 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-17T05:52:27.043 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 127569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-17T05:52:27.043 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-17T05:52:27.043 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-17T05:52:27.043 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-17T05:52:27.044 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-17T05:52:27.044 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-17T05:52:27.044 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-17T05:52:27.044 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/ibm_rtl.ko 2023-10-17T05:52:27.044 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/ 2023-10-17T05:52:27.045 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-17T05:52:27.045 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-10-17T05:52:27.045 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 43497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-17T05:52:27.045 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-17T05:52:27.045 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-17T05:52:27.046 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-17T05:52:27.046 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-17T05:52:27.046 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-17T05:52:27.046 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-17T05:52:27.046 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-17T05:52:27.047 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-17T05:52:27.047 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-17T05:52:27.047 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 57569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-17T05:52:27.047 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/ 2023-10-17T05:52:27.047 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ 2023-10-17T05:52:27.048 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/88pm860x_battery.ko 2023-10-17T05:52:27.048 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/88pm860x_charger.ko 2023-10-17T05:52:27.048 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 55057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq2415x_charger.ko 2023-10-17T05:52:27.048 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq24190_charger.ko 2023-10-17T05:52:27.048 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq24735-charger.ko 2023-10-17T05:52:27.048 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-10-17T05:52:27.049 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/da9030_battery.ko 2023-10-17T05:52:27.049 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/da9052-battery.ko 2023-10-17T05:52:27.049 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2760_battery.ko 2023-10-17T05:52:27.049 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2780_battery.ko 2023-10-17T05:52:27.049 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2781_battery.ko 2023-10-17T05:52:27.050 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2782_battery.ko 2023-10-17T05:52:27.050 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/gpio-charger.ko 2023-10-17T05:52:27.050 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/isp1704_charger.ko 2023-10-17T05:52:27.050 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/lp8727_charger.ko 2023-10-17T05:52:27.050 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max14577_charger.ko 2023-10-17T05:52:27.050 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max17040_battery.ko 2023-10-17T05:52:27.051 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max17042_battery.ko 2023-10-17T05:52:27.051 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max8903_charger.ko 2023-10-17T05:52:27.051 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max8925_power.ko 2023-10-17T05:52:27.051 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/pcf50633-charger.ko 2023-10-17T05:52:27.051 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/sbs-battery.ko 2023-10-17T05:52:27.052 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/test_power.ko 2023-10-17T05:52:27.052 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/tps65090-charger.ko 2023-10-17T05:52:27.052 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm831x_backup.ko 2023-10-17T05:52:27.052 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm831x_power.ko 2023-10-17T05:52:27.052 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm8350_power.ko 2023-10-17T05:52:27.052 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/ 2023-10-17T05:52:27.053 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 57729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-17T05:52:27.053 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-17T05:52:27.053 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/ 2023-10-17T05:52:27.053 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/ 2023-10-17T05:52:27.053 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-17T05:52:27.054 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-17T05:52:27.054 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-17T05:52:27.054 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-17T05:52:27.054 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ 2023-10-17T05:52:27.054 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 66385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-17T05:52:27.055 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-17T05:52:27.055 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/ 2023-10-17T05:52:27.055 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-88pm80x.ko 2023-10-17T05:52:27.055 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-88pm860x.ko 2023-10-17T05:52:27.055 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-17T05:52:27.055 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9052.ko 2023-10-17T05:52:27.056 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9055.ko 2023-10-17T05:52:27.056 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9063.ko 2023-10-17T05:52:27.056 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-17T05:52:27.056 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 68577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-17T05:52:27.056 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-17T05:52:27.057 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-17T05:52:27.057 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-17T05:52:27.057 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-17T05:52:27.057 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-17T05:52:27.057 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-17T05:52:27.057 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-17T05:52:27.058 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-17T05:52:27.058 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-17T05:52:27.058 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-17T05:52:27.058 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-17T05:52:27.058 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-lp8788.ko 2023-10-17T05:52:27.059 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-17T05:52:27.059 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-17T05:52:27.059 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-17T05:52:27.059 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t86.ko 2023-10-17T05:52:27.059 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-17T05:52:27.060 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8907.ko 2023-10-17T05:52:27.060 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8925.ko 2023-10-17T05:52:27.060 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8997.ko 2023-10-17T05:52:27.060 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8998.ko 2023-10-17T05:52:27.060 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-10-17T05:52:27.061 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-17T05:52:27.061 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-palmas.ko 2023-10-17T05:52:27.061 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 46633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-17T05:52:27.061 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf50633.ko 2023-10-17T05:52:27.061 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-17T05:52:27.062 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-17T05:52:27.062 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-17T05:52:27.062 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-17T05:52:27.062 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rc5t583.ko 2023-10-17T05:52:27.063 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-17T05:52:27.063 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-17T05:52:27.063 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-17T05:52:27.063 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-17T05:52:27.063 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-17T05:52:27.064 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-s35390a.ko 2023-10-17T05:52:27.064 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-17T05:52:27.064 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-tps6586x.ko 2023-10-17T05:52:27.064 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-tps65910.ko 2023-10-17T05:52:27.065 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-wm831x.ko 2023-10-17T05:52:27.065 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-wm8350.ko 2023-10-17T05:52:27.065 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-17T05:52:27.065 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ 2023-10-17T05:52:27.066 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 77617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-17T05:52:27.066 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 57665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-17T05:52:27.066 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 55169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-17T05:52:27.066 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 135185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-17T05:52:27.067 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-17T05:52:27.067 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/ 2023-10-17T05:52:27.067 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 272305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-17T05:52:27.067 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 100617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-17T05:52:27.067 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/ 2023-10-17T05:52:27.068 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 356265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-17T05:52:27.068 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 295801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-17T05:52:27.068 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic94xx/ 2023-10-17T05:52:27.068 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 189185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-10-17T05:52:27.068 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-17T05:52:27.069 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/ 2023-10-17T05:52:27.069 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 106881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-17T05:52:27.069 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-17T05:52:27.069 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/ 2023-10-17T05:52:27.069 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 246985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-17T05:52:27.069 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/ 2023-10-17T05:52:27.070 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1171945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-17T05:52:27.070 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/ 2023-10-17T05:52:27.070 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 237273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-17T05:52:27.070 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/ 2023-10-17T05:52:27.071 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 115369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-17T05:52:27.071 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-17T05:52:27.071 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/ 2023-10-17T05:52:27.071 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 308921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-17T05:52:27.071 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/ 2023-10-17T05:52:27.071 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-10-17T05:52:27.072 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 76145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-17T05:52:27.072 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-10-17T05:52:27.072 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 101449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-17T05:52:27.072 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 146689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-17T05:52:27.072 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 75553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-17T05:52:27.073 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-17T05:52:27.073 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/ 2023-10-17T05:52:27.073 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 212425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-17T05:52:27.073 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 60505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-17T05:52:27.073 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/ 2023-10-17T05:52:27.074 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 78209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-17T05:52:27.074 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 158505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-17T05:52:27.074 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fdomain.ko 2023-10-17T05:52:27.074 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/ 2023-10-17T05:52:27.074 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 263489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-17T05:52:27.074 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 201817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-17T05:52:27.075 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-17T05:52:27.075 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-17T05:52:27.075 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/imm.ko 2023-10-17T05:52:27.075 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-17T05:52:27.075 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 266537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-17T05:52:27.077 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 101881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-17T05:52:27.077 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/ 2023-10-17T05:52:27.077 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 317153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-17T05:52:27.077 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-17T05:52:27.078 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 52961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-17T05:52:27.078 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/ 2023-10-17T05:52:27.078 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 314865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-17T05:52:27.078 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 145585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-17T05:52:27.078 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-17T05:52:27.079 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/ 2023-10-17T05:52:27.079 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 216665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-17T05:52:27.079 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/ 2023-10-17T05:52:27.079 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 2197249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-17T05:52:27.079 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/ 2023-10-17T05:52:27.080 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 73569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-17T05:52:27.080 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-17T05:52:27.080 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 310617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-17T05:52:27.080 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 84721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-17T05:52:27.080 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/ 2023-10-17T05:52:27.081 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 659777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-17T05:52:27.081 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/ 2023-10-17T05:52:27.081 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 119561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-17T05:52:27.081 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 78129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-17T05:52:27.081 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/ 2023-10-17T05:52:27.082 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 81625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-10-17T05:52:27.082 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-10-17T05:52:27.082 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-10-17T05:52:27.082 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-10-17T05:52:27.082 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/ 2023-10-17T05:52:27.083 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 364105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-17T05:52:27.083 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 123617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-17T05:52:27.083 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ppa.ko 2023-10-17T05:52:27.083 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 55361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-17T05:52:27.083 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/ 2023-10-17T05:52:27.084 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1876625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-17T05:52:27.084 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 85289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-17T05:52:27.084 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/ 2023-10-17T05:52:27.084 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 559033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-17T05:52:27.084 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qlogicfas408.ko 2023-10-17T05:52:27.085 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-17T05:52:27.085 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 238825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-17T05:52:27.085 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 173937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-17T05:52:27.085 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 279313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-17T05:52:27.085 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 97729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-17T05:52:27.085 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 73881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-17T05:52:27.086 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-17T05:52:27.086 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-17T05:52:27.086 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 115889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-17T05:52:27.086 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 46825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-17T05:52:27.086 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/ 2023-10-17T05:52:27.087 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 162121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-17T05:52:27.087 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-17T05:52:27.087 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-17T05:52:27.087 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-17T05:52:27.087 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/xen-scsifront.ko 2023-10-17T05:52:27.088 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ 2023-10-17T05:52:27.088 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 129441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-17T05:52:27.088 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/ 2023-10-17T05:52:27.088 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/ 2023-10-17T05:52:27.088 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 736601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-17T05:52:27.089 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/ 2023-10-17T05:52:27.089 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-17T05:52:27.089 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-17T05:52:27.089 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 43025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-17T05:52:27.089 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 930321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-17T05:52:27.090 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-17T05:52:27.090 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 122521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-17T05:52:27.090 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/ 2023-10-17T05:52:27.090 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 75593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-17T05:52:27.090 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/ 2023-10-17T05:52:27.091 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/ 2023-10-17T05:52:27.091 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/ 2023-10-17T05:52:27.091 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-17T05:52:27.091 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-17T05:52:27.091 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-17T05:52:27.092 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-17T05:52:27.092 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-17T05:52:27.092 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-17T05:52:27.092 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-17T05:52:27.092 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-17T05:52:27.092 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-17T05:52:27.093 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-17T05:52:27.093 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-17T05:52:27.093 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-17T05:52:27.093 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-10-17T05:52:27.094 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-17T05:52:27.094 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-17T05:52:27.094 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-17T05:52:27.094 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ 2023-10-17T05:52:27.094 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ 2023-10-17T05:52:27.095 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 78425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-17T05:52:27.095 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 57865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/moxa.ko 2023-10-17T05:52:27.095 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 50953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/mxser.ko 2023-10-17T05:52:27.095 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 108601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-17T05:52:27.095 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-17T05:52:27.096 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 67929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-17T05:52:27.096 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/ 2023-10-17T05:52:27.096 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/ 2023-10-17T05:52:27.096 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-10-17T05:52:27.096 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 59497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-17T05:52:27.097 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-10-17T05:52:27.097 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/altera_uart.ko 2023-10-17T05:52:27.097 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-17T05:52:27.097 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 72425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-10-17T05:52:27.097 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/ 2023-10-17T05:52:27.098 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 103073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-17T05:52:27.098 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/rp2.ko 2023-10-17T05:52:27.098 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 52817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/sc16is7xx.ko 2023-10-17T05:52:27.098 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/ 2023-10-17T05:52:27.098 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ 2023-10-17T05:52:27.098 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 531265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-17T05:52:27.099 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ 2023-10-17T05:52:27.099 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-17T05:52:27.099 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-10-17T05:52:27.099 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/ 2023-10-17T05:52:27.099 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-17T05:52:27.100 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-17T05:52:27.100 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-17T05:52:27.100 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_dmem_genirq.ko 2023-10-17T05:52:27.100 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_mf624.ko 2023-10-17T05:52:27.100 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_netx.ko 2023-10-17T05:52:27.100 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-17T05:52:27.101 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-10-17T05:52:27.101 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-17T05:52:27.101 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/ 2023-10-17T05:52:27.101 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/c67x00/ 2023-10-17T05:52:27.101 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 73297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/c67x00/c67x00.ko 2023-10-17T05:52:27.102 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ 2023-10-17T05:52:27.102 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 144377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-10-17T05:52:27.102 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-10-17T05:52:27.102 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-10-17T05:52:27.102 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-10-17T05:52:27.103 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/ 2023-10-17T05:52:27.103 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 87089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-17T05:52:27.103 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-17T05:52:27.103 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-17T05:52:27.103 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 89857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-17T05:52:27.104 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/common/ 2023-10-17T05:52:27.104 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/common/ulpi.ko 2023-10-17T05:52:27.104 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc2/ 2023-10-17T05:52:27.104 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-10-17T05:52:27.104 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/ 2023-10-17T05:52:27.104 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-10-17T05:52:27.105 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-10-17T05:52:27.105 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 444553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3.ko 2023-10-17T05:52:27.105 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/ 2023-10-17T05:52:27.105 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/ 2023-10-17T05:52:27.105 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 60177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/u_ether.ko 2023-10-17T05:52:27.106 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/u_serial.ko 2023-10-17T05:52:27.106 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-10-17T05:52:27.106 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-10-17T05:52:27.106 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-10-17T05:52:27.106 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-10-17T05:52:27.107 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 92489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-10-17T05:52:27.107 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-10-17T05:52:27.107 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 122081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-10-17T05:52:27.107 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 57617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-10-17T05:52:27.107 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-10-17T05:52:27.108 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-10-17T05:52:27.108 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 57729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-10-17T05:52:27.108 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 85609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-10-17T05:52:27.108 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-10-17T05:52:27.108 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 58113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-10-17T05:52:27.109 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 67337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-10-17T05:52:27.109 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/ 2023-10-17T05:52:27.109 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-10-17T05:52:27.109 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-10-17T05:52:27.109 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-10-17T05:52:27.110 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-10-17T05:52:27.110 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-10-17T05:52:27.110 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-10-17T05:52:27.110 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-10-17T05:52:27.110 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-10-17T05:52:27.111 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-10-17T05:52:27.111 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-10-17T05:52:27.111 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-10-17T05:52:27.111 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-10-17T05:52:27.111 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 62185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-10-17T05:52:27.111 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-10-17T05:52:27.112 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 161225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/libcomposite.ko 2023-10-17T05:52:27.112 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/ 2023-10-17T05:52:27.112 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-10-17T05:52:27.112 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/bdc/ 2023-10-17T05:52:27.112 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 157681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-10-17T05:52:27.112 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-10-17T05:52:27.113 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 52721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-10-17T05:52:27.113 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 69705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-10-17T05:52:27.113 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 56033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-10-17T05:52:27.113 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 76057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/net2272.ko 2023-10-17T05:52:27.113 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 75073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/net2280.ko 2023-10-17T05:52:27.114 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 73169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-10-17T05:52:27.114 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 65809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-10-17T05:52:27.114 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 66097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-10-17T05:52:27.114 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 81505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-10-17T05:52:27.114 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 156073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-10-17T05:52:27.115 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/ 2023-10-17T05:52:27.115 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/bcma-hcd.ko 2023-10-17T05:52:27.115 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 80113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/isp116x-hcd.ko 2023-10-17T05:52:27.115 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 87353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-10-17T05:52:27.115 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 78873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-10-17T05:52:27.115 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-17T05:52:27.116 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811_cs.ko 2023-10-17T05:52:27.116 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/ssb-hcd.ko 2023-10-17T05:52:27.116 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-10-17T05:52:27.116 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/ 2023-10-17T05:52:27.116 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-17T05:52:27.116 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-17T05:52:27.117 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ 2023-10-17T05:52:27.117 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-17T05:52:27.117 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-17T05:52:27.117 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-10-17T05:52:27.118 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/cytherm.ko 2023-10-17T05:52:27.118 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ehset.ko 2023-10-17T05:52:27.118 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-17T05:52:27.118 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-17T05:52:27.118 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-17T05:52:27.119 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-17T05:52:27.119 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-17T05:52:27.119 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-17T05:52:27.119 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-17T05:52:27.119 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-17T05:52:27.120 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/lvstest.ko 2023-10-17T05:52:27.120 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/ 2023-10-17T05:52:27.120 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 64841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-17T05:52:27.120 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-17T05:52:27.120 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-17T05:52:27.121 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-17T05:52:27.121 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-17T05:52:27.121 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 70873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbtest.ko 2023-10-17T05:52:27.121 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-17T05:52:27.121 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-17T05:52:27.121 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/mon/ 2023-10-17T05:52:27.122 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 72953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/mon/usbmon.ko 2023-10-17T05:52:27.122 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/musb/ 2023-10-17T05:52:27.122 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 301545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/musb/musb_hdrc.ko 2023-10-17T05:52:27.122 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/ 2023-10-17T05:52:27.122 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-17T05:52:27.123 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-10-17T05:52:27.123 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-isp1301.ko 2023-10-17T05:52:27.123 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-tahvo.ko 2023-10-17T05:52:27.123 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ 2023-10-17T05:52:27.123 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-17T05:52:27.123 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-17T05:52:27.124 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-17T05:52:27.124 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-17T05:52:27.124 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 70257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-17T05:52:27.124 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-17T05:52:27.124 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 58217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-17T05:52:27.125 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-17T05:52:27.125 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-17T05:52:27.125 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/f81232.ko 2023-10-17T05:52:27.125 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 175137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-17T05:52:27.125 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-17T05:52:27.126 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 137081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-17T05:52:27.126 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 124833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-17T05:52:27.126 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 67769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-17T05:52:27.126 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-17T05:52:27.126 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-17T05:52:27.127 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 58233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-17T05:52:27.127 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 107521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-17T05:52:27.127 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-17T05:52:27.127 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-17T05:52:27.127 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-17T05:52:27.127 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-17T05:52:27.128 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/metro-usb.ko 2023-10-17T05:52:27.128 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 66449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-17T05:52:27.128 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 78217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-17T05:52:27.128 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 56337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mxuport.ko 2023-10-17T05:52:27.128 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-17T05:52:27.129 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-17T05:52:27.129 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-17T05:52:27.129 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 190633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-17T05:52:27.129 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-17T05:52:27.129 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-17T05:52:27.130 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-17T05:52:27.130 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-17T05:52:27.130 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-17T05:52:27.130 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-17T05:52:27.130 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 51625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-17T05:52:27.131 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-17T05:52:27.131 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-17T05:52:27.131 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-17T05:52:27.131 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 61489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-17T05:52:27.131 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-17T05:52:27.132 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-17T05:52:27.132 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-17T05:52:27.132 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 125609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usbserial.ko 2023-10-17T05:52:27.132 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-17T05:52:27.132 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-17T05:52:27.133 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/wishbone-serial.ko 2023-10-17T05:52:27.133 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-17T05:52:27.133 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ 2023-10-17T05:52:27.133 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 52913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-17T05:52:27.133 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-17T05:52:27.134 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-17T05:52:27.134 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-17T05:52:27.134 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-17T05:52:27.134 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-17T05:52:27.134 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-17T05:52:27.135 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-17T05:52:27.135 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-17T05:52:27.135 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-17T05:52:27.135 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-17T05:52:27.135 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-17T05:52:27.136 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-17T05:52:27.136 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-17T05:52:27.136 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 179969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-17T05:52:27.136 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/ 2023-10-17T05:52:27.136 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 67481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-17T05:52:27.137 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 72177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-17T05:52:27.137 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 107001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-17T05:52:27.137 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/ 2023-10-17T05:52:27.137 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/ 2023-10-17T05:52:27.137 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 154297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-17T05:52:27.138 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-17T05:52:27.138 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 108737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-17T05:52:27.138 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 77609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-17T05:52:27.138 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/ 2023-10-17T05:52:27.138 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 113873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-17T05:52:27.139 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-17T05:52:27.139 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 58089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-17T05:52:27.139 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 89249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-17T05:52:27.139 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/ 2023-10-17T05:52:27.139 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/ 2023-10-17T05:52:27.140 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-10-17T05:52:27.140 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/aat2870_bl.ko 2023-10-17T05:52:27.140 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp5520_bl.ko 2023-10-17T05:52:27.140 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp8860_bl.ko 2023-10-17T05:52:27.140 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp8870_bl.ko 2023-10-17T05:52:27.140 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-17T05:52:27.141 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/as3711_bl.ko 2023-10-17T05:52:27.141 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/bd6107.ko 2023-10-17T05:52:27.141 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/da903x_bl.ko 2023-10-17T05:52:27.141 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/da9052_bl.ko 2023-10-17T05:52:27.141 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/gpio_backlight.ko 2023-10-17T05:52:27.142 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/kb3886_bl.ko 2023-10-17T05:52:27.142 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-17T05:52:27.142 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lm3533_bl.ko 2023-10-17T05:52:27.142 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lm3639_bl.ko 2023-10-17T05:52:27.142 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lv5207lp.ko 2023-10-17T05:52:27.143 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/max8925_bl.ko 2023-10-17T05:52:27.143 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/pandora_bl.ko 2023-10-17T05:52:27.143 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-10-17T05:52:27.143 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-17T05:52:27.143 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/wm831x_bl.ko 2023-10-17T05:52:27.144 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/ 2023-10-17T05:52:27.144 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ 2023-10-17T05:52:27.144 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-17T05:52:27.144 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-17T05:52:27.144 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/matrox_w1.ko 2023-10-17T05:52:27.145 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/w1-gpio.ko 2023-10-17T05:52:27.145 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/ 2023-10-17T05:52:27.145 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-17T05:52:27.145 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-17T05:52:27.145 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-17T05:52:27.145 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-17T05:52:27.146 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-17T05:52:27.146 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-17T05:52:27.146 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-17T05:52:27.146 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-17T05:52:27.146 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-17T05:52:27.147 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-17T05:52:27.147 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 56425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-17T05:52:27.147 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 102673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-17T05:52:27.147 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ 2023-10-17T05:52:27.147 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/acquirewdt.ko 2023-10-17T05:52:27.148 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/advantechwdt.ko 2023-10-17T05:52:27.148 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-17T05:52:27.148 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-17T05:52:27.148 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/cpu5wdt.ko 2023-10-17T05:52:27.148 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9052_wdt.ko 2023-10-17T05:52:27.149 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9055_wdt.ko 2023-10-17T05:52:27.149 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9063_wdt.ko 2023-10-17T05:52:27.149 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/dw_wdt.ko 2023-10-17T05:52:27.149 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/eurotechwdt.ko 2023-10-17T05:52:27.149 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-17T05:52:27.149 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-17T05:52:27.150 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-17T05:52:27.150 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-17T05:52:27.150 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-17T05:52:27.150 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-17T05:52:27.150 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-17T05:52:27.151 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-17T05:52:27.151 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-17T05:52:27.151 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-17T05:52:27.151 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/kempld_wdt.ko 2023-10-17T05:52:27.151 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-17T05:52:27.152 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/mena21_wdt.ko 2023-10-17T05:52:27.152 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-10-17T05:52:27.152 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-17T05:52:27.152 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-10-17T05:52:27.152 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pc87413_wdt.ko 2023-10-17T05:52:27.153 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-17T05:52:27.153 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-17T05:52:27.153 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/retu_wdt.ko 2023-10-17T05:52:27.153 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-10-17T05:52:27.153 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-10-17T05:52:27.153 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-17T05:52:27.154 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sc1200wdt.ko 2023-10-17T05:52:27.154 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-17T05:52:27.154 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-10-17T05:52:27.154 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-17T05:52:27.154 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-17T05:52:27.155 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/twl4030_wdt.ko 2023-10-17T05:52:27.155 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-17T05:52:27.155 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-17T05:52:27.155 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-17T05:52:27.155 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-17T05:52:27.156 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wafer5823wdt.ko 2023-10-17T05:52:27.156 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-17T05:52:27.156 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wm831x_wdt.ko 2023-10-17T05:52:27.156 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wm8350_wdt.ko 2023-10-17T05:52:27.156 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-17T05:52:27.157 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/ 2023-10-17T05:52:27.157 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-17T05:52:27.157 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-17T05:52:27.157 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-17T05:52:27.157 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/ 2023-10-17T05:52:27.158 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 176441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-17T05:52:27.158 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-17T05:52:27.158 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 71249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-scsiback.ko 2023-10-17T05:52:27.158 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/ 2023-10-17T05:52:27.158 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-17T05:52:27.158 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ 2023-10-17T05:52:27.159 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/ 2023-10-17T05:52:27.159 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 166425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-17T05:52:27.159 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/adfs/ 2023-10-17T05:52:27.159 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 61073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/adfs/adfs.ko 2023-10-17T05:52:27.159 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/ 2023-10-17T05:52:27.160 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 163593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-17T05:52:27.160 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/afs/ 2023-10-17T05:52:27.160 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 932817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/afs/kafs.ko 2023-10-17T05:52:27.160 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/autofs/ 2023-10-17T05:52:27.161 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 101057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/autofs/autofs4.ko 2023-10-17T05:52:27.161 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/ 2023-10-17T05:52:27.161 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 64545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-17T05:52:27.161 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/bfs/ 2023-10-17T05:52:27.161 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/bfs/bfs.ko 2023-10-17T05:52:27.161 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-17T05:52:27.162 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/ 2023-10-17T05:52:27.162 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 3402585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-17T05:52:27.162 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/ 2023-10-17T05:52:27.162 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 306073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-17T05:52:27.162 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ 2023-10-17T05:52:27.163 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1323873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-17T05:52:27.163 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/ 2023-10-17T05:52:27.163 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 100801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-17T05:52:27.163 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/configfs/ 2023-10-17T05:52:27.163 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 108393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/configfs/configfs.ko 2023-10-17T05:52:27.163 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/ 2023-10-17T05:52:27.164 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 29625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-17T05:52:27.164 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/ 2023-10-17T05:52:27.164 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 642577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-17T05:52:27.164 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/efs/ 2023-10-17T05:52:27.164 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/efs/efs.ko 2023-10-17T05:52:27.165 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/ 2023-10-17T05:52:27.165 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1505025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-17T05:52:27.165 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/ 2023-10-17T05:52:27.165 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-17T05:52:27.165 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/freevxfs/ 2023-10-17T05:52:27.165 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/freevxfs/freevxfs.ko 2023-10-17T05:52:27.166 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/ 2023-10-17T05:52:27.166 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 226481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-17T05:52:27.166 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/ 2023-10-17T05:52:27.166 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-17T05:52:27.166 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/ 2023-10-17T05:52:27.167 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1231529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-17T05:52:27.167 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/ 2023-10-17T05:52:27.167 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 141209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-17T05:52:27.167 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/ 2023-10-17T05:52:27.167 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 222817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-17T05:52:27.168 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hpfs/ 2023-10-17T05:52:27.168 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 192329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hpfs/hpfs.ko 2023-10-17T05:52:27.168 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/ 2023-10-17T05:52:27.168 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 74065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-17T05:52:27.168 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/ 2023-10-17T05:52:27.169 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 419497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-17T05:52:27.169 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/ 2023-10-17T05:52:27.169 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 280313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-17T05:52:27.169 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/ 2023-10-17T05:52:27.170 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 89193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-17T05:52:27.170 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/ 2023-10-17T05:52:27.170 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 124649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-17T05:52:27.170 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/ 2023-10-17T05:52:27.170 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/ 2023-10-17T05:52:27.171 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 81449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-17T05:52:27.171 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/ 2023-10-17T05:52:27.171 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 59449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-17T05:52:27.171 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/ 2023-10-17T05:52:27.171 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 117513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-17T05:52:27.172 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1055649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-17T05:52:27.172 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 66441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv2.ko 2023-10-17T05:52:27.172 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 120177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-17T05:52:27.172 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 2041689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-17T05:52:27.172 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/ 2023-10-17T05:52:27.173 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-17T05:52:27.173 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-17T05:52:27.173 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/ 2023-10-17T05:52:27.173 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1516809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-17T05:52:27.173 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/ 2023-10-17T05:52:27.174 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 592833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-17T05:52:27.174 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/ 2023-10-17T05:52:27.174 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-17T05:52:27.174 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-17T05:52:27.174 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-17T05:52:27.175 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-17T05:52:27.175 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-17T05:52:27.175 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-17T05:52:27.175 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-17T05:52:27.175 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-17T05:52:27.176 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-17T05:52:27.176 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-17T05:52:27.176 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-17T05:52:27.176 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ascii.ko 2023-10-17T05:52:27.176 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-17T05:52:27.176 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-17T05:52:27.177 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-17T05:52:27.177 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-17T05:52:27.177 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-17T05:52:27.177 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-17T05:52:27.177 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-17T05:52:27.178 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-17T05:52:27.178 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-17T05:52:27.178 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-17T05:52:27.178 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-17T05:52:27.178 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-17T05:52:27.179 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-17T05:52:27.179 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-17T05:52:27.179 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-17T05:52:27.179 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-17T05:52:27.179 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-17T05:52:27.179 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-17T05:52:27.180 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 94137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-17T05:52:27.180 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 142673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-17T05:52:27.180 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 165745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-17T05:52:27.180 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 118121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-17T05:52:27.180 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-17T05:52:27.181 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-17T05:52:27.181 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-17T05:52:27.181 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-17T05:52:27.181 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-17T05:52:27.181 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-17T05:52:27.181 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-17T05:52:27.182 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-17T05:52:27.182 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-17T05:52:27.182 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-17T05:52:27.182 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-17T05:52:27.182 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-17T05:52:27.183 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-17T05:52:27.183 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-17T05:52:27.183 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-17T05:52:27.183 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-17T05:52:27.183 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-17T05:52:27.184 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ntfs/ 2023-10-17T05:52:27.184 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 219417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ntfs/ntfs.ko 2023-10-17T05:52:27.184 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ 2023-10-17T05:52:27.184 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ 2023-10-17T05:52:27.184 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 244409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-17T05:52:27.184 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ 2023-10-17T05:52:27.185 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 440737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-17T05:52:27.185 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ 2023-10-17T05:52:27.185 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-17T05:52:27.185 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 2592433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-17T05:52:27.185 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-17T05:52:27.186 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-17T05:52:27.186 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-17T05:52:27.186 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/omfs/ 2023-10-17T05:52:27.186 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/omfs/omfs.ko 2023-10-17T05:52:27.186 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/ 2023-10-17T05:52:27.187 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 352153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-17T05:52:27.187 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ 2023-10-17T05:52:27.187 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-17T05:52:27.187 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx4/ 2023-10-17T05:52:27.187 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx4/qnx4.ko 2023-10-17T05:52:27.188 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx6/ 2023-10-17T05:52:27.188 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 46689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx6/qnx6.ko 2023-10-17T05:52:27.188 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/ 2023-10-17T05:52:27.188 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_tree.ko 2023-10-17T05:52:27.188 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_v1.ko 2023-10-17T05:52:27.189 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_v2.ko 2023-10-17T05:52:27.189 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/ 2023-10-17T05:52:27.189 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 532673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-17T05:52:27.189 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/ 2023-10-17T05:52:27.189 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-17T05:52:27.189 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/ 2023-10-17T05:52:27.190 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/ 2023-10-17T05:52:27.190 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 2668121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-17T05:52:27.190 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/ 2023-10-17T05:52:27.190 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-17T05:52:27.190 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-17T05:52:27.191 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/ 2023-10-17T05:52:27.191 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 134641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-17T05:52:27.191 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/ 2023-10-17T05:52:27.191 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 90721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-17T05:52:27.191 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/ 2023-10-17T05:52:27.192 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 247737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-17T05:52:27.192 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ 2023-10-17T05:52:27.192 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 162497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-17T05:52:27.192 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/ 2023-10-17T05:52:27.192 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 4010729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-17T05:52:27.193 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/ 2023-10-17T05:52:27.193 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/locking/ 2023-10-17T05:52:27.193 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 75489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/locking/locktorture.ko 2023-10-17T05:52:27.193 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/time/ 2023-10-17T05:52:27.193 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/time/test_udelay.ko 2023-10-17T05:52:27.194 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 60553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-17T05:52:27.194 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ 2023-10-17T05:52:27.194 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 6833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-17T05:52:27.194 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 6529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc7.ko 2023-10-17T05:52:27.194 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-17T05:52:27.195 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/ 2023-10-17T05:52:27.195 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-17T05:52:27.195 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-17T05:52:27.195 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/interval_tree_test.ko 2023-10-17T05:52:27.195 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-17T05:52:27.196 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-17T05:52:27.196 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/ 2023-10-17T05:52:27.196 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-17T05:52:27.196 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-17T05:52:27.196 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/ 2023-10-17T05:52:27.197 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 6617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-17T05:52:27.197 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/memory-notifier-error-inject.ko 2023-10-17T05:52:27.197 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/notifier-error-inject.ko 2023-10-17T05:52:27.197 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/percpu_test.ko 2023-10-17T05:52:27.197 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/pm-notifier-error-inject.ko 2023-10-17T05:52:27.198 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/ 2023-10-17T05:52:27.198 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 143433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-17T05:52:27.198 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/rbtree_test.ko 2023-10-17T05:52:27.198 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/ 2023-10-17T05:52:27.198 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-17T05:52:27.199 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test-kstrtox.ko 2023-10-17T05:52:27.199 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test-string_helpers.ko 2023-10-17T05:52:27.199 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 4760425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_bpf.ko 2023-10-17T05:52:27.199 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_firmware.ko 2023-10-17T05:52:27.199 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 6369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_module.ko 2023-10-17T05:52:27.200 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_user_copy.ko 2023-10-17T05:52:27.200 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-17T05:52:27.200 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-17T05:52:27.200 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-17T05:52:27.200 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/xz/ 2023-10-17T05:52:27.201 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/xz/xz_dec_test.ko 2023-10-17T05:52:27.201 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/ 2023-10-17T05:52:27.201 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-17T05:52:27.201 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ 2023-10-17T05:52:27.202 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/ 2023-10-17T05:52:27.202 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 55737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-17T05:52:27.202 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-17T05:52:27.202 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-17T05:52:27.202 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-17T05:52:27.203 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 6985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-17T05:52:27.203 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-17T05:52:27.203 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-17T05:52:27.203 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-17T05:52:27.203 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/ 2023-10-17T05:52:27.204 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-17T05:52:27.204 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-17T05:52:27.204 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-17T05:52:27.204 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-17T05:52:27.204 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-17T05:52:27.205 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/ 2023-10-17T05:52:27.205 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 81737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-17T05:52:27.205 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/ 2023-10-17T05:52:27.205 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 198337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-17T05:52:27.205 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-17T05:52:27.206 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-17T05:52:27.206 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-17T05:52:27.206 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/ 2023-10-17T05:52:27.206 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 649297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-17T05:52:27.206 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/ 2023-10-17T05:52:27.207 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 63809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-17T05:52:27.207 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 777689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-17T05:52:27.207 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ 2023-10-17T05:52:27.207 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-17T05:52:27.207 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-17T05:52:27.208 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-17T05:52:27.208 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-17T05:52:27.208 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-17T05:52:27.208 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-17T05:52:27.208 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-17T05:52:27.209 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-17T05:52:27.209 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-17T05:52:27.209 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-17T05:52:27.209 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-17T05:52:27.209 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-17T05:52:27.210 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-17T05:52:27.210 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-17T05:52:27.210 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-17T05:52:27.210 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-17T05:52:27.210 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-17T05:52:27.211 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-17T05:52:27.211 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-17T05:52:27.211 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-17T05:52:27.211 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 55929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-17T05:52:27.211 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-17T05:52:27.211 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-17T05:52:27.212 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/ 2023-10-17T05:52:27.212 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1047017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-17T05:52:27.212 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/ 2023-10-17T05:52:27.212 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 125697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-17T05:52:27.212 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/ 2023-10-17T05:52:27.213 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 194209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-17T05:52:27.213 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-17T05:52:27.213 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 57881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-17T05:52:27.213 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 60337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-17T05:52:27.213 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/ 2023-10-17T05:52:27.213 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 390473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-17T05:52:27.214 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-17T05:52:27.214 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-17T05:52:27.214 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-17T05:52:27.214 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-17T05:52:27.214 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/hsr/ 2023-10-17T05:52:27.215 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 99729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/hsr/hsr.ko 2023-10-17T05:52:27.215 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ 2023-10-17T05:52:27.215 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ 2023-10-17T05:52:27.215 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 45233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-17T05:52:27.215 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 254625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-17T05:52:27.216 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-17T05:52:27.216 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ 2023-10-17T05:52:27.216 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-17T05:52:27.216 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-17T05:52:27.216 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 48401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-17T05:52:27.217 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-17T05:52:27.217 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 48657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-17T05:52:27.217 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 60633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-17T05:52:27.217 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 61225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-17T05:52:27.217 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-17T05:52:27.218 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-17T05:52:27.218 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-17T05:52:27.218 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ 2023-10-17T05:52:27.218 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-17T05:52:27.218 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-17T05:52:27.218 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-17T05:52:27.219 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ip_tables.ko 2023-10-17T05:52:27.219 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-17T05:52:27.219 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-10-17T05:52:27.219 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-17T05:52:27.219 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-17T05:52:27.220 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-17T05:52:27.220 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-10-17T05:52:27.220 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-17T05:52:27.220 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-17T05:52:27.220 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-17T05:52:27.221 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-17T05:52:27.221 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-17T05:52:27.221 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-17T05:52:27.221 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-17T05:52:27.221 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-17T05:52:27.222 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-17T05:52:27.222 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-10-17T05:52:27.222 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-17T05:52:27.222 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-17T05:52:27.222 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-17T05:52:27.222 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-17T05:52:27.223 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-17T05:52:27.223 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-17T05:52:27.223 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-17T05:52:27.223 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-17T05:52:27.223 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-17T05:52:27.224 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-17T05:52:27.224 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-17T05:52:27.224 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-17T05:52:27.224 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-17T05:52:27.224 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-17T05:52:27.225 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-17T05:52:27.225 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-17T05:52:27.225 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-17T05:52:27.225 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-17T05:52:27.225 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-17T05:52:27.226 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-17T05:52:27.226 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 41665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-17T05:52:27.226 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-17T05:52:27.226 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ 2023-10-17T05:52:27.226 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-17T05:52:27.226 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-17T05:52:27.227 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-17T05:52:27.227 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 80897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_gre.ko 2023-10-17T05:52:27.227 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 93577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-17T05:52:27.227 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-17T05:52:27.227 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-17T05:52:27.228 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-17T05:52:27.228 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/mip6.ko 2023-10-17T05:52:27.228 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ 2023-10-17T05:52:27.228 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-17T05:52:27.228 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-10-17T05:52:27.228 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-17T05:52:27.229 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-17T05:52:27.229 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-17T05:52:27.229 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-17T05:52:27.229 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-17T05:52:27.229 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-17T05:52:27.230 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-17T05:52:27.230 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-17T05:52:27.230 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-17T05:52:27.230 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-17T05:52:27.230 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-17T05:52:27.231 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-17T05:52:27.231 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-17T05:52:27.231 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-17T05:52:27.231 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-17T05:52:27.231 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-17T05:52:27.232 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-17T05:52:27.232 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-17T05:52:27.232 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-17T05:52:27.232 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-17T05:52:27.232 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-17T05:52:27.232 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-17T05:52:27.233 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-17T05:52:27.233 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 74073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-17T05:52:27.233 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-17T05:52:27.233 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-17T05:52:27.233 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/ 2023-10-17T05:52:27.234 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 82833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-17T05:52:27.234 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/ 2023-10-17T05:52:27.234 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 125281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-17T05:52:27.234 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-17T05:52:27.234 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 25953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-17T05:52:27.234 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-17T05:52:27.235 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-17T05:52:27.235 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-17T05:52:27.235 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 53241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-17T05:52:27.235 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/lapb/ 2023-10-17T05:52:27.235 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 47977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/lapb/lapb.ko 2023-10-17T05:52:27.236 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/ 2023-10-17T05:52:27.236 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-17T05:52:27.236 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 267777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc2.ko 2023-10-17T05:52:27.236 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/ 2023-10-17T05:52:27.236 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 290417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-17T05:52:27.237 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/ 2023-10-17T05:52:27.237 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-17T05:52:27.237 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ 2023-10-17T05:52:27.237 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ 2023-10-17T05:52:27.237 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 119585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-17T05:52:27.237 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-17T05:52:27.238 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-17T05:52:27.238 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-17T05:52:27.238 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 100297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-17T05:52:27.238 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 101441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-17T05:52:27.238 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 102817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-17T05:52:27.239 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 103481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-17T05:52:27.239 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 112849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-17T05:52:27.239 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 60329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-17T05:52:27.239 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 109593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-17T05:52:27.239 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 113129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-17T05:52:27.240 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 112585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-17T05:52:27.240 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 111585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-17T05:52:27.240 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 114465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-17T05:52:27.240 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-17T05:52:27.240 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ 2023-10-17T05:52:27.241 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 411729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-17T05:52:27.241 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-17T05:52:27.241 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-17T05:52:27.241 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-17T05:52:27.241 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-17T05:52:27.242 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-17T05:52:27.242 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-17T05:52:27.242 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-17T05:52:27.242 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-17T05:52:27.242 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-17T05:52:27.243 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-17T05:52:27.243 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-17T05:52:27.243 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-17T05:52:27.243 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-17T05:52:27.243 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-17T05:52:27.244 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 408257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-17T05:52:27.244 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-17T05:52:27.244 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-17T05:52:27.244 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-17T05:52:27.245 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 118145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-17T05:52:27.245 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-17T05:52:27.245 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-17T05:52:27.245 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 107297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-17T05:52:27.245 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-17T05:52:27.246 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-17T05:52:27.246 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 66641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-17T05:52:27.246 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-17T05:52:27.246 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-17T05:52:27.247 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-17T05:52:27.247 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 89473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-17T05:52:27.247 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-17T05:52:27.247 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 37129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-17T05:52:27.247 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 95417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-17T05:52:27.248 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-17T05:52:27.248 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-17T05:52:27.248 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-17T05:52:27.248 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-17T05:52:27.248 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-17T05:52:27.249 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 44065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-17T05:52:27.249 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 615313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-17T05:52:27.249 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 42561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-17T05:52:27.249 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-17T05:52:27.249 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-10-17T05:52:27.250 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 39785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-17T05:52:27.250 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-17T05:52:27.250 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-17T05:52:27.250 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-17T05:52:27.250 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-17T05:52:27.251 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 40721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-17T05:52:27.251 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-17T05:52:27.251 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-17T05:52:27.251 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-17T05:52:27.251 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-17T05:52:27.251 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-17T05:52:27.252 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-17T05:52:27.252 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-17T05:52:27.252 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-17T05:52:27.252 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-17T05:52:27.252 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_osf.ko 2023-10-17T05:52:27.253 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-17T05:52:27.253 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-17T05:52:27.253 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-17T05:52:27.253 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-17T05:52:27.253 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-17T05:52:27.253 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_synproxy.ko 2023-10-17T05:52:27.254 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tproxy.ko 2023-10-17T05:52:27.254 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 89313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/x_tables.ko 2023-10-17T05:52:27.254 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-17T05:52:27.254 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-17T05:52:27.254 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-17T05:52:27.255 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-17T05:52:27.255 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 18169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-17T05:52:27.255 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-17T05:52:27.255 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-17T05:52:27.255 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-17T05:52:27.256 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-17T05:52:27.256 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-17T05:52:27.256 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-17T05:52:27.256 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-17T05:52:27.256 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-17T05:52:27.257 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-17T05:52:27.257 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-17T05:52:27.257 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-17T05:52:27.257 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-17T05:52:27.257 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 14337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-17T05:52:27.258 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-17T05:52:27.258 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-17T05:52:27.258 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-17T05:52:27.258 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-17T05:52:27.259 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-17T05:52:27.259 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-17T05:52:27.259 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-17T05:52:27.259 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-17T05:52:27.259 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-17T05:52:27.260 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-17T05:52:27.260 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-17T05:52:27.260 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-17T05:52:27.260 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-17T05:52:27.260 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-17T05:52:27.261 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-17T05:52:27.261 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-17T05:52:27.261 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-17T05:52:27.261 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-17T05:52:27.261 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-17T05:52:27.262 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-17T05:52:27.262 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-17T05:52:27.262 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 43289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-17T05:52:27.262 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-17T05:52:27.262 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-17T05:52:27.263 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-17T05:52:27.263 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-17T05:52:27.263 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-17T05:52:27.263 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-17T05:52:27.263 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-17T05:52:27.264 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-17T05:52:27.264 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-17T05:52:27.264 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-17T05:52:27.264 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-17T05:52:27.264 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-17T05:52:27.264 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-17T05:52:27.265 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-17T05:52:27.265 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-17T05:52:27.265 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-17T05:52:27.265 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-17T05:52:27.265 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-17T05:52:27.266 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-17T05:52:27.266 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-17T05:52:27.266 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-17T05:52:27.266 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-17T05:52:27.266 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-17T05:52:27.267 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-17T05:52:27.267 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 16089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-17T05:52:27.267 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-17T05:52:27.267 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-17T05:52:27.267 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-17T05:52:27.267 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 8553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-17T05:52:27.268 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpudp.ko 2023-10-17T05:52:27.268 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-17T05:52:27.268 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-17T05:52:27.268 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/ 2023-10-17T05:52:27.268 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-17T05:52:27.269 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/ 2023-10-17T05:52:27.269 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 12425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-17T05:52:27.269 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/ 2023-10-17T05:52:27.269 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 380033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-17T05:52:27.269 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-17T05:52:27.270 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-17T05:52:27.270 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 11793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-17T05:52:27.270 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/ 2023-10-17T05:52:27.270 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-17T05:52:27.270 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/ 2023-10-17T05:52:27.270 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 110201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/phonet.ko 2023-10-17T05:52:27.271 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/pn_pep.ko 2023-10-17T05:52:27.271 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/ 2023-10-17T05:52:27.271 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 251481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-17T05:52:27.271 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 164937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-17T05:52:27.271 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 67377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-17T05:52:27.272 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rxrpc/ 2023-10-17T05:52:27.272 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 819657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rxrpc/rxrpc.ko 2023-10-17T05:52:27.272 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/ 2023-10-17T05:52:27.272 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-17T05:52:27.272 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-17T05:52:27.273 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-17T05:52:27.273 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-17T05:52:27.273 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-17T05:52:27.273 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 43449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-17T05:52:27.273 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-17T05:52:27.273 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-17T05:52:27.274 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-17T05:52:27.274 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-17T05:52:27.274 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-17T05:52:27.274 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-17T05:52:27.274 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_cgroup.ko 2023-10-17T05:52:27.275 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-17T05:52:27.275 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-17T05:52:27.275 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 38489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-17T05:52:27.275 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 61409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-17T05:52:27.275 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-17T05:52:27.276 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 13409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-17T05:52:27.276 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-17T05:52:27.276 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-17T05:52:27.276 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-17T05:52:27.276 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-17T05:52:27.277 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 21649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-17T05:52:27.277 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-17T05:52:27.277 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 34633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-17T05:52:27.277 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 33609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-17T05:52:27.277 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq_codel.ko 2023-10-17T05:52:27.278 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 35433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-17T05:52:27.278 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 49601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-17T05:52:27.278 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-17T05:52:27.278 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 66393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-17T05:52:27.278 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-17T05:52:27.278 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 30273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-17T05:52:27.279 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-17T05:52:27.279 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-17T05:52:27.279 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 36137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-17T05:52:27.279 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 27497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-17T05:52:27.279 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-17T05:52:27.280 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-17T05:52:27.280 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 48793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-17T05:52:27.280 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 32905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-17T05:52:27.280 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 26881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-17T05:52:27.280 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 31353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-17T05:52:27.280 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-17T05:52:27.281 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 28105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-17T05:52:27.281 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/ 2023-10-17T05:52:27.281 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 929745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-17T05:52:27.281 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 19033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-17T05:52:27.281 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/ 2023-10-17T05:52:27.282 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/ 2023-10-17T05:52:27.282 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 336529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-17T05:52:27.282 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 54737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-17T05:52:27.282 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 1520161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-17T05:52:27.282 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/ 2023-10-17T05:52:27.283 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 707721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-17T05:52:27.283 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/ 2023-10-17T05:52:27.283 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-17T05:52:27.283 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 862641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-17T05:52:27.285 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/ 2023-10-17T05:52:27.285 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-17T05:52:27.285 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/ 2023-10-17T05:52:27.285 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 85337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-17T05:52:27.286 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 68049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-17T05:52:27.286 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 96193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-17T05:52:27.286 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 10705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-17T05:52:27.286 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 17521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-17T05:52:27.287 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/x25/ 2023-10-17T05:52:27.287 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 125177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/x25/x25.ko 2023-10-17T05:52:27.287 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/ 2023-10-17T05:52:27.287 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 22657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_algo.ko 2023-10-17T05:52:27.287 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 20649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-17T05:52:27.288 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 102257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_user.ko 2023-10-17T05:52:27.288 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/ 2023-10-17T05:52:27.288 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/ 2023-10-17T05:52:27.288 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 15537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-17T05:52:27.288 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 639863 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-17T05:52:27.289 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 623919 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-17T05:52:27.289 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 7663 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-17T05:52:27.289 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 23428 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-17T05:52:27.289 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 9821 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-17T05:52:27.289 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 70004 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-17T05:52:27.289 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 146313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-17T05:52:27.290 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 232548 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-17T05:52:27.290 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 210 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-17T05:52:27.290 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 72606 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-17T05:52:27.290 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 879 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-17T05:52:27.290 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 254438 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-17T05:52:27.291 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 309363 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-17T05:52:27.291 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./usr/ 2023-10-17T05:52:27.291 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./usr/share/ 2023-10-17T05:52:27.291 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./usr/share/doc/ 2023-10-17T05:52:27.291 INFO:teuthology.orchestra.run.smithi125.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/ 2023-10-17T05:52:27.292 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 174 2023-10-10 19:59 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/changelog.Debian.gz 2023-10-17T05:52:27.292 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r-- root/root 691 2023-10-10 19:59 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/copyright 2023-10-17T05:52:27.293 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-17T05:52:27.293 INFO:teuthology.task.kernel:searching for kernel 6.6.0-rc5-g47672119149b 2023-10-17T05:52:27.293 DEBUG:teuthology.orchestra.run.smithi125:> egrep '(submenu|menuentry.*6.6.0-rc5-g47672119149b).*{' /boot/grub/grub.cfg 2023-10-17T05:52:27.303 INFO:teuthology.orchestra.run.smithi125.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-17T05:52:27.303 INFO:teuthology.orchestra.run.smithi125.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g47672119149b' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g47672119149b-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-17T05:52:27.303 INFO:teuthology.orchestra.run.smithi125.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g47672119149b (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g47672119149b-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-17T05:52:27.304 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-10-17T05:52:27.304 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-rc5-g47672119149b 2023-10-17T05:52:27.304 DEBUG:teuthology.orchestra.run.smithi125:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-10-17T05:52:27.307 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi125.front.sepia.ceph.com to complete... 2023-10-17T05:52:27.662 INFO:teuthology.orchestra.run.smithi184.stderr:done 2023-10-17T05:52:27.865 DEBUG:teuthology.orchestra.run.smithi184:> dpkg-deb -c /tmp/linux-image.deb 2023-10-17T05:52:27.875 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./ 2023-10-17T05:52:27.875 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./boot/ 2023-10-17T05:52:27.875 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 4415097 2023-10-10 19:59 ./boot/System.map-6.6.0-rc5-g47672119149b 2023-10-17T05:52:27.890 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 169298 2023-10-10 19:59 ./boot/config-6.6.0-rc5-g47672119149b 2023-10-17T05:52:27.891 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11352928 2023-10-10 19:59 ./boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-17T05:52:27.912 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/ 2023-10-17T05:52:27.912 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/ 2023-10-17T05:52:27.912 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/postinst.d/ 2023-10-17T05:52:27.913 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/postrm.d/ 2023-10-17T05:52:27.913 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/preinst.d/ 2023-10-17T05:52:27.913 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/prerm.d/ 2023-10-17T05:52:27.913 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/ 2023-10-17T05:52:27.913 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/ 2023-10-17T05:52:27.914 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/ 2023-10-17T05:52:27.914 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/ 2023-10-17T05:52:27.914 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/ 2023-10-17T05:52:27.914 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/ 2023-10-17T05:52:27.914 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ 2023-10-17T05:52:27.915 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 490233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/aesni-intel.ko 2023-10-17T05:52:27.917 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-17T05:52:27.918 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-17T05:52:27.918 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-17T05:52:27.918 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 93113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-17T05:52:27.918 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 106729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-17T05:52:27.918 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 152241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-17T05:52:27.919 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-17T05:52:27.919 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-17T05:52:27.919 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 83889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-17T05:52:27.919 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-17T05:52:27.920 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-17T05:52:27.920 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-17T05:52:27.920 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-17T05:52:27.920 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-17T05:52:27.920 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-17T05:52:27.921 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 58585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-17T05:52:27.921 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-17T05:52:27.921 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-17T05:52:27.921 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-17T05:52:27.921 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/ 2023-10-17T05:52:27.922 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/ 2023-10-17T05:52:27.922 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/ 2023-10-17T05:52:27.922 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-17T05:52:27.922 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpuid.ko 2023-10-17T05:52:27.922 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/msr.ko 2023-10-17T05:52:27.923 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/ 2023-10-17T05:52:27.923 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 353761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-17T05:52:27.923 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 881713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-17T05:52:27.923 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 2276817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-17T05:52:27.981 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ 2023-10-17T05:52:27.982 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/af_alg.ko 2023-10-17T05:52:27.982 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/algif_hash.ko 2023-10-17T05:52:27.982 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/algif_skcipher.ko 2023-10-17T05:52:27.982 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-17T05:52:27.982 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-17T05:52:27.983 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-17T05:52:27.983 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/asymmetric_keys/ 2023-10-17T05:52:27.983 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-10-17T05:52:27.983 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/ 2023-10-17T05:52:27.983 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-17T05:52:27.983 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-17T05:52:27.984 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-17T05:52:27.984 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-17T05:52:27.984 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-17T05:52:27.984 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-17T05:52:27.984 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-17T05:52:27.985 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-17T05:52:27.985 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-17T05:52:27.985 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-17T05:52:27.985 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-17T05:52:27.985 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-17T05:52:27.986 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-17T05:52:27.986 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-17T05:52:27.986 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-17T05:52:27.986 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-17T05:52:27.986 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-17T05:52:27.986 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-17T05:52:27.987 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cryptd.ko 2023-10-17T05:52:27.987 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-17T05:52:27.987 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_simd.ko 2023-10-17T05:52:27.987 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-17T05:52:27.987 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-17T05:52:27.988 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-17T05:52:27.988 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-17T05:52:27.988 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-17T05:52:27.988 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-17T05:52:27.988 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-17T05:52:27.988 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-17T05:52:27.989 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lrw.ko 2023-10-17T05:52:27.989 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-17T05:52:27.989 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-17T05:52:27.989 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-17T05:52:27.989 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-17T05:52:27.990 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-17T05:52:27.990 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-17T05:52:27.990 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-17T05:52:27.990 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-17T05:52:27.990 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-17T05:52:27.991 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 149193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-17T05:52:27.991 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-17T05:52:27.991 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-17T05:52:27.991 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-17T05:52:27.991 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-17T05:52:27.992 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-17T05:52:27.992 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-17T05:52:27.992 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-17T05:52:27.992 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xts.ko 2023-10-17T05:52:27.992 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-17T05:52:27.993 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ 2023-10-17T05:52:27.993 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ 2023-10-17T05:52:27.993 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_extlog.ko 2023-10-17T05:52:27.993 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-17T05:52:27.993 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-17T05:52:27.994 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/apei/ 2023-10-17T05:52:27.994 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/apei/einj.ko 2023-10-17T05:52:27.994 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-17T05:52:27.994 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-17T05:52:27.994 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-17T05:52:27.994 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-17T05:52:27.995 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 103025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-17T05:52:27.995 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ 2023-10-17T05:52:27.995 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-17T05:52:27.995 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 88865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci.ko 2023-10-17T05:52:27.995 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-17T05:52:27.996 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 88289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci.ko 2023-10-17T05:52:27.996 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-17T05:52:27.996 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-17T05:52:27.996 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-17T05:52:27.996 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-17T05:52:27.997 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-17T05:52:27.997 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-17T05:52:27.997 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-17T05:52:27.997 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-17T05:52:27.997 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-17T05:52:27.998 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-17T05:52:27.998 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-17T05:52:27.998 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-17T05:52:27.998 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-17T05:52:27.998 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-17T05:52:27.998 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-17T05:52:27.999 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-17T05:52:27.999 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-17T05:52:27.999 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-17T05:52:27.999 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_legacy.ko 2023-10-17T05:52:27.999 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-17T05:52:28.000 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-17T05:52:28.000 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-17T05:52:28.000 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-17T05:52:28.000 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-17T05:52:28.000 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-17T05:52:28.000 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-17T05:52:28.001 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-17T05:52:28.001 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-17T05:52:28.001 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-17T05:52:28.001 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-17T05:52:28.001 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-17T05:52:28.002 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-17T05:52:28.002 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_radisys.ko 2023-10-17T05:52:28.002 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-17T05:52:28.002 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rz1000.ko 2023-10-17T05:52:28.002 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-17T05:52:28.003 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-17T05:52:28.003 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-17T05:52:28.003 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-17T05:52:28.003 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-17T05:52:28.003 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-17T05:52:28.004 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-17T05:52:28.004 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-17T05:52:28.004 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 83345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-17T05:52:28.004 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 70393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-17T05:52:28.004 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-17T05:52:28.004 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-17T05:52:28.005 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-17T05:52:28.005 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-17T05:52:28.005 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-17T05:52:28.005 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-17T05:52:28.005 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-17T05:52:28.006 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-17T05:52:28.006 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-17T05:52:28.006 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-17T05:52:28.006 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ 2023-10-17T05:52:28.006 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-17T05:52:28.007 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/ 2023-10-17T05:52:28.007 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 124473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-17T05:52:28.007 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/ 2023-10-17T05:52:28.007 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/ 2023-10-17T05:52:28.007 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 113665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-17T05:52:28.007 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/ 2023-10-17T05:52:28.008 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 965585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-17T05:52:28.008 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 173225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-17T05:52:28.008 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/ 2023-10-17T05:52:28.008 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 94297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-17T05:52:28.008 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 115793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-17T05:52:28.009 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/ 2023-10-17T05:52:28.009 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 110449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-17T05:52:28.009 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 98193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-17T05:52:28.009 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 263769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-17T05:52:28.009 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/ 2023-10-17T05:52:28.010 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 98145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-17T05:52:28.010 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/ 2023-10-17T05:52:28.010 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-17T05:52:28.010 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ 2023-10-17T05:52:28.010 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/applicom.ko 2023-10-17T05:52:28.011 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-17T05:52:28.011 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/ 2023-10-17T05:52:28.011 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-17T05:52:28.011 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-17T05:52:28.011 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-17T05:52:28.011 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-17T05:52:28.012 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-17T05:52:28.012 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ 2023-10-17T05:52:28.012 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-17T05:52:28.012 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 148601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-17T05:52:28.012 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-17T05:52:28.013 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 139313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-17T05:52:28.013 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 70921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-17T05:52:28.013 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-17T05:52:28.013 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-17T05:52:28.013 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/ 2023-10-17T05:52:28.013 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 84097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-17T05:52:28.014 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/nvram.ko 2023-10-17T05:52:28.014 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-17T05:52:28.014 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-17T05:52:28.014 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/ 2023-10-17T05:52:28.014 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-17T05:52:28.015 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-10-17T05:52:28.015 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-10-17T05:52:28.015 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-10-17T05:52:28.015 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-17T05:52:28.015 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-17T05:52:28.016 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-10-17T05:52:28.016 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/ 2023-10-17T05:52:28.016 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_class.ko 2023-10-17T05:52:28.016 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_core.ko 2023-10-17T05:52:28.016 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-10-17T05:52:28.016 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/ 2023-10-17T05:52:28.017 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-palmas.ko 2023-10-17T05:52:28.017 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-si5351.ko 2023-10-17T05:52:28.017 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-twl6040.ko 2023-10-17T05:52:28.017 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-wm831x.ko 2023-10-17T05:52:28.017 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/ 2023-10-17T05:52:28.018 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-17T05:52:28.018 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-17T05:52:28.018 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-17T05:52:28.018 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ 2023-10-17T05:52:28.018 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ 2023-10-17T05:52:28.018 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 70801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-17T05:52:28.019 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 243025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-17T05:52:28.019 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/ 2023-10-17T05:52:28.019 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/ 2023-10-17T05:52:28.019 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/ 2023-10-17T05:52:28.019 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 438761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-17T05:52:28.020 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-10-17T05:52:28.020 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-17T05:52:28.020 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-17T05:52:28.020 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-17T05:52:28.020 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/ 2023-10-17T05:52:28.021 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 68857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-17T05:52:28.021 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/ 2023-10-17T05:52:28.021 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-17T05:52:28.021 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ 2023-10-17T05:52:28.021 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/ 2023-10-17T05:52:28.022 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-17T05:52:28.022 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ 2023-10-17T05:52:28.022 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 122569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-17T05:52:28.022 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ 2023-10-17T05:52:28.022 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 79953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-17T05:52:28.022 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-17T05:52:28.023 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 63617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-17T05:52:28.023 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-17T05:52:28.023 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-17T05:52:28.023 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-17T05:52:28.023 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-17T05:52:28.024 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-17T05:52:28.024 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 52041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-17T05:52:28.024 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-17T05:52:28.024 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-17T05:52:28.024 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 56825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-17T05:52:28.025 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-17T05:52:28.025 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/ 2023-10-17T05:52:28.025 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-gpio.ko 2023-10-17T05:52:28.025 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max14577.ko 2023-10-17T05:52:28.025 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max77693.ko 2023-10-17T05:52:28.026 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max8997.ko 2023-10-17T05:52:28.026 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-palmas.ko 2023-10-17T05:52:28.026 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-rt8973a.ko 2023-10-17T05:52:28.026 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-sm5502.ko 2023-10-17T05:52:28.026 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/ 2023-10-17T05:52:28.026 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/dmi-sysfs.ko 2023-10-17T05:52:28.027 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/efi/ 2023-10-17T05:52:28.027 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/efi/efi-pstore.ko 2023-10-17T05:52:28.027 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-17T05:52:28.027 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/ 2023-10-17T05:52:28.027 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-adp5520.ko 2023-10-17T05:52:28.028 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-amd8111.ko 2023-10-17T05:52:28.028 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-arizona.ko 2023-10-17T05:52:28.028 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-da9052.ko 2023-10-17T05:52:28.028 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-da9055.ko 2023-10-17T05:52:28.028 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-dln2.ko 2023-10-17T05:52:28.029 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 77849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-f7188x.ko 2023-10-17T05:52:28.029 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-generic.ko 2023-10-17T05:52:28.029 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-17T05:52:28.029 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-10-17T05:52:28.029 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-kempld.ko 2023-10-17T05:52:28.029 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-lp3943.ko 2023-10-17T05:52:28.030 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max7300.ko 2023-10-17T05:52:28.030 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max730x.ko 2023-10-17T05:52:28.030 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max732x.ko 2023-10-17T05:52:28.030 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-10-17T05:52:28.030 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-pca953x.ko 2023-10-17T05:52:28.031 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-pcf857x.ko 2023-10-17T05:52:28.031 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-rdc321x.ko 2023-10-17T05:52:28.031 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-sch.ko 2023-10-17T05:52:28.031 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-sch311x.ko 2023-10-17T05:52:28.031 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-tps65912.ko 2023-10-17T05:52:28.031 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-twl4030.ko 2023-10-17T05:52:28.032 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-twl6040.ko 2023-10-17T05:52:28.032 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-17T05:52:28.032 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-vx855.ko 2023-10-17T05:52:28.032 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm831x.ko 2023-10-17T05:52:28.032 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm8350.ko 2023-10-17T05:52:28.033 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm8994.ko 2023-10-17T05:52:28.033 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/ 2023-10-17T05:52:28.033 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-a4tech.ko 2023-10-17T05:52:28.033 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-apple.ko 2023-10-17T05:52:28.033 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-17T05:52:28.033 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-17T05:52:28.034 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-17T05:52:28.034 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-belkin.ko 2023-10-17T05:52:28.034 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cherry.ko 2023-10-17T05:52:28.034 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-chicony.ko 2023-10-17T05:52:28.034 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cp2112.ko 2023-10-17T05:52:28.035 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cypress.ko 2023-10-17T05:52:28.035 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-17T05:52:28.035 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-17T05:52:28.035 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-17T05:52:28.035 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-17T05:52:28.036 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ezkey.ko 2023-10-17T05:52:28.036 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-17T05:52:28.036 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-generic.ko 2023-10-17T05:52:28.036 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-17T05:52:28.036 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-17T05:52:28.036 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-17T05:52:28.037 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-17T05:52:28.037 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-17T05:52:28.037 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-17T05:52:28.037 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-17T05:52:28.037 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kensington.ko 2023-10-17T05:52:28.038 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-17T05:52:28.038 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-17T05:52:28.038 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-17T05:52:28.038 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-17T05:52:28.038 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-17T05:52:28.039 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lg-g15.ko 2023-10-17T05:52:28.039 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 58185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-17T05:52:28.039 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 101369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-17T05:52:28.039 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 80993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech.ko 2023-10-17T05:52:28.039 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-magicmouse.ko 2023-10-17T05:52:28.039 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-microsoft.ko 2023-10-17T05:52:28.040 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-monterey.ko 2023-10-17T05:52:28.040 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-17T05:52:28.040 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ntrig.ko 2023-10-17T05:52:28.040 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-17T05:52:28.040 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-17T05:52:28.041 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-17T05:52:28.041 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 72937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-17T05:52:28.041 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-17T05:52:28.041 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-17T05:52:28.041 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-17T05:52:28.042 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-17T05:52:28.042 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-17T05:52:28.042 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-17T05:52:28.042 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-17T05:52:28.042 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-17T05:52:28.043 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-17T05:52:28.043 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-17T05:52:28.043 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-17T05:52:28.043 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-17T05:52:28.043 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-17T05:52:28.044 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-17T05:52:28.044 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-17T05:52:28.044 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-17T05:52:28.044 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-17T05:52:28.044 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-17T05:52:28.044 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-17T05:52:28.045 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-17T05:52:28.045 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-17T05:52:28.045 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-17T05:52:28.045 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-17T05:52:28.045 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-17T05:52:28.046 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-17T05:52:28.046 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-17T05:52:28.046 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-17T05:52:28.046 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-17T05:52:28.046 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-17T05:52:28.047 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 71073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-17T05:52:28.047 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-17T05:52:28.047 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 143473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-17T05:52:28.047 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-17T05:52:28.047 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-17T05:52:28.047 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-17T05:52:28.048 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 267825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid.ko 2023-10-17T05:52:28.048 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-17T05:52:28.048 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/ 2023-10-17T05:52:28.048 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 125721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbhid.ko 2023-10-17T05:52:28.048 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbkbd.ko 2023-10-17T05:52:28.049 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbmouse.ko 2023-10-17T05:52:28.049 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 217873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-17T05:52:28.049 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/ 2023-10-17T05:52:28.049 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 64201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-17T05:52:28.049 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 89625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-17T05:52:28.049 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 305465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-17T05:52:28.050 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ 2023-10-17T05:52:28.050 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 66521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-17T05:52:28.050 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 61393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-17T05:52:28.050 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-17T05:52:28.050 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-17T05:52:28.051 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-17T05:52:28.051 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-17T05:52:28.051 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-17T05:52:28.051 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 97977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-17T05:52:28.051 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-17T05:52:28.052 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 45553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-17T05:52:28.052 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-17T05:52:28.052 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-17T05:52:28.052 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-17T05:52:28.052 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-17T05:52:28.052 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 74433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-17T05:52:28.053 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-17T05:52:28.053 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 67929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-17T05:52:28.053 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-17T05:52:28.053 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-17T05:52:28.053 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 55265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-17T05:52:28.053 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-17T05:52:28.054 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 58617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-17T05:52:28.054 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-17T05:52:28.054 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-17T05:52:28.054 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-17T05:52:28.054 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/da9052-hwmon.ko 2023-10-17T05:52:28.055 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/da9055-hwmon.ko 2023-10-17T05:52:28.055 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-17T05:52:28.055 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 99601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-17T05:52:28.055 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-17T05:52:28.055 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-17T05:52:28.055 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-17T05:52:28.056 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc2103.ko 2023-10-17T05:52:28.056 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-17T05:52:28.056 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 66985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-17T05:52:28.056 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 94457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-17T05:52:28.056 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-17T05:52:28.057 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-17T05:52:28.057 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 55449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-17T05:52:28.057 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-17T05:52:28.057 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-17T05:52:28.057 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 46801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-17T05:52:28.057 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 45529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-17T05:52:28.058 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hih6130.ko 2023-10-17T05:52:28.058 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-17T05:52:28.058 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-17T05:52:28.058 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-17T05:52:28.058 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-17T05:52:28.059 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-17T05:52:28.059 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-17T05:52:28.059 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-17T05:52:28.059 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 130449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-17T05:52:28.059 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/jc42.ko 2023-10-17T05:52:28.060 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-17T05:52:28.060 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-17T05:52:28.060 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-17T05:52:28.060 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 48601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-17T05:52:28.060 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-17T05:52:28.060 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-17T05:52:28.061 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-17T05:52:28.061 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-17T05:52:28.061 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-17T05:52:28.061 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-17T05:52:28.061 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 72833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-17T05:52:28.062 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 46153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-17T05:52:28.062 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-17T05:52:28.062 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-17T05:52:28.062 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 108841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-17T05:52:28.062 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-17T05:52:28.062 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-17T05:52:28.063 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-17T05:52:28.063 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-17T05:52:28.063 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-17T05:52:28.063 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-17T05:52:28.063 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-17T05:52:28.064 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-17T05:52:28.064 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-17T05:52:28.064 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-17T05:52:28.064 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-17T05:52:28.064 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-17T05:52:28.064 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-17T05:52:28.065 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-17T05:52:28.065 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-17T05:52:28.065 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-17T05:52:28.065 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-17T05:52:28.065 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mc13783-adc.ko 2023-10-17T05:52:28.066 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-17T05:52:28.066 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-10-17T05:52:28.066 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-17T05:52:28.066 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 119817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-17T05:52:28.066 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-17T05:52:28.066 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 59737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-17T05:52:28.067 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 82337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-17T05:52:28.067 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-17T05:52:28.067 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-17T05:52:28.067 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ 2023-10-17T05:52:28.067 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-17T05:52:28.068 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-17T05:52:28.068 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-17T05:52:28.068 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-17T05:52:28.068 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-17T05:52:28.068 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-17T05:52:28.068 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-17T05:52:28.069 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 82577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-17T05:52:28.069 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-17T05:52:28.069 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-17T05:52:28.069 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-17T05:52:28.069 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-17T05:52:28.070 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-17T05:52:28.070 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-17T05:52:28.070 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-17T05:52:28.070 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-17T05:52:28.070 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-17T05:52:28.070 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-17T05:52:28.071 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-17T05:52:28.071 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-17T05:52:28.071 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-17T05:52:28.071 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-17T05:52:28.071 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-17T05:52:28.072 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-17T05:52:28.072 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-17T05:52:28.072 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-17T05:52:28.072 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-17T05:52:28.072 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-17T05:52:28.073 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-17T05:52:28.073 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-17T05:52:28.073 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 52457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-17T05:52:28.073 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-17T05:52:28.073 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 57513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-17T05:52:28.073 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 78873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-17T05:52:28.074 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 71345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-17T05:52:28.074 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 63289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-17T05:52:28.074 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 71321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-17T05:52:28.074 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 101473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-17T05:52:28.074 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 119505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-17T05:52:28.075 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-17T05:52:28.075 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-17T05:52:28.075 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-10-17T05:52:28.075 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-10-17T05:52:28.075 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/ 2023-10-17T05:52:28.075 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/ 2023-10-17T05:52:28.076 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-17T05:52:28.076 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-17T05:52:28.076 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/ 2023-10-17T05:52:28.076 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-10-17T05:52:28.076 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-10-17T05:52:28.077 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-10-17T05:52:28.077 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-17T05:52:28.077 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-17T05:52:28.077 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-17T05:52:28.077 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-10-17T05:52:28.077 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 6929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-17T05:52:28.078 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-10-17T05:52:28.078 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-17T05:52:28.078 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-17T05:52:28.078 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-17T05:52:28.078 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-17T05:52:28.079 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-10-17T05:52:28.079 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-10-17T05:52:28.079 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 62817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-17T05:52:28.079 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-17T05:52:28.079 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-17T05:52:28.079 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-10-17T05:52:28.080 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-17T05:52:28.080 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-17T05:52:28.080 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-10-17T05:52:28.080 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-17T05:52:28.080 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-17T05:52:28.081 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-17T05:52:28.081 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-10-17T05:52:28.081 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-17T05:52:28.081 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-17T05:52:28.081 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-10-17T05:52:28.081 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-10-17T05:52:28.082 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-17T05:52:28.082 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-10-17T05:52:28.082 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-17T05:52:28.082 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-17T05:52:28.082 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-17T05:52:28.083 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-17T05:52:28.083 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-10-17T05:52:28.083 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-17T05:52:28.083 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-17T05:52:28.083 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-17T05:52:28.083 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/ 2023-10-17T05:52:28.084 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-10-17T05:52:28.084 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-10-17T05:52:28.084 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-10-17T05:52:28.084 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ 2023-10-17T05:52:28.084 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ 2023-10-17T05:52:28.085 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 273609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-17T05:52:28.085 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 879969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-17T05:52:28.085 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 69337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-17T05:52:28.085 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 324217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-17T05:52:28.085 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 97985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-17T05:52:28.085 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 282273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-17T05:52:28.086 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 66201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-17T05:52:28.086 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ 2023-10-17T05:52:28.086 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/ 2023-10-17T05:52:28.086 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 493073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-17T05:52:28.086 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/ 2023-10-17T05:52:28.087 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 419737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-17T05:52:28.087 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/ 2023-10-17T05:52:28.087 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 739025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-17T05:52:28.087 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ 2023-10-17T05:52:28.087 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 296625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-17T05:52:28.087 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ocrdma/ 2023-10-17T05:52:28.088 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 153697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-10-17T05:52:28.088 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/usnic/ 2023-10-17T05:52:28.088 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 168969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-10-17T05:52:28.088 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ 2023-10-17T05:52:28.088 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ 2023-10-17T05:52:28.089 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 263081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-17T05:52:28.089 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ 2023-10-17T05:52:28.089 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 100241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-17T05:52:28.089 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ 2023-10-17T05:52:28.089 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 111425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-17T05:52:28.089 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ 2023-10-17T05:52:28.090 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 128753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-17T05:52:28.090 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ 2023-10-17T05:52:28.090 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 129529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-17T05:52:28.090 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/ 2023-10-17T05:52:28.090 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/evbug.ko 2023-10-17T05:52:28.091 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/ff-memless.ko 2023-10-17T05:52:28.091 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/ 2023-10-17T05:52:28.091 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-17T05:52:28.091 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-17T05:52:28.091 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-17T05:52:28.092 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-17T05:52:28.092 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/ 2023-10-17T05:52:28.092 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-10-17T05:52:28.092 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-10-17T05:52:28.092 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-10-17T05:52:28.092 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-10-17T05:52:28.093 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-17T05:52:28.093 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-10-17T05:52:28.093 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lkkbd.ko 2023-10-17T05:52:28.093 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lm8323.ko 2023-10-17T05:52:28.093 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lm8333.ko 2023-10-17T05:52:28.094 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-10-17T05:52:28.094 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-10-17T05:52:28.094 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-10-17T05:52:28.094 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-10-17T05:52:28.094 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/newtonkbd.ko 2023-10-17T05:52:28.094 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-10-17T05:52:28.095 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/qt1070.ko 2023-10-17T05:52:28.095 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/qt2160.ko 2023-10-17T05:52:28.095 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-10-17T05:52:28.095 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/stowaway.ko 2023-10-17T05:52:28.095 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/sunkbd.ko 2023-10-17T05:52:28.096 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-10-17T05:52:28.096 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-10-17T05:52:28.096 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-10-17T05:52:28.096 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/xtkbd.ko 2023-10-17T05:52:28.096 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/matrix-keymap.ko 2023-10-17T05:52:28.097 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/ 2023-10-17T05:52:28.097 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-17T05:52:28.097 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-17T05:52:28.097 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 123681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-17T05:52:28.097 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 89449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-17T05:52:28.097 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/gpio_mouse.ko 2023-10-17T05:52:28.098 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 335977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/psmouse.ko 2023-10-17T05:52:28.098 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-17T05:52:28.098 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-17T05:52:28.098 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-17T05:52:28.098 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-17T05:52:28.099 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/ 2023-10-17T05:52:28.099 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 109873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-17T05:52:28.099 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ 2023-10-17T05:52:28.099 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-17T05:52:28.099 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-17T05:52:28.099 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ct82c710.ko 2023-10-17T05:52:28.100 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-17T05:52:28.100 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/parkbd.ko 2023-10-17T05:52:28.100 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/pcips2.ko 2023-10-17T05:52:28.100 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ps2mult.ko 2023-10-17T05:52:28.100 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-17T05:52:28.101 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serport.ko 2023-10-17T05:52:28.101 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-17T05:52:28.101 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/ 2023-10-17T05:52:28.101 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/ 2023-10-17T05:52:28.101 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-17T05:52:28.101 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/ 2023-10-17T05:52:28.102 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-88pm860x.ko 2023-10-17T05:52:28.102 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-adp5520.ko 2023-10-17T05:52:28.102 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 59753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-bd2802.ko 2023-10-17T05:52:28.102 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-17T05:52:28.102 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-da903x.ko 2023-10-17T05:52:28.103 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-da9052.ko 2023-10-17T05:52:28.103 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-gpio.ko 2023-10-17T05:52:28.103 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-17T05:52:28.103 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3533.ko 2023-10-17T05:52:28.103 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm355x.ko 2023-10-17T05:52:28.104 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3642.ko 2023-10-17T05:52:28.104 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-17T05:52:28.104 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp8788.ko 2023-10-17T05:52:28.104 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-max8997.ko 2023-10-17T05:52:28.104 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-mc13783.ko 2023-10-17T05:52:28.104 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-menf21bmc.ko 2023-10-17T05:52:28.105 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca9532.ko 2023-10-17T05:52:28.105 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca955x.ko 2023-10-17T05:52:28.105 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca963x.ko 2023-10-17T05:52:28.105 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-17T05:52:28.105 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-tca6507.ko 2023-10-17T05:52:28.106 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-wm831x-status.ko 2023-10-17T05:52:28.106 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-wm8350.ko 2023-10-17T05:52:28.106 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ 2023-10-17T05:52:28.106 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-17T05:52:28.106 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-17T05:52:28.106 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-17T05:52:28.107 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-17T05:52:28.107 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-17T05:52:28.107 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-17T05:52:28.107 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-17T05:52:28.107 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-17T05:52:28.108 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/ 2023-10-17T05:52:28.108 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/ 2023-10-17T05:52:28.108 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 654969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-17T05:52:28.108 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-17T05:52:28.108 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 89601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bufio.ko 2023-10-17T05:52:28.108 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-17T05:52:28.109 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 156009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-17T05:52:28.109 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 106897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-17T05:52:28.109 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-17T05:52:28.109 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-era.ko 2023-10-17T05:52:28.109 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-17T05:52:28.110 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-17T05:52:28.110 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log.ko 2023-10-17T05:52:28.110 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-mirror.ko 2023-10-17T05:52:28.110 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 78033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-17T05:52:28.110 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-17T05:52:28.110 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 70825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-17T05:52:28.111 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-region-hash.ko 2023-10-17T05:52:28.111 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-17T05:52:28.111 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-17T05:52:28.111 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 109593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-snapshot.ko 2023-10-17T05:52:28.111 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-17T05:52:28.112 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 181865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-17T05:52:28.112 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-17T05:52:28.112 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-zero.ko 2023-10-17T05:52:28.112 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-17T05:52:28.112 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-17T05:52:28.113 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-17T05:52:28.113 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/ 2023-10-17T05:52:28.113 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 199937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-17T05:52:28.113 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-17T05:52:28.113 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 113073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-17T05:52:28.113 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 158681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-17T05:52:28.114 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 395721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-17T05:52:28.114 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/ 2023-10-17T05:52:28.114 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/ 2023-10-17T05:52:28.114 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 178137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-17T05:52:28.114 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 63385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-17T05:52:28.115 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-17T05:52:28.115 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-17T05:52:28.115 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 123321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-17T05:52:28.115 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 79041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-17T05:52:28.116 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-17T05:52:28.116 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/ 2023-10-17T05:52:28.116 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm800.ko 2023-10-17T05:52:28.116 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm805.ko 2023-10-17T05:52:28.116 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm80x.ko 2023-10-17T05:52:28.117 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/arizona-i2c.ko 2023-10-17T05:52:28.117 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 123721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/arizona.ko 2023-10-17T05:52:28.117 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/bcm590xx.ko 2023-10-17T05:52:28.117 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/cros_ec_dev.ko 2023-10-17T05:52:28.117 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/dln2.ko 2023-10-17T05:52:28.117 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/janz-cmodio.ko 2023-10-17T05:52:28.118 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/kempld-core.ko 2023-10-17T05:52:28.118 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lm3533-core.ko 2023-10-17T05:52:28.118 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-10-17T05:52:28.118 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lp3943.ko 2023-10-17T05:52:28.118 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-17T05:52:28.119 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-17T05:52:28.119 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/max8907.ko 2023-10-17T05:52:28.119 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mc13xxx-core.ko 2023-10-17T05:52:28.119 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-10-17T05:52:28.119 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/menf21bmc.ko 2023-10-17T05:52:28.120 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633-adc.ko 2023-10-17T05:52:28.120 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633-gpio.ko 2023-10-17T05:52:28.120 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633.ko 2023-10-17T05:52:28.120 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-10-17T05:52:28.120 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/retu-mfd.ko 2023-10-17T05:52:28.120 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 80425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/si476x-core.ko 2023-10-17T05:52:28.121 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 48457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-17T05:52:28.121 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-10-17T05:52:28.121 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/tps65010.ko 2023-10-17T05:52:28.121 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/tps6507x.ko 2023-10-17T05:52:28.121 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-17T05:52:28.122 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-17T05:52:28.122 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-17T05:52:28.122 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wm8994.ko 2023-10-17T05:52:28.122 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ 2023-10-17T05:52:28.122 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-10-17T05:52:28.122 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 48489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ad525x_dpot.ko 2023-10-17T05:52:28.123 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/ 2023-10-17T05:52:28.123 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 46585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-17T05:52:28.123 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-17T05:52:28.123 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-17T05:52:28.123 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 45593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-17T05:52:28.124 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/ 2023-10-17T05:52:28.124 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-10-17T05:52:28.124 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/core.ko 2023-10-17T05:52:28.124 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/ 2023-10-17T05:52:28.124 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-17T05:52:28.124 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ds1682.ko 2023-10-17T05:52:28.125 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/dummy-irq.ko 2023-10-17T05:52:28.125 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/echo/ 2023-10-17T05:52:28.125 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/echo/echo.ko 2023-10-17T05:52:28.125 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/ 2023-10-17T05:52:28.125 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-17T05:52:28.126 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-17T05:52:28.126 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-17T05:52:28.126 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-17T05:52:28.126 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-17T05:52:28.126 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/genwqe/ 2023-10-17T05:52:28.126 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 152201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-10-17T05:52:28.127 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hmc6352.ko 2023-10-17T05:52:28.127 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-17T05:52:28.127 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ibmasm/ 2023-10-17T05:52:28.127 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 72129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-10-17T05:52:28.127 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ics932s401.ko 2023-10-17T05:52:28.128 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-17T05:52:28.128 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-17T05:52:28.128 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/ 2023-10-17T05:52:28.128 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-17T05:52:28.128 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-17T05:52:28.128 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/ 2023-10-17T05:52:28.129 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 125209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-17T05:52:28.129 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 56521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-17T05:52:28.129 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 310113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-17T05:52:28.129 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/phantom.ko 2023-10-17T05:52:28.129 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ti-st/ 2023-10-17T05:52:28.130 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 74265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ti-st/st_drv.ko 2023-10-17T05:52:28.130 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-17T05:52:28.130 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-17T05:52:28.130 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-17T05:52:28.130 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 48697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-17T05:52:28.130 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/ 2023-10-17T05:52:28.131 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 183609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-17T05:52:28.131 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ 2023-10-17T05:52:28.131 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/ 2023-10-17T05:52:28.131 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 490129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-17T05:52:28.131 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/ 2023-10-17T05:52:28.132 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/ 2023-10-17T05:52:28.132 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 106033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-17T05:52:28.132 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-17T05:52:28.132 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-17T05:52:28.132 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/ 2023-10-17T05:52:28.132 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 453737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-17T05:52:28.134 INFO:teuthology.orchestra.run.smithi125.stderr:Sourcing file `/etc/default/grub' 2023-10-17T05:52:28.134 INFO:teuthology.orchestra.run.smithi125.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-17T05:52:28.134 INFO:teuthology.orchestra.run.smithi125.stderr:Generating grub configuration file ... 2023-10-17T05:52:28.231 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-17T05:52:28.232 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-17T05:52:28.232 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ 2023-10-17T05:52:28.232 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/ 2023-10-17T05:52:28.232 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 45785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-17T05:52:28.233 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-17T05:52:28.233 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 130553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-17T05:52:28.233 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 68849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-17T05:52:28.233 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ 2023-10-17T05:52:28.233 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-17T05:52:28.234 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 59689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-17T05:52:28.234 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-17T05:52:28.234 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 99113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-17T05:52:28.234 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/ 2023-10-17T05:52:28.234 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-17T05:52:28.235 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/ 2023-10-17T05:52:28.235 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 69201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-17T05:52:28.235 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/ 2023-10-17T05:52:28.235 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 59585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-17T05:52:28.235 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/ 2023-10-17T05:52:28.235 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-17T05:52:28.236 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/ 2023-10-17T05:52:28.236 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-17T05:52:28.236 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-17T05:52:28.236 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 87297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-17T05:52:28.236 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/ 2023-10-17T05:52:28.237 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/ 2023-10-17T05:52:28.237 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 97337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-17T05:52:28.237 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-10-17T05:52:28.237 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 104673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-17T05:52:28.237 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-10-17T05:52:28.238 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 90257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-17T05:52:28.238 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/ 2023-10-17T05:52:28.238 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 81569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-17T05:52:28.238 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 69729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-17T05:52:28.238 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/ 2023-10-17T05:52:28.239 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 78401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-17T05:52:28.239 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 176761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-17T05:52:28.239 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-10-17T05:52:28.239 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1421497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-17T05:52:28.239 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 128569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-17T05:52:28.240 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/ 2023-10-17T05:52:28.240 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 132089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-17T05:52:28.240 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 312081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-17T05:52:28.240 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/ 2023-10-17T05:52:28.240 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/ 2023-10-17T05:52:28.240 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 323513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-17T05:52:28.241 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/ 2023-10-17T05:52:28.241 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-10-17T05:52:28.241 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 193497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-17T05:52:28.241 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-10-17T05:52:28.241 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 347417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-17T05:52:28.242 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-10-17T05:52:28.242 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1044433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-17T05:52:28.242 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-10-17T05:52:28.242 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 166193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-17T05:52:28.242 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-10-17T05:52:28.243 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-17T05:52:28.243 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/ 2023-10-17T05:52:28.243 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/ 2023-10-17T05:52:28.243 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 204345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-17T05:52:28.243 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/ 2023-10-17T05:52:28.243 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/ 2023-10-17T05:52:28.244 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 69449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-17T05:52:28.244 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 61489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-17T05:52:28.244 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 141225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-17T05:52:28.244 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-17T05:52:28.244 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 62817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-17T05:52:28.245 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-17T05:52:28.245 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/ 2023-10-17T05:52:28.245 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-17T05:52:28.245 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 62833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-17T05:52:28.245 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 45721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-17T05:52:28.246 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ec_bhf.ko 2023-10-17T05:52:28.246 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/ 2023-10-17T05:52:28.246 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/ 2023-10-17T05:52:28.246 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 281137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-17T05:52:28.246 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-17T05:52:28.247 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-17T05:52:28.247 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fujitsu/ 2023-10-17T05:52:28.247 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 45345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-10-17T05:52:28.247 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ 2023-10-17T05:52:28.247 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 90465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-17T05:52:28.248 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/ 2023-10-17T05:52:28.248 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 295577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-17T05:52:28.248 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/ 2023-10-17T05:52:28.248 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 584497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-17T05:52:28.248 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/ 2023-10-17T05:52:28.248 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 246209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-17T05:52:28.249 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/ 2023-10-17T05:52:28.249 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 925697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-17T05:52:28.249 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/ 2023-10-17T05:52:28.249 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 302849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-17T05:52:28.249 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/ 2023-10-17T05:52:28.250 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 514681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-17T05:52:28.250 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/ 2023-10-17T05:52:28.250 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 93593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-17T05:52:28.250 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-10-17T05:52:28.250 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 734305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-17T05:52:28.251 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-10-17T05:52:28.251 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 151769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-17T05:52:28.251 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 86921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-17T05:52:28.251 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/ 2023-10-17T05:52:28.251 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-17T05:52:28.252 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 102289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-17T05:52:28.252 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 122649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-17T05:52:28.252 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/ 2023-10-17T05:52:28.252 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-10-17T05:52:28.252 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 727601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-17T05:52:28.253 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 278937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-17T05:52:28.253 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-10-17T05:52:28.253 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-10-17T05:52:28.253 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1113993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-17T05:52:28.253 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ 2023-10-17T05:52:28.253 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-10-17T05:52:28.254 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-10-17T05:52:28.254 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-10-17T05:52:28.254 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 95665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-17T05:52:28.254 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/ 2023-10-17T05:52:28.254 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-10-17T05:52:28.255 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 108649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-17T05:52:28.255 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ 2023-10-17T05:52:28.255 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 73441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-17T05:52:28.255 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-17T05:52:28.255 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/ 2023-10-17T05:52:28.256 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 150905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-17T05:52:28.256 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/ 2023-10-17T05:52:28.256 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 136721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-17T05:52:28.256 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/ 2023-10-17T05:52:28.256 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-17T05:52:28.256 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 43145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-17T05:52:28.257 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/ 2023-10-17T05:52:28.257 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-10-17T05:52:28.257 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 227897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-17T05:52:28.257 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 87081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-17T05:52:28.257 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-10-17T05:52:28.258 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 672049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-17T05:52:28.258 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/ 2023-10-17T05:52:28.258 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 43017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-17T05:52:28.258 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/ 2023-10-17T05:52:28.258 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 67385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-17T05:52:28.259 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 83985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-17T05:52:28.259 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-17T05:52:28.259 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 189801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-17T05:52:28.259 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/ 2023-10-17T05:52:28.259 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-10-17T05:52:28.259 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 104241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-10-17T05:52:28.260 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/ 2023-10-17T05:52:28.260 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1053921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-17T05:52:28.260 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/ 2023-10-17T05:52:28.260 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-17T05:52:28.260 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/ 2023-10-17T05:52:28.261 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-17T05:52:28.261 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 63337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-17T05:52:28.261 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/ 2023-10-17T05:52:28.261 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 61601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-17T05:52:28.261 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 67193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-17T05:52:28.261 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 73409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-17T05:52:28.262 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 68177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-17T05:52:28.262 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/ 2023-10-17T05:52:28.262 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-10-17T05:52:28.262 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-10-17T05:52:28.262 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-17T05:52:28.263 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-10-17T05:52:28.263 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 486961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-17T05:52:28.263 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/ 2023-10-17T05:52:28.263 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 103337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-17T05:52:28.263 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 166161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-17T05:52:28.264 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 66329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-17T05:52:28.264 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 78801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-17T05:52:28.264 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/ 2023-10-17T05:52:28.264 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-17T05:52:28.264 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/ 2023-10-17T05:52:28.265 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 86529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-17T05:52:28.265 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/ 2023-10-17T05:52:28.265 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 80273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-17T05:52:28.265 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 83633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-17T05:52:28.265 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/ 2023-10-17T05:52:28.265 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 46241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-17T05:52:28.266 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-17T05:52:28.266 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/ 2023-10-17T05:52:28.266 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-17T05:52:28.266 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/ 2023-10-17T05:52:28.266 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/defxx.ko 2023-10-17T05:52:28.267 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/skfp/ 2023-10-17T05:52:28.267 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 216985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/skfp/skfp.ko 2023-10-17T05:52:28.267 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 77345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-17T05:52:28.267 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/ 2023-10-17T05:52:28.267 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 235521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-17T05:52:28.267 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/ 2023-10-17T05:52:28.268 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-17T05:52:28.268 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-17T05:52:28.268 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ 2023-10-17T05:52:28.268 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 83769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-17T05:52:28.268 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 62209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-17T05:52:28.269 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-17T05:52:28.269 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/ 2023-10-17T05:52:28.269 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-17T05:52:28.269 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-17T05:52:28.269 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-gpio.ko 2023-10-17T05:52:28.270 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-17T05:52:28.270 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-17T05:52:28.270 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-17T05:52:28.270 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 43953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-17T05:52:28.270 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-17T05:52:28.270 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/ 2023-10-17T05:52:28.271 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-17T05:52:28.271 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-17T05:52:28.271 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ 2023-10-17T05:52:28.271 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-17T05:52:28.271 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-17T05:52:28.272 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-17T05:52:28.272 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-17T05:52:28.272 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-17T05:52:28.272 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-17T05:52:28.272 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-17T05:52:28.272 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-17T05:52:28.273 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-17T05:52:28.273 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-17T05:52:28.273 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 82049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-17T05:52:28.273 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 76177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-17T05:52:28.273 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-17T05:52:28.274 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 97857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-17T05:52:28.274 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-17T05:52:28.274 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-17T05:52:28.274 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-17T05:52:28.274 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-17T05:52:28.275 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-17T05:52:28.275 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/plip/ 2023-10-17T05:52:28.275 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 43569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/plip/plip.ko 2023-10-17T05:52:28.275 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ 2023-10-17T05:52:28.275 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-17T05:52:28.275 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-17T05:52:28.276 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-17T05:52:28.276 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-17T05:52:28.276 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-17T05:52:28.276 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-17T05:52:28.276 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-17T05:52:28.276 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-17T05:52:28.277 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sb1000.ko 2023-10-17T05:52:28.277 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/ 2023-10-17T05:52:28.277 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-17T05:52:28.277 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-17T05:52:28.277 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 64385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-17T05:52:28.278 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/ 2023-10-17T05:52:28.278 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 106169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-17T05:52:28.278 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-17T05:52:28.278 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-17T05:52:28.278 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-17T05:52:28.279 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-17T05:52:28.279 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-17T05:52:28.279 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 87017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-17T05:52:28.279 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/ 2023-10-17T05:52:28.279 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 144297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-17T05:52:28.279 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/ 2023-10-17T05:52:28.280 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 297329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-17T05:52:28.280 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/ 2023-10-17T05:52:28.280 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 144649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-17T05:52:28.280 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ 2023-10-17T05:52:28.280 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-17T05:52:28.281 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/ 2023-10-17T05:52:28.281 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/ 2023-10-17T05:52:28.281 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 264937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-17T05:52:28.281 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 102209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-17T05:52:28.281 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/ 2023-10-17T05:52:28.282 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 133841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-17T05:52:28.282 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-17T05:52:28.282 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 84465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-17T05:52:28.282 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-17T05:52:28.282 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/ 2023-10-17T05:52:28.283 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/ 2023-10-17T05:52:28.283 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-17T05:52:28.283 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-10-17T05:52:28.283 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-10-17T05:52:28.283 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pci-stub.ko 2023-10-17T05:52:28.283 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 46529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-17T05:52:28.284 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/ 2023-10-17T05:52:28.284 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-17T05:52:28.284 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 145809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia.ko 2023-10-17T05:52:28.284 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 62137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia_core.ko 2023-10-17T05:52:28.284 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-10-17T05:52:28.285 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-17T05:52:28.285 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 112889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-17T05:52:28.285 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/ 2023-10-17T05:52:28.285 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/broadcom/ 2023-10-17T05:52:28.285 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-10-17T05:52:28.286 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/samsung/ 2023-10-17T05:52:28.286 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-10-17T05:52:28.286 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/ 2023-10-17T05:52:28.286 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/ 2023-10-17T05:52:28.286 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 70153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-17T05:52:28.287 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/ 2023-10-17T05:52:28.287 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/ 2023-10-17T05:52:28.287 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-10-17T05:52:28.287 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec.ko 2023-10-17T05:52:28.287 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-10-17T05:52:28.288 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-10-17T05:52:28.288 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-10-17T05:52:28.288 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-10-17T05:52:28.288 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-10-17T05:52:28.288 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/ 2023-10-17T05:52:28.288 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 67097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-17T05:52:28.289 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-17T05:52:28.289 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-17T05:52:28.289 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 59665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-17T05:52:28.289 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-17T05:52:28.289 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 127569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-17T05:52:28.290 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-17T05:52:28.290 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-17T05:52:28.290 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-17T05:52:28.290 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-17T05:52:28.290 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-17T05:52:28.291 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-17T05:52:28.291 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/ibm_rtl.ko 2023-10-17T05:52:28.291 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/ 2023-10-17T05:52:28.291 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-17T05:52:28.291 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-10-17T05:52:28.291 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 43497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-17T05:52:28.292 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-17T05:52:28.292 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-17T05:52:28.292 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-17T05:52:28.292 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-17T05:52:28.292 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-17T05:52:28.293 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-17T05:52:28.293 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-17T05:52:28.293 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-17T05:52:28.293 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-17T05:52:28.293 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 57569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-17T05:52:28.293 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/ 2023-10-17T05:52:28.294 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ 2023-10-17T05:52:28.294 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/88pm860x_battery.ko 2023-10-17T05:52:28.294 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/88pm860x_charger.ko 2023-10-17T05:52:28.294 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 55057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq2415x_charger.ko 2023-10-17T05:52:28.294 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq24190_charger.ko 2023-10-17T05:52:28.295 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq24735-charger.ko 2023-10-17T05:52:28.295 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-10-17T05:52:28.295 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/da9030_battery.ko 2023-10-17T05:52:28.295 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/da9052-battery.ko 2023-10-17T05:52:28.295 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2760_battery.ko 2023-10-17T05:52:28.295 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2780_battery.ko 2023-10-17T05:52:28.296 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2781_battery.ko 2023-10-17T05:52:28.296 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2782_battery.ko 2023-10-17T05:52:28.296 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/gpio-charger.ko 2023-10-17T05:52:28.296 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/isp1704_charger.ko 2023-10-17T05:52:28.296 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/lp8727_charger.ko 2023-10-17T05:52:28.297 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max14577_charger.ko 2023-10-17T05:52:28.297 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max17040_battery.ko 2023-10-17T05:52:28.297 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max17042_battery.ko 2023-10-17T05:52:28.297 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max8903_charger.ko 2023-10-17T05:52:28.297 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max8925_power.ko 2023-10-17T05:52:28.297 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/pcf50633-charger.ko 2023-10-17T05:52:28.298 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/sbs-battery.ko 2023-10-17T05:52:28.298 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/test_power.ko 2023-10-17T05:52:28.298 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/tps65090-charger.ko 2023-10-17T05:52:28.298 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm831x_backup.ko 2023-10-17T05:52:28.298 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm831x_power.ko 2023-10-17T05:52:28.299 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm8350_power.ko 2023-10-17T05:52:28.299 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/ 2023-10-17T05:52:28.299 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 57729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-17T05:52:28.299 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-17T05:52:28.299 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/ 2023-10-17T05:52:28.300 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/ 2023-10-17T05:52:28.300 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-17T05:52:28.300 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-17T05:52:28.300 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-17T05:52:28.300 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-17T05:52:28.300 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ 2023-10-17T05:52:28.301 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 66385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-17T05:52:28.301 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-17T05:52:28.301 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/ 2023-10-17T05:52:28.301 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-88pm80x.ko 2023-10-17T05:52:28.301 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-88pm860x.ko 2023-10-17T05:52:28.302 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-17T05:52:28.302 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9052.ko 2023-10-17T05:52:28.302 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9055.ko 2023-10-17T05:52:28.302 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9063.ko 2023-10-17T05:52:28.302 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-17T05:52:28.302 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 68577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-17T05:52:28.303 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-17T05:52:28.303 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-17T05:52:28.303 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-17T05:52:28.303 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-17T05:52:28.303 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-17T05:52:28.304 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-17T05:52:28.304 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-17T05:52:28.304 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-17T05:52:28.304 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-17T05:52:28.304 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-17T05:52:28.304 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-17T05:52:28.305 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-lp8788.ko 2023-10-17T05:52:28.305 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-17T05:52:28.305 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-17T05:52:28.305 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-17T05:52:28.305 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t86.ko 2023-10-17T05:52:28.306 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-17T05:52:28.306 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8907.ko 2023-10-17T05:52:28.306 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8925.ko 2023-10-17T05:52:28.306 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8997.ko 2023-10-17T05:52:28.306 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8998.ko 2023-10-17T05:52:28.307 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-10-17T05:52:28.307 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-17T05:52:28.307 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-palmas.ko 2023-10-17T05:52:28.307 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 46633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-17T05:52:28.307 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf50633.ko 2023-10-17T05:52:28.309 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-17T05:52:28.309 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-17T05:52:28.309 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-17T05:52:28.310 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-17T05:52:28.310 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rc5t583.ko 2023-10-17T05:52:28.310 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-17T05:52:28.310 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-17T05:52:28.310 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-17T05:52:28.311 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-17T05:52:28.311 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-17T05:52:28.311 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-s35390a.ko 2023-10-17T05:52:28.311 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-17T05:52:28.311 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-tps6586x.ko 2023-10-17T05:52:28.312 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-tps65910.ko 2023-10-17T05:52:28.312 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-wm831x.ko 2023-10-17T05:52:28.312 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-wm8350.ko 2023-10-17T05:52:28.312 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-17T05:52:28.312 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ 2023-10-17T05:52:28.312 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 77617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-17T05:52:28.313 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 57665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-17T05:52:28.313 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 55169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-17T05:52:28.313 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 135185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-17T05:52:28.313 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-17T05:52:28.313 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/ 2023-10-17T05:52:28.314 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 272305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-17T05:52:28.314 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 100617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-17T05:52:28.314 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/ 2023-10-17T05:52:28.314 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 356265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-17T05:52:28.314 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 295801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-17T05:52:28.314 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic94xx/ 2023-10-17T05:52:28.315 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 189185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-10-17T05:52:28.315 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-17T05:52:28.315 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/ 2023-10-17T05:52:28.315 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 106881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-17T05:52:28.315 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-17T05:52:28.316 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/ 2023-10-17T05:52:28.316 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 246985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-17T05:52:28.316 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/ 2023-10-17T05:52:28.316 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1171945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-17T05:52:28.316 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/ 2023-10-17T05:52:28.317 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 237273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-17T05:52:28.317 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/ 2023-10-17T05:52:28.317 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 115369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-17T05:52:28.317 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-17T05:52:28.317 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/ 2023-10-17T05:52:28.317 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 308921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-17T05:52:28.318 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/ 2023-10-17T05:52:28.318 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-10-17T05:52:28.318 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 76145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-17T05:52:28.318 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-10-17T05:52:28.318 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 101449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-17T05:52:28.319 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 146689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-17T05:52:28.319 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 75553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-17T05:52:28.319 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-17T05:52:28.319 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/ 2023-10-17T05:52:28.319 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 212425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-17T05:52:28.320 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-17T05:52:28.320 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/ 2023-10-17T05:52:28.320 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 78209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-17T05:52:28.320 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 158505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-17T05:52:28.320 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fdomain.ko 2023-10-17T05:52:28.321 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/ 2023-10-17T05:52:28.321 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 263489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-17T05:52:28.321 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 201817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-17T05:52:28.321 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-17T05:52:28.321 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-17T05:52:28.322 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/imm.ko 2023-10-17T05:52:28.322 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-17T05:52:28.322 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 266537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-17T05:52:28.322 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 101881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-17T05:52:28.322 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/ 2023-10-17T05:52:28.323 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 317153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-17T05:52:28.323 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-17T05:52:28.323 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 52961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-17T05:52:28.323 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/ 2023-10-17T05:52:28.323 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 314865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-17T05:52:28.323 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 145585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-17T05:52:28.324 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-17T05:52:28.324 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/ 2023-10-17T05:52:28.324 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 216665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-17T05:52:28.324 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/ 2023-10-17T05:52:28.324 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 2197249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-17T05:52:28.325 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/ 2023-10-17T05:52:28.325 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 73569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-17T05:52:28.325 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-17T05:52:28.325 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 310617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-17T05:52:28.325 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 84721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-17T05:52:28.325 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/ 2023-10-17T05:52:28.326 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 659777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-17T05:52:28.326 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/ 2023-10-17T05:52:28.326 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 119561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-17T05:52:28.326 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 78129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-17T05:52:28.327 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/ 2023-10-17T05:52:28.327 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 81625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-10-17T05:52:28.327 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-10-17T05:52:28.327 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-10-17T05:52:28.327 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-10-17T05:52:28.327 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/ 2023-10-17T05:52:28.328 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 364105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-17T05:52:28.328 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 123617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-17T05:52:28.328 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ppa.ko 2023-10-17T05:52:28.328 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 55361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-17T05:52:28.328 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/ 2023-10-17T05:52:28.329 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1876625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-17T05:52:28.329 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 85289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-17T05:52:28.329 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/ 2023-10-17T05:52:28.329 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 559033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-17T05:52:28.329 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qlogicfas408.ko 2023-10-17T05:52:28.330 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-17T05:52:28.330 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 238825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-17T05:52:28.330 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 173937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-17T05:52:28.330 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 279313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-17T05:52:28.330 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 97729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-17T05:52:28.331 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 73881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-17T05:52:28.331 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-17T05:52:28.331 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-17T05:52:28.331 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 115889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-17T05:52:28.331 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 46825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-17T05:52:28.332 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/ 2023-10-17T05:52:28.332 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 162121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-17T05:52:28.332 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-17T05:52:28.332 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-17T05:52:28.332 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-17T05:52:28.333 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/xen-scsifront.ko 2023-10-17T05:52:28.333 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ 2023-10-17T05:52:28.333 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 129441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-17T05:52:28.333 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/ 2023-10-17T05:52:28.333 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/ 2023-10-17T05:52:28.333 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 736601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-17T05:52:28.334 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/ 2023-10-17T05:52:28.334 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-17T05:52:28.334 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-17T05:52:28.334 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 43025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-17T05:52:28.334 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 930321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-17T05:52:28.335 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-17T05:52:28.335 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 122521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-17T05:52:28.335 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/ 2023-10-17T05:52:28.335 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 75593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-17T05:52:28.335 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/ 2023-10-17T05:52:28.336 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/ 2023-10-17T05:52:28.336 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/ 2023-10-17T05:52:28.336 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-17T05:52:28.336 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-17T05:52:28.336 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-17T05:52:28.336 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-17T05:52:28.337 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-17T05:52:28.337 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-17T05:52:28.337 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-17T05:52:28.337 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-17T05:52:28.337 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-17T05:52:28.338 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-17T05:52:28.338 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-17T05:52:28.338 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-17T05:52:28.338 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-10-17T05:52:28.338 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-17T05:52:28.339 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-17T05:52:28.339 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-17T05:52:28.339 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ 2023-10-17T05:52:28.339 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ 2023-10-17T05:52:28.339 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 78425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-17T05:52:28.339 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 57865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/moxa.ko 2023-10-17T05:52:28.340 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 50953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/mxser.ko 2023-10-17T05:52:28.340 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 108601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-17T05:52:28.340 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-17T05:52:28.340 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 67929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-17T05:52:28.340 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/ 2023-10-17T05:52:28.341 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/ 2023-10-17T05:52:28.341 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-10-17T05:52:28.341 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 59497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-17T05:52:28.341 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-10-17T05:52:28.341 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/altera_uart.ko 2023-10-17T05:52:28.341 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-17T05:52:28.342 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 72425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-10-17T05:52:28.342 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/ 2023-10-17T05:52:28.342 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 103073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-17T05:52:28.342 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/rp2.ko 2023-10-17T05:52:28.342 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 52817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/sc16is7xx.ko 2023-10-17T05:52:28.343 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/ 2023-10-17T05:52:28.343 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ 2023-10-17T05:52:28.343 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 531265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-17T05:52:28.343 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ 2023-10-17T05:52:28.343 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-17T05:52:28.343 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-10-17T05:52:28.344 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/ 2023-10-17T05:52:28.344 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-17T05:52:28.344 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-17T05:52:28.344 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-17T05:52:28.344 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_dmem_genirq.ko 2023-10-17T05:52:28.345 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_mf624.ko 2023-10-17T05:52:28.345 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_netx.ko 2023-10-17T05:52:28.345 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-17T05:52:28.345 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-10-17T05:52:28.345 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-17T05:52:28.346 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/ 2023-10-17T05:52:28.346 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/c67x00/ 2023-10-17T05:52:28.346 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 73297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/c67x00/c67x00.ko 2023-10-17T05:52:28.346 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ 2023-10-17T05:52:28.346 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 144377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-10-17T05:52:28.346 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-10-17T05:52:28.347 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-10-17T05:52:28.347 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-10-17T05:52:28.347 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/ 2023-10-17T05:52:28.347 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 87089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-17T05:52:28.347 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-17T05:52:28.348 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-17T05:52:28.348 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 89857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-17T05:52:28.348 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/common/ 2023-10-17T05:52:28.348 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/common/ulpi.ko 2023-10-17T05:52:28.348 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc2/ 2023-10-17T05:52:28.348 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-10-17T05:52:28.349 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/ 2023-10-17T05:52:28.349 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-10-17T05:52:28.349 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-10-17T05:52:28.349 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 444553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3.ko 2023-10-17T05:52:28.349 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/ 2023-10-17T05:52:28.350 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/ 2023-10-17T05:52:28.350 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/u_ether.ko 2023-10-17T05:52:28.350 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/u_serial.ko 2023-10-17T05:52:28.350 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-10-17T05:52:28.350 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-10-17T05:52:28.350 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-10-17T05:52:28.351 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-10-17T05:52:28.351 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 92489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-10-17T05:52:28.351 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-10-17T05:52:28.351 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 122081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-10-17T05:52:28.351 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 57617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-10-17T05:52:28.352 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-10-17T05:52:28.352 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-10-17T05:52:28.352 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 57729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-10-17T05:52:28.352 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 85609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-10-17T05:52:28.352 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-10-17T05:52:28.352 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 58113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-10-17T05:52:28.353 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 67337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-10-17T05:52:28.353 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/ 2023-10-17T05:52:28.353 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-10-17T05:52:28.353 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-10-17T05:52:28.353 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-10-17T05:52:28.354 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-10-17T05:52:28.354 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-10-17T05:52:28.354 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-10-17T05:52:28.354 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-10-17T05:52:28.354 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-10-17T05:52:28.355 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-10-17T05:52:28.355 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-10-17T05:52:28.355 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-10-17T05:52:28.355 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-10-17T05:52:28.355 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 62185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-10-17T05:52:28.355 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-10-17T05:52:28.356 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 161225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/libcomposite.ko 2023-10-17T05:52:28.356 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/ 2023-10-17T05:52:28.356 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-10-17T05:52:28.356 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/bdc/ 2023-10-17T05:52:28.356 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 157681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-10-17T05:52:28.357 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-10-17T05:52:28.357 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 52721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-10-17T05:52:28.357 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 69705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-10-17T05:52:28.357 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 56033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-10-17T05:52:28.357 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 76057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/net2272.ko 2023-10-17T05:52:28.358 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 75073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/net2280.ko 2023-10-17T05:52:28.358 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 73169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-10-17T05:52:28.358 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 65809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-10-17T05:52:28.358 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 66097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-10-17T05:52:28.358 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 81505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-10-17T05:52:28.358 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 156073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-10-17T05:52:28.359 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/ 2023-10-17T05:52:28.359 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/bcma-hcd.ko 2023-10-17T05:52:28.359 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 80113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/isp116x-hcd.ko 2023-10-17T05:52:28.359 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 87353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-10-17T05:52:28.359 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 78873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-10-17T05:52:28.360 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-17T05:52:28.360 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811_cs.ko 2023-10-17T05:52:28.360 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/ssb-hcd.ko 2023-10-17T05:52:28.360 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-10-17T05:52:28.360 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/ 2023-10-17T05:52:28.360 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-17T05:52:28.361 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-17T05:52:28.361 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ 2023-10-17T05:52:28.361 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-17T05:52:28.361 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-17T05:52:28.361 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-10-17T05:52:28.362 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/cytherm.ko 2023-10-17T05:52:28.362 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ehset.ko 2023-10-17T05:52:28.362 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-17T05:52:28.362 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-17T05:52:28.362 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-17T05:52:28.363 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-17T05:52:28.363 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-17T05:52:28.363 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-17T05:52:28.363 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-17T05:52:28.363 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-17T05:52:28.363 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/lvstest.ko 2023-10-17T05:52:28.364 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/ 2023-10-17T05:52:28.364 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 64841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-17T05:52:28.364 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-17T05:52:28.364 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-17T05:52:28.364 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-17T05:52:28.365 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-17T05:52:28.365 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 70873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbtest.ko 2023-10-17T05:52:28.365 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-17T05:52:28.365 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-17T05:52:28.365 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/mon/ 2023-10-17T05:52:28.365 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 72953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/mon/usbmon.ko 2023-10-17T05:52:28.366 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/musb/ 2023-10-17T05:52:28.366 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 301545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/musb/musb_hdrc.ko 2023-10-17T05:52:28.366 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/ 2023-10-17T05:52:28.366 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-17T05:52:28.366 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-10-17T05:52:28.367 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-isp1301.ko 2023-10-17T05:52:28.367 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-tahvo.ko 2023-10-17T05:52:28.367 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ 2023-10-17T05:52:28.367 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-17T05:52:28.367 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-17T05:52:28.367 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-17T05:52:28.368 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-17T05:52:28.368 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 70257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-17T05:52:28.368 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-17T05:52:28.368 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 58217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-17T05:52:28.368 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-17T05:52:28.369 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-17T05:52:28.369 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/f81232.ko 2023-10-17T05:52:28.369 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 175137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-17T05:52:28.369 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-17T05:52:28.369 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 137081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-17T05:52:28.369 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 124833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-17T05:52:28.370 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 67769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-17T05:52:28.370 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-17T05:52:28.370 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-17T05:52:28.370 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 58233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-17T05:52:28.370 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 107521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-17T05:52:28.371 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-17T05:52:28.371 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-17T05:52:28.371 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-17T05:52:28.371 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-17T05:52:28.371 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/metro-usb.ko 2023-10-17T05:52:28.372 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 66449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-17T05:52:28.372 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 78217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-17T05:52:28.372 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 56337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mxuport.ko 2023-10-17T05:52:28.372 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-17T05:52:28.372 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-17T05:52:28.373 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-17T05:52:28.373 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 190633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-17T05:52:28.373 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-17T05:52:28.373 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-17T05:52:28.373 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-17T05:52:28.374 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-17T05:52:28.374 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-17T05:52:28.374 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-17T05:52:28.374 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 51625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-17T05:52:28.374 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-17T05:52:28.374 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-17T05:52:28.375 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-17T05:52:28.375 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 61489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-17T05:52:28.375 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-17T05:52:28.375 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-17T05:52:28.375 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-17T05:52:28.376 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 125609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usbserial.ko 2023-10-17T05:52:28.376 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-17T05:52:28.376 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-17T05:52:28.376 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/wishbone-serial.ko 2023-10-17T05:52:28.376 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-17T05:52:28.377 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ 2023-10-17T05:52:28.377 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 52913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-17T05:52:28.377 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-17T05:52:28.377 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-17T05:52:28.377 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-17T05:52:28.377 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-17T05:52:28.378 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-17T05:52:28.378 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-17T05:52:28.378 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-17T05:52:28.378 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-17T05:52:28.378 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-17T05:52:28.379 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-17T05:52:28.379 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-17T05:52:28.379 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-17T05:52:28.379 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-17T05:52:28.379 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 179969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-17T05:52:28.379 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/ 2023-10-17T05:52:28.380 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 67481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-17T05:52:28.380 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 72177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-17T05:52:28.380 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 107001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-17T05:52:28.380 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/ 2023-10-17T05:52:28.380 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/ 2023-10-17T05:52:28.381 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 154297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-17T05:52:28.381 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-17T05:52:28.381 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 108737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-17T05:52:28.381 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 77609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-17T05:52:28.381 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/ 2023-10-17T05:52:28.382 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 113873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-17T05:52:28.382 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-17T05:52:28.382 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 58089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-17T05:52:28.382 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 89249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-17T05:52:28.382 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/ 2023-10-17T05:52:28.383 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/ 2023-10-17T05:52:28.383 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-10-17T05:52:28.383 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/aat2870_bl.ko 2023-10-17T05:52:28.383 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp5520_bl.ko 2023-10-17T05:52:28.383 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp8860_bl.ko 2023-10-17T05:52:28.383 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp8870_bl.ko 2023-10-17T05:52:28.384 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-17T05:52:28.384 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/as3711_bl.ko 2023-10-17T05:52:28.384 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/bd6107.ko 2023-10-17T05:52:28.384 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/da903x_bl.ko 2023-10-17T05:52:28.384 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/da9052_bl.ko 2023-10-17T05:52:28.385 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/gpio_backlight.ko 2023-10-17T05:52:28.385 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/kb3886_bl.ko 2023-10-17T05:52:28.385 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-17T05:52:28.385 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lm3533_bl.ko 2023-10-17T05:52:28.385 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lm3639_bl.ko 2023-10-17T05:52:28.385 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lv5207lp.ko 2023-10-17T05:52:28.386 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/max8925_bl.ko 2023-10-17T05:52:28.386 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/pandora_bl.ko 2023-10-17T05:52:28.386 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-10-17T05:52:28.386 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-17T05:52:28.386 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/wm831x_bl.ko 2023-10-17T05:52:28.387 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/ 2023-10-17T05:52:28.387 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ 2023-10-17T05:52:28.387 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-17T05:52:28.387 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-17T05:52:28.387 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/matrox_w1.ko 2023-10-17T05:52:28.387 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/w1-gpio.ko 2023-10-17T05:52:28.388 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/ 2023-10-17T05:52:28.388 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-17T05:52:28.388 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-17T05:52:28.388 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-17T05:52:28.388 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-17T05:52:28.389 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-17T05:52:28.389 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-17T05:52:28.389 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-17T05:52:28.389 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-17T05:52:28.389 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-17T05:52:28.389 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-17T05:52:28.390 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 56425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-17T05:52:28.390 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 102673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-17T05:52:28.390 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ 2023-10-17T05:52:28.390 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/acquirewdt.ko 2023-10-17T05:52:28.390 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/advantechwdt.ko 2023-10-17T05:52:28.391 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-17T05:52:28.391 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-17T05:52:28.391 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/cpu5wdt.ko 2023-10-17T05:52:28.391 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9052_wdt.ko 2023-10-17T05:52:28.391 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9055_wdt.ko 2023-10-17T05:52:28.391 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9063_wdt.ko 2023-10-17T05:52:28.392 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/dw_wdt.ko 2023-10-17T05:52:28.392 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/eurotechwdt.ko 2023-10-17T05:52:28.392 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-17T05:52:28.392 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-17T05:52:28.392 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-17T05:52:28.393 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-17T05:52:28.393 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-17T05:52:28.393 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-17T05:52:28.393 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-17T05:52:28.393 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-17T05:52:28.394 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-17T05:52:28.394 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-17T05:52:28.394 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/kempld_wdt.ko 2023-10-17T05:52:28.394 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-17T05:52:28.394 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/mena21_wdt.ko 2023-10-17T05:52:28.394 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-10-17T05:52:28.395 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-17T05:52:28.395 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-10-17T05:52:28.395 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pc87413_wdt.ko 2023-10-17T05:52:28.395 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-17T05:52:28.395 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-17T05:52:28.396 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/retu_wdt.ko 2023-10-17T05:52:28.396 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-10-17T05:52:28.396 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-10-17T05:52:28.396 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-17T05:52:28.396 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sc1200wdt.ko 2023-10-17T05:52:28.397 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-17T05:52:28.397 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-10-17T05:52:28.397 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-17T05:52:28.397 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-17T05:52:28.397 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/twl4030_wdt.ko 2023-10-17T05:52:28.398 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-17T05:52:28.398 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-17T05:52:28.398 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-17T05:52:28.398 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-17T05:52:28.398 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wafer5823wdt.ko 2023-10-17T05:52:28.398 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-17T05:52:28.399 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wm831x_wdt.ko 2023-10-17T05:52:28.399 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wm8350_wdt.ko 2023-10-17T05:52:28.399 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-17T05:52:28.399 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/ 2023-10-17T05:52:28.399 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-17T05:52:28.400 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-17T05:52:28.400 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-17T05:52:28.400 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/ 2023-10-17T05:52:28.400 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 176441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-17T05:52:28.400 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-17T05:52:28.400 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 71249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-scsiback.ko 2023-10-17T05:52:28.401 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/ 2023-10-17T05:52:28.401 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-17T05:52:28.401 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ 2023-10-17T05:52:28.401 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/ 2023-10-17T05:52:28.401 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 166425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-17T05:52:28.402 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/adfs/ 2023-10-17T05:52:28.402 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 61073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/adfs/adfs.ko 2023-10-17T05:52:28.402 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/ 2023-10-17T05:52:28.402 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 163593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-17T05:52:28.402 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/afs/ 2023-10-17T05:52:28.403 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 932817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/afs/kafs.ko 2023-10-17T05:52:28.403 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/autofs/ 2023-10-17T05:52:28.403 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 101057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/autofs/autofs4.ko 2023-10-17T05:52:28.403 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/ 2023-10-17T05:52:28.403 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 64545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-17T05:52:28.404 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/bfs/ 2023-10-17T05:52:28.404 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/bfs/bfs.ko 2023-10-17T05:52:28.404 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-17T05:52:28.404 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/ 2023-10-17T05:52:28.404 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 3402585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-17T05:52:28.404 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/ 2023-10-17T05:52:28.405 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 306073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-17T05:52:28.405 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ 2023-10-17T05:52:28.405 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1323873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-17T05:52:28.405 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/ 2023-10-17T05:52:28.405 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 100801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-17T05:52:28.406 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/configfs/ 2023-10-17T05:52:28.406 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 108393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/configfs/configfs.ko 2023-10-17T05:52:28.406 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/ 2023-10-17T05:52:28.406 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 29625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-17T05:52:28.406 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/ 2023-10-17T05:52:28.406 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 642577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-17T05:52:28.407 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/efs/ 2023-10-17T05:52:28.407 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/efs/efs.ko 2023-10-17T05:52:28.407 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/ 2023-10-17T05:52:28.407 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1505025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-17T05:52:28.407 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/ 2023-10-17T05:52:28.408 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-17T05:52:28.408 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/freevxfs/ 2023-10-17T05:52:28.408 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/freevxfs/freevxfs.ko 2023-10-17T05:52:28.408 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/ 2023-10-17T05:52:28.408 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 226481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-17T05:52:28.409 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/ 2023-10-17T05:52:28.409 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-17T05:52:28.409 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/ 2023-10-17T05:52:28.409 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1231529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-17T05:52:28.409 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/ 2023-10-17T05:52:28.410 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 141209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-17T05:52:28.410 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/ 2023-10-17T05:52:28.410 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 222817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-17T05:52:28.410 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hpfs/ 2023-10-17T05:52:28.410 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 192329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hpfs/hpfs.ko 2023-10-17T05:52:28.410 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/ 2023-10-17T05:52:28.411 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 74065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-17T05:52:28.411 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/ 2023-10-17T05:52:28.411 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 419497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-17T05:52:28.411 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/ 2023-10-17T05:52:28.411 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 280313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-17T05:52:28.412 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/ 2023-10-17T05:52:28.412 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 89193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-17T05:52:28.412 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/ 2023-10-17T05:52:28.412 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 124649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-17T05:52:28.412 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/ 2023-10-17T05:52:28.412 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/ 2023-10-17T05:52:28.413 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 81449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-17T05:52:28.413 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/ 2023-10-17T05:52:28.413 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 59449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-17T05:52:28.413 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/ 2023-10-17T05:52:28.413 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 117513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-17T05:52:28.414 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1055649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-17T05:52:28.414 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 66441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv2.ko 2023-10-17T05:52:28.414 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 120177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-17T05:52:28.414 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 2041689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-17T05:52:28.414 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/ 2023-10-17T05:52:28.414 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-17T05:52:28.415 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-17T05:52:28.415 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/ 2023-10-17T05:52:28.415 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1516809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-17T05:52:28.415 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/ 2023-10-17T05:52:28.415 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 592833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-17T05:52:28.416 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/ 2023-10-17T05:52:28.416 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-17T05:52:28.416 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-17T05:52:28.416 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-17T05:52:28.416 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-17T05:52:28.416 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-17T05:52:28.417 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-17T05:52:28.417 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-17T05:52:28.417 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-17T05:52:28.417 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-17T05:52:28.417 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-17T05:52:28.418 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-17T05:52:28.418 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ascii.ko 2023-10-17T05:52:28.418 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-17T05:52:28.418 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-17T05:52:28.418 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-17T05:52:28.419 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-17T05:52:28.419 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-17T05:52:28.419 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-17T05:52:28.419 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-17T05:52:28.419 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-17T05:52:28.419 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-17T05:52:28.420 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-17T05:52:28.420 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-17T05:52:28.420 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-17T05:52:28.420 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-17T05:52:28.420 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-17T05:52:28.421 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-17T05:52:28.421 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-17T05:52:28.421 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-17T05:52:28.421 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-17T05:52:28.421 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 94137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-17T05:52:28.421 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 142673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-17T05:52:28.422 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 165745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-17T05:52:28.422 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 118121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-17T05:52:28.422 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-17T05:52:28.422 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-17T05:52:28.422 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-17T05:52:28.423 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-17T05:52:28.423 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-17T05:52:28.423 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-17T05:52:28.423 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-17T05:52:28.423 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-17T05:52:28.423 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-17T05:52:28.424 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-17T05:52:28.424 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-17T05:52:28.424 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-17T05:52:28.424 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-17T05:52:28.424 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-17T05:52:28.425 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-17T05:52:28.425 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-17T05:52:28.425 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-17T05:52:28.425 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ntfs/ 2023-10-17T05:52:28.425 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 219417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ntfs/ntfs.ko 2023-10-17T05:52:28.425 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ 2023-10-17T05:52:28.426 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ 2023-10-17T05:52:28.426 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 244409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-17T05:52:28.426 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ 2023-10-17T05:52:28.426 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 440737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-17T05:52:28.426 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ 2023-10-17T05:52:28.427 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-17T05:52:28.427 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 2592433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-17T05:52:28.427 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-17T05:52:28.427 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-17T05:52:28.427 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-17T05:52:28.428 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/omfs/ 2023-10-17T05:52:28.428 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/omfs/omfs.ko 2023-10-17T05:52:28.428 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/ 2023-10-17T05:52:28.428 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 352153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-17T05:52:28.428 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ 2023-10-17T05:52:28.428 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-17T05:52:28.429 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx4/ 2023-10-17T05:52:28.429 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx4/qnx4.ko 2023-10-17T05:52:28.429 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx6/ 2023-10-17T05:52:28.429 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 46689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx6/qnx6.ko 2023-10-17T05:52:28.429 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/ 2023-10-17T05:52:28.430 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_tree.ko 2023-10-17T05:52:28.430 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_v1.ko 2023-10-17T05:52:28.430 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_v2.ko 2023-10-17T05:52:28.430 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/ 2023-10-17T05:52:28.430 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 532673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-17T05:52:28.430 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/ 2023-10-17T05:52:28.431 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-17T05:52:28.431 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/ 2023-10-17T05:52:28.431 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/ 2023-10-17T05:52:28.431 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 2668121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-17T05:52:28.431 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/ 2023-10-17T05:52:28.432 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-17T05:52:28.432 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-17T05:52:28.432 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/ 2023-10-17T05:52:28.432 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 134641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-17T05:52:28.432 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/ 2023-10-17T05:52:28.432 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 90721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-17T05:52:28.433 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/ 2023-10-17T05:52:28.433 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 247737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-17T05:52:28.433 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ 2023-10-17T05:52:28.433 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 162497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-17T05:52:28.433 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/ 2023-10-17T05:52:28.434 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 4010729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-17T05:52:28.434 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/ 2023-10-17T05:52:28.434 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/locking/ 2023-10-17T05:52:28.434 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 75489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/locking/locktorture.ko 2023-10-17T05:52:28.434 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/time/ 2023-10-17T05:52:28.435 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/time/test_udelay.ko 2023-10-17T05:52:28.435 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-17T05:52:28.435 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ 2023-10-17T05:52:28.435 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 6833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-17T05:52:28.435 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 6529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc7.ko 2023-10-17T05:52:28.435 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-17T05:52:28.436 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/ 2023-10-17T05:52:28.436 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-17T05:52:28.436 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-17T05:52:28.436 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/interval_tree_test.ko 2023-10-17T05:52:28.436 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-17T05:52:28.437 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-17T05:52:28.437 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/ 2023-10-17T05:52:28.437 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-17T05:52:28.437 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-17T05:52:28.437 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/ 2023-10-17T05:52:28.438 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 6617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-17T05:52:28.438 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/memory-notifier-error-inject.ko 2023-10-17T05:52:28.438 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/notifier-error-inject.ko 2023-10-17T05:52:28.438 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/percpu_test.ko 2023-10-17T05:52:28.438 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/pm-notifier-error-inject.ko 2023-10-17T05:52:28.439 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/ 2023-10-17T05:52:28.439 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 143433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-17T05:52:28.439 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/rbtree_test.ko 2023-10-17T05:52:28.439 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/ 2023-10-17T05:52:28.439 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-17T05:52:28.439 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test-kstrtox.ko 2023-10-17T05:52:28.440 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test-string_helpers.ko 2023-10-17T05:52:28.440 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 4760425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_bpf.ko 2023-10-17T05:52:28.440 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_firmware.ko 2023-10-17T05:52:28.440 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 6369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_module.ko 2023-10-17T05:52:28.440 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_user_copy.ko 2023-10-17T05:52:28.441 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-17T05:52:28.441 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-17T05:52:28.441 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-17T05:52:28.441 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/xz/ 2023-10-17T05:52:28.441 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/xz/xz_dec_test.ko 2023-10-17T05:52:28.441 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/ 2023-10-17T05:52:28.442 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-17T05:52:28.442 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ 2023-10-17T05:52:28.442 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/ 2023-10-17T05:52:28.442 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 55737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-17T05:52:28.442 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-17T05:52:28.443 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-17T05:52:28.443 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-17T05:52:28.443 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 6985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-17T05:52:28.443 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-17T05:52:28.443 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-17T05:52:28.444 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-17T05:52:28.444 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/ 2023-10-17T05:52:28.444 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-17T05:52:28.444 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-17T05:52:28.444 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-17T05:52:28.444 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-17T05:52:28.445 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-17T05:52:28.445 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/ 2023-10-17T05:52:28.445 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 81737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-17T05:52:28.445 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/ 2023-10-17T05:52:28.445 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 198337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-17T05:52:28.446 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-17T05:52:28.446 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-17T05:52:28.446 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-17T05:52:28.446 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/ 2023-10-17T05:52:28.446 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 649297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-17T05:52:28.447 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/ 2023-10-17T05:52:28.447 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 63809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-17T05:52:28.447 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 777689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-17T05:52:28.447 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ 2023-10-17T05:52:28.447 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-17T05:52:28.447 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-17T05:52:28.448 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-17T05:52:28.448 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-17T05:52:28.448 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-17T05:52:28.448 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-17T05:52:28.448 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-17T05:52:28.449 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-17T05:52:28.449 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-17T05:52:28.449 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-17T05:52:28.449 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-17T05:52:28.449 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-17T05:52:28.450 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-17T05:52:28.450 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-17T05:52:28.450 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-17T05:52:28.450 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-17T05:52:28.450 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-17T05:52:28.451 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-17T05:52:28.451 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-17T05:52:28.451 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-17T05:52:28.451 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 55929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-17T05:52:28.451 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-17T05:52:28.452 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-17T05:52:28.452 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/ 2023-10-17T05:52:28.452 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1047017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-17T05:52:28.452 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/ 2023-10-17T05:52:28.452 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 125697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-17T05:52:28.453 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/ 2023-10-17T05:52:28.453 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 194209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-17T05:52:28.453 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-17T05:52:28.453 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 57881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-17T05:52:28.453 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-17T05:52:28.454 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/ 2023-10-17T05:52:28.454 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 390473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-17T05:52:28.454 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-17T05:52:28.454 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-17T05:52:28.454 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-17T05:52:28.455 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-17T05:52:28.455 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/hsr/ 2023-10-17T05:52:28.455 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 99729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/hsr/hsr.ko 2023-10-17T05:52:28.455 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ 2023-10-17T05:52:28.455 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ 2023-10-17T05:52:28.456 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 45233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-17T05:52:28.456 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 254625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-17T05:52:28.456 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-17T05:52:28.456 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ 2023-10-17T05:52:28.456 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-17T05:52:28.456 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-17T05:52:28.457 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 48401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-17T05:52:28.457 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-17T05:52:28.457 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 48657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-17T05:52:28.457 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-17T05:52:28.458 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 61225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-17T05:52:28.458 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-17T05:52:28.458 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-17T05:52:28.458 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-17T05:52:28.458 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ 2023-10-17T05:52:28.459 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-17T05:52:28.459 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-17T05:52:28.459 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-17T05:52:28.459 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ip_tables.ko 2023-10-17T05:52:28.459 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-17T05:52:28.460 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-10-17T05:52:28.460 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-17T05:52:28.460 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-17T05:52:28.460 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-17T05:52:28.460 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-10-17T05:52:28.461 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-17T05:52:28.461 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-17T05:52:28.461 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-17T05:52:28.461 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-17T05:52:28.461 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-17T05:52:28.462 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-17T05:52:28.462 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-17T05:52:28.462 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-17T05:52:28.462 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-17T05:52:28.462 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-10-17T05:52:28.463 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-17T05:52:28.463 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-17T05:52:28.463 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-17T05:52:28.463 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-17T05:52:28.464 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-17T05:52:28.464 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-17T05:52:28.464 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-17T05:52:28.464 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-17T05:52:28.464 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-17T05:52:28.464 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-17T05:52:28.465 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-17T05:52:28.465 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-17T05:52:28.465 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-17T05:52:28.465 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-17T05:52:28.465 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-17T05:52:28.466 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-17T05:52:28.466 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-17T05:52:28.466 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-17T05:52:28.466 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-17T05:52:28.467 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-17T05:52:28.467 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 41665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-17T05:52:28.467 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-17T05:52:28.467 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ 2023-10-17T05:52:28.467 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-17T05:52:28.468 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-17T05:52:28.468 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-17T05:52:28.468 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 80897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_gre.ko 2023-10-17T05:52:28.468 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 93577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-17T05:52:28.468 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-17T05:52:28.469 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-17T05:52:28.469 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-17T05:52:28.469 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/mip6.ko 2023-10-17T05:52:28.469 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ 2023-10-17T05:52:28.469 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-17T05:52:28.469 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-10-17T05:52:28.470 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-17T05:52:28.470 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-17T05:52:28.470 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-17T05:52:28.470 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-17T05:52:28.470 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-17T05:52:28.471 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-17T05:52:28.471 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-17T05:52:28.471 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-17T05:52:28.471 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-17T05:52:28.471 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-17T05:52:28.472 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-17T05:52:28.472 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-17T05:52:28.472 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-17T05:52:28.472 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-17T05:52:28.472 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-17T05:52:28.472 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-17T05:52:28.473 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-17T05:52:28.473 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-17T05:52:28.473 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-17T05:52:28.473 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-17T05:52:28.473 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-17T05:52:28.474 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-17T05:52:28.474 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-17T05:52:28.474 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 74073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-17T05:52:28.474 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-17T05:52:28.474 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-17T05:52:28.474 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/ 2023-10-17T05:52:28.475 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 82833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-17T05:52:28.475 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/ 2023-10-17T05:52:28.475 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 125281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-17T05:52:28.475 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-17T05:52:28.475 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 25953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-17T05:52:28.476 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-17T05:52:28.476 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-17T05:52:28.476 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-17T05:52:28.476 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 53241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-17T05:52:28.476 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/lapb/ 2023-10-17T05:52:28.477 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 47977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/lapb/lapb.ko 2023-10-17T05:52:28.477 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/ 2023-10-17T05:52:28.477 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-17T05:52:28.477 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 267777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc2.ko 2023-10-17T05:52:28.477 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/ 2023-10-17T05:52:28.477 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 290417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-17T05:52:28.478 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/ 2023-10-17T05:52:28.478 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-17T05:52:28.478 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ 2023-10-17T05:52:28.478 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ 2023-10-17T05:52:28.478 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 119585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-17T05:52:28.479 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-17T05:52:28.479 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-17T05:52:28.479 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-17T05:52:28.479 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 100297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-17T05:52:28.479 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 101441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-17T05:52:28.479 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 102817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-17T05:52:28.480 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 103481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-17T05:52:28.480 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 112849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-17T05:52:28.480 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 60329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-17T05:52:28.480 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 109593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-17T05:52:28.480 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 113129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-17T05:52:28.481 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 112585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-17T05:52:28.481 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 111585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-17T05:52:28.481 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 114465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-17T05:52:28.481 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-17T05:52:28.481 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ 2023-10-17T05:52:28.481 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 411729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-17T05:52:28.482 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-17T05:52:28.482 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-17T05:52:28.482 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-17T05:52:28.482 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-17T05:52:28.482 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-17T05:52:28.483 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-17T05:52:28.483 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-17T05:52:28.483 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-17T05:52:28.483 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-17T05:52:28.483 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-17T05:52:28.484 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-17T05:52:28.484 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-17T05:52:28.484 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-17T05:52:28.484 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-17T05:52:28.484 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 408257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-17T05:52:28.484 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-17T05:52:28.485 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-17T05:52:28.485 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-17T05:52:28.485 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 118145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-17T05:52:28.485 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-17T05:52:28.485 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-17T05:52:28.486 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 107297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-17T05:52:28.486 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-17T05:52:28.486 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-17T05:52:28.486 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 66641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-17T05:52:28.486 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-17T05:52:28.486 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-17T05:52:28.487 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-17T05:52:28.487 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 89473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-17T05:52:28.487 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-17T05:52:28.487 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 37129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-17T05:52:28.487 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 95417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-17T05:52:28.488 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-17T05:52:28.488 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-17T05:52:28.488 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-17T05:52:28.488 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-17T05:52:28.488 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-17T05:52:28.489 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 44065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-17T05:52:28.489 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 615313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-17T05:52:28.489 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 42561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-17T05:52:28.489 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-17T05:52:28.489 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-10-17T05:52:28.489 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 39785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-17T05:52:28.490 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-17T05:52:28.490 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-17T05:52:28.490 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-17T05:52:28.490 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-17T05:52:28.490 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 40721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-17T05:52:28.491 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-17T05:52:28.491 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-17T05:52:28.491 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-17T05:52:28.491 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-17T05:52:28.491 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-17T05:52:28.492 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-17T05:52:28.492 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-17T05:52:28.492 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-17T05:52:28.492 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-17T05:52:28.492 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_osf.ko 2023-10-17T05:52:28.493 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-17T05:52:28.493 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-17T05:52:28.493 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-17T05:52:28.493 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-17T05:52:28.493 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-17T05:52:28.494 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_synproxy.ko 2023-10-17T05:52:28.494 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tproxy.ko 2023-10-17T05:52:28.494 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 89313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/x_tables.ko 2023-10-17T05:52:28.494 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-17T05:52:28.494 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-17T05:52:28.495 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-17T05:52:28.495 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-17T05:52:28.495 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 18169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-17T05:52:28.495 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-17T05:52:28.495 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-17T05:52:28.495 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-17T05:52:28.496 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-17T05:52:28.496 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-17T05:52:28.496 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-17T05:52:28.496 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-17T05:52:28.496 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-17T05:52:28.497 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-17T05:52:28.497 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-17T05:52:28.497 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-17T05:52:28.497 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-17T05:52:28.497 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 14337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-17T05:52:28.498 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-17T05:52:28.498 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-17T05:52:28.498 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-17T05:52:28.498 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-17T05:52:28.498 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-17T05:52:28.499 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-17T05:52:28.499 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-17T05:52:28.499 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-17T05:52:28.499 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-17T05:52:28.499 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-17T05:52:28.499 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-17T05:52:28.500 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-17T05:52:28.500 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-17T05:52:28.500 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-17T05:52:28.500 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-17T05:52:28.500 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-17T05:52:28.501 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-17T05:52:28.501 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-17T05:52:28.501 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-17T05:52:28.501 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-17T05:52:28.501 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-17T05:52:28.502 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 43289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-17T05:52:28.502 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-17T05:52:28.502 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-17T05:52:28.502 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-17T05:52:28.502 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-17T05:52:28.503 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-17T05:52:28.503 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-17T05:52:28.503 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-17T05:52:28.503 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-17T05:52:28.503 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-17T05:52:28.503 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-17T05:52:28.504 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-17T05:52:28.504 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-17T05:52:28.504 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-17T05:52:28.504 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-17T05:52:28.504 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-17T05:52:28.505 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-17T05:52:28.505 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-17T05:52:28.505 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-17T05:52:28.505 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-17T05:52:28.505 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-17T05:52:28.506 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-17T05:52:28.506 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-17T05:52:28.506 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-17T05:52:28.506 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-17T05:52:28.506 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 16089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-17T05:52:28.506 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-17T05:52:28.507 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-17T05:52:28.507 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-17T05:52:28.507 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 8553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-17T05:52:28.507 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpudp.ko 2023-10-17T05:52:28.507 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-17T05:52:28.508 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-17T05:52:28.508 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/ 2023-10-17T05:52:28.508 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-17T05:52:28.508 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/ 2023-10-17T05:52:28.508 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 12425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-17T05:52:28.509 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/ 2023-10-17T05:52:28.509 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 380033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-17T05:52:28.509 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-17T05:52:28.509 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-17T05:52:28.509 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 11793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-17T05:52:28.510 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/ 2023-10-17T05:52:28.510 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-17T05:52:28.510 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/ 2023-10-17T05:52:28.510 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 110201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/phonet.ko 2023-10-17T05:52:28.510 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/pn_pep.ko 2023-10-17T05:52:28.510 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/ 2023-10-17T05:52:28.513 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 251481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-17T05:52:28.513 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 164937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-17T05:52:28.513 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 67377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-17T05:52:28.514 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rxrpc/ 2023-10-17T05:52:28.514 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 819657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rxrpc/rxrpc.ko 2023-10-17T05:52:28.514 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/ 2023-10-17T05:52:28.514 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-17T05:52:28.514 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-17T05:52:28.514 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-17T05:52:28.515 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-17T05:52:28.515 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-17T05:52:28.515 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 43449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-17T05:52:28.515 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-17T05:52:28.515 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-17T05:52:28.516 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-17T05:52:28.516 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-17T05:52:28.516 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-17T05:52:28.516 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-17T05:52:28.516 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_cgroup.ko 2023-10-17T05:52:28.517 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-17T05:52:28.517 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-17T05:52:28.517 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 38489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-17T05:52:28.517 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 61409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-17T05:52:28.517 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-17T05:52:28.517 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 13409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-17T05:52:28.518 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-17T05:52:28.518 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-17T05:52:28.518 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-17T05:52:28.518 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-17T05:52:28.518 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 21649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-17T05:52:28.519 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-17T05:52:28.519 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 34633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-17T05:52:28.519 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 33609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-17T05:52:28.519 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq_codel.ko 2023-10-17T05:52:28.519 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 35433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-17T05:52:28.519 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 49601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-17T05:52:28.520 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-17T05:52:28.520 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 66393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-17T05:52:28.520 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-17T05:52:28.520 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 30273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-17T05:52:28.520 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-17T05:52:28.521 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-17T05:52:28.521 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 36137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-17T05:52:28.521 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 27497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-17T05:52:28.521 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-17T05:52:28.521 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-17T05:52:28.522 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 48793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-17T05:52:28.522 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 32905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-17T05:52:28.522 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 26881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-17T05:52:28.522 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 31353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-17T05:52:28.522 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-17T05:52:28.522 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 28105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-17T05:52:28.523 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/ 2023-10-17T05:52:28.523 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 929745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-17T05:52:28.523 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 19033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-17T05:52:28.523 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/ 2023-10-17T05:52:28.523 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/ 2023-10-17T05:52:28.524 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 336529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-17T05:52:28.524 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 54737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-17T05:52:28.524 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 1520161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-17T05:52:28.524 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/ 2023-10-17T05:52:28.524 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 707721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-17T05:52:28.525 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/ 2023-10-17T05:52:28.525 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-17T05:52:28.525 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 862641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-17T05:52:28.525 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/ 2023-10-17T05:52:28.525 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-17T05:52:28.526 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/ 2023-10-17T05:52:28.526 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 85337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-17T05:52:28.526 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 68049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-17T05:52:28.526 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 96193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-17T05:52:28.526 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 10705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-17T05:52:28.527 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 17521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-17T05:52:28.527 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/x25/ 2023-10-17T05:52:28.527 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 125177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/x25/x25.ko 2023-10-17T05:52:28.527 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/ 2023-10-17T05:52:28.527 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 22657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_algo.ko 2023-10-17T05:52:28.528 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 20649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-17T05:52:28.528 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 102257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_user.ko 2023-10-17T05:52:28.528 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/ 2023-10-17T05:52:28.528 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/ 2023-10-17T05:52:28.528 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 15537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-17T05:52:28.528 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 639863 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-17T05:52:28.529 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 623919 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-17T05:52:28.529 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 7663 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-17T05:52:28.529 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 23428 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-17T05:52:28.529 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 9821 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-17T05:52:28.529 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 70004 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-17T05:52:28.530 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 146313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-17T05:52:28.530 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 232548 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-17T05:52:28.530 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 210 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-17T05:52:28.530 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 72606 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-17T05:52:28.530 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 879 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-17T05:52:28.531 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 254438 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-17T05:52:28.531 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 309363 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-17T05:52:28.531 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./usr/ 2023-10-17T05:52:28.531 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./usr/share/ 2023-10-17T05:52:28.531 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./usr/share/doc/ 2023-10-17T05:52:28.531 INFO:teuthology.orchestra.run.smithi184.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/ 2023-10-17T05:52:28.532 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 174 2023-10-10 19:59 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/changelog.Debian.gz 2023-10-17T05:52:28.532 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r-- root/root 691 2023-10-10 19:59 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/copyright 2023-10-17T05:52:28.533 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-17T05:52:28.533 INFO:teuthology.task.kernel:searching for kernel 6.6.0-rc5-g47672119149b 2023-10-17T05:52:28.533 DEBUG:teuthology.orchestra.run.smithi184:> egrep '(submenu|menuentry.*6.6.0-rc5-g47672119149b).*{' /boot/grub/grub.cfg 2023-10-17T05:52:28.534 INFO:teuthology.orchestra.run.smithi125.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-17T05:52:28.534 INFO:teuthology.orchestra.run.smithi125.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-17T05:52:28.543 INFO:teuthology.orchestra.run.smithi184.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-17T05:52:28.543 INFO:teuthology.orchestra.run.smithi184.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g47672119149b' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g47672119149b-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-17T05:52:28.543 INFO:teuthology.orchestra.run.smithi184.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g47672119149b (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g47672119149b-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-17T05:52:28.544 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-10-17T05:52:28.544 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-rc5-g47672119149b 2023-10-17T05:52:28.544 DEBUG:teuthology.orchestra.run.smithi184:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-10-17T05:52:28.588 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi184.front.sepia.ceph.com to complete... 2023-10-17T05:52:28.723 INFO:teuthology.orchestra.run.smithi125.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-17T05:52:28.735 INFO:teuthology.orchestra.run.smithi125.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-17T05:52:29.322 INFO:teuthology.orchestra.run.smithi184.stderr:Sourcing file `/etc/default/grub' 2023-10-17T05:52:29.327 INFO:teuthology.orchestra.run.smithi184.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-17T05:52:29.346 INFO:teuthology.orchestra.run.smithi184.stderr:Generating grub configuration file ... 2023-10-17T05:52:29.596 INFO:teuthology.orchestra.run.smithi184.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-17T05:52:29.608 INFO:teuthology.orchestra.run.smithi184.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-17T05:52:29.678 INFO:teuthology.orchestra.run.smithi125.stderr:done 2023-10-17T05:52:30.003 INFO:teuthology.orchestra.run.smithi184.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-17T05:52:30.014 INFO:teuthology.orchestra.run.smithi184.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-17T05:52:30.925 INFO:teuthology.orchestra.run.smithi184.stderr:done 2023-10-17T05:53:00.818 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-17T05:53:00.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-17T05:53:00.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T05:53:02.052 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-17T05:53:02.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-17T05:53:02.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T05:53:20.506 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-10-17T05:53:29.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-17T05:53:29.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T05:53:32.570 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-10-17T05:53:35.358 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-17T05:53:44.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-17T05:53:44.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T05:53:44.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-17T05:53:44.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T05:54:02.747 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-17T05:54:03.006 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-10-17T05:54:14.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-17T05:54:14.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T05:54:15.012 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-10-17T05:54:15.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-17T05:54:15.761 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-rc5-g47672119149b"... 2023-10-17T05:54:15.762 DEBUG:teuthology.orchestra.run.smithi125:> uname -r 2023-10-17T05:54:15.820 INFO:teuthology.orchestra.run.smithi125.stdout:6.6.0-rc5-g47672119149b 2023-10-17T05:54:15.820 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-17T05:54:15.821 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-17T05:54:15.821 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-17T05:54:16.822 DEBUG:teuthology.parallel:result is None 2023-10-17T05:54:18.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-17T05:54:18.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T05:54:18.256 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-10-17T05:54:19.038 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-17T05:54:19.039 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-rc5-g47672119149b"... 2023-10-17T05:54:19.039 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2023-10-17T05:54:19.098 INFO:teuthology.orchestra.run.smithi184.stdout:6.6.0-rc5-g47672119149b 2023-10-17T05:54:19.098 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-17T05:54:19.098 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-17T05:54:19.098 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-17T05:54:20.099 DEBUG:teuthology.parallel:result is None 2023-10-17T05:54:20.100 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-17T05:54:20.109 INFO:teuthology.task.internal:Creating test directory... 2023-10-17T05:54:20.109 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-17T05:54:20.116 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-17T05:54:20.138 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-17T05:54:20.168 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-17T05:54:20.174 INFO:teuthology.task.internal:Creating archive directory... 2023-10-17T05:54:20.175 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-17T05:54:20.182 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-17T05:54:20.213 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-17T05:54:20.220 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-17T05:54:20.220 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-17T05:54:20.256 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-17T05:54:20.357 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-17T05:54:20.363 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-17T05:54:20.387 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-17T05:54:20.393 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-17T05:54:20.398 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-17T05:54:20.405 INFO:teuthology.task.internal:Configuring sudo... 2023-10-17T05:54:20.406 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-17T05:54:20.413 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-17T05:54:20.449 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-17T05:54:20.458 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-17T05:54:20.459 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-17T05:54:20.500 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-17T05:54:20.521 DEBUG:teuthology.orchestra.run.smithi125:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-17T05:54:20.575 DEBUG:teuthology.orchestra.run.smithi125:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-17T05:54:20.640 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T05:54:20.641 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-17T05:54:20.726 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-17T05:54:20.744 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-17T05:54:20.808 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T05:54:20.809 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-17T05:54:20.892 DEBUG:teuthology.orchestra.run.smithi125:> sudo service rsyslog restart 2023-10-17T05:54:20.900 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2023-10-17T05:54:21.059 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-17T05:54:21.067 INFO:teuthology.task.internal:Starting timer... 2023-10-17T05:54:21.068 INFO:teuthology.run_tasks:Running task pcp... 2023-10-17T05:54:21.078 INFO:teuthology.run_tasks:Running task selinux... 2023-10-17T05:54:21.088 DEBUG:teuthology.task.selinux:Excluding smithi125: OS 'ubuntu' does not support SELinux 2023-10-17T05:54:21.089 DEBUG:teuthology.task.selinux:Excluding smithi184: OS 'ubuntu' does not support SELinux 2023-10-17T05:54:21.089 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-17T05:54:21.090 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-10-17T05:54:21.090 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-17T05:54:21.091 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-17T05:54:21.151 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-17T05:54:21.158 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-17T05:54:21.284 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-17T05:54:21.300 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-17T05:54:21.301 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi125.front.sepia.ceph.com,smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-17T06:02:15.160 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi125.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2023-10-17T06:02:15.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-17T06:02:15.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T06:02:15.270 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-10-17T06:02:15.519 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-17T06:02:15.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-17T06:02:15.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T06:02:15.623 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-10-17T06:02:15.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-17T06:02:15.853 INFO:teuthology.run_tasks:Running task clock... 2023-10-17T06:02:15.865 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-17T06:02:15.866 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-17T06:02:15.866 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-17T06:02:15.874 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-17T06:02:15.874 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-17T06:02:15.935 INFO:teuthology.orchestra.run.smithi125.stdout:17 Oct 06:02:15 ntpd[22762]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-17T06:02:15.936 INFO:teuthology.orchestra.run.smithi125.stdout:17 Oct 06:02:15 ntpd[22762]: Command line: ntpd -gq 2023-10-17T06:02:15.937 INFO:teuthology.orchestra.run.smithi125.stdout:17 Oct 06:02:15 ntpd[22762]: proto: precision = 0.052 usec (-24) 2023-10-17T06:02:15.937 INFO:teuthology.orchestra.run.smithi125.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-17T06:02:15.938 INFO:teuthology.orchestra.run.smithi125.stdout:17 Oct 06:02:15 ntpd[22762]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-17T06:02:15.938 INFO:teuthology.orchestra.run.smithi125.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-17T06:02:15.939 INFO:teuthology.orchestra.run.smithi125.stdout:17 Oct 06:02:15 ntpd[22762]: restrict ::: KOD does nothing without LIMITED. 2023-10-17T06:02:15.939 INFO:teuthology.orchestra.run.smithi125.stdout:17 Oct 06:02:15 ntpd[22762]: Listen and drop on 0 v6wildcard [::]:123 2023-10-17T06:02:15.940 INFO:teuthology.orchestra.run.smithi125.stdout:17 Oct 06:02:15 ntpd[22762]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-17T06:02:15.940 INFO:teuthology.orchestra.run.smithi125.stdout:17 Oct 06:02:15 ntpd[22762]: Listen normally on 2 lo 127.0.0.1:123 2023-10-17T06:02:15.940 INFO:teuthology.orchestra.run.smithi125.stdout:17 Oct 06:02:15 ntpd[22762]: Listen normally on 3 enp3s0f1 172.21.15.125:123 2023-10-17T06:02:15.940 INFO:teuthology.orchestra.run.smithi125.stdout:17 Oct 06:02:15 ntpd[22762]: Listen normally on 4 lo [::1]:123 2023-10-17T06:02:15.940 INFO:teuthology.orchestra.run.smithi125.stdout:17 Oct 06:02:15 ntpd[22762]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d739%5]:123 2023-10-17T06:02:15.941 INFO:teuthology.orchestra.run.smithi125.stdout:17 Oct 06:02:15 ntpd[22762]: Listening on routing socket on fd #22 for interface updates 2023-10-17T06:02:15.978 INFO:teuthology.orchestra.run.smithi184.stdout:17 Oct 06:02:15 ntpd[22724]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-17T06:02:15.979 INFO:teuthology.orchestra.run.smithi184.stdout:17 Oct 06:02:15 ntpd[22724]: Command line: ntpd -gq 2023-10-17T06:02:15.980 INFO:teuthology.orchestra.run.smithi184.stdout:17 Oct 06:02:15 ntpd[22724]: proto: precision = 0.047 usec (-24) 2023-10-17T06:02:15.980 INFO:teuthology.orchestra.run.smithi184.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-17T06:02:15.980 INFO:teuthology.orchestra.run.smithi184.stdout:17 Oct 06:02:15 ntpd[22724]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-17T06:02:15.981 INFO:teuthology.orchestra.run.smithi184.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-17T06:02:15.982 INFO:teuthology.orchestra.run.smithi184.stdout:17 Oct 06:02:15 ntpd[22724]: restrict ::: KOD does nothing without LIMITED. 2023-10-17T06:02:15.982 INFO:teuthology.orchestra.run.smithi184.stdout:17 Oct 06:02:15 ntpd[22724]: Listen and drop on 0 v6wildcard [::]:123 2023-10-17T06:02:15.982 INFO:teuthology.orchestra.run.smithi184.stdout:17 Oct 06:02:15 ntpd[22724]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-17T06:02:15.983 INFO:teuthology.orchestra.run.smithi184.stdout:17 Oct 06:02:15 ntpd[22724]: Listen normally on 2 lo 127.0.0.1:123 2023-10-17T06:02:15.983 INFO:teuthology.orchestra.run.smithi184.stdout:17 Oct 06:02:15 ntpd[22724]: Listen normally on 3 enp3s0f1 172.21.15.184:123 2023-10-17T06:02:15.983 INFO:teuthology.orchestra.run.smithi184.stdout:17 Oct 06:02:15 ntpd[22724]: Listen normally on 4 lo [::1]:123 2023-10-17T06:02:15.983 INFO:teuthology.orchestra.run.smithi184.stdout:17 Oct 06:02:15 ntpd[22724]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7b8f%5]:123 2023-10-17T06:02:15.983 INFO:teuthology.orchestra.run.smithi184.stdout:17 Oct 06:02:15 ntpd[22724]: Listening on routing socket on fd #22 for interface updates 2023-10-17T06:02:16.936 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:16 ntpd[22762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:16.936 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:16 ntpd[22762]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:16.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:16 ntpd[22762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:16.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:16 ntpd[22762]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:16.938 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:16 ntpd[22762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-17T06:02:16.938 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:16 ntpd[22762]: can't open /var/log/ntpstats/peerstats.20231017: Permission denied 2023-10-17T06:02:16.979 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:16 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:16.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:16 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:16.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:16 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:16.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:16 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:16.981 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:16 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:16.981 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:16 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:16.981 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:16 ntpd[22724]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-17T06:02:16.982 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:16 ntpd[22724]: can't open /var/log/ntpstats/peerstats.20231017: Permission denied 2023-10-17T06:02:17.936 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:17 ntpd[22762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:17.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:17 ntpd[22762]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:17.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:17 ntpd[22762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:17.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:17 ntpd[22762]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:17.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:17 ntpd[22762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-17T06:02:17.938 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:17 ntpd[22762]: can't open /var/log/ntpstats/peerstats.20231017: Permission denied 2023-10-17T06:02:17.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:17 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:17.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:17 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:17.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:17 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:17.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:17 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:17.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:17 ntpd[22724]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-17T06:02:17.981 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:17 ntpd[22724]: can't open /var/log/ntpstats/peerstats.20231017: Permission denied 2023-10-17T06:02:18.936 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:18 ntpd[22762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:18.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:18 ntpd[22762]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:18.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:18 ntpd[22762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:18.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:18 ntpd[22762]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:18.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:18 ntpd[22762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:18.938 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:18 ntpd[22762]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:18.939 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:18 ntpd[22762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:18.939 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:18 ntpd[22762]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:18.939 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:18 ntpd[22762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-17T06:02:18.940 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:18 ntpd[22762]: can't open /var/log/ntpstats/peerstats.20231017: Permission denied 2023-10-17T06:02:18.940 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:18 ntpd[22762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:18.940 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:18 ntpd[22762]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:18.940 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:18 ntpd[22762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-17T06:02:18.940 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:18 ntpd[22762]: can't open /var/log/ntpstats/peerstats.20231017: Permission denied 2023-10-17T06:02:18.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:18 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:18.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:18 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:18.981 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:18 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:18.981 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:18 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:18.981 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:18 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:18.981 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:18 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:18.982 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:18 ntpd[22724]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-17T06:02:18.982 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:18 ntpd[22724]: can't open /var/log/ntpstats/peerstats.20231017: Permission denied 2023-10-17T06:02:18.982 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:18 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:18.982 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:18 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:18.983 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:18 ntpd[22724]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-17T06:02:18.983 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:18 ntpd[22724]: can't open /var/log/ntpstats/peerstats.20231017: Permission denied 2023-10-17T06:02:19.936 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:19 ntpd[22762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:19.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:19 ntpd[22762]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:19.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:19 ntpd[22762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:19.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:19 ntpd[22762]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:19.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:19 ntpd[22762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-17T06:02:19.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:19 ntpd[22762]: can't open /var/log/ntpstats/peerstats.20231017: Permission denied 2023-10-17T06:02:19.979 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:19 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:19.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:19 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:19.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:19 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:19.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:19 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:19.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:19 ntpd[22724]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-17T06:02:19.981 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:19 ntpd[22724]: can't open /var/log/ntpstats/peerstats.20231017: Permission denied 2023-10-17T06:02:20.936 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:20 ntpd[22762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:20.936 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:20 ntpd[22762]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:20.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:20 ntpd[22762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:20.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:20 ntpd[22762]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:20.938 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:20 ntpd[22762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:20.938 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:20 ntpd[22762]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:20.938 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:20 ntpd[22762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-17T06:02:20.939 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:20 ntpd[22762]: can't open /var/log/ntpstats/peerstats.20231017: Permission denied 2023-10-17T06:02:20.939 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:20 ntpd[22762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:20.939 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:20 ntpd[22762]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:20.939 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:20 ntpd[22762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-17T06:02:20.939 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:20 ntpd[22762]: can't open /var/log/ntpstats/peerstats.20231017: Permission denied 2023-10-17T06:02:20.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:20 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:20.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:20 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:20.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:20 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:20.981 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:20 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:20.981 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:20 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:20.981 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:20 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:20.981 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:20 ntpd[22724]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-17T06:02:20.981 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:20 ntpd[22724]: can't open /var/log/ntpstats/peerstats.20231017: Permission denied 2023-10-17T06:02:20.982 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:20 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:20.982 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:20 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:20.982 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:20 ntpd[22724]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-17T06:02:20.982 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:20 ntpd[22724]: can't open /var/log/ntpstats/peerstats.20231017: Permission denied 2023-10-17T06:02:21.936 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:21 ntpd[22762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:21.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:21 ntpd[22762]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:21.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:21 ntpd[22762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:21.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:21 ntpd[22762]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:21.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:21 ntpd[22762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-17T06:02:21.938 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:21 ntpd[22762]: can't open /var/log/ntpstats/peerstats.20231017: Permission denied 2023-10-17T06:02:21.979 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:21 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:21.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:21 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:21.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:21 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:21.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:21 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:21.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:21 ntpd[22724]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-17T06:02:21.981 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:21 ntpd[22724]: can't open /var/log/ntpstats/peerstats.20231017: Permission denied 2023-10-17T06:02:22.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:22 ntpd[22762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:22.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:22 ntpd[22762]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:22.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:22 ntpd[22762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:22.937 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:22 ntpd[22762]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:22.938 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:22 ntpd[22762]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:22.938 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:22 ntpd[22762]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:22.938 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:22 ntpd[22762]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-17T06:02:22.938 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:22 ntpd[22762]: can't open /var/log/ntpstats/peerstats.20231017: Permission denied 2023-10-17T06:02:22.939 INFO:teuthology.orchestra.run.smithi125.stdout:17 Oct 06:02:22 ntpd[22762]: ntpd: time slew +0.001128 s 2023-10-17T06:02:22.939 INFO:teuthology.orchestra.run.smithi125.stdout:ntpd: time slew +0.001128s 2023-10-17T06:02:22.940 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:22 ntpd[22762]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-17T06:02:22.940 INFO:teuthology.orchestra.run.smithi125.stderr:17 Oct 06:02:22 ntpd[22762]: can't open /var/log/ntpstats/loopstats.20231017: Permission denied 2023-10-17T06:02:22.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:22 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:22.980 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:22 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:22.981 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:22 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:22.981 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:22 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:22.981 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:22 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:22.981 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:22 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:22.981 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:22 ntpd[22724]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-17T06:02:22.982 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:22 ntpd[22724]: can't open /var/log/ntpstats/peerstats.20231017: Permission denied 2023-10-17T06:02:22.982 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:22 ntpd[22724]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-17T06:02:22.982 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:22 ntpd[22724]: can't open /var/log/ntpstats/rawstats.20231017: Permission denied 2023-10-17T06:02:22.982 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:22 ntpd[22724]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-17T06:02:22.983 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:22 ntpd[22724]: can't open /var/log/ntpstats/peerstats.20231017: Permission denied 2023-10-17T06:02:22.983 INFO:teuthology.orchestra.run.smithi184.stdout:17 Oct 06:02:22 ntpd[22724]: ntpd: time slew +0.000301 s 2023-10-17T06:02:22.983 INFO:teuthology.orchestra.run.smithi184.stdout:ntpd: time slew +0.000301s 2023-10-17T06:02:22.984 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:22 ntpd[22724]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-17T06:02:22.984 INFO:teuthology.orchestra.run.smithi184.stderr:17 Oct 06:02:22 ntpd[22724]: can't open /var/log/ntpstats/loopstats.20231017: Permission denied 2023-10-17T06:02:23.070 INFO:teuthology.orchestra.run.smithi125.stdout: remote refid st t when poll reach delay offset jitter 2023-10-17T06:02:23.070 INFO:teuthology.orchestra.run.smithi125.stdout:============================================================================== 2023-10-17T06:02:23.070 INFO:teuthology.orchestra.run.smithi125.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-17T06:02:23.070 INFO:teuthology.orchestra.run.smithi125.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-17T06:02:23.071 INFO:teuthology.orchestra.run.smithi125.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-17T06:02:23.071 INFO:teuthology.orchestra.run.smithi125.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-17T06:02:23.128 INFO:teuthology.orchestra.run.smithi184.stdout: remote refid st t when poll reach delay offset jitter 2023-10-17T06:02:23.129 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================== 2023-10-17T06:02:23.129 INFO:teuthology.orchestra.run.smithi184.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-17T06:02:23.129 INFO:teuthology.orchestra.run.smithi184.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-17T06:02:23.130 INFO:teuthology.orchestra.run.smithi184.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-17T06:02:23.130 INFO:teuthology.orchestra.run.smithi184.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-17T06:02:23.131 INFO:teuthology.run_tasks:Running task install... 2023-10-17T06:02:23.140 DEBUG:teuthology.task.install:project ceph 2023-10-17T06:02:23.141 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6f3e6b48891b9b50415c0822b6b870797fcda16d'}} 2023-10-17T06:02:23.141 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6f3e6b48891b9b50415c0822b6b870797fcda16d'} 2023-10-17T06:02:23.142 INFO:teuthology.task.install:Using flavor: default 2023-10-17T06:02:23.148 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-17T06:02:23.148 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-17T06:02:23.149 DEBUG:teuthology.orchestra.run.smithi125:> sudo apt-key list | grep Ceph 2023-10-17T06:02:23.150 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-key list | grep Ceph 2023-10-17T06:02:23.384 INFO:teuthology.orchestra.run.smithi184.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-17T06:02:23.386 INFO:teuthology.orchestra.run.smithi125.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-17T06:02:23.512 INFO:teuthology.orchestra.run.smithi125.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-17T06:02:23.513 INFO:teuthology.orchestra.run.smithi125.stdout:uid [ unknown] Ceph.com (release key) 2023-10-17T06:02:23.514 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-17T06:02:23.514 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-17T06:02:23.515 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6f3e6b48891b9b50415c0822b6b870797fcda16d 2023-10-17T06:02:23.521 INFO:teuthology.orchestra.run.smithi184.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-17T06:02:23.521 INFO:teuthology.orchestra.run.smithi184.stdout:uid [ unknown] Ceph.com (release key) 2023-10-17T06:02:23.523 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-17T06:02:23.523 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-17T06:02:23.524 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6f3e6b48891b9b50415c0822b6b870797fcda16d 2023-10-17T06:02:23.653 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default/ 2023-10-17T06:02:23.653 INFO:teuthology.task.install.deb:Package version is 18.0.0-5610-g6f3e6b48-1focal 2023-10-17T06:02:23.741 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default/ 2023-10-17T06:02:23.741 INFO:teuthology.task.install.deb:Package version is 18.0.0-5610-g6f3e6b48-1focal 2023-10-17T06:02:23.821 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:02:23.821 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-17T06:02:23.859 DEBUG:teuthology.orchestra.run.smithi125:> sudo apt-get update 2023-10-17T06:02:23.912 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:02:23.912 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-17T06:02:23.947 DEBUG:teuthology.orchestra.run.smithi184:> sudo apt-get update 2023-10-17T06:02:24.145 INFO:teuthology.orchestra.run.smithi125.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-17T06:02:24.146 INFO:teuthology.orchestra.run.smithi125.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-17T06:02:24.159 INFO:teuthology.orchestra.run.smithi125.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-17T06:02:24.179 INFO:teuthology.orchestra.run.smithi125.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-17T06:02:24.299 INFO:teuthology.orchestra.run.smithi125.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal InRelease 2023-10-17T06:02:24.345 INFO:teuthology.orchestra.run.smithi125.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-17T06:02:24.356 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-17T06:02:24.357 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-17T06:02:24.357 INFO:teuthology.orchestra.run.smithi184.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal InRelease 2023-10-17T06:02:24.387 INFO:teuthology.orchestra.run.smithi125.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal Release.gpg 2023-10-17T06:02:24.393 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-17T06:02:24.417 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-17T06:02:24.432 INFO:teuthology.orchestra.run.smithi184.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal Release.gpg 2023-10-17T06:02:24.458 INFO:teuthology.orchestra.run.smithi125.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-17T06:02:24.495 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main i386 Packages [3,429 B] 2023-10-17T06:02:24.521 INFO:teuthology.orchestra.run.smithi184.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-17T06:02:24.521 INFO:teuthology.orchestra.run.smithi125.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main i386 Packages [3,429 B] 2023-10-17T06:02:24.557 INFO:teuthology.orchestra.run.smithi184.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-17T06:02:25.540 INFO:teuthology.orchestra.run.smithi125.stdout:Fetched 28.5 kB in 1s (21.2 kB/s) 2023-10-17T06:02:25.752 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 28.5 kB in 1s (19.4 kB/s) 2023-10-17T06:02:26.732 INFO:teuthology.orchestra.run.smithi125.stdout:Reading package lists... 2023-10-17T06:02:26.779 DEBUG:teuthology.orchestra.run.smithi125:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-5610-g6f3e6b48-1focal cephadm=18.0.0-5610-g6f3e6b48-1focal ceph-mds=18.0.0-5610-g6f3e6b48-1focal ceph-mgr=18.0.0-5610-g6f3e6b48-1focal ceph-common=18.0.0-5610-g6f3e6b48-1focal ceph-fuse=18.0.0-5610-g6f3e6b48-1focal ceph-test=18.0.0-5610-g6f3e6b48-1focal ceph-volume=18.0.0-5610-g6f3e6b48-1focal radosgw=18.0.0-5610-g6f3e6b48-1focal python3-rados=18.0.0-5610-g6f3e6b48-1focal python3-rgw=18.0.0-5610-g6f3e6b48-1focal python3-cephfs=18.0.0-5610-g6f3e6b48-1focal python3-rbd=18.0.0-5610-g6f3e6b48-1focal libcephfs2=18.0.0-5610-g6f3e6b48-1focal libcephfs-dev=18.0.0-5610-g6f3e6b48-1focal librados2=18.0.0-5610-g6f3e6b48-1focal librbd1=18.0.0-5610-g6f3e6b48-1focal rbd-fuse=18.0.0-5610-g6f3e6b48-1focal python3-cephfs=18.0.0-5610-g6f3e6b48-1focal cephfs-shell=18.0.0-5610-g6f3e6b48-1focal cephfs-top=18.0.0-5610-g6f3e6b48-1focal cephfs-mirror=18.0.0-5610-g6f3e6b48-1focal 2023-10-17T06:02:26.902 INFO:teuthology.orchestra.run.smithi125.stdout:Reading package lists... 2023-10-17T06:02:26.963 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2023-10-17T06:02:27.007 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-5610-g6f3e6b48-1focal cephadm=18.0.0-5610-g6f3e6b48-1focal ceph-mds=18.0.0-5610-g6f3e6b48-1focal ceph-mgr=18.0.0-5610-g6f3e6b48-1focal ceph-common=18.0.0-5610-g6f3e6b48-1focal ceph-fuse=18.0.0-5610-g6f3e6b48-1focal ceph-test=18.0.0-5610-g6f3e6b48-1focal ceph-volume=18.0.0-5610-g6f3e6b48-1focal radosgw=18.0.0-5610-g6f3e6b48-1focal python3-rados=18.0.0-5610-g6f3e6b48-1focal python3-rgw=18.0.0-5610-g6f3e6b48-1focal python3-cephfs=18.0.0-5610-g6f3e6b48-1focal python3-rbd=18.0.0-5610-g6f3e6b48-1focal libcephfs2=18.0.0-5610-g6f3e6b48-1focal libcephfs-dev=18.0.0-5610-g6f3e6b48-1focal librados2=18.0.0-5610-g6f3e6b48-1focal librbd1=18.0.0-5610-g6f3e6b48-1focal rbd-fuse=18.0.0-5610-g6f3e6b48-1focal python3-cephfs=18.0.0-5610-g6f3e6b48-1focal cephfs-shell=18.0.0-5610-g6f3e6b48-1focal cephfs-top=18.0.0-5610-g6f3e6b48-1focal cephfs-mirror=18.0.0-5610-g6f3e6b48-1focal 2023-10-17T06:02:27.103 INFO:teuthology.orchestra.run.smithi125.stdout:Building dependency tree... 2023-10-17T06:02:27.104 INFO:teuthology.orchestra.run.smithi125.stdout:Reading state information... 2023-10-17T06:02:27.135 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2023-10-17T06:02:27.292 INFO:teuthology.orchestra.run.smithi125.stdout:The following packages were automatically installed and are no longer required: 2023-10-17T06:02:27.294 INFO:teuthology.orchestra.run.smithi125.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-17T06:02:27.294 INFO:teuthology.orchestra.run.smithi125.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-17T06:02:27.294 INFO:teuthology.orchestra.run.smithi125.stdout:The following additional packages will be installed: 2023-10-17T06:02:27.294 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-17T06:02:27.295 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-17T06:02:27.295 INFO:teuthology.orchestra.run.smithi125.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-17T06:02:27.295 INFO:teuthology.orchestra.run.smithi125.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-17T06:02:27.295 INFO:teuthology.orchestra.run.smithi125.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-17T06:02:27.296 INFO:teuthology.orchestra.run.smithi125.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-17T06:02:27.296 INFO:teuthology.orchestra.run.smithi125.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-10-17T06:02:27.296 INFO:teuthology.orchestra.run.smithi125.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-10-17T06:02:27.297 INFO:teuthology.orchestra.run.smithi125.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-10-17T06:02:27.297 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-10-17T06:02:27.297 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-10-17T06:02:27.297 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-10-17T06:02:27.297 INFO:teuthology.orchestra.run.smithi125.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-10-17T06:02:27.298 INFO:teuthology.orchestra.run.smithi125.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-10-17T06:02:27.298 INFO:teuthology.orchestra.run.smithi125.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-17T06:02:27.298 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-10-17T06:02:27.298 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-10-17T06:02:27.298 INFO:teuthology.orchestra.run.smithi125.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-10-17T06:02:27.299 INFO:teuthology.orchestra.run.smithi125.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-17T06:02:27.299 INFO:teuthology.orchestra.run.smithi125.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-17T06:02:27.299 INFO:teuthology.orchestra.run.smithi125.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-17T06:02:27.299 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-17T06:02:27.300 INFO:teuthology.orchestra.run.smithi125.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-17T06:02:27.300 INFO:teuthology.orchestra.run.smithi125.stdout:Suggested packages: 2023-10-17T06:02:27.300 INFO:teuthology.orchestra.run.smithi125.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-17T06:02:27.300 INFO:teuthology.orchestra.run.smithi125.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-17T06:02:27.300 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-17T06:02:27.301 INFO:teuthology.orchestra.run.smithi125.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-17T06:02:27.301 INFO:teuthology.orchestra.run.smithi125.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-17T06:02:27.301 INFO:teuthology.orchestra.run.smithi125.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-17T06:02:27.301 INFO:teuthology.orchestra.run.smithi125.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-17T06:02:27.301 INFO:teuthology.orchestra.run.smithi125.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-17T06:02:27.302 INFO:teuthology.orchestra.run.smithi125.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-17T06:02:27.302 INFO:teuthology.orchestra.run.smithi125.stdout:Recommended packages: 2023-10-17T06:02:27.302 INFO:teuthology.orchestra.run.smithi125.stdout: btrfs-tools 2023-10-17T06:02:27.349 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2023-10-17T06:02:27.350 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2023-10-17T06:02:27.499 INFO:teuthology.orchestra.run.smithi125.stdout:The following NEW packages will be installed: 2023-10-17T06:02:27.499 INFO:teuthology.orchestra.run.smithi125.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-17T06:02:27.500 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-17T06:02:27.500 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-17T06:02:27.500 INFO:teuthology.orchestra.run.smithi125.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-17T06:02:27.500 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-17T06:02:27.500 INFO:teuthology.orchestra.run.smithi125.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-17T06:02:27.501 INFO:teuthology.orchestra.run.smithi125.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-17T06:02:27.502 INFO:teuthology.orchestra.run.smithi125.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-17T06:02:27.502 INFO:teuthology.orchestra.run.smithi125.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-10-17T06:02:27.502 INFO:teuthology.orchestra.run.smithi125.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-10-17T06:02:27.503 INFO:teuthology.orchestra.run.smithi125.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-10-17T06:02:27.503 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-10-17T06:02:27.503 INFO:teuthology.orchestra.run.smithi125.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-17T06:02:27.503 INFO:teuthology.orchestra.run.smithi125.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-17T06:02:27.503 INFO:teuthology.orchestra.run.smithi125.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-17T06:02:27.504 INFO:teuthology.orchestra.run.smithi125.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-17T06:02:27.504 INFO:teuthology.orchestra.run.smithi125.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-17T06:02:27.504 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-17T06:02:27.504 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-17T06:02:27.504 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-17T06:02:27.505 INFO:teuthology.orchestra.run.smithi125.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-17T06:02:27.505 INFO:teuthology.orchestra.run.smithi125.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-17T06:02:27.505 INFO:teuthology.orchestra.run.smithi125.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-17T06:02:27.505 INFO:teuthology.orchestra.run.smithi125.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-17T06:02:27.505 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-17T06:02:27.506 INFO:teuthology.orchestra.run.smithi125.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-17T06:02:27.506 INFO:teuthology.orchestra.run.smithi125.stdout:The following packages will be upgraded: 2023-10-17T06:02:27.506 INFO:teuthology.orchestra.run.smithi125.stdout: librados2 librbd1 2023-10-17T06:02:27.530 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages were automatically installed and are no longer required: 2023-10-17T06:02:27.531 INFO:teuthology.orchestra.run.smithi184.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-17T06:02:27.531 INFO:teuthology.orchestra.run.smithi184.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-17T06:02:27.531 INFO:teuthology.orchestra.run.smithi184.stdout:The following additional packages will be installed: 2023-10-17T06:02:27.531 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-17T06:02:27.533 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-17T06:02:27.533 INFO:teuthology.orchestra.run.smithi184.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-17T06:02:27.534 INFO:teuthology.orchestra.run.smithi184.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-17T06:02:27.534 INFO:teuthology.orchestra.run.smithi184.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-17T06:02:27.534 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-17T06:02:27.534 INFO:teuthology.orchestra.run.smithi184.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-10-17T06:02:27.534 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-10-17T06:02:27.535 INFO:teuthology.orchestra.run.smithi184.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-10-17T06:02:27.535 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-10-17T06:02:27.535 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-10-17T06:02:27.535 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-10-17T06:02:27.535 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-10-17T06:02:27.535 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-10-17T06:02:27.536 INFO:teuthology.orchestra.run.smithi184.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-17T06:02:27.536 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-10-17T06:02:27.536 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-10-17T06:02:27.536 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-10-17T06:02:27.536 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-17T06:02:27.536 INFO:teuthology.orchestra.run.smithi184.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-17T06:02:27.537 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-17T06:02:27.537 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-17T06:02:27.537 INFO:teuthology.orchestra.run.smithi184.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-17T06:02:27.537 INFO:teuthology.orchestra.run.smithi184.stdout:Suggested packages: 2023-10-17T06:02:27.537 INFO:teuthology.orchestra.run.smithi184.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-17T06:02:27.537 INFO:teuthology.orchestra.run.smithi184.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-17T06:02:27.538 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-17T06:02:27.538 INFO:teuthology.orchestra.run.smithi184.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-17T06:02:27.538 INFO:teuthology.orchestra.run.smithi184.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-17T06:02:27.538 INFO:teuthology.orchestra.run.smithi184.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-17T06:02:27.538 INFO:teuthology.orchestra.run.smithi184.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-17T06:02:27.539 INFO:teuthology.orchestra.run.smithi184.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-17T06:02:27.539 INFO:teuthology.orchestra.run.smithi184.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-17T06:02:27.539 INFO:teuthology.orchestra.run.smithi184.stdout:Recommended packages: 2023-10-17T06:02:27.539 INFO:teuthology.orchestra.run.smithi184.stdout: btrfs-tools 2023-10-17T06:02:27.593 INFO:teuthology.orchestra.run.smithi125.stdout:2 upgraded, 116 newly installed, 0 to remove and 256 not upgraded. 2023-10-17T06:02:27.594 INFO:teuthology.orchestra.run.smithi125.stdout:Need to get 210 MB of archives. 2023-10-17T06:02:27.594 INFO:teuthology.orchestra.run.smithi125.stdout:After this operation, 1,040 MB of additional disk space will be used. 2023-10-17T06:02:27.594 INFO:teuthology.orchestra.run.smithi125.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-17T06:02:27.616 INFO:teuthology.orchestra.run.smithi125.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-17T06:02:27.624 INFO:teuthology.orchestra.run.smithi125.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-17T06:02:27.657 INFO:teuthology.orchestra.run.smithi125.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-17T06:02:27.690 INFO:teuthology.orchestra.run.smithi125.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-17T06:02:27.694 INFO:teuthology.orchestra.run.smithi125.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-17T06:02:27.710 INFO:teuthology.orchestra.run.smithi125.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-17T06:02:27.725 INFO:teuthology.orchestra.run.smithi125.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-5610-g6f3e6b48-1focal [3,591 kB] 2023-10-17T06:02:27.738 INFO:teuthology.orchestra.run.smithi184.stdout:The following NEW packages will be installed: 2023-10-17T06:02:27.739 INFO:teuthology.orchestra.run.smithi184.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-17T06:02:27.739 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-17T06:02:27.739 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-17T06:02:27.741 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-17T06:02:27.741 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-17T06:02:27.742 INFO:teuthology.orchestra.run.smithi184.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-17T06:02:27.742 INFO:teuthology.orchestra.run.smithi184.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-17T06:02:27.742 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-17T06:02:27.742 INFO:teuthology.orchestra.run.smithi184.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-10-17T06:02:27.742 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-10-17T06:02:27.743 INFO:teuthology.orchestra.run.smithi184.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-10-17T06:02:27.743 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-10-17T06:02:27.743 INFO:teuthology.orchestra.run.smithi184.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-17T06:02:27.743 INFO:teuthology.orchestra.run.smithi184.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-17T06:02:27.743 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-17T06:02:27.744 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-17T06:02:27.744 INFO:teuthology.orchestra.run.smithi184.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-17T06:02:27.744 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-17T06:02:27.744 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-17T06:02:27.744 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-17T06:02:27.744 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-17T06:02:27.745 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-17T06:02:27.745 INFO:teuthology.orchestra.run.smithi184.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-17T06:02:27.745 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-17T06:02:27.745 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-17T06:02:27.745 INFO:teuthology.orchestra.run.smithi184.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-17T06:02:27.746 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages will be upgraded: 2023-10-17T06:02:27.746 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 librbd1 2023-10-17T06:02:27.761 INFO:teuthology.orchestra.run.smithi125.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-17T06:02:27.764 INFO:teuthology.orchestra.run.smithi125.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-17T06:02:27.771 INFO:teuthology.orchestra.run.smithi125.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-17T06:02:27.774 INFO:teuthology.orchestra.run.smithi125.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-17T06:02:27.774 INFO:teuthology.orchestra.run.smithi125.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-17T06:02:27.775 INFO:teuthology.orchestra.run.smithi125.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-17T06:02:27.776 INFO:teuthology.orchestra.run.smithi125.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-17T06:02:27.780 INFO:teuthology.orchestra.run.smithi125.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-17T06:02:27.780 INFO:teuthology.orchestra.run.smithi125.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-17T06:02:27.782 INFO:teuthology.orchestra.run.smithi125.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-17T06:02:27.802 INFO:teuthology.orchestra.run.smithi125.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-17T06:02:27.803 INFO:teuthology.orchestra.run.smithi125.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-17T06:02:27.805 INFO:teuthology.orchestra.run.smithi125.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-17T06:02:27.807 INFO:teuthology.orchestra.run.smithi125.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-17T06:02:27.808 INFO:teuthology.orchestra.run.smithi125.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-17T06:02:27.809 INFO:teuthology.orchestra.run.smithi125.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-17T06:02:27.811 INFO:teuthology.orchestra.run.smithi125.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-17T06:02:27.812 INFO:teuthology.orchestra.run.smithi125.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-17T06:02:27.821 INFO:teuthology.orchestra.run.smithi125.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-17T06:02:27.823 INFO:teuthology.orchestra.run.smithi125.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-17T06:02:27.842 INFO:teuthology.orchestra.run.smithi125.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-17T06:02:27.853 INFO:teuthology.orchestra.run.smithi125.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-17T06:02:27.853 INFO:teuthology.orchestra.run.smithi125.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-17T06:02:27.854 INFO:teuthology.orchestra.run.smithi125.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-17T06:02:27.854 INFO:teuthology.orchestra.run.smithi125.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-17T06:02:27.855 INFO:teuthology.orchestra.run.smithi125.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-17T06:02:27.857 INFO:teuthology.orchestra.run.smithi125.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-17T06:02:27.860 INFO:teuthology.orchestra.run.smithi125.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-17T06:02:27.862 INFO:teuthology.orchestra.run.smithi125.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-10-17T06:02:27.864 INFO:teuthology.orchestra.run.smithi125.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-17T06:02:27.882 INFO:teuthology.orchestra.run.smithi125.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-17T06:02:27.883 INFO:teuthology.orchestra.run.smithi125.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-17T06:02:27.884 INFO:teuthology.orchestra.run.smithi125.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-17T06:02:27.886 INFO:teuthology.orchestra.run.smithi125.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-17T06:02:27.890 INFO:teuthology.orchestra.run.smithi125.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-17T06:02:27.893 INFO:teuthology.orchestra.run.smithi125.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-17T06:02:27.895 INFO:teuthology.orchestra.run.smithi125.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-17T06:02:27.896 INFO:teuthology.orchestra.run.smithi125.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-17T06:02:27.901 INFO:teuthology.orchestra.run.smithi125.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-17T06:02:27.928 INFO:teuthology.orchestra.run.smithi184.stdout:2 upgraded, 116 newly installed, 0 to remove and 256 not upgraded. 2023-10-17T06:02:27.928 INFO:teuthology.orchestra.run.smithi184.stdout:Need to get 210 MB of archives. 2023-10-17T06:02:27.929 INFO:teuthology.orchestra.run.smithi184.stdout:After this operation, 1,040 MB of additional disk space will be used. 2023-10-17T06:02:27.929 INFO:teuthology.orchestra.run.smithi184.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-5610-g6f3e6b48-1focal [3,591 kB] 2023-10-17T06:02:27.959 INFO:teuthology.orchestra.run.smithi184.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-17T06:02:28.009 INFO:teuthology.orchestra.run.smithi125.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-17T06:02:28.028 INFO:teuthology.orchestra.run.smithi125.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-17T06:02:28.030 INFO:teuthology.orchestra.run.smithi125.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-17T06:02:28.047 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-17T06:02:28.049 INFO:teuthology.orchestra.run.smithi125.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-17T06:02:28.050 INFO:teuthology.orchestra.run.smithi125.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-17T06:02:28.050 INFO:teuthology.orchestra.run.smithi125.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-17T06:02:28.051 INFO:teuthology.orchestra.run.smithi125.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-17T06:02:28.052 INFO:teuthology.orchestra.run.smithi125.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-17T06:02:28.053 INFO:teuthology.orchestra.run.smithi125.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-17T06:02:28.053 INFO:teuthology.orchestra.run.smithi125.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-17T06:02:28.058 INFO:teuthology.orchestra.run.smithi125.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-17T06:02:28.058 INFO:teuthology.orchestra.run.smithi125.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-17T06:02:28.078 INFO:teuthology.orchestra.run.smithi125.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-17T06:02:28.078 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-17T06:02:28.084 INFO:teuthology.orchestra.run.smithi125.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-17T06:02:28.086 INFO:teuthology.orchestra.run.smithi125.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-17T06:02:28.089 INFO:teuthology.orchestra.run.smithi125.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-17T06:02:28.090 INFO:teuthology.orchestra.run.smithi125.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-17T06:02:28.090 INFO:teuthology.orchestra.run.smithi125.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-5610-g6f3e6b48-1focal [4,010 kB] 2023-10-17T06:02:28.093 INFO:teuthology.orchestra.run.smithi125.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-17T06:02:28.096 INFO:teuthology.orchestra.run.smithi125.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-17T06:02:28.097 INFO:teuthology.orchestra.run.smithi125.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-17T06:02:28.115 INFO:teuthology.orchestra.run.smithi125.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-17T06:02:28.117 INFO:teuthology.orchestra.run.smithi125.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-10-17T06:02:28.127 INFO:teuthology.orchestra.run.smithi125.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-17T06:02:28.181 INFO:teuthology.orchestra.run.smithi125.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-17T06:02:28.182 INFO:teuthology.orchestra.run.smithi125.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-17T06:02:28.183 INFO:teuthology.orchestra.run.smithi125.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-17T06:02:28.183 INFO:teuthology.orchestra.run.smithi125.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-17T06:02:28.184 INFO:teuthology.orchestra.run.smithi125.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-17T06:02:28.185 INFO:teuthology.orchestra.run.smithi125.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-17T06:02:28.203 INFO:teuthology.orchestra.run.smithi125.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-17T06:02:28.203 INFO:teuthology.orchestra.run.smithi125.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-17T06:02:28.204 INFO:teuthology.orchestra.run.smithi125.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-17T06:02:28.204 INFO:teuthology.orchestra.run.smithi125.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-17T06:02:28.221 INFO:teuthology.orchestra.run.smithi125.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-17T06:02:28.222 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-17T06:02:28.223 INFO:teuthology.orchestra.run.smithi125.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-17T06:02:28.224 INFO:teuthology.orchestra.run.smithi125.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-17T06:02:28.228 INFO:teuthology.orchestra.run.smithi125.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-17T06:02:28.229 INFO:teuthology.orchestra.run.smithi125.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-17T06:02:28.352 INFO:teuthology.orchestra.run.smithi125.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-5610-g6f3e6b48-1focal [736 kB] 2023-10-17T06:02:28.362 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-17T06:02:28.381 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-17T06:02:28.395 INFO:teuthology.orchestra.run.smithi125.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-5610-g6f3e6b48-1focal [378 kB] 2023-10-17T06:02:28.415 INFO:teuthology.orchestra.run.smithi125.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-5610-g6f3e6b48-1focal [22.5 kB] 2023-10-17T06:02:28.438 INFO:teuthology.orchestra.run.smithi125.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-5610-g6f3e6b48-1focal [191 kB] 2023-10-17T06:02:28.443 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-17T06:02:28.444 INFO:teuthology.orchestra.run.smithi125.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-5610-g6f3e6b48-1focal [51.7 kB] 2023-10-17T06:02:28.493 INFO:teuthology.orchestra.run.smithi125.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-5610-g6f3e6b48-1focal [355 kB] 2023-10-17T06:02:28.534 INFO:teuthology.orchestra.run.smithi125.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-5610-g6f3e6b48-1focal [6,829 kB] 2023-10-17T06:02:28.645 INFO:teuthology.orchestra.run.smithi184.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-17T06:02:28.653 INFO:teuthology.orchestra.run.smithi184.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-17T06:02:28.679 INFO:teuthology.orchestra.run.smithi184.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-17T06:02:28.688 INFO:teuthology.orchestra.run.smithi184.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-17T06:02:28.853 INFO:teuthology.orchestra.run.smithi184.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-17T06:02:28.883 INFO:teuthology.orchestra.run.smithi184.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-5610-g6f3e6b48-1focal [4,010 kB] 2023-10-17T06:02:28.884 INFO:teuthology.orchestra.run.smithi125.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-5610-g6f3e6b48-1focal [103 kB] 2023-10-17T06:02:28.897 INFO:teuthology.orchestra.run.smithi125.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-5610-g6f3e6b48-1focal [464 kB] 2023-10-17T06:02:28.910 INFO:teuthology.orchestra.run.smithi125.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-5610-g6f3e6b48-1focal [25.7 MB] 2023-10-17T06:02:29.226 INFO:teuthology.orchestra.run.smithi184.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-17T06:02:29.248 INFO:teuthology.orchestra.run.smithi184.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-17T06:02:29.359 INFO:teuthology.orchestra.run.smithi184.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-5610-g6f3e6b48-1focal [736 kB] 2023-10-17T06:02:29.428 INFO:teuthology.orchestra.run.smithi184.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-17T06:02:29.438 INFO:teuthology.orchestra.run.smithi184.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-17T06:02:29.478 INFO:teuthology.orchestra.run.smithi184.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-17T06:02:29.478 INFO:teuthology.orchestra.run.smithi184.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-5610-g6f3e6b48-1focal [378 kB] 2023-10-17T06:02:29.482 INFO:teuthology.orchestra.run.smithi184.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-17T06:02:29.485 INFO:teuthology.orchestra.run.smithi184.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-17T06:02:29.488 INFO:teuthology.orchestra.run.smithi184.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-17T06:02:29.496 INFO:teuthology.orchestra.run.smithi184.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-17T06:02:29.498 INFO:teuthology.orchestra.run.smithi184.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-17T06:02:29.540 INFO:teuthology.orchestra.run.smithi184.stdout:Get:27 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-5610-g6f3e6b48-1focal [22.5 kB] 2023-10-17T06:02:29.542 INFO:teuthology.orchestra.run.smithi184.stdout:Get:28 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-5610-g6f3e6b48-1focal [191 kB] 2023-10-17T06:02:29.550 INFO:teuthology.orchestra.run.smithi184.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-5610-g6f3e6b48-1focal [51.7 kB] 2023-10-17T06:02:29.552 INFO:teuthology.orchestra.run.smithi184.stdout:Get:30 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-5610-g6f3e6b48-1focal [355 kB] 2023-10-17T06:02:29.615 INFO:teuthology.orchestra.run.smithi184.stdout:Get:31 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-5610-g6f3e6b48-1focal [6,829 kB] 2023-10-17T06:02:29.663 INFO:teuthology.orchestra.run.smithi184.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-17T06:02:30.009 INFO:teuthology.orchestra.run.smithi184.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-17T06:02:30.033 INFO:teuthology.orchestra.run.smithi184.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-17T06:02:30.104 INFO:teuthology.orchestra.run.smithi125.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-5610-g6f3e6b48-1focal [11.0 MB] 2023-10-17T06:02:30.106 INFO:teuthology.orchestra.run.smithi184.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-17T06:02:30.171 INFO:teuthology.orchestra.run.smithi184.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-17T06:02:30.179 INFO:teuthology.orchestra.run.smithi184.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-17T06:02:30.269 INFO:teuthology.orchestra.run.smithi184.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-5610-g6f3e6b48-1focal [103 kB] 2023-10-17T06:02:30.271 INFO:teuthology.orchestra.run.smithi184.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-5610-g6f3e6b48-1focal [464 kB] 2023-10-17T06:02:30.286 INFO:teuthology.orchestra.run.smithi184.stdout:Get:40 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-5610-g6f3e6b48-1focal [25.7 MB] 2023-10-17T06:02:30.300 INFO:teuthology.orchestra.run.smithi184.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-17T06:02:30.300 INFO:teuthology.orchestra.run.smithi184.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-17T06:02:30.304 INFO:teuthology.orchestra.run.smithi184.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-17T06:02:30.308 INFO:teuthology.orchestra.run.smithi184.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-17T06:02:30.320 INFO:teuthology.orchestra.run.smithi184.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-17T06:02:30.507 INFO:teuthology.orchestra.run.smithi184.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-17T06:02:30.733 INFO:teuthology.orchestra.run.smithi125.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-5610-g6f3e6b48-1focal [224 kB] 2023-10-17T06:02:30.766 INFO:teuthology.orchestra.run.smithi125.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-5610-g6f3e6b48-1focal [135 kB] 2023-10-17T06:02:30.770 INFO:teuthology.orchestra.run.smithi125.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-5610-g6f3e6b48-1focal [1,564 kB] 2023-10-17T06:02:30.876 INFO:teuthology.orchestra.run.smithi125.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-5610-g6f3e6b48-1focal [9,388 kB] 2023-10-17T06:02:30.956 INFO:teuthology.orchestra.run.smithi184.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-17T06:02:30.968 INFO:teuthology.orchestra.run.smithi184.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-10-17T06:02:31.014 INFO:teuthology.orchestra.run.smithi184.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-17T06:02:31.058 INFO:teuthology.orchestra.run.smithi184.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-17T06:02:31.067 INFO:teuthology.orchestra.run.smithi184.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-17T06:02:31.073 INFO:teuthology.orchestra.run.smithi184.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-17T06:02:31.076 INFO:teuthology.orchestra.run.smithi184.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-17T06:02:31.103 INFO:teuthology.orchestra.run.smithi184.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-17T06:02:31.124 INFO:teuthology.orchestra.run.smithi184.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-17T06:02:31.135 INFO:teuthology.orchestra.run.smithi184.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-17T06:02:31.301 INFO:teuthology.orchestra.run.smithi184.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-17T06:02:31.495 INFO:teuthology.orchestra.run.smithi184.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-17T06:02:31.678 INFO:teuthology.orchestra.run.smithi125.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-5610-g6f3e6b48-1focal [31.4 MB] 2023-10-17T06:02:31.809 INFO:teuthology.orchestra.run.smithi184.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-5610-g6f3e6b48-1focal [11.0 MB] 2023-10-17T06:02:32.379 INFO:teuthology.orchestra.run.smithi184.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-17T06:02:32.425 INFO:teuthology.orchestra.run.smithi184.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-5610-g6f3e6b48-1focal [224 kB] 2023-10-17T06:02:32.437 INFO:teuthology.orchestra.run.smithi184.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-5610-g6f3e6b48-1focal [135 kB] 2023-10-17T06:02:32.443 INFO:teuthology.orchestra.run.smithi184.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-5610-g6f3e6b48-1focal [1,564 kB] 2023-10-17T06:02:32.453 INFO:teuthology.orchestra.run.smithi184.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-17T06:02:32.455 INFO:teuthology.orchestra.run.smithi184.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-17T06:02:32.523 INFO:teuthology.orchestra.run.smithi184.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-17T06:02:32.523 INFO:teuthology.orchestra.run.smithi184.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-17T06:02:32.524 INFO:teuthology.orchestra.run.smithi184.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-17T06:02:32.524 INFO:teuthology.orchestra.run.smithi184.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-17T06:02:32.525 INFO:teuthology.orchestra.run.smithi184.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-17T06:02:32.526 INFO:teuthology.orchestra.run.smithi184.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-17T06:02:32.545 INFO:teuthology.orchestra.run.smithi184.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-5610-g6f3e6b48-1focal [9,388 kB] 2023-10-17T06:02:32.690 INFO:teuthology.orchestra.run.smithi184.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-17T06:02:33.032 INFO:teuthology.orchestra.run.smithi184.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-17T06:02:33.046 INFO:teuthology.orchestra.run.smithi184.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-17T06:02:33.073 INFO:teuthology.orchestra.run.smithi184.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-17T06:02:33.133 INFO:teuthology.orchestra.run.smithi184.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-5610-g6f3e6b48-1focal [31.4 MB] 2023-10-17T06:02:33.234 INFO:teuthology.orchestra.run.smithi184.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-17T06:02:33.281 INFO:teuthology.orchestra.run.smithi184.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-17T06:02:33.309 INFO:teuthology.orchestra.run.smithi184.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-17T06:02:33.317 INFO:teuthology.orchestra.run.smithi184.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-17T06:02:33.362 INFO:teuthology.orchestra.run.smithi184.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-17T06:02:33.392 INFO:teuthology.orchestra.run.smithi184.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-17T06:02:33.393 INFO:teuthology.orchestra.run.smithi184.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-17T06:02:33.684 INFO:teuthology.orchestra.run.smithi184.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-17T06:02:33.956 INFO:teuthology.orchestra.run.smithi125.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-5610-g6f3e6b48-1focal [3,808 B] 2023-10-17T06:02:33.957 INFO:teuthology.orchestra.run.smithi125.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-5610-g6f3e6b48-1focal [846 kB] 2023-10-17T06:02:34.010 INFO:teuthology.orchestra.run.smithi125.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-5610-g6f3e6b48-1focal [2,299 kB] 2023-10-17T06:02:34.162 INFO:teuthology.orchestra.run.smithi125.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-5610-g6f3e6b48-1focal [227 kB] 2023-10-17T06:02:34.169 INFO:teuthology.orchestra.run.smithi125.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-5610-g6f3e6b48-1focal [126 kB] 2023-10-17T06:02:34.172 INFO:teuthology.orchestra.run.smithi125.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-5610-g6f3e6b48-1focal [1,817 kB] 2023-10-17T06:02:34.179 INFO:teuthology.orchestra.run.smithi184.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-10-17T06:02:34.233 INFO:teuthology.orchestra.run.smithi125.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-5610-g6f3e6b48-1focal [7,890 kB] 2023-10-17T06:02:34.240 INFO:teuthology.orchestra.run.smithi184.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-17T06:02:34.586 INFO:teuthology.orchestra.run.smithi184.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-17T06:02:34.588 INFO:teuthology.orchestra.run.smithi184.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-17T06:02:34.588 INFO:teuthology.orchestra.run.smithi184.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-17T06:02:34.589 INFO:teuthology.orchestra.run.smithi184.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-17T06:02:34.590 INFO:teuthology.orchestra.run.smithi184.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-17T06:02:34.591 INFO:teuthology.orchestra.run.smithi184.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-17T06:02:34.634 INFO:teuthology.orchestra.run.smithi184.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-17T06:02:34.634 INFO:teuthology.orchestra.run.smithi184.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-17T06:02:34.779 INFO:teuthology.orchestra.run.smithi125.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-5610-g6f3e6b48-1focal [3,932 B] 2023-10-17T06:02:34.780 INFO:teuthology.orchestra.run.smithi125.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-5610-g6f3e6b48-1focal [50.8 MB] 2023-10-17T06:02:34.799 INFO:teuthology.orchestra.run.smithi184.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-17T06:02:34.969 INFO:teuthology.orchestra.run.smithi184.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-17T06:02:35.171 INFO:teuthology.orchestra.run.smithi184.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-5610-g6f3e6b48-1focal [3,808 B] 2023-10-17T06:02:35.171 INFO:teuthology.orchestra.run.smithi184.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-5610-g6f3e6b48-1focal [846 kB] 2023-10-17T06:02:35.205 INFO:teuthology.orchestra.run.smithi184.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-17T06:02:35.210 INFO:teuthology.orchestra.run.smithi184.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-5610-g6f3e6b48-1focal [2,299 kB] 2023-10-17T06:02:35.255 INFO:teuthology.orchestra.run.smithi184.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-17T06:02:35.268 INFO:teuthology.orchestra.run.smithi184.stdout:Get:103 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-17T06:02:35.333 INFO:teuthology.orchestra.run.smithi184.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-17T06:02:35.342 INFO:teuthology.orchestra.run.smithi184.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-5610-g6f3e6b48-1focal [227 kB] 2023-10-17T06:02:35.347 INFO:teuthology.orchestra.run.smithi184.stdout:Get:106 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-17T06:02:35.348 INFO:teuthology.orchestra.run.smithi184.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-5610-g6f3e6b48-1focal [126 kB] 2023-10-17T06:02:35.354 INFO:teuthology.orchestra.run.smithi184.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-5610-g6f3e6b48-1focal [1,817 kB] 2023-10-17T06:02:35.469 INFO:teuthology.orchestra.run.smithi184.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-5610-g6f3e6b48-1focal [7,890 kB] 2023-10-17T06:02:35.956 INFO:teuthology.orchestra.run.smithi184.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-5610-g6f3e6b48-1focal [3,932 B] 2023-10-17T06:02:35.956 INFO:teuthology.orchestra.run.smithi184.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-5610-g6f3e6b48-1focal [50.8 MB] 2023-10-17T06:02:38.457 INFO:teuthology.orchestra.run.smithi125.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-5610-g6f3e6b48-1focal [222 kB] 2023-10-17T06:02:38.459 INFO:teuthology.orchestra.run.smithi125.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-5610-g6f3e6b48-1focal [258 kB] 2023-10-17T06:02:38.461 INFO:teuthology.orchestra.run.smithi125.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-5610-g6f3e6b48-1focal [23.3 kB] 2023-10-17T06:02:38.462 INFO:teuthology.orchestra.run.smithi125.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-5610-g6f3e6b48-1focal [12.9 kB] 2023-10-17T06:02:38.462 INFO:teuthology.orchestra.run.smithi125.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-5610-g6f3e6b48-1focal [28.1 kB] 2023-10-17T06:02:38.462 INFO:teuthology.orchestra.run.smithi125.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-5610-g6f3e6b48-1focal [13.8 MB] 2023-10-17T06:02:39.066 INFO:teuthology.orchestra.run.smithi184.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-5610-g6f3e6b48-1focal [222 kB] 2023-10-17T06:02:39.067 INFO:teuthology.orchestra.run.smithi184.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-5610-g6f3e6b48-1focal [258 kB] 2023-10-17T06:02:39.070 INFO:teuthology.orchestra.run.smithi184.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-5610-g6f3e6b48-1focal [23.3 kB] 2023-10-17T06:02:39.070 INFO:teuthology.orchestra.run.smithi184.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-5610-g6f3e6b48-1focal [12.9 kB] 2023-10-17T06:02:39.071 INFO:teuthology.orchestra.run.smithi184.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-5610-g6f3e6b48-1focal [28.1 kB] 2023-10-17T06:02:39.071 INFO:teuthology.orchestra.run.smithi184.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-5610-g6f3e6b48-1focal [13.8 MB] 2023-10-17T06:02:39.473 INFO:teuthology.orchestra.run.smithi125.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-5610-g6f3e6b48-1focal [96.3 kB] 2023-10-17T06:02:39.713 INFO:teuthology.orchestra.run.smithi184.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-5610-g6f3e6b48-1focal [96.3 kB] 2023-10-17T06:02:40.399 INFO:teuthology.orchestra.run.smithi125.stdout:Fetched 210 MB in 12s (17.6 MB/s) 2023-10-17T06:02:40.576 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-17T06:02:40.646 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 210 MB in 12s (17.6 MB/s) 2023-10-17T06:02:40.648 INFO:teuthology.orchestra.run.smithi125.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107758 files and directories currently installed.) 2023-10-17T06:02:40.651 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-17T06:02:40.697 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-17T06:02:40.824 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-17T06:02:40.896 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107758 files and directories currently installed.) 2023-10-17T06:02:40.900 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-17T06:02:40.937 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-17T06:02:41.050 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-17T06:02:41.072 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-17T06:02:41.117 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-17T06:02:41.265 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-17T06:02:41.278 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-17T06:02:41.323 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-17T06:02:41.453 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-cmd2. 2023-10-17T06:02:41.471 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-17T06:02:41.631 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-17T06:02:41.684 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cmd2. 2023-10-17T06:02:41.704 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-17T06:02:41.743 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-17T06:02:42.130 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-17T06:02:42.146 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-17T06:02:42.181 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-17T06:02:42.199 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-17T06:02:42.229 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-17T06:02:42.281 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-17T06:02:42.608 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-17T06:02:42.626 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-17T06:02:42.666 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-17T06:02:42.685 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-17T06:02:42.703 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-17T06:02:42.743 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-17T06:02:43.037 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-17T06:02:43.054 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-17T06:02:43.121 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-17T06:02:43.127 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-17T06:02:43.140 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-17T06:02:43.170 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-17T06:02:43.657 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-17T06:02:43.677 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-17T06:02:43.716 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-17T06:02:43.733 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-17T06:02:43.734 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-17T06:02:43.801 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-17T06:02:44.293 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-17T06:02:44.312 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-17T06:02:44.376 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-17T06:02:44.394 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-17T06:02:44.409 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-17T06:02:44.453 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-17T06:02:44.814 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-17T06:02:44.837 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-17T06:02:44.856 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-17T06:02:44.873 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-17T06:02:44.880 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-17T06:02:44.914 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-17T06:02:45.292 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-17T06:02:45.312 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-17T06:02:45.350 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-17T06:02:45.368 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-17T06:02:45.389 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-17T06:02:45.434 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-17T06:02:45.799 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../010-librbd1_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:45.841 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../010-librbd1_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:45.921 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librbd1 (18.0.0-5610-g6f3e6b48-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-17T06:02:45.995 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking librbd1 (18.0.0-5610-g6f3e6b48-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-17T06:02:46.704 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../011-librados2_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:46.808 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librados2 (18.0.0-5610-g6f3e6b48-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-17T06:02:46.819 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../011-librados2_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:46.958 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking librados2 (18.0.0-5610-g6f3e6b48-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-17T06:02:47.613 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libcephfs2. 2023-10-17T06:02:47.634 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:47.712 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libcephfs2 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:47.779 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libcephfs2. 2023-10-17T06:02:47.800 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:47.870 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libcephfs2 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:48.082 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rados. 2023-10-17T06:02:48.094 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../013-python3-rados_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:48.156 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rados (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:48.240 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-rados. 2023-10-17T06:02:48.258 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../013-python3-rados_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:48.298 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-rados (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:48.559 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-17T06:02:48.580 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-17T06:02:48.618 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-ceph-argparse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:48.701 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-17T06:02:48.723 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-17T06:02:48.768 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-ceph-argparse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:48.905 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cephfs. 2023-10-17T06:02:48.925 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:48.988 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cephfs (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:49.054 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-cephfs. 2023-10-17T06:02:49.075 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:49.120 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-cephfs (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:49.391 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-17T06:02:49.413 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-17T06:02:49.457 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-ceph-common (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:49.465 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-17T06:02:49.484 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-17T06:02:49.522 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-ceph-common (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:49.843 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-prettytable. 2023-10-17T06:02:49.862 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-10-17T06:02:49.904 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-17T06:02:49.918 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-prettytable. 2023-10-17T06:02:49.938 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-10-17T06:02:49.976 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-17T06:02:50.215 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rbd. 2023-10-17T06:02:50.237 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:50.270 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-rbd. 2023-10-17T06:02:50.281 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rbd (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:50.290 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:50.328 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-rbd (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:50.714 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-17T06:02:50.732 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-17T06:02:50.772 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-17T06:02:50.900 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-17T06:02:50.920 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-17T06:02:50.958 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-17T06:02:51.151 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-17T06:02:51.171 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-17T06:02:51.209 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-17T06:02:51.378 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-17T06:02:51.400 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-17T06:02:51.469 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-17T06:02:51.612 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-17T06:02:51.631 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-17T06:02:51.703 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-17T06:02:51.865 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-17T06:02:51.883 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-17T06:02:51.922 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-17T06:02:52.106 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package librgw2. 2023-10-17T06:02:52.124 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../022-librgw2_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:52.164 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking librgw2 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:52.350 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package librgw2. 2023-10-17T06:02:52.368 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../022-librgw2_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:52.408 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking librgw2 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:53.109 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-rgw. 2023-10-17T06:02:53.133 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:53.175 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-rgw (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:53.369 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rgw. 2023-10-17T06:02:53.389 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:53.427 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rgw (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:53.553 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package liboath0. 2023-10-17T06:02:53.571 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-17T06:02:53.636 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-17T06:02:53.830 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liboath0. 2023-10-17T06:02:53.849 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-17T06:02:53.888 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-17T06:02:54.005 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libradosstriper1. 2023-10-17T06:02:54.025 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:54.063 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libradosstriper1 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:54.274 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libradosstriper1. 2023-10-17T06:02:54.295 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:54.366 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libradosstriper1 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:54.528 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-common. 2023-10-17T06:02:54.549 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../026-ceph-common_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:54.585 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-common (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:54.894 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-common. 2023-10-17T06:02:54.914 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../026-ceph-common_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:54.952 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-common (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:57.616 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-base. 2023-10-17T06:02:57.637 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../027-ceph-base_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:57.706 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-base (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:57.866 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-base. 2023-10-17T06:02:57.886 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../027-ceph-base_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:02:57.945 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-base (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:02:59.203 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-17T06:02:59.222 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-17T06:02:59.261 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-17T06:02:59.412 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-17T06:02:59.432 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-17T06:02:59.470 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-17T06:02:59.657 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-natsort. 2023-10-17T06:02:59.673 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-10-17T06:02:59.714 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-17T06:02:59.806 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-natsort. 2023-10-17T06:02:59.829 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-10-17T06:02:59.873 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-17T06:03:00.101 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-logutils. 2023-10-17T06:03:00.117 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-10-17T06:03:00.159 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-17T06:03:00.251 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-logutils. 2023-10-17T06:03:00.271 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-10-17T06:03:00.309 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-17T06:03:00.554 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-17T06:03:00.571 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-17T06:03:00.611 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-17T06:03:00.679 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-17T06:03:00.700 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-17T06:03:00.745 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-17T06:03:01.115 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-mako. 2023-10-17T06:03:01.135 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-17T06:03:01.172 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-17T06:03:01.568 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-17T06:03:01.588 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-17T06:03:01.624 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-mako. 2023-10-17T06:03:01.642 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-17T06:03:01.644 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-17T06:03:01.681 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-17T06:03:02.004 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-17T06:03:02.025 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-17T06:03:02.043 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-17T06:03:02.063 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-17T06:03:02.070 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-17T06:03:02.121 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-17T06:03:02.440 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-webob. 2023-10-17T06:03:02.459 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-17T06:03:02.463 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-17T06:03:02.482 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-17T06:03:02.497 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-17T06:03:02.565 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-17T06:03:02.876 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-17T06:03:02.896 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-17T06:03:02.907 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-webob. 2023-10-17T06:03:02.928 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-17T06:03:02.933 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-17T06:03:02.990 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-17T06:03:03.295 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-bs4. 2023-10-17T06:03:03.315 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-10-17T06:03:03.353 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-17T06:03:03.371 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-17T06:03:03.389 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-17T06:03:03.434 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-17T06:03:03.748 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-waitress. 2023-10-17T06:03:03.768 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-17T06:03:03.804 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-bs4. 2023-10-17T06:03:03.813 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-17T06:03:03.823 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-10-17T06:03:03.862 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-17T06:03:04.226 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-tempita. 2023-10-17T06:03:04.247 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-10-17T06:03:04.282 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-waitress. 2023-10-17T06:03:04.301 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-17T06:03:04.317 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-17T06:03:04.347 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-17T06:03:04.645 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-paste. 2023-10-17T06:03:04.663 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-17T06:03:04.728 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-17T06:03:04.735 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-tempita. 2023-10-17T06:03:04.755 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-10-17T06:03:04.793 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-17T06:03:05.115 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-17T06:03:05.135 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-17T06:03:05.154 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-paste. 2023-10-17T06:03:05.172 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-17T06:03:05.173 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-17T06:03:05.212 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-17T06:03:05.551 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-17T06:03:05.571 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-17T06:03:05.607 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-17T06:03:05.609 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-17T06:03:05.628 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-17T06:03:05.665 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-17T06:03:05.987 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-webtest. 2023-10-17T06:03:06.001 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-10-17T06:03:06.010 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-17T06:03:06.030 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-17T06:03:06.045 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-17T06:03:06.067 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-17T06:03:06.407 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pecan. 2023-10-17T06:03:06.424 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-17T06:03:06.446 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-webtest. 2023-10-17T06:03:06.462 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-10-17T06:03:06.464 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-17T06:03:06.504 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-17T06:03:06.865 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pecan. 2023-10-17T06:03:06.882 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-17T06:03:06.894 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-17T06:03:06.915 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-17T06:03:06.922 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-17T06:03:06.952 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-17T06:03:07.322 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-17T06:03:07.343 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-17T06:03:07.344 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-17T06:03:07.366 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-17T06:03:07.405 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mgr-modules-core (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:07.410 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-17T06:03:07.789 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-17T06:03:07.809 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-17T06:03:07.843 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-17T06:03:07.847 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-modules-core (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:07.864 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:07.901 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:08.238 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-cryptography. 2023-10-17T06:03:08.259 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-17T06:03:08.304 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-17T06:03:08.310 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-17T06:03:08.329 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:08.393 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:08.724 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-openssl. 2023-10-17T06:03:08.741 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-17T06:03:08.746 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cryptography. 2023-10-17T06:03:08.766 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-17T06:03:08.782 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-17T06:03:08.829 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-17T06:03:09.186 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mgr. 2023-10-17T06:03:09.208 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:09.251 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mgr (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:09.266 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-openssl. 2023-10-17T06:03:09.286 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-17T06:03:09.324 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-17T06:03:09.738 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mon. 2023-10-17T06:03:09.758 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:09.761 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr. 2023-10-17T06:03:09.781 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:09.796 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mon (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:09.818 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:10.339 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mon. 2023-10-17T06:03:10.358 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:10.396 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mon (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:11.075 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-osd. 2023-10-17T06:03:11.095 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:11.132 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-osd (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:11.709 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-osd. 2023-10-17T06:03:11.727 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:11.799 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-osd (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:13.961 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph. 2023-10-17T06:03:13.980 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../053-ceph_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:14.019 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:14.413 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-fuse. 2023-10-17T06:03:14.434 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:14.479 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-fuse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:14.553 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph. 2023-10-17T06:03:14.574 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../053-ceph_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:14.619 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:14.932 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mds. 2023-10-17T06:03:14.945 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:14.990 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mds (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:15.005 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-fuse. 2023-10-17T06:03:15.027 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:15.071 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-fuse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:15.516 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mds. 2023-10-17T06:03:15.534 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:15.577 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package cephadm. 2023-10-17T06:03:15.590 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../056-cephadm_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:15.599 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mds (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:15.635 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking cephadm (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:15.996 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-17T06:03:16.017 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-10-17T06:03:16.079 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-10-17T06:03:16.185 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package cephadm. 2023-10-17T06:03:16.202 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../056-cephadm_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:16.243 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking cephadm (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:16.507 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-jinja2. 2023-10-17T06:03:16.527 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-10-17T06:03:16.565 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-17T06:03:16.622 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-17T06:03:16.641 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-10-17T06:03:16.679 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-10-17T06:03:16.952 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-17T06:03:16.972 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-17T06:03:17.009 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mgr-cephadm (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:17.126 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jinja2. 2023-10-17T06:03:17.127 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-10-17T06:03:17.157 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-17T06:03:17.405 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-17T06:03:17.424 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-17T06:03:17.462 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-17T06:03:17.577 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-17T06:03:17.597 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-17T06:03:17.668 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-cephadm (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:17.807 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-jwt. 2023-10-17T06:03:17.827 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-17T06:03:17.865 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-17T06:03:18.079 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-17T06:03:18.092 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-17T06:03:18.137 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-17T06:03:18.243 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-17T06:03:18.263 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-10-17T06:03:18.293 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-17T06:03:18.507 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-jwt. 2023-10-17T06:03:18.525 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-17T06:03:18.565 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-17T06:03:18.604 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libjs-underscore. 2023-10-17T06:03:18.625 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-17T06:03:18.670 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-17T06:03:18.951 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-17T06:03:18.970 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-10-17T06:03:19.009 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-17T06:03:19.031 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-17T06:03:19.051 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-17T06:03:19.089 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-17T06:03:19.329 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libjs-underscore. 2023-10-17T06:03:19.347 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-17T06:03:19.386 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-17T06:03:19.458 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-routes. 2023-10-17T06:03:19.479 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-10-17T06:03:19.549 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-17T06:03:19.698 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-17T06:03:19.715 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-17T06:03:19.772 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-17T06:03:19.969 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-17T06:03:19.992 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-17T06:03:20.035 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mgr-dashboard (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:20.158 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-routes. 2023-10-17T06:03:20.178 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-10-17T06:03:20.218 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-17T06:03:20.594 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-17T06:03:20.597 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-decorator. 2023-10-17T06:03:20.614 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-17T06:03:20.620 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-17T06:03:20.652 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-dashboard (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:20.705 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-17T06:03:21.025 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-17T06:03:21.043 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-17T06:03:21.099 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-17T06:03:21.206 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-decorator. 2023-10-17T06:03:21.227 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-17T06:03:21.272 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-17T06:03:21.486 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-scipy. 2023-10-17T06:03:21.510 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-17T06:03:21.552 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-17T06:03:21.650 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-17T06:03:21.667 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-17T06:03:21.707 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-17T06:03:22.337 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-scipy. 2023-10-17T06:03:22.355 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-17T06:03:22.393 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-17T06:03:23.044 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-17T06:03:23.062 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-17T06:03:23.102 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-17T06:03:23.706 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-joblib. 2023-10-17T06:03:23.724 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-10-17T06:03:23.788 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-17T06:03:23.844 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-17T06:03:23.866 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-17T06:03:23.926 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-17T06:03:24.200 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-sklearn. 2023-10-17T06:03:24.220 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-17T06:03:24.258 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-17T06:03:24.521 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-joblib. 2023-10-17T06:03:24.535 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-10-17T06:03:24.579 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-17T06:03:25.000 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-sklearn. 2023-10-17T06:03:25.018 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-17T06:03:25.058 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-17T06:03:25.121 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-17T06:03:25.143 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-17T06:03:25.188 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:25.854 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-17T06:03:25.875 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-17T06:03:25.929 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:26.408 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-cachetools. 2023-10-17T06:03:26.426 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-10-17T06:03:26.499 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-17T06:03:26.869 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-17T06:03:26.887 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-17T06:03:26.926 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-17T06:03:27.182 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-cachetools. 2023-10-17T06:03:27.199 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-10-17T06:03:27.265 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-17T06:03:27.297 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-17T06:03:27.317 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-17T06:03:27.354 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-17T06:03:27.584 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-17T06:03:27.605 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-17T06:03:27.658 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-17T06:03:27.741 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-rsa. 2023-10-17T06:03:27.762 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-10-17T06:03:27.807 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-17T06:03:27.996 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-17T06:03:28.018 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-17T06:03:28.087 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-17T06:03:28.169 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-google-auth. 2023-10-17T06:03:28.189 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-10-17T06:03:28.227 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-17T06:03:28.406 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-rsa. 2023-10-17T06:03:28.420 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-10-17T06:03:28.464 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-17T06:03:28.625 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-blinker. 2023-10-17T06:03:28.645 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-17T06:03:28.683 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-17T06:03:28.826 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-google-auth. 2023-10-17T06:03:28.846 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-10-17T06:03:28.884 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-17T06:03:29.061 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-17T06:03:29.082 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-17T06:03:29.127 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-17T06:03:29.246 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-blinker. 2023-10-17T06:03:29.259 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-17T06:03:29.349 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-17T06:03:29.657 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-17T06:03:29.676 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-17T06:03:29.691 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-17T06:03:29.714 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-17T06:03:29.715 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-17T06:03:29.781 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-17T06:03:30.102 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-websocket. 2023-10-17T06:03:30.120 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-17T06:03:30.160 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-17T06:03:30.291 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-17T06:03:30.312 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-17T06:03:30.358 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-17T06:03:30.522 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-17T06:03:30.541 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-17T06:03:30.579 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-17T06:03:30.743 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-websocket. 2023-10-17T06:03:30.764 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-17T06:03:30.809 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-17T06:03:31.180 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-17T06:03:31.198 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-17T06:03:31.236 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-17T06:03:31.237 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-17T06:03:31.258 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-17T06:03:31.302 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:31.680 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-17T06:03:31.702 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-10-17T06:03:31.738 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-17T06:03:31.910 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-17T06:03:31.932 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-17T06:03:31.975 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:32.125 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-17T06:03:32.142 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-17T06:03:32.182 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-17T06:03:32.354 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-17T06:03:32.373 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-10-17T06:03:32.412 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-17T06:03:32.511 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package jq. 2023-10-17T06:03:32.531 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-17T06:03:32.576 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-17T06:03:32.807 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-17T06:03:32.830 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-17T06:03:32.873 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-17T06:03:32.880 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package socat. 2023-10-17T06:03:32.900 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-10-17T06:03:32.937 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-17T06:03:33.202 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package jq. 2023-10-17T06:03:33.219 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-17T06:03:33.259 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-17T06:03:33.308 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package xmlstarlet. 2023-10-17T06:03:33.325 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-17T06:03:33.399 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-17T06:03:33.579 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package socat. 2023-10-17T06:03:33.599 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-10-17T06:03:33.636 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-17T06:03:33.828 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-test. 2023-10-17T06:03:33.849 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../090-ceph-test_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:33.886 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-test (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:34.001 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package xmlstarlet. 2023-10-17T06:03:34.021 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-17T06:03:34.066 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-17T06:03:34.496 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-test. 2023-10-17T06:03:34.517 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../090-ceph-test_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:34.562 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-test (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:38.123 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ceph-volume. 2023-10-17T06:03:38.137 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-17T06:03:38.214 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ceph-volume (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:38.686 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-17T06:03:38.705 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:38.744 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking cephfs-mirror (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:38.858 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ceph-volume. 2023-10-17T06:03:38.878 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-17T06:03:38.924 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ceph-volume (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:39.124 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-colorama. 2023-10-17T06:03:39.146 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-17T06:03:39.181 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-17T06:03:39.379 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-17T06:03:39.399 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:39.478 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking cephfs-mirror (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:39.509 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package cephfs-shell. 2023-10-17T06:03:39.531 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-17T06:03:39.575 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking cephfs-shell (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:39.874 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-colorama. 2023-10-17T06:03:39.889 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package cephfs-top. 2023-10-17T06:03:39.892 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-17T06:03:39.909 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-17T06:03:39.931 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-17T06:03:39.971 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking cephfs-top (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:40.226 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package cephfs-shell. 2023-10-17T06:03:40.246 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-17T06:03:40.291 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-17T06:03:40.315 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-17T06:03:40.317 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking cephfs-shell (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:40.357 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-17T06:03:40.613 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package cephfs-top. 2023-10-17T06:03:40.634 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-17T06:03:40.704 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking cephfs-top (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:40.911 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-17T06:03:40.932 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:40.969 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libcephfs-dev (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:40.990 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-17T06:03:41.012 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-17T06:03:41.056 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-17T06:03:41.422 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package nvme-cli. 2023-10-17T06:03:41.443 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-17T06:03:41.519 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-17T06:03:41.652 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-17T06:03:41.673 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:41.718 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libcephfs-dev (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:41.902 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-17T06:03:41.923 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-10-17T06:03:41.968 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-10-17T06:03:42.188 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package nvme-cli. 2023-10-17T06:03:42.209 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-17T06:03:42.285 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-17T06:03:42.446 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-17T06:03:42.466 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-17T06:03:42.504 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-17T06:03:42.709 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-17T06:03:42.727 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-10-17T06:03:42.791 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-10-17T06:03:43.245 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-17T06:03:43.266 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-17T06:03:43.311 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-17T06:03:44.891 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-17T06:03:44.914 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-17T06:03:44.957 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-17T06:03:45.362 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-17T06:03:45.384 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-17T06:03:45.396 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-17T06:03:45.419 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-17T06:03:45.428 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-17T06:03:45.462 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-17T06:03:45.773 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-attr. 2023-10-17T06:03:45.794 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-10-17T06:03:45.839 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-17T06:03:45.840 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-17T06:03:45.863 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-17T06:03:45.907 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-17T06:03:46.234 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-webencodings. 2023-10-17T06:03:46.257 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-17T06:03:46.267 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-attr. 2023-10-17T06:03:46.287 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-10-17T06:03:46.325 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-17T06:03:46.335 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-17T06:03:46.637 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-html5lib. 2023-10-17T06:03:46.657 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-10-17T06:03:46.727 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-17T06:03:46.730 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-webencodings. 2023-10-17T06:03:46.748 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-17T06:03:46.788 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-17T06:03:47.106 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-17T06:03:47.124 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-html5lib. 2023-10-17T06:03:47.127 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-17T06:03:47.143 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-10-17T06:03:47.172 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-17T06:03:47.181 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-17T06:03:47.684 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-packaging. 2023-10-17T06:03:47.694 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-17T06:03:47.708 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-10-17T06:03:47.715 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-17T06:03:47.750 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-17T06:03:47.793 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-17T06:03:48.137 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pastescript. 2023-10-17T06:03:48.159 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-10-17T06:03:48.247 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-17T06:03:48.296 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-packaging. 2023-10-17T06:03:48.319 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-10-17T06:03:48.362 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-17T06:03:48.648 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pluggy. 2023-10-17T06:03:48.667 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-10-17T06:03:48.697 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-17T06:03:48.699 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pastescript. 2023-10-17T06:03:48.720 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-10-17T06:03:48.765 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-17T06:03:49.158 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-psutil. 2023-10-17T06:03:49.179 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-17T06:03:49.193 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pluggy. 2023-10-17T06:03:49.215 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-10-17T06:03:49.250 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-17T06:03:49.259 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-17T06:03:49.630 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-psutil. 2023-10-17T06:03:49.637 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-py. 2023-10-17T06:03:49.648 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-17T06:03:49.656 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-17T06:03:49.687 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-17T06:03:49.720 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-17T06:03:50.068 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-17T06:03:50.090 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-17T06:03:50.090 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-py. 2023-10-17T06:03:50.109 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-17T06:03:50.148 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-17T06:03:50.167 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-17T06:03:50.504 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-pytest. 2023-10-17T06:03:50.518 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-17T06:03:50.524 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-10-17T06:03:50.540 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-17T06:03:50.578 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-17T06:03:50.584 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-17T06:03:50.946 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-pytest. 2023-10-17T06:03:50.968 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-10-17T06:03:50.982 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package python3-simplejson. 2023-10-17T06:03:51.005 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-17T06:03:51.012 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-17T06:03:51.040 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-17T06:03:51.371 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-17T06:03:51.385 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package python3-simplejson. 2023-10-17T06:03:51.392 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-17T06:03:51.407 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-17T06:03:51.437 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-17T06:03:51.451 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-17T06:03:51.788 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-17T06:03:51.811 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-17T06:03:51.853 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-17T06:03:52.199 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package radosgw. 2023-10-17T06:03:52.214 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../116-radosgw_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:52.257 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking radosgw (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:53.027 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package radosgw. 2023-10-17T06:03:53.050 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../116-radosgw_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:53.093 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking radosgw (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:53.703 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package rbd-fuse. 2023-10-17T06:03:53.721 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:53.762 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking rbd-fuse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:54.118 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-17T06:03:54.522 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package rbd-fuse. 2023-10-17T06:03:54.525 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-17T06:03:54.542 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-17T06:03:54.579 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking rbd-fuse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:54.676 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-17T06:03:54.803 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-17T06:03:54.971 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-17T06:03:55.054 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up cephadm (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:55.370 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-17T06:03:55.521 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-17T06:03:55.647 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-17T06:03:55.789 INFO:teuthology.orchestra.run.smithi125.stdout:Adding system user cephadm....done 2023-10-17T06:03:55.856 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up cephadm (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:03:55.976 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-17T06:03:56.136 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-17T06:03:56.562 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-17T06:03:56.631 INFO:teuthology.orchestra.run.smithi184.stdout:Adding system user cephadm....done 2023-10-17T06:03:56.846 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-17T06:03:56.905 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-17T06:03:56.971 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-17T06:03:57.031 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-17T06:03:57.149 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-17T06:03:57.406 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-17T06:03:57.576 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-17T06:03:57.758 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-17T06:03:57.883 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-17T06:03:58.035 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-17T06:03:58.103 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-17T06:03:58.453 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-17T06:03:58.462 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-17T06:03:58.830 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-17T06:03:58.946 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-17T06:03:59.206 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-17T06:03:59.306 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-17T06:03:59.566 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-17T06:03:59.682 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-17T06:03:59.961 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-ceph-argparse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:00.049 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-17T06:04:00.351 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-17T06:04:00.434 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-17T06:04:00.477 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-17T06:04:00.826 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-ceph-argparse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:00.836 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-17T06:04:01.187 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-17T06:04:01.219 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-17T06:04:01.370 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-17T06:04:01.547 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-17T06:04:01.672 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-17T06:04:01.767 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-17T06:04:02.132 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-17T06:04:02.169 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-17T06:04:02.484 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-17T06:04:02.523 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-17T06:04:02.674 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-17T06:04:02.826 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-17T06:04:03.142 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-17T06:04:03.236 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-17T06:04:03.501 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-17T06:04:03.603 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-17T06:04:03.869 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-17T06:04:04.029 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-17T06:04:04.303 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-17T06:04:04.389 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-17T06:04:04.696 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-17T06:04:04.765 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-17T06:04:04.891 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-17T06:04:05.050 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-17T06:04:05.114 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-17T06:04:05.410 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-17T06:04:05.499 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-17T06:04:05.858 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-17T06:04:05.878 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-17T06:04:06.017 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-17T06:04:06.143 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-17T06:04:06.245 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-17T06:04:06.494 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-17T06:04:06.689 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-17T06:04:06.971 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-17T06:04:07.115 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-17T06:04:07.275 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-ceph-common (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:07.363 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-17T06:04:07.684 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-17T06:04:07.798 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-17T06:04:07.827 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-17T06:04:08.242 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-17T06:04:08.253 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-17T06:04:08.359 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-ceph-common (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:08.412 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-17T06:04:08.539 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-17T06:04:08.839 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-17T06:04:08.890 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-17T06:04:08.986 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-17T06:04:09.283 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-17T06:04:09.409 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-17T06:04:09.412 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-17T06:04:09.538 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-17T06:04:09.560 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-17T06:04:09.689 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-17T06:04:09.969 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-17T06:04:10.099 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-17T06:04:10.329 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-17T06:04:10.517 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-17T06:04:10.643 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-17T06:04:10.730 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-17T06:04:10.769 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-17T06:04:10.856 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-17T06:04:11.170 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-17T06:04:11.207 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-17T06:04:11.521 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-17T06:04:11.566 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-17T06:04:11.897 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-17T06:04:11.951 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-17T06:04:12.023 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-17T06:04:12.326 INFO:teuthology.orchestra.run.smithi125.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-17T06:04:12.399 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-17T06:04:12.665 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-17T06:04:12.767 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-17T06:04:12.790 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-17T06:04:13.151 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-17T06:04:13.176 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-17T06:04:13.535 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-17T06:04:13.601 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-17T06:04:13.727 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-17T06:04:13.871 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-17T06:04:13.886 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-17T06:04:13.988 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-17T06:04:14.280 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-17T06:04:14.373 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-17T06:04:14.625 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-17T06:04:14.821 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-17T06:04:14.947 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-17T06:04:15.123 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-17T06:04:15.532 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-17T06:04:15.908 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-17T06:04:16.715 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-17T06:04:16.841 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-17T06:04:17.293 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-17T06:04:17.669 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-17T06:04:17.689 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-17T06:04:17.815 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-17T06:04:18.037 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-17T06:04:18.162 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-17T06:04:18.283 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-17T06:04:18.589 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-17T06:04:18.693 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-17T06:04:19.049 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-10-17T06:04:19.071 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-17T06:04:19.230 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-17T06:04:19.508 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-17T06:04:19.657 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-17T06:04:19.936 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-17T06:04:20.084 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-10-17T06:04:20.552 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-17T06:04:20.961 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-17T06:04:21.216 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-17T06:04:21.375 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-17T06:04:21.535 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-17T06:04:21.661 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-17T06:04:22.045 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-17T06:04:22.179 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-17T06:04:22.218 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-17T06:04:22.344 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-17T06:04:22.470 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-17T06:04:22.547 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-17T06:04:22.621 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-17T06:04:22.915 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-17T06:04:22.997 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-17T06:04:23.123 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-17T06:04:23.300 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-17T06:04:23.658 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-17T06:04:23.752 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up librados2 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:23.980 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-10-17T06:04:24.009 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-17T06:04:24.139 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up librgw2 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:24.265 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libsqlite3-mod-ceph (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:24.385 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-17T06:04:24.408 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libcephfs2 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:24.534 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-17T06:04:24.829 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librados2 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:24.911 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libradosstriper1 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:25.037 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-17T06:04:25.074 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-10-17T06:04:25.225 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librgw2 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:25.351 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libsqlite3-mod-ceph (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:25.405 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up librbd1 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:25.477 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libcephfs2 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:25.614 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mgr-modules-core (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:25.628 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-17T06:04:25.732 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-fuse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:25.985 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-17T06:04:25.985 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-17T06:04:25.988 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libradosstriper1 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:26.114 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-17T06:04:26.482 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up librbd1 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:26.608 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-modules-core (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:26.735 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-fuse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:26.867 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libcephfs-dev (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:26.993 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-rados (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:27.020 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-17T06:04:27.020 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-17T06:04:27.152 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up cephfs-top (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:27.278 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-17T06:04:27.886 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libcephfs-dev (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:28.037 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rados (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:28.163 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up cephfs-top (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:28.289 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-17T06:04:28.432 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-rbd (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:28.550 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up rbd-fuse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:28.709 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-rgw (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:28.835 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up python3-cephfs (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:28.961 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up cephfs-shell (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:29.120 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-common (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:29.427 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rbd (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:29.553 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up rbd-fuse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:29.704 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-rgw (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:29.735 INFO:teuthology.orchestra.run.smithi125.stdout:Adding group ceph....done 2023-10-17T06:04:29.829 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up python3-cephfs (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:29.956 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up cephfs-shell (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:30.107 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-common (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:30.209 INFO:teuthology.orchestra.run.smithi125.stdout:Adding system user ceph....done 2023-10-17T06:04:30.430 INFO:teuthology.orchestra.run.smithi125.stdout:Setting system user ceph properties....done 2023-10-17T06:04:30.461 INFO:teuthology.orchestra.run.smithi125.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-17T06:04:30.649 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-17T06:04:30.723 INFO:teuthology.orchestra.run.smithi184.stdout:Adding group ceph....done 2023-10-17T06:04:31.174 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-17T06:04:31.202 INFO:teuthology.orchestra.run.smithi184.stdout:Adding system user ceph....done 2023-10-17T06:04:31.460 INFO:teuthology.orchestra.run.smithi184.stdout:Setting system user ceph properties....done 2023-10-17T06:04:31.500 INFO:teuthology.orchestra.run.smithi184.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-17T06:04:31.690 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-17T06:04:32.131 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up cephfs-mirror (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:32.259 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-17T06:04:32.387 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-17T06:04:32.388 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-17T06:04:33.200 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up cephfs-mirror (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:33.249 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-test (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:33.366 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up radosgw (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:33.469 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-17T06:04:33.469 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-17T06:04:33.679 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-17T06:04:33.680 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-17T06:04:34.335 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-test (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:34.461 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up radosgw (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:34.774 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-17T06:04:34.774 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-17T06:04:34.959 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-base (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:35.494 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-17T06:04:36.071 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-base (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:36.403 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mds (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:36.564 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-17T06:04:36.679 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-17T06:04:36.679 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-17T06:04:37.423 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mds (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:37.546 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mgr (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:37.714 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-17T06:04:37.715 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-17T06:04:37.820 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-17T06:04:37.820 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-17T06:04:38.592 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:38.656 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-osd (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:38.863 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-17T06:04:38.863 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-17T06:04:39.467 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-17T06:04:39.467 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-17T06:04:39.752 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-osd (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:40.299 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mgr-k8sevents (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:40.425 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:40.547 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-17T06:04:40.547 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-17T06:04:40.602 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mon (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:40.865 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-17T06:04:40.866 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-17T06:04:41.395 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-k8sevents (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:41.521 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:41.672 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mon (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:41.720 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mgr-cephadm (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:41.871 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:41.957 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-17T06:04:41.957 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-17T06:04:41.988 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-mgr-dashboard (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:42.164 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ceph-volume (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:42.292 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-17T06:04:42.501 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-17T06:04:42.823 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-cephadm (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:42.995 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:43.002 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-17T06:04:43.126 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-mgr-dashboard (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:43.276 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ceph-volume (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-17T06:04:43.428 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-17T06:04:43.597 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-17T06:04:44.057 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-17T06:04:48.047 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-17T06:04:48.813 INFO:teuthology.orchestra.run.smithi125.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-17T06:04:48.819 DEBUG:teuthology.orchestra.run.smithi125:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-17T06:04:48.955 INFO:teuthology.orchestra.run.smithi125.stdout:Reading package lists... 2023-10-17T06:04:49.157 INFO:teuthology.orchestra.run.smithi125.stdout:Building dependency tree... 2023-10-17T06:04:49.222 INFO:teuthology.orchestra.run.smithi125.stdout:Reading state information... 2023-10-17T06:04:49.260 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-17T06:04:49.356 INFO:teuthology.orchestra.run.smithi125.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-17T06:04:49.357 INFO:teuthology.orchestra.run.smithi125.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-17T06:04:49.357 INFO:teuthology.orchestra.run.smithi125.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-17T06:04:49.357 INFO:teuthology.orchestra.run.smithi125.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-17T06:04:49.357 INFO:teuthology.orchestra.run.smithi125.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-17T06:04:49.358 INFO:teuthology.orchestra.run.smithi125.stdout:The following packages were automatically installed and are no longer required: 2023-10-17T06:04:49.362 INFO:teuthology.orchestra.run.smithi125.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-17T06:04:49.362 INFO:teuthology.orchestra.run.smithi125.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-17T06:04:49.362 INFO:teuthology.orchestra.run.smithi125.stdout:The following additional packages will be installed: 2023-10-17T06:04:49.362 INFO:teuthology.orchestra.run.smithi125.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-17T06:04:49.362 INFO:teuthology.orchestra.run.smithi125.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-10-17T06:04:49.363 INFO:teuthology.orchestra.run.smithi125.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-10-17T06:04:49.363 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-10-17T06:04:49.363 INFO:teuthology.orchestra.run.smithi125.stdout: usb-modeswitch-data wpasupplicant 2023-10-17T06:04:49.363 INFO:teuthology.orchestra.run.smithi125.stdout:Suggested packages: 2023-10-17T06:04:49.364 INFO:teuthology.orchestra.run.smithi125.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-10-17T06:04:49.364 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-10-17T06:04:49.364 INFO:teuthology.orchestra.run.smithi125.stdout: libengine-pkcs11-openssl 2023-10-17T06:04:49.471 INFO:teuthology.orchestra.run.smithi125.stdout:The following NEW packages will be installed: 2023-10-17T06:04:49.472 INFO:teuthology.orchestra.run.smithi125.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-17T06:04:49.472 INFO:teuthology.orchestra.run.smithi125.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-10-17T06:04:49.473 INFO:teuthology.orchestra.run.smithi125.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-17T06:04:49.473 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-10-17T06:04:49.473 INFO:teuthology.orchestra.run.smithi125.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-10-17T06:04:49.473 INFO:teuthology.orchestra.run.smithi125.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-17T06:04:49.474 INFO:teuthology.orchestra.run.smithi125.stdout:The following packages will be upgraded: 2023-10-17T06:04:49.475 INFO:teuthology.orchestra.run.smithi125.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-17T06:04:49.541 INFO:teuthology.orchestra.run.smithi125.stdout:6 upgraded, 31 newly installed, 0 to remove and 250 not upgraded. 2023-10-17T06:04:49.542 INFO:teuthology.orchestra.run.smithi125.stdout:Need to get 25.3 MB of archives. 2023-10-17T06:04:49.542 INFO:teuthology.orchestra.run.smithi125.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-10-17T06:04:49.542 INFO:teuthology.orchestra.run.smithi125.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-17T06:04:49.674 INFO:teuthology.orchestra.run.smithi125.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-17T06:04:49.676 INFO:teuthology.orchestra.run.smithi125.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-17T06:04:49.678 INFO:teuthology.orchestra.run.smithi125.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-17T06:04:49.683 INFO:teuthology.orchestra.run.smithi125.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-17T06:04:49.684 INFO:teuthology.orchestra.run.smithi125.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-17T06:04:49.701 INFO:teuthology.orchestra.run.smithi125.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-17T06:04:49.701 INFO:teuthology.orchestra.run.smithi125.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-17T06:04:49.703 INFO:teuthology.orchestra.run.smithi125.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-17T06:04:49.704 INFO:teuthology.orchestra.run.smithi125.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-17T06:04:49.705 INFO:teuthology.orchestra.run.smithi125.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-17T06:04:49.707 INFO:teuthology.orchestra.run.smithi125.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-17T06:04:49.708 INFO:teuthology.orchestra.run.smithi125.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-17T06:04:49.710 INFO:teuthology.orchestra.run.smithi125.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-17T06:04:49.710 INFO:teuthology.orchestra.run.smithi125.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-17T06:04:49.724 INFO:teuthology.orchestra.run.smithi125.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-17T06:04:49.725 INFO:teuthology.orchestra.run.smithi125.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-17T06:04:49.734 INFO:teuthology.orchestra.run.smithi125.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-10-17T06:04:49.736 INFO:teuthology.orchestra.run.smithi125.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-17T06:04:49.743 INFO:teuthology.orchestra.run.smithi125.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-17T06:04:49.743 INFO:teuthology.orchestra.run.smithi125.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-17T06:04:49.759 INFO:teuthology.orchestra.run.smithi125.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-17T06:04:49.760 INFO:teuthology.orchestra.run.smithi125.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-17T06:04:49.769 INFO:teuthology.orchestra.run.smithi125.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-17T06:04:49.782 INFO:teuthology.orchestra.run.smithi125.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-17T06:04:49.800 INFO:teuthology.orchestra.run.smithi125.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-17T06:04:49.804 INFO:teuthology.orchestra.run.smithi125.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-17T06:04:49.804 INFO:teuthology.orchestra.run.smithi125.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-17T06:04:49.805 INFO:teuthology.orchestra.run.smithi125.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-10-17T06:04:49.805 INFO:teuthology.orchestra.run.smithi125.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-10-17T06:04:49.816 INFO:teuthology.orchestra.run.smithi125.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-10-17T06:04:49.818 INFO:teuthology.orchestra.run.smithi125.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-10-17T06:04:49.948 INFO:teuthology.orchestra.run.smithi125.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-10-17T06:04:49.948 INFO:teuthology.orchestra.run.smithi125.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-10-17T06:04:49.949 INFO:teuthology.orchestra.run.smithi125.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-10-17T06:04:49.949 INFO:teuthology.orchestra.run.smithi125.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-17T06:04:49.949 INFO:teuthology.orchestra.run.smithi125.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-17T06:04:50.061 INFO:teuthology.orchestra.run.smithi184.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-17T06:04:50.066 DEBUG:teuthology.orchestra.run.smithi184:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-17T06:04:50.193 INFO:teuthology.orchestra.run.smithi184.stdout:Reading package lists... 2023-10-17T06:04:50.398 INFO:teuthology.orchestra.run.smithi184.stdout:Building dependency tree... 2023-10-17T06:04:50.399 INFO:teuthology.orchestra.run.smithi184.stdout:Reading state information... 2023-10-17T06:04:50.509 INFO:teuthology.orchestra.run.smithi125.stdout:Preconfiguring packages ... 2023-10-17T06:04:50.599 INFO:teuthology.orchestra.run.smithi184.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-17T06:04:50.599 INFO:teuthology.orchestra.run.smithi184.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-17T06:04:50.599 INFO:teuthology.orchestra.run.smithi184.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-17T06:04:50.599 INFO:teuthology.orchestra.run.smithi184.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-17T06:04:50.600 INFO:teuthology.orchestra.run.smithi184.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-17T06:04:50.600 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages were automatically installed and are no longer required: 2023-10-17T06:04:50.601 INFO:teuthology.orchestra.run.smithi184.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-17T06:04:50.601 INFO:teuthology.orchestra.run.smithi184.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-17T06:04:50.601 INFO:teuthology.orchestra.run.smithi184.stdout:The following additional packages will be installed: 2023-10-17T06:04:50.602 INFO:teuthology.orchestra.run.smithi184.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-17T06:04:50.602 INFO:teuthology.orchestra.run.smithi184.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-10-17T06:04:50.602 INFO:teuthology.orchestra.run.smithi184.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-10-17T06:04:50.602 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-10-17T06:04:50.602 INFO:teuthology.orchestra.run.smithi184.stdout: usb-modeswitch-data wpasupplicant 2023-10-17T06:04:50.603 INFO:teuthology.orchestra.run.smithi184.stdout:Suggested packages: 2023-10-17T06:04:50.603 INFO:teuthology.orchestra.run.smithi184.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-10-17T06:04:50.603 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-10-17T06:04:50.603 INFO:teuthology.orchestra.run.smithi184.stdout: libengine-pkcs11-openssl 2023-10-17T06:04:50.709 INFO:teuthology.orchestra.run.smithi184.stdout:The following NEW packages will be installed: 2023-10-17T06:04:50.711 INFO:teuthology.orchestra.run.smithi184.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-17T06:04:50.711 INFO:teuthology.orchestra.run.smithi184.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-10-17T06:04:50.711 INFO:teuthology.orchestra.run.smithi184.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-17T06:04:50.712 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-10-17T06:04:50.712 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-10-17T06:04:50.712 INFO:teuthology.orchestra.run.smithi184.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-17T06:04:50.712 INFO:teuthology.orchestra.run.smithi184.stdout:The following packages will be upgraded: 2023-10-17T06:04:50.713 INFO:teuthology.orchestra.run.smithi184.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-17T06:04:50.754 INFO:teuthology.orchestra.run.smithi125.stdout:Fetched 25.3 MB in 0s (54.4 MB/s) 2023-10-17T06:04:50.782 INFO:teuthology.orchestra.run.smithi184.stdout:6 upgraded, 31 newly installed, 0 to remove and 250 not upgraded. 2023-10-17T06:04:50.783 INFO:teuthology.orchestra.run.smithi184.stdout:Need to get 25.3 MB of archives. 2023-10-17T06:04:50.783 INFO:teuthology.orchestra.run.smithi184.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-10-17T06:04:50.783 INFO:teuthology.orchestra.run.smithi184.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-17T06:04:50.945 INFO:teuthology.orchestra.run.smithi184.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-17T06:04:50.947 INFO:teuthology.orchestra.run.smithi184.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-17T06:04:50.948 INFO:teuthology.orchestra.run.smithi184.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-17T06:04:50.955 INFO:teuthology.orchestra.run.smithi184.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-17T06:04:50.956 INFO:teuthology.orchestra.run.smithi184.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-17T06:04:50.975 INFO:teuthology.orchestra.run.smithi184.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-17T06:04:50.975 INFO:teuthology.orchestra.run.smithi184.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-17T06:04:50.982 INFO:teuthology.orchestra.run.smithi184.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-17T06:04:50.985 INFO:teuthology.orchestra.run.smithi184.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-17T06:04:50.986 INFO:teuthology.orchestra.run.smithi184.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-17T06:04:50.987 INFO:teuthology.orchestra.run.smithi184.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-17T06:04:50.988 INFO:teuthology.orchestra.run.smithi184.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-17T06:04:50.991 INFO:teuthology.orchestra.run.smithi184.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-17T06:04:50.992 INFO:teuthology.orchestra.run.smithi184.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-17T06:04:51.007 INFO:teuthology.orchestra.run.smithi184.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-17T06:04:51.007 INFO:teuthology.orchestra.run.smithi184.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-17T06:04:51.018 INFO:teuthology.orchestra.run.smithi184.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-10-17T06:04:51.026 INFO:teuthology.orchestra.run.smithi184.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-17T06:04:51.038 INFO:teuthology.orchestra.run.smithi184.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-17T06:04:51.039 INFO:teuthology.orchestra.run.smithi184.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-17T06:04:51.057 INFO:teuthology.orchestra.run.smithi184.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-17T06:04:51.058 INFO:teuthology.orchestra.run.smithi184.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-17T06:04:51.067 INFO:teuthology.orchestra.run.smithi184.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-17T06:04:51.083 INFO:teuthology.orchestra.run.smithi184.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-17T06:04:51.106 INFO:teuthology.orchestra.run.smithi184.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-17T06:04:51.109 INFO:teuthology.orchestra.run.smithi184.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-17T06:04:51.110 INFO:teuthology.orchestra.run.smithi184.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-17T06:04:51.111 INFO:teuthology.orchestra.run.smithi184.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-10-17T06:04:51.112 INFO:teuthology.orchestra.run.smithi184.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-10-17T06:04:51.123 INFO:teuthology.orchestra.run.smithi184.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-10-17T06:04:51.125 INFO:teuthology.orchestra.run.smithi184.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-10-17T06:04:51.146 INFO:teuthology.orchestra.run.smithi125.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118871 files and directories currently installed.) 2023-10-17T06:04:51.150 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-17T06:04:51.276 INFO:teuthology.orchestra.run.smithi184.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-10-17T06:04:51.276 INFO:teuthology.orchestra.run.smithi184.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-10-17T06:04:51.277 INFO:teuthology.orchestra.run.smithi184.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-10-17T06:04:51.277 INFO:teuthology.orchestra.run.smithi184.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-17T06:04:51.277 INFO:teuthology.orchestra.run.smithi184.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-17T06:04:51.409 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-17T06:04:51.845 INFO:teuthology.orchestra.run.smithi184.stdout:Preconfiguring packages ... 2023-10-17T06:04:52.070 INFO:teuthology.orchestra.run.smithi184.stdout:Fetched 25.3 MB in 1s (45.6 MB/s) 2023-10-17T06:04:52.422 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118871 files and directories currently installed.) 2023-10-17T06:04:52.426 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-17T06:04:52.629 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-17T06:04:53.119 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-17T06:04:54.720 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-17T06:04:55.070 INFO:teuthology.orchestra.run.smithi125.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118871 files and directories currently installed.) 2023-10-17T06:04:55.074 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-17T06:04:55.230 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-17T06:04:55.694 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-17T06:04:55.845 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-17T06:04:56.487 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-17T06:04:56.746 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118871 files and directories currently installed.) 2023-10-17T06:04:56.750 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-17T06:04:56.878 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-17T06:04:56.979 INFO:teuthology.orchestra.run.smithi125.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118871 files and directories currently installed.) 2023-10-17T06:04:56.982 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-17T06:04:57.154 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-17T06:04:57.394 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-17T06:04:57.568 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-17T06:04:57.681 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-17T06:04:57.817 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-17T06:04:57.974 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-17T06:04:58.385 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-17T06:04:58.502 INFO:teuthology.orchestra.run.smithi184.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118871 files and directories currently installed.) 2023-10-17T06:04:58.506 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-17T06:04:58.522 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-17T06:04:58.668 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-17T06:04:59.109 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-17T06:04:59.133 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-17T06:04:59.163 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-17T06:04:59.176 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-17T06:04:59.298 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-17T06:04:59.529 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package dump. 2023-10-17T06:04:59.550 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-17T06:04:59.595 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking dump (0.4b46-6) ... 2023-10-17T06:04:59.974 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package indent. 2023-10-17T06:04:59.984 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-17T06:04:59.997 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-17T06:05:00.040 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-17T06:05:00.121 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-17T06:05:00.393 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-17T06:05:00.417 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-17T06:05:00.460 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-17T06:05:00.701 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-17T06:05:00.721 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-17T06:05:00.759 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-17T06:05:00.830 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-17T06:05:00.850 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-17T06:05:00.879 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-17T06:05:01.145 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package dump. 2023-10-17T06:05:01.166 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-17T06:05:01.208 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-17T06:05:01.211 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking dump (0.4b46-6) ... 2023-10-17T06:05:01.230 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-17T06:05:01.274 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-17T06:05:01.566 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package indent. 2023-10-17T06:05:01.585 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-17T06:05:01.624 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-17T06:05:01.787 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-17T06:05:01.809 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-17T06:05:01.853 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-17T06:05:02.002 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-17T06:05:02.025 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-17T06:05:02.068 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-17T06:05:02.165 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-17T06:05:02.187 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-17T06:05:02.231 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-17T06:05:02.472 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-17T06:05:02.486 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-17T06:05:02.530 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-17T06:05:02.609 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-17T06:05:02.628 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-17T06:05:02.667 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-17T06:05:02.841 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-17T06:05:02.855 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-17T06:05:02.899 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-17T06:05:03.062 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-17T06:05:03.083 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-17T06:05:03.120 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-17T06:05:03.303 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-17T06:05:03.322 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-17T06:05:03.361 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-17T06:05:03.515 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-17T06:05:03.537 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-17T06:05:03.581 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-17T06:05:03.672 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-17T06:05:03.691 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-17T06:05:03.730 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-17T06:05:04.034 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-17T06:05:04.056 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-10-17T06:05:04.100 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-10-17T06:05:04.108 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-17T06:05:04.131 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-17T06:05:04.175 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-17T06:05:04.503 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-17T06:05:04.525 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-17T06:05:04.570 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-17T06:05:04.578 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-17T06:05:04.599 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-17T06:05:04.644 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-17T06:05:04.948 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-17T06:05:04.967 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-17T06:05:05.006 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-17T06:05:05.182 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-17T06:05:05.203 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-17T06:05:05.289 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-17T06:05:05.325 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-17T06:05:05.343 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-17T06:05:05.383 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-17T06:05:05.726 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-17T06:05:05.747 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-10-17T06:05:05.792 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-10-17T06:05:05.970 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-17T06:05:05.989 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-10-17T06:05:06.028 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-17T06:05:06.204 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-17T06:05:06.226 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-17T06:05:06.270 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-17T06:05:06.457 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package modemmanager. 2023-10-17T06:05:06.479 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-17T06:05:06.548 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-17T06:05:06.656 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-17T06:05:06.678 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-17T06:05:06.723 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-17T06:05:07.042 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-17T06:05:07.062 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-17T06:05:07.100 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-17T06:05:07.229 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package wpasupplicant. 2023-10-17T06:05:07.247 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-17T06:05:07.287 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-17T06:05:07.654 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-17T06:05:07.675 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-10-17T06:05:07.720 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-17T06:05:07.884 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package network-manager. 2023-10-17T06:05:07.905 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-17T06:05:07.995 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-17T06:05:08.191 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package modemmanager. 2023-10-17T06:05:08.212 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-17T06:05:08.279 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-17T06:05:08.850 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package ppp. 2023-10-17T06:05:08.870 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-17T06:05:08.963 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package wpasupplicant. 2023-10-17T06:05:08.985 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-17T06:05:09.046 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-17T06:05:09.376 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-17T06:05:09.619 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package network-manager. 2023-10-17T06:05:09.641 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-17T06:05:09.735 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-17T06:05:09.796 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package pptp-linux. 2023-10-17T06:05:09.810 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-17T06:05:09.854 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-17T06:05:10.266 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-17T06:05:10.280 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-17T06:05:10.361 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-17T06:05:10.501 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package ppp. 2023-10-17T06:05:10.520 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-17T06:05:10.719 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-17T06:05:10.740 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-10-17T06:05:10.777 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-10-17T06:05:10.978 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-17T06:05:11.149 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package postgresql-client-12. 2023-10-17T06:05:11.170 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-10-17T06:05:11.215 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-17T06:05:11.398 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package pptp-linux. 2023-10-17T06:05:11.420 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-17T06:05:11.456 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-17T06:05:11.828 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package postgresql-common. 2023-10-17T06:05:11.850 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-10-17T06:05:11.885 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-17T06:05:11.905 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-17T06:05:11.928 INFO:teuthology.orchestra.run.smithi125.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-17T06:05:11.956 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-10-17T06:05:11.997 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-17T06:05:12.363 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-17T06:05:12.384 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-10-17T06:05:12.429 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-10-17T06:05:12.485 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package postgresql-12. 2023-10-17T06:05:12.506 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-10-17T06:05:12.558 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-17T06:05:12.792 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-client-12. 2023-10-17T06:05:12.813 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-10-17T06:05:12.850 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-17T06:05:13.480 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-common. 2023-10-17T06:05:13.499 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-10-17T06:05:13.573 INFO:teuthology.orchestra.run.smithi184.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-17T06:05:13.608 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-10-17T06:05:14.112 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-12. 2023-10-17T06:05:14.133 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-10-17T06:05:14.184 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-17T06:05:14.263 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package postgresql. 2023-10-17T06:05:14.288 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-10-17T06:05:14.329 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-10-17T06:05:14.649 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package postgresql-client. 2023-10-17T06:05:14.671 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-10-17T06:05:14.715 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-10-17T06:05:15.018 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-17T06:05:15.038 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-10-17T06:05:15.083 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-10-17T06:05:15.395 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-17T06:05:15.414 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-17T06:05:15.452 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-17T06:05:15.875 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql. 2023-10-17T06:05:15.897 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-10-17T06:05:15.897 INFO:teuthology.orchestra.run.smithi125.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-17T06:05:15.918 INFO:teuthology.orchestra.run.smithi125.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-17T06:05:15.941 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-10-17T06:05:16.003 INFO:teuthology.orchestra.run.smithi125.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-17T06:05:16.269 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-client. 2023-10-17T06:05:16.291 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-10-17T06:05:16.335 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-10-17T06:05:16.382 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-10-17T06:05:16.594 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-17T06:05:16.613 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-17T06:05:16.636 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-10-17T06:05:16.696 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-10-17T06:05:16.973 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-17T06:05:16.995 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-17T06:05:17.039 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-17T06:05:17.364 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-10-17T06:05:17.510 INFO:teuthology.orchestra.run.smithi184.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-17T06:05:17.513 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-17T06:05:17.528 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-17T06:05:17.591 INFO:teuthology.orchestra.run.smithi184.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-17T06:05:17.648 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-17T06:05:17.774 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-17T06:05:17.975 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-10-17T06:05:18.182 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-17T06:05:18.240 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-17T06:05:18.241 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-17T06:05:18.609 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-10-17T06:05:18.777 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-17T06:05:18.902 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-17T06:05:19.029 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-17T06:05:19.126 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-17T06:05:19.477 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-17T06:05:19.478 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-17T06:05:20.590 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-17T06:05:21.240 INFO:teuthology.orchestra.run.smithi125.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-17T06:05:21.357 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-17T06:05:21.483 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-17T06:05:21.625 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-10-17T06:05:22.674 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-17T06:05:22.787 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-17T06:05:22.938 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-17T06:05:23.064 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-10-17T06:05:23.294 INFO:teuthology.orchestra.run.smithi125.stdout:Adding user postgres to group ssl-cert 2023-10-17T06:05:23.688 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:05:23.689 INFO:teuthology.orchestra.run.smithi125.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-17T06:05:24.160 INFO:teuthology.orchestra.run.smithi125.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-17T06:05:24.160 INFO:teuthology.orchestra.run.smithi125.stdout:Removing obsolete dictionary files: 2023-10-17T06:05:24.368 INFO:teuthology.orchestra.run.smithi184.stdout:Adding user postgres to group ssl-cert 2023-10-17T06:05:24.740 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:05:24.741 INFO:teuthology.orchestra.run.smithi184.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-17T06:05:24.742 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-17T06:05:25.226 INFO:teuthology.orchestra.run.smithi184.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-17T06:05:25.226 INFO:teuthology.orchestra.run.smithi184.stdout:Removing obsolete dictionary files: 2023-10-17T06:05:25.784 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-17T06:05:26.235 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-17T06:05:26.361 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-17T06:05:26.512 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-17T06:05:26.638 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-17T06:05:27.224 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-17T06:05:27.359 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-17T06:05:27.526 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-17T06:05:27.652 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-17T06:05:27.976 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-17T06:05:28.426 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up dump (0.4b46-6) ... 2023-10-17T06:05:28.532 INFO:teuthology.orchestra.run.smithi125.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-17T06:05:28.603 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-17T06:05:28.712 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-17T06:05:28.863 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-17T06:05:28.878 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-17T06:05:28.998 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-17T06:05:29.199 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-17T06:05:29.300 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up dump (0.4b46-6) ... 2023-10-17T06:05:29.325 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-17T06:05:29.407 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-17T06:05:29.477 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-17T06:05:29.627 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-17T06:05:29.753 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-17T06:05:29.821 INFO:teuthology.orchestra.run.smithi125.stdout:Creating new PostgreSQL cluster 12/main ... 2023-10-17T06:05:29.852 INFO:teuthology.orchestra.run.smithi125.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-10-17T06:05:29.880 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-17T06:05:29.922 INFO:teuthology.orchestra.run.smithi125.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-17T06:05:29.922 INFO:teuthology.orchestra.run.smithi125.stdout:This user must also own the server process. 2023-10-17T06:05:29.922 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:05:29.922 INFO:teuthology.orchestra.run.smithi125.stdout:The database cluster will be initialized with locale "en_US". 2023-10-17T06:05:29.923 INFO:teuthology.orchestra.run.smithi125.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-17T06:05:29.923 INFO:teuthology.orchestra.run.smithi125.stdout:The default text search configuration will be set to "english". 2023-10-17T06:05:29.923 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:05:29.923 INFO:teuthology.orchestra.run.smithi125.stdout:Data page checksums are disabled. 2023-10-17T06:05:29.923 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:05:29.924 INFO:teuthology.orchestra.run.smithi125.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-10-17T06:05:29.925 INFO:teuthology.orchestra.run.smithi125.stdout:creating subdirectories ... ok 2023-10-17T06:05:29.926 INFO:teuthology.orchestra.run.smithi125.stdout:selecting dynamic shared memory implementation ... posix 2023-10-17T06:05:29.961 INFO:teuthology.orchestra.run.smithi125.stdout:selecting default max_connections ... 100 2023-10-17T06:05:30.009 INFO:teuthology.orchestra.run.smithi125.stdout:selecting default shared_buffers ... 128MB 2023-10-17T06:05:30.031 INFO:teuthology.orchestra.run.smithi125.stdout:selecting default time zone ... Etc/UTC 2023-10-17T06:05:30.032 INFO:teuthology.orchestra.run.smithi125.stdout:creating configuration files ... ok 2023-10-17T06:05:30.089 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-17T06:05:30.215 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-17T06:05:30.216 INFO:teuthology.orchestra.run.smithi125.stdout:running bootstrap script ... ok 2023-10-17T06:05:30.723 INFO:teuthology.orchestra.run.smithi184.stdout:Creating new PostgreSQL cluster 12/main ... 2023-10-17T06:05:30.756 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-10-17T06:05:30.846 INFO:teuthology.orchestra.run.smithi125.stdout:performing post-bootstrap initialization ... ok 2023-10-17T06:05:30.853 INFO:teuthology.orchestra.run.smithi184.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-17T06:05:30.853 INFO:teuthology.orchestra.run.smithi184.stdout:This user must also own the server process. 2023-10-17T06:05:30.853 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:05:30.853 INFO:teuthology.orchestra.run.smithi184.stdout:The database cluster will be initialized with locale "en_US". 2023-10-17T06:05:30.854 INFO:teuthology.orchestra.run.smithi184.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-17T06:05:30.854 INFO:teuthology.orchestra.run.smithi184.stdout:The default text search configuration will be set to "english". 2023-10-17T06:05:30.854 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:05:30.854 INFO:teuthology.orchestra.run.smithi184.stdout:Data page checksums are disabled. 2023-10-17T06:05:30.854 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:05:30.855 INFO:teuthology.orchestra.run.smithi184.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-10-17T06:05:30.856 INFO:teuthology.orchestra.run.smithi184.stdout:creating subdirectories ... ok 2023-10-17T06:05:30.857 INFO:teuthology.orchestra.run.smithi184.stdout:selecting dynamic shared memory implementation ... posix 2023-10-17T06:05:30.892 INFO:teuthology.orchestra.run.smithi184.stdout:selecting default max_connections ... 100 2023-10-17T06:05:30.941 INFO:teuthology.orchestra.run.smithi184.stdout:selecting default shared_buffers ... 128MB 2023-10-17T06:05:30.965 INFO:teuthology.orchestra.run.smithi184.stdout:selecting default time zone ... Etc/UTC 2023-10-17T06:05:30.965 INFO:teuthology.orchestra.run.smithi184.stdout:creating configuration files ... ok 2023-10-17T06:05:31.150 INFO:teuthology.orchestra.run.smithi184.stdout:running bootstrap script ... ok 2023-10-17T06:05:31.390 INFO:teuthology.orchestra.run.smithi125.stdout:syncing data to disk ... ok 2023-10-17T06:05:31.391 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:05:31.391 INFO:teuthology.orchestra.run.smithi125.stdout:Success. You can now start the database server using: 2023-10-17T06:05:31.391 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:05:31.391 INFO:teuthology.orchestra.run.smithi125.stdout: pg_ctlcluster 12 main start 2023-10-17T06:05:31.391 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:05:31.769 INFO:teuthology.orchestra.run.smithi184.stdout:performing post-bootstrap initialization ... ok 2023-10-17T06:05:31.978 INFO:teuthology.orchestra.run.smithi125.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-10-17T06:05:31.978 INFO:teuthology.orchestra.run.smithi125.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-10-17T06:05:32.196 INFO:teuthology.orchestra.run.smithi125.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-17T06:05:32.323 INFO:teuthology.orchestra.run.smithi184.stdout:syncing data to disk ... ok 2023-10-17T06:05:32.323 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:05:32.324 INFO:teuthology.orchestra.run.smithi184.stdout:Success. You can now start the database server using: 2023-10-17T06:05:32.324 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:05:32.324 INFO:teuthology.orchestra.run.smithi184.stdout: pg_ctlcluster 12 main start 2023-10-17T06:05:32.324 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:05:32.874 INFO:teuthology.orchestra.run.smithi184.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-10-17T06:05:32.875 INFO:teuthology.orchestra.run.smithi184.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-10-17T06:05:33.097 INFO:teuthology.orchestra.run.smithi184.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-17T06:05:35.907 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-17T06:05:36.033 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-17T06:05:36.159 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-17T06:05:36.360 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-17T06:05:36.486 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-10-17T06:05:36.621 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-17T06:05:36.757 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-17T06:05:36.891 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-17T06:05:37.017 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-17T06:05:37.210 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-17T06:05:37.336 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-10-17T06:05:37.462 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-17T06:05:37.817 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:05:37.818 INFO:teuthology.orchestra.run.smithi125.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-17T06:05:37.818 INFO:teuthology.orchestra.run.smithi125.stdout:which means they are currently configured by ifupdown: 2023-10-17T06:05:37.818 INFO:teuthology.orchestra.run.smithi125.stdout:- enp3s0f1 2023-10-17T06:05:37.818 INFO:teuthology.orchestra.run.smithi125.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-17T06:05:37.819 INFO:teuthology.orchestra.run.smithi125.stdout:remove their configuration from /etc/network/interfaces. 2023-10-17T06:05:37.819 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:05:38.048 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-17T06:05:38.586 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-17T06:05:38.695 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:05:38.695 INFO:teuthology.orchestra.run.smithi184.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-17T06:05:38.695 INFO:teuthology.orchestra.run.smithi184.stdout:which means they are currently configured by ifupdown: 2023-10-17T06:05:38.696 INFO:teuthology.orchestra.run.smithi184.stdout:- enp3s0f1 2023-10-17T06:05:38.696 INFO:teuthology.orchestra.run.smithi184.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-17T06:05:38.696 INFO:teuthology.orchestra.run.smithi184.stdout:remove their configuration from /etc/network/interfaces. 2023-10-17T06:05:38.696 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:05:38.917 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-17T06:05:39.511 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-17T06:05:39.527 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-17T06:05:40.482 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-17T06:05:40.493 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-17T06:05:40.616 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-17T06:05:40.827 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-17T06:05:40.960 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-10-17T06:05:41.086 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-10-17T06:05:41.229 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-17T06:05:41.355 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-17T06:05:41.466 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-17T06:05:41.481 INFO:teuthology.orchestra.run.smithi125.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-17T06:05:41.600 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-17T06:05:41.784 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-17T06:05:41.842 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-17T06:05:41.842 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-17T06:05:41.902 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-10-17T06:05:42.028 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-10-17T06:05:42.187 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-17T06:05:42.313 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-17T06:05:42.440 INFO:teuthology.orchestra.run.smithi184.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-17T06:05:42.809 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-17T06:05:42.809 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-17T06:05:42.875 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-17T06:05:42.992 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-17T06:05:43.152 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-17T06:05:43.312 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-17T06:05:43.813 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-17T06:05:43.859 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-17T06:05:43.968 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-17T06:05:44.103 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-17T06:05:44.296 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-17T06:05:44.797 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-17T06:05:57.266 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-17T06:05:57.399 INFO:teuthology.orchestra.run.smithi125.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-17T06:05:57.957 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-17T06:05:58.059 INFO:teuthology.orchestra.run.smithi184.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-17T06:05:58.666 INFO:teuthology.orchestra.run.smithi125.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-17T06:05:58.672 DEBUG:teuthology.parallel:result is None 2023-10-17T06:05:59.313 INFO:teuthology.orchestra.run.smithi184.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-17T06:05:59.320 DEBUG:teuthology.parallel:result is None 2023-10-17T06:05:59.321 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6f3e6b48891b9b50415c0822b6b870797fcda16d 2023-10-17T06:05:59.545 DEBUG:teuthology.orchestra.run.smithi125:> dpkg-query -W -f '${Version}' ceph 2023-10-17T06:05:59.589 INFO:teuthology.orchestra.run.smithi125.stdout:18.0.0-5610-g6f3e6b48-1focal 2023-10-17T06:05:59.589 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5610-g6f3e6b48-1focal 2023-10-17T06:05:59.590 INFO:teuthology.task.install:The correct ceph version 18.0.0-5610-g6f3e6b48-1focal is installed. 2023-10-17T06:05:59.590 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6f3e6b48891b9b50415c0822b6b870797fcda16d 2023-10-17T06:05:59.734 DEBUG:teuthology.orchestra.run.smithi184:> dpkg-query -W -f '${Version}' ceph 2023-10-17T06:05:59.774 INFO:teuthology.orchestra.run.smithi184.stdout:18.0.0-5610-g6f3e6b48-1focal 2023-10-17T06:05:59.774 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5610-g6f3e6b48-1focal 2023-10-17T06:05:59.775 INFO:teuthology.task.install:The correct ceph version 18.0.0-5610-g6f3e6b48-1focal is installed. 2023-10-17T06:05:59.775 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-17T06:05:59.776 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:05:59.776 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-17T06:05:59.814 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:05:59.815 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-17T06:05:59.855 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-17T06:05:59.855 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:05:59.855 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/daemon-helper 2023-10-17T06:05:59.890 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-17T06:05:59.971 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:05:59.971 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2023-10-17T06:06:00.008 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-17T06:06:00.086 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-17T06:06:00.087 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:00.087 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-17T06:06:00.127 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-17T06:06:00.204 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:06:00.205 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-17T06:06:00.240 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-17T06:06:00.316 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-17T06:06:00.317 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:00.317 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/stdin-killer 2023-10-17T06:06:00.351 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-17T06:06:00.433 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:06:00.433 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2023-10-17T06:06:00.468 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-17T06:06:00.542 INFO:teuthology.run_tasks:Running task ceph... 2023-10-17T06:06:00.607 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-17T06:06:00.608 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 777 /var/log/ceph 2023-10-17T06:06:00.616 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /var/log/ceph 2023-10-17T06:06:00.654 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-17T06:06:00.655 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-17T06:06:00.698 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-17T06:06:00.732 INFO:tasks.ceph:Creating extra log directories... 2023-10-17T06:06:00.733 DEBUG:teuthology.orchestra.run.smithi125:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-17T06:06:00.772 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-17T06:06:00.817 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-17T06:06:00.818 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-17T06:06:00.819 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-17T06:06:00.819 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:00.820 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-17T06:06:00.866 DEBUG:teuthology.orchestra.run.smithi125:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-17T06:06:00.998 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:06:00.999 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-17T06:06:01.019 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-17T06:06:01.149 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-17T06:06:01.150 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'but it is still running', 'slow request', 'MDS_CLIENT_LATE_RELEASE', 't responding to mclientcaps', 'file system flag refuse_client_session is set', 'Degraded data redundancy', 'MDS_CLIENTS_LAGGY', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-17T06:06:01.150 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/dparmar-2023-10-17_05:37:11-fs:functional-wip-63105-distro-default-smithi/7431046', 'branch': 'wip-63105', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery}', 'email': None, 'first_in_suite': False, 'job_id': '7431046', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'dparmar-2023-10-17_05:37:11-fs:functional-wip-63105-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-63105'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'but it is still running', 'slow request', 'MDS_CLIENT_LATE_RELEASE', 't responding to mclientcaps', 'file system flag refuse_client_session is set', 'Degraded data redundancy', 'MDS_CLIENTS_LAGGY', 'Reduced data availability'], 'sha1': '6f3e6b48891b9b50415c0822b6b870797fcda16d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6f3e6b48891b9b50415c0822b6b870797fcda16d'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-63105', 'sha1': '3aa759a2d032371ce26212d0251f10b9c2613685'}}, 'owner': 'scheduled_dparmar@teuthology', 'priority': 55, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6930, 'sha1': '6f3e6b48891b9b50415c0822b6b870797fcda16d', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-63105', 'suite_path': '/home/teuthworker/src/github.com_dparmar18_ceph_3aa759a2d032371ce26212d0251f10b9c2613685/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/dparmar18/ceph', 'suite_sha1': '3aa759a2d032371ce26212d0251f10b9c2613685', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi125.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi184.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6f3e6b48891b9b50415c0822b6b870797fcda16d'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_client_recovery']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-17_05:37:11', 'tube': 'smithi', 'user': 'dparmar', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-17T06:06:01.151 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-17T06:06:01.157 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-17T06:06:01.190 DEBUG:teuthology.orchestra.run.smithi125:> sudo install -d -m0777 -- /var/run/ceph 2023-10-17T06:06:01.223 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/run/ceph 2023-10-17T06:06:01.269 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:01.270 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/scratch_devs of=/dev/stdout 2023-10-17T06:06:01.318 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-17T06:06:01.318 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_1 2023-10-17T06:06:01.379 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-17T06:06:01.379 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-17T06:06:01.379 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 5h/5d Inode: 495 Links: 1 2023-10-17T06:06:01.380 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-17T06:06:01.380 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-10-17 06:00:17.631612283 +0000 2023-10-17T06:06:01.380 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-10-17 06:00:17.147623443 +0000 2023-10-17T06:06:01.380 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-10-17 06:00:17.147623443 +0000 2023-10-17T06:06:01.380 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: - 2023-10-17T06:06:01.381 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-17T06:06:01.455 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-10-17T06:06:01.455 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-10-17T06:06:01.455 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000703968 s, 727 kB/s 2023-10-17T06:06:01.457 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-17T06:06:01.525 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_2 2023-10-17T06:06:01.587 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-17T06:06:01.587 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-17T06:06:01.587 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 5h/5d Inode: 500 Links: 1 2023-10-17T06:06:01.588 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-17T06:06:01.588 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-10-17 06:00:18.367595309 +0000 2023-10-17T06:06:01.588 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-10-17 06:00:17.907605917 +0000 2023-10-17T06:06:01.588 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-10-17 06:00:17.907605917 +0000 2023-10-17T06:06:01.588 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: - 2023-10-17T06:06:01.589 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-17T06:06:01.662 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-10-17T06:06:01.662 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-10-17T06:06:01.663 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000542572 s, 944 kB/s 2023-10-17T06:06:01.666 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-17T06:06:01.735 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_3 2023-10-17T06:06:01.794 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-17T06:06:01.794 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-17T06:06:01.794 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 5h/5d Inode: 506 Links: 1 2023-10-17T06:06:01.795 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-17T06:06:01.795 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-10-17 06:00:19.131577691 +0000 2023-10-17T06:06:01.795 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-10-17 06:00:18.655588668 +0000 2023-10-17T06:06:01.795 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-10-17 06:00:18.655588668 +0000 2023-10-17T06:06:01.795 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: - 2023-10-17T06:06:01.796 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-17T06:06:01.873 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-10-17T06:06:01.873 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-10-17T06:06:01.873 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000689648 s, 742 kB/s 2023-10-17T06:06:01.876 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-17T06:06:01.941 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_4 2023-10-17T06:06:02.003 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-17T06:06:02.003 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-17T06:06:02.003 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 5h/5d Inode: 513 Links: 1 2023-10-17T06:06:02.004 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-17T06:06:02.004 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-10-17 06:00:19.415571141 +0000 2023-10-17T06:06:02.004 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-10-17 06:00:19.411571233 +0000 2023-10-17T06:06:02.004 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-10-17 06:00:19.411571233 +0000 2023-10-17T06:06:02.004 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: - 2023-10-17T06:06:02.005 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-17T06:06:02.077 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-10-17T06:06:02.078 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-10-17T06:06:02.078 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000589271 s, 869 kB/s 2023-10-17T06:06:02.079 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-17T06:06:02.144 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-17T06:06:02.145 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:06:02.145 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2023-10-17T06:06:02.165 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-17T06:06:02.166 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2023-10-17T06:06:02.234 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-17T06:06:02.235 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-17T06:06:02.235 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 494 Links: 1 2023-10-17T06:06:02.235 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-17T06:06:02.235 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-10-17 06:00:17.251337045 +0000 2023-10-17T06:06:02.236 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-10-17 06:00:17.247337136 +0000 2023-10-17T06:06:02.236 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-10-17 06:00:17.247337136 +0000 2023-10-17T06:06:02.236 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-10-17T06:06:02.236 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-17T06:06:02.313 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-10-17T06:06:02.313 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-10-17T06:06:02.313 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000697392 s, 734 kB/s 2023-10-17T06:06:02.315 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-17T06:06:02.381 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2023-10-17T06:06:02.450 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-17T06:06:02.450 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-17T06:06:02.451 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 502 Links: 1 2023-10-17T06:06:02.451 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-17T06:06:02.451 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-10-17 06:00:18.499308264 +0000 2023-10-17T06:06:02.451 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-10-17 06:00:18.019319333 +0000 2023-10-17T06:06:02.451 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-10-17 06:00:18.019319333 +0000 2023-10-17T06:06:02.452 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-10-17T06:06:02.452 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-17T06:06:02.528 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-10-17T06:06:02.528 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-10-17T06:06:02.529 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000635645 s, 805 kB/s 2023-10-17T06:06:02.530 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-17T06:06:02.598 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2023-10-17T06:06:02.662 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-17T06:06:02.663 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-17T06:06:02.663 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 506 Links: 1 2023-10-17T06:06:02.663 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-17T06:06:02.663 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-10-17 06:00:18.799301346 +0000 2023-10-17T06:06:02.664 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-10-17 06:00:18.795301438 +0000 2023-10-17T06:06:02.664 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-10-17 06:00:18.795301438 +0000 2023-10-17T06:06:02.664 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-10-17T06:06:02.664 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-17T06:06:02.738 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-10-17T06:06:02.739 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-10-17T06:06:02.739 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000705283 s, 726 kB/s 2023-10-17T06:06:02.741 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-17T06:06:02.811 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2023-10-17T06:06:02.871 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-17T06:06:02.872 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-17T06:06:02.872 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 512 Links: 1 2023-10-17T06:06:02.872 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-17T06:06:02.872 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-10-17 06:00:19.551284003 +0000 2023-10-17T06:06:02.872 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-10-17 06:00:19.547284096 +0000 2023-10-17T06:06:02.873 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-10-17 06:00:19.547284096 +0000 2023-10-17T06:06:02.873 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-10-17T06:06:02.873 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-17T06:06:02.946 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-10-17T06:06:02.946 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-10-17T06:06:02.946 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000645989 s, 793 kB/s 2023-10-17T06:06:02.948 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-17T06:06:03.014 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-17T06:06:03.015 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi125.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-17T06:06:03.015 INFO:tasks.ceph:Generating config... 2023-10-17T06:06:03.016 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-17T06:06:03.017 INFO:tasks.ceph:[client] debug client = 20 2023-10-17T06:06:03.017 INFO:tasks.ceph:[client] debug ms = 1 2023-10-17T06:06:03.017 INFO:tasks.ceph:[client] pid file = 2023-10-17T06:06:03.017 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-17T06:06:03.018 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-17T06:06:03.018 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-17T06:06:03.018 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-17T06:06:03.018 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-17T06:06:03.019 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-17T06:06:03.019 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-17T06:06:03.019 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-17T06:06:03.019 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-17T06:06:03.020 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-17T06:06:03.020 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-17T06:06:03.020 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-17T06:06:03.021 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-17T06:06:03.021 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-17T06:06:03.021 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-17T06:06:03.021 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-17T06:06:03.022 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-17T06:06:03.022 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-17T06:06:03.022 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-17T06:06:03.022 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-17T06:06:03.023 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-17T06:06:03.023 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-17T06:06:03.023 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-17T06:06:03.024 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-17T06:06:03.024 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-17T06:06:03.024 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-17T06:06:03.024 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-17T06:06:03.025 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-17T06:06:03.025 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-17T06:06:03.025 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-17T06:06:03.025 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-17T06:06:03.026 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-17T06:06:03.026 INFO:tasks.ceph:Setting up mon.a... 2023-10-17T06:06:03.026 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-17T06:06:03.099 INFO:teuthology.orchestra.run.smithi125.stdout:creating /etc/ceph/ceph.keyring 2023-10-17T06:06:03.120 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-17T06:06:03.194 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-17T06:06:03.227 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.125'), ('mon.b', '172.21.15.184'), ('mon.c', '[v2:172.21.15.184:3301,v1:172.21.15.184:6790]')] 2023-10-17T06:06:03.228 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.125,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-17T06:06:03.229 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:03.230 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-17T06:06:03.285 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.125 --add b 172.21.15.184 --addv c '[v2:172.21.15.184:3301,v1:172.21.15.184:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-17T06:06:03.398 INFO:teuthology.orchestra.run.smithi125.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-17T06:06:03.398 INFO:teuthology.orchestra.run.smithi125.stdout:monmaptool: generated fsid c779df02-0ec4-47de-a0f3-2371e60a2dde 2023-10-17T06:06:03.398 INFO:teuthology.orchestra.run.smithi125.stdout:setting min_mon_release = pacific 2023-10-17T06:06:03.399 INFO:teuthology.orchestra.run.smithi125.stdout:epoch 0 2023-10-17T06:06:03.399 INFO:teuthology.orchestra.run.smithi125.stdout:fsid c779df02-0ec4-47de-a0f3-2371e60a2dde 2023-10-17T06:06:03.399 INFO:teuthology.orchestra.run.smithi125.stdout:last_changed 2023-10-17T06:06:03.398044+0000 2023-10-17T06:06:03.399 INFO:teuthology.orchestra.run.smithi125.stdout:created 2023-10-17T06:06:03.398044+0000 2023-10-17T06:06:03.399 INFO:teuthology.orchestra.run.smithi125.stdout:min_mon_release 16 (pacific) 2023-10-17T06:06:03.400 INFO:teuthology.orchestra.run.smithi125.stdout:election_strategy: 1 2023-10-17T06:06:03.400 INFO:teuthology.orchestra.run.smithi125.stdout:0: [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] mon.a 2023-10-17T06:06:03.400 INFO:teuthology.orchestra.run.smithi125.stdout:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2023-10-17T06:06:03.400 INFO:teuthology.orchestra.run.smithi125.stdout:2: [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] mon.c 2023-10-17T06:06:03.400 INFO:teuthology.orchestra.run.smithi125.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-17T06:06:03.402 DEBUG:teuthology.orchestra.run.smithi125:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-17T06:06:03.416 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c779df02-0ec4-47de-a0f3-2371e60a2dde... 2023-10-17T06:06:03.417 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-17T06:06:03.467 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-17T06:06:03.540 INFO:teuthology.orchestra.run.smithi125.stdout:[global] 2023-10-17T06:06:03.540 INFO:teuthology.orchestra.run.smithi125.stdout: chdir = "" 2023-10-17T06:06:03.540 INFO:teuthology.orchestra.run.smithi125.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-17T06:06:03.541 INFO:teuthology.orchestra.run.smithi125.stdout: auth supported = cephx 2023-10-17T06:06:03.541 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.541 INFO:teuthology.orchestra.run.smithi125.stdout: filestore xattr use omap = true 2023-10-17T06:06:03.541 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.542 INFO:teuthology.orchestra.run.smithi125.stdout: mon clock drift allowed = 1.000 2023-10-17T06:06:03.542 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.542 INFO:teuthology.orchestra.run.smithi125.stdout: osd crush chooseleaf type = 0 2023-10-17T06:06:03.542 INFO:teuthology.orchestra.run.smithi125.stdout: auth debug = true 2023-10-17T06:06:03.542 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.543 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on old message = true 2023-10-17T06:06:03.543 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on bug = true 2023-10-17T06:06:03.543 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.543 INFO:teuthology.orchestra.run.smithi125.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-17T06:06:03.543 INFO:teuthology.orchestra.run.smithi125.stdout: mon pg warn max object skew = 0 2023-10-17T06:06:03.544 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.544 INFO:teuthology.orchestra.run.smithi125.stdout: # disable pg_autoscaler by default for new pools 2023-10-17T06:06:03.544 INFO:teuthology.orchestra.run.smithi125.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-17T06:06:03.544 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.544 INFO:teuthology.orchestra.run.smithi125.stdout: osd pool default size = 2 2023-10-17T06:06:03.545 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.545 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd allow primary affinity = true 2023-10-17T06:06:03.545 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd allow pg remap = true 2023-10-17T06:06:03.545 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on legacy crush tunables = false 2023-10-17T06:06:03.546 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on crush straw calc version zero = false 2023-10-17T06:06:03.546 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on no sortbitwise = false 2023-10-17T06:06:03.546 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on osd down out interval zero = false 2023-10-17T06:06:03.546 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on too few osds = false 2023-10-17T06:06:03.546 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-17T06:06:03.547 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-17T06:06:03.547 INFO:teuthology.orchestra.run.smithi125.stdout: mon_allow_pool_size_one = true 2023-10-17T06:06:03.547 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.547 INFO:teuthology.orchestra.run.smithi125.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-17T06:06:03.547 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.548 INFO:teuthology.orchestra.run.smithi125.stdout: osd default data pool replay window = 5 2023-10-17T06:06:03.548 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.548 INFO:teuthology.orchestra.run.smithi125.stdout: mon allow pool delete = true 2023-10-17T06:06:03.548 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.548 INFO:teuthology.orchestra.run.smithi125.stdout: mon cluster log file level = debug 2023-10-17T06:06:03.549 INFO:teuthology.orchestra.run.smithi125.stdout: debug asserts on shutdown = true 2023-10-17T06:06:03.549 INFO:teuthology.orchestra.run.smithi125.stdout: mon health detail to clog = false 2023-10-17T06:06:03.549 INFO:teuthology.orchestra.run.smithi125.stdout: mon host = "172.21.15.125,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2023-10-17T06:06:03.549 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on skipped message = False 2023-10-17T06:06:03.549 INFO:teuthology.orchestra.run.smithi125.stdout: fsid = c779df02-0ec4-47de-a0f3-2371e60a2dde 2023-10-17T06:06:03.550 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.550 INFO:teuthology.orchestra.run.smithi125.stdout:[osd] 2023-10-17T06:06:03.550 INFO:teuthology.orchestra.run.smithi125.stdout: osd journal size = 100 2023-10-17T06:06:03.550 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.550 INFO:teuthology.orchestra.run.smithi125.stdout: osd scrub load threshold = 5.0 2023-10-17T06:06:03.551 INFO:teuthology.orchestra.run.smithi125.stdout: osd scrub max interval = 600 2023-10-17T06:06:03.551 INFO:teuthology.orchestra.run.smithi125.stdout: osd mclock profile = high_recovery_ops 2023-10-17T06:06:03.551 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.551 INFO:teuthology.orchestra.run.smithi125.stdout: osd recover clone overlap = true 2023-10-17T06:06:03.551 INFO:teuthology.orchestra.run.smithi125.stdout: osd recovery max chunk = 1048576 2023-10-17T06:06:03.552 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.552 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug shutdown = true 2023-10-17T06:06:03.552 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug op order = true 2023-10-17T06:06:03.552 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug verify stray on activate = true 2023-10-17T06:06:03.552 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.553 INFO:teuthology.orchestra.run.smithi125.stdout: osd open classes on start = true 2023-10-17T06:06:03.553 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug pg log writeout = true 2023-10-17T06:06:03.553 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.553 INFO:teuthology.orchestra.run.smithi125.stdout: osd deep scrub update digest min age = 30 2023-10-17T06:06:03.553 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.553 INFO:teuthology.orchestra.run.smithi125.stdout: osd map max advance = 10 2023-10-17T06:06:03.554 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.554 INFO:teuthology.orchestra.run.smithi125.stdout: journal zero on create = true 2023-10-17T06:06:03.554 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.554 INFO:teuthology.orchestra.run.smithi125.stdout: filestore ondisk finisher threads = 3 2023-10-17T06:06:03.554 INFO:teuthology.orchestra.run.smithi125.stdout: filestore apply finisher threads = 3 2023-10-17T06:06:03.555 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.555 INFO:teuthology.orchestra.run.smithi125.stdout: bdev debug aio = true 2023-10-17T06:06:03.555 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug misdirected ops = true 2023-10-17T06:06:03.555 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore block size = 96636764160 2023-10-17T06:06:03.555 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore fsck on mount = True 2023-10-17T06:06:03.556 INFO:teuthology.orchestra.run.smithi125.stdout: debug bluefs = 20 2023-10-17T06:06:03.556 INFO:teuthology.orchestra.run.smithi125.stdout: debug bluestore = 20 2023-10-17T06:06:03.556 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-10-17T06:06:03.556 INFO:teuthology.orchestra.run.smithi125.stdout: debug osd = 20 2023-10-17T06:06:03.556 INFO:teuthology.orchestra.run.smithi125.stdout: debug rocksdb = 10 2023-10-17T06:06:03.557 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd backfillfull_ratio = 0.85 2023-10-17T06:06:03.557 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd full ratio = 0.9 2023-10-17T06:06:03.557 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd nearfull ratio = 0.8 2023-10-17T06:06:03.557 INFO:teuthology.orchestra.run.smithi125.stdout: osd failsafe full ratio = 0.95 2023-10-17T06:06:03.557 INFO:teuthology.orchestra.run.smithi125.stdout: osd objectstore = bluestore 2023-10-17T06:06:03.558 INFO:teuthology.orchestra.run.smithi125.stdout: osd op complaint time = 180 2023-10-17T06:06:03.558 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.558 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr] 2023-10-17T06:06:03.558 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-10-17T06:06:03.558 INFO:teuthology.orchestra.run.smithi125.stdout: debug mgr = 20 2023-10-17T06:06:03.559 INFO:teuthology.orchestra.run.smithi125.stdout: debug mon = 20 2023-10-17T06:06:03.559 INFO:teuthology.orchestra.run.smithi125.stdout: debug auth = 20 2023-10-17T06:06:03.559 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min pgs per osd = 4 2023-10-17T06:06:03.559 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min bytes per osd = 10 2023-10-17T06:06:03.560 INFO:teuthology.orchestra.run.smithi125.stdout: mgr/telemetry/nag = false 2023-10-17T06:06:03.560 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.560 INFO:teuthology.orchestra.run.smithi125.stdout:[mon] 2023-10-17T06:06:03.560 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-10-17T06:06:03.560 INFO:teuthology.orchestra.run.smithi125.stdout: debug mon = 20 2023-10-17T06:06:03.561 INFO:teuthology.orchestra.run.smithi125.stdout: debug paxos = 20 2023-10-17T06:06:03.561 INFO:teuthology.orchestra.run.smithi125.stdout: debug auth = 20 2023-10-17T06:06:03.561 INFO:teuthology.orchestra.run.smithi125.stdout: mon data avail warn = 5 2023-10-17T06:06:03.561 INFO:teuthology.orchestra.run.smithi125.stdout: mon mgr mkfs grace = 240 2023-10-17T06:06:03.561 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min pgs per osd = 4 2023-10-17T06:06:03.562 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd reporter subtree level = osd 2023-10-17T06:06:03.562 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd prime pg temp = true 2023-10-17T06:06:03.562 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min bytes per osd = 10 2023-10-17T06:06:03.562 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.562 INFO:teuthology.orchestra.run.smithi125.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-17T06:06:03.563 INFO:teuthology.orchestra.run.smithi125.stdout: auth mon ticket ttl = 660 # 11m 2023-10-17T06:06:03.563 INFO:teuthology.orchestra.run.smithi125.stdout: auth service ticket ttl = 240 # 4m 2023-10-17T06:06:03.563 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.563 INFO:teuthology.orchestra.run.smithi125.stdout: # don't complain about insecure global_id in the test suite 2023-10-17T06:06:03.564 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-17T06:06:03.564 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-17T06:06:03.564 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.564 INFO:teuthology.orchestra.run.smithi125.stdout: # 1m isn't quite enough 2023-10-17T06:06:03.564 INFO:teuthology.orchestra.run.smithi125.stdout: mon_down_mkfs_grace = 2m 2023-10-17T06:06:03.565 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.565 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_filestore_osds = false 2023-10-17T06:06:03.565 INFO:teuthology.orchestra.run.smithi125.stdout: mon op complaint time = 120 2023-10-17T06:06:03.566 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:03.566 INFO:teuthology.orchestra.run.smithi125.stdout:[client] 2023-10-17T06:06:03.566 INFO:teuthology.orchestra.run.smithi125.stdout: rgw cache enabled = true 2023-10-17T06:06:03.566 INFO:teuthology.orchestra.run.smithi125.stdout: rgw enable ops log = true 2023-10-17T06:06:03.566 INFO:teuthology.orchestra.run.smithi125.stdout: rgw enable usage log = true 2023-10-17T06:06:03.567 INFO:teuthology.orchestra.run.smithi125.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-17T06:06:03.567 INFO:teuthology.orchestra.run.smithi125.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-17T06:06:03.567 INFO:teuthology.orchestra.run.smithi125.stdout: client mount timeout = 600 2023-10-17T06:06:03.567 INFO:teuthology.orchestra.run.smithi125.stdout: debug client = 20 2023-10-17T06:06:03.568 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-10-17T06:06:03.568 INFO:teuthology.orchestra.run.smithi125.stdout: pid file = "" 2023-10-17T06:06:03.568 INFO:teuthology.orchestra.run.smithi125.stdout: rados mon op timeout = 900 2023-10-17T06:06:03.568 INFO:teuthology.orchestra.run.smithi125.stdout: rados osd op timeout = 900 2023-10-17T06:06:03.568 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.a] 2023-10-17T06:06:03.569 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.b] 2023-10-17T06:06:03.569 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.c] 2023-10-17T06:06:03.569 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.a] 2023-10-17T06:06:03.569 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.c] 2023-10-17T06:06:03.569 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.b] 2023-10-17T06:06:03.570 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.d] 2023-10-17T06:06:03.570 INFO:teuthology.orchestra.run.smithi125.stdout:[mds] 2023-10-17T06:06:03.570 INFO:teuthology.orchestra.run.smithi125.stdout: debug mds = 20 2023-10-17T06:06:03.570 INFO:teuthology.orchestra.run.smithi125.stdout: debug mds balancer = 20 2023-10-17T06:06:03.570 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-10-17T06:06:03.571 INFO:teuthology.orchestra.run.smithi125.stdout: mds debug frag = True 2023-10-17T06:06:03.571 INFO:teuthology.orchestra.run.smithi125.stdout: mds debug scatterstat = True 2023-10-17T06:06:03.571 INFO:teuthology.orchestra.run.smithi125.stdout: mds op complaint time = 180 2023-10-17T06:06:03.571 INFO:teuthology.orchestra.run.smithi125.stdout: mds verify scatter = True 2023-10-17T06:06:03.571 INFO:teuthology.orchestra.run.smithi125.stdout: osd op complaint time = 180 2023-10-17T06:06:03.572 INFO:teuthology.orchestra.run.smithi125.stdout: rados mon op timeout = 900 2023-10-17T06:06:03.572 INFO:teuthology.orchestra.run.smithi125.stdout: rados osd op timeout = 900 2023-10-17T06:06:03.573 INFO:teuthology.orchestra.run.smithi184.stdout:[global] 2023-10-17T06:06:03.573 INFO:teuthology.orchestra.run.smithi184.stdout: chdir = "" 2023-10-17T06:06:03.573 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-17T06:06:03.573 INFO:teuthology.orchestra.run.smithi184.stdout: auth supported = cephx 2023-10-17T06:06:03.573 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.574 INFO:teuthology.orchestra.run.smithi184.stdout: filestore xattr use omap = true 2023-10-17T06:06:03.574 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.574 INFO:teuthology.orchestra.run.smithi184.stdout: mon clock drift allowed = 1.000 2023-10-17T06:06:03.574 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.575 INFO:teuthology.orchestra.run.smithi184.stdout: osd crush chooseleaf type = 0 2023-10-17T06:06:03.575 INFO:teuthology.orchestra.run.smithi184.stdout: auth debug = true 2023-10-17T06:06:03.575 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.575 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on old message = true 2023-10-17T06:06:03.575 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on bug = true 2023-10-17T06:06:03.576 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.576 INFO:teuthology.orchestra.run.smithi184.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-17T06:06:03.576 INFO:teuthology.orchestra.run.smithi184.stdout: mon pg warn max object skew = 0 2023-10-17T06:06:03.576 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.576 INFO:teuthology.orchestra.run.smithi184.stdout: # disable pg_autoscaler by default for new pools 2023-10-17T06:06:03.577 INFO:teuthology.orchestra.run.smithi184.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-17T06:06:03.577 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.577 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default size = 2 2023-10-17T06:06:03.577 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.577 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow primary affinity = true 2023-10-17T06:06:03.578 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow pg remap = true 2023-10-17T06:06:03.578 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on legacy crush tunables = false 2023-10-17T06:06:03.578 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on crush straw calc version zero = false 2023-10-17T06:06:03.578 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on no sortbitwise = false 2023-10-17T06:06:03.578 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on osd down out interval zero = false 2023-10-17T06:06:03.578 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on too few osds = false 2023-10-17T06:06:03.579 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-17T06:06:03.581 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-17T06:06:03.581 INFO:teuthology.orchestra.run.smithi184.stdout: mon_allow_pool_size_one = true 2023-10-17T06:06:03.581 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.582 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-17T06:06:03.582 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.582 INFO:teuthology.orchestra.run.smithi184.stdout: osd default data pool replay window = 5 2023-10-17T06:06:03.582 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.583 INFO:teuthology.orchestra.run.smithi184.stdout: mon allow pool delete = true 2023-10-17T06:06:03.583 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.583 INFO:teuthology.orchestra.run.smithi184.stdout: mon cluster log file level = debug 2023-10-17T06:06:03.583 INFO:teuthology.orchestra.run.smithi184.stdout: debug asserts on shutdown = true 2023-10-17T06:06:03.583 INFO:teuthology.orchestra.run.smithi184.stdout: mon health detail to clog = false 2023-10-17T06:06:03.584 INFO:teuthology.orchestra.run.smithi184.stdout: mon host = "172.21.15.125,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2023-10-17T06:06:03.584 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on skipped message = False 2023-10-17T06:06:03.584 INFO:teuthology.orchestra.run.smithi184.stdout: fsid = c779df02-0ec4-47de-a0f3-2371e60a2dde 2023-10-17T06:06:03.584 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.584 INFO:teuthology.orchestra.run.smithi184.stdout:[osd] 2023-10-17T06:06:03.585 INFO:teuthology.orchestra.run.smithi184.stdout: osd journal size = 100 2023-10-17T06:06:03.585 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.585 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub load threshold = 5.0 2023-10-17T06:06:03.585 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub max interval = 600 2023-10-17T06:06:03.585 INFO:teuthology.orchestra.run.smithi184.stdout: osd mclock profile = high_recovery_ops 2023-10-17T06:06:03.585 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.586 INFO:teuthology.orchestra.run.smithi184.stdout: osd recover clone overlap = true 2023-10-17T06:06:03.586 INFO:teuthology.orchestra.run.smithi184.stdout: osd recovery max chunk = 1048576 2023-10-17T06:06:03.586 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.586 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug shutdown = true 2023-10-17T06:06:03.586 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug op order = true 2023-10-17T06:06:03.587 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify stray on activate = true 2023-10-17T06:06:03.587 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.587 INFO:teuthology.orchestra.run.smithi184.stdout: osd open classes on start = true 2023-10-17T06:06:03.587 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug pg log writeout = true 2023-10-17T06:06:03.587 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.588 INFO:teuthology.orchestra.run.smithi184.stdout: osd deep scrub update digest min age = 30 2023-10-17T06:06:03.588 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.588 INFO:teuthology.orchestra.run.smithi184.stdout: osd map max advance = 10 2023-10-17T06:06:03.588 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.588 INFO:teuthology.orchestra.run.smithi184.stdout: journal zero on create = true 2023-10-17T06:06:03.588 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.589 INFO:teuthology.orchestra.run.smithi184.stdout: filestore ondisk finisher threads = 3 2023-10-17T06:06:03.589 INFO:teuthology.orchestra.run.smithi184.stdout: filestore apply finisher threads = 3 2023-10-17T06:06:03.589 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.589 INFO:teuthology.orchestra.run.smithi184.stdout: bdev debug aio = true 2023-10-17T06:06:03.589 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug misdirected ops = true 2023-10-17T06:06:03.590 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore block size = 96636764160 2023-10-17T06:06:03.590 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore fsck on mount = True 2023-10-17T06:06:03.590 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluefs = 20 2023-10-17T06:06:03.590 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluestore = 20 2023-10-17T06:06:03.590 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-17T06:06:03.591 INFO:teuthology.orchestra.run.smithi184.stdout: debug osd = 20 2023-10-17T06:06:03.591 INFO:teuthology.orchestra.run.smithi184.stdout: debug rocksdb = 10 2023-10-17T06:06:03.591 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd backfillfull_ratio = 0.85 2023-10-17T06:06:03.591 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd full ratio = 0.9 2023-10-17T06:06:03.591 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd nearfull ratio = 0.8 2023-10-17T06:06:03.592 INFO:teuthology.orchestra.run.smithi184.stdout: osd failsafe full ratio = 0.95 2023-10-17T06:06:03.592 INFO:teuthology.orchestra.run.smithi184.stdout: osd objectstore = bluestore 2023-10-17T06:06:03.592 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2023-10-17T06:06:03.592 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.592 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr] 2023-10-17T06:06:03.593 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-17T06:06:03.593 INFO:teuthology.orchestra.run.smithi184.stdout: debug mgr = 20 2023-10-17T06:06:03.593 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2023-10-17T06:06:03.593 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2023-10-17T06:06:03.593 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2023-10-17T06:06:03.593 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2023-10-17T06:06:03.594 INFO:teuthology.orchestra.run.smithi184.stdout: mgr/telemetry/nag = false 2023-10-17T06:06:03.594 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.594 INFO:teuthology.orchestra.run.smithi184.stdout:[mon] 2023-10-17T06:06:03.594 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-17T06:06:03.594 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2023-10-17T06:06:03.595 INFO:teuthology.orchestra.run.smithi184.stdout: debug paxos = 20 2023-10-17T06:06:03.595 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2023-10-17T06:06:03.595 INFO:teuthology.orchestra.run.smithi184.stdout: mon data avail warn = 5 2023-10-17T06:06:03.595 INFO:teuthology.orchestra.run.smithi184.stdout: mon mgr mkfs grace = 240 2023-10-17T06:06:03.595 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2023-10-17T06:06:03.596 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd reporter subtree level = osd 2023-10-17T06:06:03.596 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd prime pg temp = true 2023-10-17T06:06:03.596 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2023-10-17T06:06:03.596 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.596 INFO:teuthology.orchestra.run.smithi184.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-17T06:06:03.597 INFO:teuthology.orchestra.run.smithi184.stdout: auth mon ticket ttl = 660 # 11m 2023-10-17T06:06:03.597 INFO:teuthology.orchestra.run.smithi184.stdout: auth service ticket ttl = 240 # 4m 2023-10-17T06:06:03.597 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.597 INFO:teuthology.orchestra.run.smithi184.stdout: # don't complain about insecure global_id in the test suite 2023-10-17T06:06:03.597 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-17T06:06:03.598 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-17T06:06:03.598 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.598 INFO:teuthology.orchestra.run.smithi184.stdout: # 1m isn't quite enough 2023-10-17T06:06:03.598 INFO:teuthology.orchestra.run.smithi184.stdout: mon_down_mkfs_grace = 2m 2023-10-17T06:06:03.598 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.598 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_filestore_osds = false 2023-10-17T06:06:03.599 INFO:teuthology.orchestra.run.smithi184.stdout: mon op complaint time = 120 2023-10-17T06:06:03.599 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-10-17T06:06:03.599 INFO:teuthology.orchestra.run.smithi184.stdout:[client] 2023-10-17T06:06:03.599 INFO:teuthology.orchestra.run.smithi184.stdout: rgw cache enabled = true 2023-10-17T06:06:03.599 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable ops log = true 2023-10-17T06:06:03.600 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable usage log = true 2023-10-17T06:06:03.600 INFO:teuthology.orchestra.run.smithi184.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-17T06:06:03.600 INFO:teuthology.orchestra.run.smithi184.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-17T06:06:03.600 INFO:teuthology.orchestra.run.smithi184.stdout: client mount timeout = 600 2023-10-17T06:06:03.600 INFO:teuthology.orchestra.run.smithi184.stdout: debug client = 20 2023-10-17T06:06:03.601 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-17T06:06:03.601 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = "" 2023-10-17T06:06:03.601 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2023-10-17T06:06:03.601 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2023-10-17T06:06:03.601 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.a] 2023-10-17T06:06:03.602 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.b] 2023-10-17T06:06:03.602 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.c] 2023-10-17T06:06:03.602 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2023-10-17T06:06:03.602 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2023-10-17T06:06:03.602 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2023-10-17T06:06:03.603 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2023-10-17T06:06:03.603 INFO:teuthology.orchestra.run.smithi184.stdout:[mds] 2023-10-17T06:06:03.603 INFO:teuthology.orchestra.run.smithi184.stdout: debug mds = 20 2023-10-17T06:06:03.603 INFO:teuthology.orchestra.run.smithi184.stdout: debug mds balancer = 20 2023-10-17T06:06:03.603 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-10-17T06:06:03.604 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug frag = True 2023-10-17T06:06:03.604 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug scatterstat = True 2023-10-17T06:06:03.604 INFO:teuthology.orchestra.run.smithi184.stdout: mds op complaint time = 180 2023-10-17T06:06:03.604 INFO:teuthology.orchestra.run.smithi184.stdout: mds verify scatter = True 2023-10-17T06:06:03.604 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2023-10-17T06:06:03.604 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2023-10-17T06:06:03.605 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2023-10-17T06:06:03.606 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-17T06:06:03.607 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-17T06:06:03.696 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-17T06:06:03.696 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:03.697 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-17T06:06:03.712 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:03.712 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-17T06:06:03.780 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi125.front.sepia.ceph.com 2023-10-17T06:06:03.780 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:03.781 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-17T06:06:03.781 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-17T06:06:03.885 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:03.885 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-17T06:06:03.945 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi184.front.sepia.ceph.com 2023-10-17T06:06:03.945 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:06:03.946 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-17T06:06:03.946 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-17T06:06:04.008 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:06:04.008 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-17T06:06:04.071 INFO:tasks.ceph:Setting up mon nodes... 2023-10-17T06:06:04.071 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-17T06:06:04.071 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-17T06:06:04.174 INFO:teuthology.orchestra.run.smithi125.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-17T06:06:04.182 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-17T06:06:04.285 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-17T06:06:04.306 INFO:tasks.ceph:Setting up mds nodes... 2023-10-17T06:06:04.307 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-17T06:06:04.409 INFO:teuthology.orchestra.run.smithi125.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-17T06:06:04.415 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-17T06:06:04.449 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-17T06:06:04.592 INFO:teuthology.orchestra.run.smithi125.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-17T06:06:04.600 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-17T06:06:04.635 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-17T06:06:04.733 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-17T06:06:04.740 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-17T06:06:04.775 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-17T06:06:04.918 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-17T06:06:04.925 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-17T06:06:04.959 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-17T06:06:04.959 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-17T06:06:05.034 INFO:teuthology.orchestra.run.smithi125.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-17T06:06:05.062 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-17T06:06:05.138 INFO:teuthology.orchestra.run.smithi125.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-17T06:06:05.166 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-17T06:06:05.244 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-17T06:06:05.273 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-17T06:06:05.347 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-17T06:06:05.375 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-17T06:06:05.376 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi125.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-17T06:06:05.376 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-17T06:06:05.412 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-17T06:06:05.412 INFO:tasks.ceph:role: osd.0 2023-10-17T06:06:05.412 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-17T06:06:05.413 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-17T06:06:06.036 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-17T06:06:06.036 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-17T06:06:06.036 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-17T06:06:06.036 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 2023-10-17T06:06:06.037 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-17T06:06:06.037 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2023-10-17T06:06:06.037 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-17T06:06:06.037 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-17T06:06:06.037 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-17T06:06:06.037 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-17T06:06:06.040 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2023-10-17T06:06:06.041 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-17T06:06:06.155 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-17T06:06:06.175 INFO:teuthology.orchestra.run.smithi125.stderr:sudo: /sbin/restorecon: command not found 2023-10-17T06:06:06.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-17T06:06:06.177 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-17T06:06:06.261 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-17T06:06:06.261 INFO:tasks.ceph:role: osd.1 2023-10-17T06:06:06.261 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-17T06:06:06.262 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-17T06:06:06.811 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-17T06:06:06.812 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-17T06:06:06.812 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-17T06:06:06.812 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 2023-10-17T06:06:06.812 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-17T06:06:06.812 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2023-10-17T06:06:06.813 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-17T06:06:06.813 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-17T06:06:06.813 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-17T06:06:06.813 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-17T06:06:06.817 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2023-10-17T06:06:06.817 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-17T06:06:06.885 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-17T06:06:06.908 INFO:teuthology.orchestra.run.smithi125.stderr:sudo: /sbin/restorecon: command not found 2023-10-17T06:06:06.909 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-17T06:06:06.910 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-17T06:06:06.984 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-17T06:06:06.984 INFO:tasks.ceph:role: osd.2 2023-10-17T06:06:06.985 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-17T06:06:06.985 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-17T06:06:07.586 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-17T06:06:07.587 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-17T06:06:07.587 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-17T06:06:07.587 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 2023-10-17T06:06:07.587 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-17T06:06:07.587 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2023-10-17T06:06:07.588 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-17T06:06:07.588 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-17T06:06:07.588 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-17T06:06:07.588 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-17T06:06:07.592 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2023-10-17T06:06:07.592 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-17T06:06:07.719 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-17T06:06:07.739 INFO:teuthology.orchestra.run.smithi125.stderr:sudo: /sbin/restorecon: command not found 2023-10-17T06:06:07.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-17T06:06:07.741 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-17T06:06:07.820 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-17T06:06:07.821 INFO:tasks.ceph:role: osd.3 2023-10-17T06:06:07.821 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-17T06:06:07.821 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-17T06:06:08.410 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-17T06:06:08.411 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-17T06:06:08.411 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-17T06:06:08.411 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 2023-10-17T06:06:08.411 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-17T06:06:08.412 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2023-10-17T06:06:08.412 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-17T06:06:08.412 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-17T06:06:08.412 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-17T06:06:08.412 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-17T06:06:08.414 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2023-10-17T06:06:08.415 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-17T06:06:08.533 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-17T06:06:08.553 INFO:teuthology.orchestra.run.smithi125.stderr:sudo: /sbin/restorecon: command not found 2023-10-17T06:06:08.554 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-17T06:06:08.555 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-17T06:06:08.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:08.709+0000 7fcaec0c9700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-17T06:06:08.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:08.713+0000 7fcaec0c9700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-17T06:06:08.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:08.713+0000 7fcaec0c9700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-17T06:06:08.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:08.713+0000 7fcaec0c9700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-17T06:06:08.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:08.713+0000 7fcaec0c9700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-17T06:06:08.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:08.713+0000 7fcaec0c9700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-17T06:06:11.773 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-17T06:06:11.807 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-17T06:06:11.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:11.929+0000 7f9d94812700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-17T06:06:11.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:11.929+0000 7f9d94812700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-17T06:06:11.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:11.929+0000 7f9d94812700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-17T06:06:11.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:11.929+0000 7f9d94812700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-17T06:06:11.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:11.929+0000 7f9d94812700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-17T06:06:11.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:11.933+0000 7f9d94812700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-17T06:06:15.012 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-17T06:06:15.047 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-17T06:06:15.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:15.169+0000 7f30df5af700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-17T06:06:15.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:15.169+0000 7f30df5af700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-17T06:06:15.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:15.169+0000 7f30df5af700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-17T06:06:15.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:15.169+0000 7f30df5af700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-17T06:06:15.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:15.169+0000 7f30df5af700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-17T06:06:15.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:15.173+0000 7f30df5af700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-17T06:06:18.232 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-17T06:06:18.265 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-17T06:06:18.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:18.393+0000 7f57950f8700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-17T06:06:18.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:18.393+0000 7f57950f8700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-17T06:06:18.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:18.393+0000 7f57950f8700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-17T06:06:18.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:18.393+0000 7f57950f8700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-17T06:06:18.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:18.393+0000 7f57950f8700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-17T06:06:18.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:18.393+0000 7f57950f8700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-17T06:06:21.456 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-17T06:06:21.490 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-17T06:06:21.531 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-17T06:06:21.531 INFO:tasks.ceph:role: osd.4 2023-10-17T06:06:21.531 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-17T06:06:21.532 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-17T06:06:22.150 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-17T06:06:22.151 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-17T06:06:22.151 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-17T06:06:22.151 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 2023-10-17T06:06:22.152 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-17T06:06:22.152 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-10-17T06:06:22.152 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-17T06:06:22.152 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-17T06:06:22.152 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-17T06:06:22.153 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-17T06:06:22.157 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-10-17T06:06:22.158 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-17T06:06:22.290 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-17T06:06:22.310 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2023-10-17T06:06:22.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-17T06:06:22.313 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-17T06:06:22.391 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-17T06:06:22.392 INFO:tasks.ceph:role: osd.5 2023-10-17T06:06:22.393 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-17T06:06:22.393 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-17T06:06:22.917 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-17T06:06:22.917 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-17T06:06:22.917 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-17T06:06:22.918 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 2023-10-17T06:06:22.918 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-17T06:06:22.918 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-10-17T06:06:22.918 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-17T06:06:22.918 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-17T06:06:22.919 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-17T06:06:22.919 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-17T06:06:22.923 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-10-17T06:06:22.923 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-17T06:06:22.996 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-17T06:06:23.020 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2023-10-17T06:06:23.021 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-17T06:06:23.022 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-17T06:06:23.103 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-17T06:06:23.103 INFO:tasks.ceph:role: osd.6 2023-10-17T06:06:23.104 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-17T06:06:23.104 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-17T06:06:23.675 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-17T06:06:23.676 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-17T06:06:23.676 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-17T06:06:23.676 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 2023-10-17T06:06:23.676 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-17T06:06:23.677 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-10-17T06:06:23.677 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-17T06:06:23.677 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-17T06:06:23.677 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-17T06:06:23.677 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-17T06:06:23.680 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-10-17T06:06:23.681 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-17T06:06:23.817 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-17T06:06:23.838 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2023-10-17T06:06:23.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-17T06:06:23.839 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-17T06:06:23.917 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-17T06:06:23.917 INFO:tasks.ceph:role: osd.7 2023-10-17T06:06:23.917 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-17T06:06:23.918 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-17T06:06:24.497 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-17T06:06:24.498 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-17T06:06:24.498 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-17T06:06:24.498 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 2023-10-17T06:06:24.499 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-17T06:06:24.499 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-10-17T06:06:24.499 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-17T06:06:24.499 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-17T06:06:24.500 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-17T06:06:24.500 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-17T06:06:24.503 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-10-17T06:06:24.503 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-17T06:06:24.636 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-17T06:06:24.658 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: /sbin/restorecon: command not found 2023-10-17T06:06:24.659 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-17T06:06:24.660 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-17T06:06:24.827 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:24.824+0000 7f26fecd5700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-17T06:06:24.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:24.824+0000 7f26fecd5700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-17T06:06:24.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:24.824+0000 7f26fecd5700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-17T06:06:24.828 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:24.824+0000 7f26fecd5700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-17T06:06:24.829 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:24.824+0000 7f26fecd5700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-17T06:06:24.831 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:24.828+0000 7f26fecd5700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-17T06:06:27.894 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-17T06:06:27.930 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-17T06:06:28.058 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:28.056+0000 7f7adfecd700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-17T06:06:28.059 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:28.056+0000 7f7adfecd700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-17T06:06:28.059 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:28.056+0000 7f7adfecd700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-17T06:06:28.060 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:28.056+0000 7f7adfecd700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-17T06:06:28.060 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:28.056+0000 7f7adfecd700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-17T06:06:28.062 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:28.060+0000 7f7adfecd700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-17T06:06:31.123 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-17T06:06:31.152 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:06:31.156 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-17T06:06:31.160 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:06:31.287 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:31.284+0000 7f606cc0c700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-17T06:06:31.288 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:31.284+0000 7f606cc0c700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-17T06:06:31.289 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:31.284+0000 7f606cc0c700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-17T06:06:31.289 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:31.284+0000 7f606cc0c700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-17T06:06:31.289 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:31.284+0000 7f606cc0c700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-17T06:06:31.290 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:31.288+0000 7f606cc0c700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-17T06:06:34.348 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-17T06:06:34.431 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-17T06:06:34.564 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:34.560+0000 7f2790b62700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-17T06:06:34.565 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:34.560+0000 7f2790b62700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-17T06:06:34.566 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:34.564+0000 7f2790b62700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-17T06:06:34.566 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:34.564+0000 7f2790b62700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-17T06:06:34.566 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:34.564+0000 7f2790b62700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-17T06:06:34.567 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:34.564+0000 7f2790b62700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-17T06:06:37.627 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-17T06:06:37.664 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-17T06:06:37.665 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:37.665 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-17T06:06:37.699 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:37.700 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-17T06:06:37.773 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:37.774 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-17T06:06:37.851 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:37.851 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-17T06:06:37.925 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:37.926 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-17T06:06:38.007 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:38.007 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-17T06:06:38.080 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:38.081 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-17T06:06:38.160 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:06:38.161 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-17T06:06:38.196 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:06:38.196 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-17T06:06:38.270 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:06:38.271 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-17T06:06:38.347 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:06:38.347 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-17T06:06:38.424 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:06:38.424 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-17T06:06:38.501 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:06:38.501 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-17T06:06:38.580 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:06:38.580 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-17T06:06:38.656 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:38.656 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-17T06:06:38.673 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:38.674 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-17T06:06:38.734 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:06:38.734 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-17T06:06:38.752 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:06:38.753 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-17T06:06:38.817 INFO:tasks.ceph:Adding keys to all mons... 2023-10-17T06:06:38.817 DEBUG:teuthology.orchestra.run.smithi125:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-17T06:06:38.825 DEBUG:teuthology.orchestra.run.smithi184:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-17T06:06:38.868 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr.y] 2023-10-17T06:06:38.869 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBMJC5l/spoChAAa8GK97TQHrtWg9Kz5dIRwQ== 2023-10-17T06:06:38.869 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.a] 2023-10-17T06:06:38.869 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBMJC5lbwFsGBAAg30VvKz8gdZC7vuR/25KrQ== 2023-10-17T06:06:38.869 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.c] 2023-10-17T06:06:38.869 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBMJC5lQuhLIxAAjHxZw3JyPuU4dM84yABF7A== 2023-10-17T06:06:38.870 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.0] 2023-10-17T06:06:38.870 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBQJC5lBqiVKhAApFbSJD8hHjVCxYE2twpOXg== 2023-10-17T06:06:38.870 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.1] 2023-10-17T06:06:38.870 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBTJC5lEYe6NxAAhPDwNfWkQ3AYfyRw6a5b+g== 2023-10-17T06:06:38.870 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.2] 2023-10-17T06:06:38.871 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBXJC5lY3FbChAAGj4bCxuhQTvlXyVL8VeZKQ== 2023-10-17T06:06:38.871 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.3] 2023-10-17T06:06:38.871 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBaJC5looamFxAAii4ABnhybpRFTINvAPi1hg== 2023-10-17T06:06:38.871 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr.x] 2023-10-17T06:06:38.871 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBMJC5luST0EBAAlwryGbYZc6rp+liC3XMOcQ== 2023-10-17T06:06:38.872 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.b] 2023-10-17T06:06:38.872 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBMJC5l0oW3KxAACNIHUFhALoDq5ApUiETKIw== 2023-10-17T06:06:38.872 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.d] 2023-10-17T06:06:38.872 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBMJC5lvCnINhAAdwKQRv4EI5ghCnm88z2FDg== 2023-10-17T06:06:38.872 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.4] 2023-10-17T06:06:38.873 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBgJC5lSUNNMRAAQdbVEi1QShkJJoYJCuljSQ== 2023-10-17T06:06:38.873 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.5] 2023-10-17T06:06:38.873 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBkJC5l6XGCAxAAS5CJqVk8Ne0psdGgNttBqA== 2023-10-17T06:06:38.873 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.6] 2023-10-17T06:06:38.873 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBnJC5lTF4hERAAP2kjm98J37GBMzfiMrOCOQ== 2023-10-17T06:06:38.874 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.7] 2023-10-17T06:06:38.874 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBqJC5lLO6hIRAA5WuKIexp7r1Xtw2jX/7c4g== 2023-10-17T06:06:38.874 INFO:teuthology.orchestra.run.smithi125.stdout:[client.0] 2023-10-17T06:06:38.874 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBNJC5lWPILAhAAvN089kyq+D6h+L1E8T+LQA== 2023-10-17T06:06:38.874 INFO:teuthology.orchestra.run.smithi125.stdout:[client.2] 2023-10-17T06:06:38.875 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBNJC5lOG06CBAAwyjkl91C81I3JM9OAElRFA== 2023-10-17T06:06:38.875 INFO:teuthology.orchestra.run.smithi125.stdout:[client.1] 2023-10-17T06:06:38.875 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBNJC5lTHSNDhAA5AND2sAS7MqLaJ6ly4GGLw== 2023-10-17T06:06:38.875 INFO:teuthology.orchestra.run.smithi125.stdout:[client.3] 2023-10-17T06:06:38.875 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBNJC5lNI23FBAAIwAzQFVDutGBm0x9ayQh0g== 2023-10-17T06:06:38.896 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.y] 2023-10-17T06:06:38.896 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBMJC5l/spoChAAa8GK97TQHrtWg9Kz5dIRwQ== 2023-10-17T06:06:38.896 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2023-10-17T06:06:38.896 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBMJC5lbwFsGBAAg30VvKz8gdZC7vuR/25KrQ== 2023-10-17T06:06:38.897 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2023-10-17T06:06:38.897 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBMJC5lQuhLIxAAjHxZw3JyPuU4dM84yABF7A== 2023-10-17T06:06:38.897 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.0] 2023-10-17T06:06:38.897 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBQJC5lBqiVKhAApFbSJD8hHjVCxYE2twpOXg== 2023-10-17T06:06:38.897 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.1] 2023-10-17T06:06:38.898 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBTJC5lEYe6NxAAhPDwNfWkQ3AYfyRw6a5b+g== 2023-10-17T06:06:38.898 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.2] 2023-10-17T06:06:38.898 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBXJC5lY3FbChAAGj4bCxuhQTvlXyVL8VeZKQ== 2023-10-17T06:06:38.898 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.3] 2023-10-17T06:06:38.898 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBaJC5looamFxAAii4ABnhybpRFTINvAPi1hg== 2023-10-17T06:06:38.898 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.x] 2023-10-17T06:06:38.899 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBMJC5luST0EBAAlwryGbYZc6rp+liC3XMOcQ== 2023-10-17T06:06:38.899 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2023-10-17T06:06:38.899 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBMJC5l0oW3KxAACNIHUFhALoDq5ApUiETKIw== 2023-10-17T06:06:38.899 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2023-10-17T06:06:38.900 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBMJC5lvCnINhAAdwKQRv4EI5ghCnm88z2FDg== 2023-10-17T06:06:38.900 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.4] 2023-10-17T06:06:38.900 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBgJC5lSUNNMRAAQdbVEi1QShkJJoYJCuljSQ== 2023-10-17T06:06:38.900 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.5] 2023-10-17T06:06:38.900 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBkJC5l6XGCAxAAS5CJqVk8Ne0psdGgNttBqA== 2023-10-17T06:06:38.901 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.6] 2023-10-17T06:06:38.901 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBnJC5lTF4hERAAP2kjm98J37GBMzfiMrOCOQ== 2023-10-17T06:06:38.901 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.7] 2023-10-17T06:06:38.901 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBqJC5lLO6hIRAA5WuKIexp7r1Xtw2jX/7c4g== 2023-10-17T06:06:38.901 INFO:teuthology.orchestra.run.smithi184.stdout:[client.0] 2023-10-17T06:06:38.902 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBNJC5lWPILAhAAvN089kyq+D6h+L1E8T+LQA== 2023-10-17T06:06:38.902 INFO:teuthology.orchestra.run.smithi184.stdout:[client.2] 2023-10-17T06:06:38.902 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBNJC5lOG06CBAAwyjkl91C81I3JM9OAElRFA== 2023-10-17T06:06:38.902 INFO:teuthology.orchestra.run.smithi184.stdout:[client.1] 2023-10-17T06:06:38.902 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBNJC5lTHSNDhAA5AND2sAS7MqLaJ6ly4GGLw== 2023-10-17T06:06:38.903 INFO:teuthology.orchestra.run.smithi184.stdout:[client.3] 2023-10-17T06:06:38.903 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBNJC5lNI23FBAAIwAzQFVDutGBm0x9ayQh0g== 2023-10-17T06:06:38.904 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-17T06:06:38.930 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-17T06:06:39.032 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-17T06:06:39.040 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-17T06:06:39.129 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-17T06:06:39.136 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-17T06:06:39.222 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-17T06:06:39.229 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-17T06:06:39.317 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-17T06:06:39.324 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-17T06:06:39.412 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-17T06:06:39.419 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-17T06:06:39.500 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-17T06:06:39.506 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-17T06:06:39.590 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-17T06:06:39.597 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-17T06:06:39.680 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-17T06:06:39.687 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-17T06:06:39.775 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-17T06:06:39.782 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-17T06:06:39.867 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-17T06:06:39.874 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-17T06:06:39.955 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-17T06:06:39.962 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-17T06:06:40.046 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-17T06:06:40.053 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-17T06:06:40.133 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-17T06:06:40.140 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-17T06:06:40.226 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-17T06:06:40.233 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-17T06:06:40.320 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-17T06:06:40.327 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-17T06:06:40.415 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-17T06:06:40.421 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-17T06:06:40.508 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-17T06:06:40.514 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-17T06:06:40.601 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-17T06:06:40.601 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-17T06:06:40.637 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-17T06:06:40.787 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-17T06:06:40.821 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-17T06:06:40.860 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-17T06:06:41.010 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-17T06:06:41.050 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-17T06:06:41.132 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-17T06:06:41.281 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-17T06:06:41.314 DEBUG:teuthology.orchestra.run.smithi125:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-17T06:06:41.322 DEBUG:teuthology.orchestra.run.smithi184:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-17T06:06:41.374 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-17T06:06:41.375 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-17T06:06:41.375 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-17T06:06:41.386 INFO:tasks.ceph.mon.a:Started 2023-10-17T06:06:41.386 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-17T06:06:41.387 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-17T06:06:41.422 INFO:tasks.ceph.mon.b:Started 2023-10-17T06:06:41.423 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-17T06:06:41.423 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-17T06:06:41.430 INFO:tasks.ceph.mon.c:Started 2023-10-17T06:06:41.430 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-17T06:06:41.430 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-17T06:06:41.431 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-17T06:06:41.438 INFO:tasks.ceph.mgr.y:Started 2023-10-17T06:06:41.438 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-17T06:06:41.438 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-17T06:06:41.445 INFO:tasks.ceph.mgr.x:Started 2023-10-17T06:06:41.445 INFO:tasks.ceph:Setting crush tunables to default 2023-10-17T06:06:41.446 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd crush tunables default 2023-10-17T06:06:41.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.601+0000 7f111107d700 1 Processor -- start 2023-10-17T06:06:41.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f111107d700 1 -- start start 2023-10-17T06:06:41.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f111107d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f110c0d23e0 0x7f110c15dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:41.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f111107d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f110c06fef0 0x7f110c0b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:41.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f111107d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f110c0d2e20 0x7f110c0d3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:41.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f111107d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110c070360 con 0x7f110c06fef0 2023-10-17T06:06:41.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f111107d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110c0d37a0 con 0x7f110c0d23e0 2023-10-17T06:06:41.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f111107d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0b6e40 con 0x7f110c0d2e20 2023-10-17T06:06:41.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f110bfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f110c0d23e0 0x7f110c15dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:41.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f110bfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f110c0d23e0 0x7f110c15dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:60514/0 (socket says 172.21.15.125:60514) 2023-10-17T06:06:41.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f110bfff700 1 -- 172.21.15.125:0/643322914 learned_addr learned my addr 172.21.15.125:0/643322914 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:06:41.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f110b7fe700 1 --2- 172.21.15.125:0/643322914 >> v2:172.21.15.125:3300/0 conn(0x7f110c06fef0 0x7f110c0b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:41.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f110bfff700 1 -- 172.21.15.125:0/643322914 >> v2:172.21.15.184:3300/0 conn(0x7f110c0d23e0 msgr2=0x7f110c15dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-17T06:06:41.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f110bfff700 1 -- 172.21.15.125:0/643322914 >> v2:172.21.15.184:3300/0 conn(0x7f110c0d23e0 msgr2=0x7f110c15dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-17T06:06:41.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f110bfff700 1 --2- 172.21.15.125:0/643322914 >> v2:172.21.15.184:3300/0 conn(0x7f110c0d23e0 0x7f110c15dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-17T06:06:41.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f110bfff700 1 --2- 172.21.15.125:0/643322914 >> v2:172.21.15.184:3300/0 conn(0x7f110c0d23e0 0x7f110c15dcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-17T06:06:41.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f110b7fe700 1 -- 172.21.15.125:0/643322914 >> v2:172.21.15.125:3300/0 conn(0x7f110c06fef0 msgr2=0x7f110c0b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-17T06:06:41.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f110b7fe700 1 -- 172.21.15.125:0/643322914 >> v2:172.21.15.125:3300/0 conn(0x7f110c06fef0 msgr2=0x7f110c0b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-17T06:06:41.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f110b7fe700 1 --2- 172.21.15.125:0/643322914 >> v2:172.21.15.125:3300/0 conn(0x7f110c06fef0 0x7f110c0b65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-17T06:06:41.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f111087c700 1 --2- 172.21.15.125:0/643322914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f110c0d2e20 0x7f110c0d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:41.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f110b7fe700 1 --2- 172.21.15.125:0/643322914 >> v2:172.21.15.125:3300/0 conn(0x7f110c06fef0 0x7f110c0b65f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-17T06:06:41.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f111087c700 1 -- 172.21.15.125:0/643322914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f110c0d2e20 msgr2=0x7f110c0d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-17T06:06:41.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f111087c700 1 -- 172.21.15.125:0/643322914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f110c0d2e20 msgr2=0x7f110c0d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-17T06:06:41.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f111087c700 1 --2- 172.21.15.125:0/643322914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f110c0d2e20 0x7f110c0d3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-17T06:06:41.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.605+0000 7f111087c700 1 --2- 172.21.15.125:0/643322914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f110c0d2e20 0x7f110c0d3260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-17T06:06:41.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.809+0000 7f110bfff700 1 --2- 172.21.15.125:0/643322914 >> v2:172.21.15.184:3300/0 conn(0x7f110c0d23e0 0x7f110c15dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:41.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.809+0000 7f110b7fe700 1 --2- 172.21.15.125:0/643322914 >> v2:172.21.15.125:3300/0 conn(0x7f110c06fef0 0x7f110c0b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:41.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.809+0000 7f111087c700 1 --2- 172.21.15.125:0/643322914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f110c0d2e20 0x7f110c0d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:41.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.809+0000 7f110bfff700 1 -- 172.21.15.125:0/643322914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f110c0d2e20 msgr2=0x7f110c0d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:06:41.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.809+0000 7f110bfff700 1 --2- 172.21.15.125:0/643322914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f110c0d2e20 0x7f110c0d3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:41.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.809+0000 7f110bfff700 1 -- 172.21.15.125:0/643322914 >> v2:172.21.15.125:3300/0 conn(0x7f110c06fef0 msgr2=0x7f110c0b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:06:41.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.809+0000 7f110bfff700 1 --2- 172.21.15.125:0/643322914 >> v2:172.21.15.125:3300/0 conn(0x7f110c06fef0 0x7f110c0b65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:41.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.809+0000 7f110bfff700 1 -- 172.21.15.125:0/643322914 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c0b7120 con 0x7f110c0d23e0 2023-10-17T06:06:41.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.809+0000 7f110bfff700 1 --2- 172.21.15.125:0/643322914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f110c0d23e0 0x7f110c15dcf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f110c0d3a60 tx=0x7f10fc009c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80522f7ca610bea8 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:41.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.809+0000 7f110affd700 1 -- 172.21.15.125:0/643322914 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc00c070 con 0x7f110c0d23e0 2023-10-17T06:06:41.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.809+0000 7f110affd700 1 -- 172.21.15.125:0/643322914 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc00e670 con 0x7f110c0d23e0 2023-10-17T06:06:41.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.809+0000 7f110affd700 1 -- 172.21.15.125:0/643322914 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc00ea00 con 0x7f110c0d23e0 2023-10-17T06:06:41.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.813+0000 7f111107d700 1 -- 172.21.15.125:0/643322914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f110c0d23e0 msgr2=0x7f110c15dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:41.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.813+0000 7f111107d700 1 --2- 172.21.15.125:0/643322914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f110c0d23e0 0x7f110c15dcf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f110c0d3a60 tx=0x7f10fc009c70 comp rx=0 tx=0).stop 2023-10-17T06:06:41.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.813+0000 7f111107d700 1 -- 172.21.15.125:0/643322914 shutdown_connections 2023-10-17T06:06:41.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.813+0000 7f111107d700 1 --2- 172.21.15.125:0/643322914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f110c0d2e20 0x7f110c0d3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:41.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.813+0000 7f111107d700 1 --2- 172.21.15.125:0/643322914 >> v2:172.21.15.125:3300/0 conn(0x7f110c06fef0 0x7f110c0b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:41.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.813+0000 7f111107d700 1 --2- 172.21.15.125:0/643322914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f110c0d23e0 0x7f110c15dcf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:41.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.813+0000 7f111107d700 1 -- 172.21.15.125:0/643322914 >> 172.21.15.125:0/643322914 conn(0x7f110c069f20 msgr2=0x7f110c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:41.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.813+0000 7f111107d700 1 -- 172.21.15.125:0/643322914 shutdown_connections 2023-10-17T06:06:41.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.813+0000 7f111107d700 1 -- 172.21.15.125:0/643322914 wait complete. 2023-10-17T06:06:41.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.813+0000 7f111107d700 1 Processor -- start 2023-10-17T06:06:41.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f111107d700 1 -- start start 2023-10-17T06:06:41.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f111107d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f110c06fef0 0x7f110c157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:41.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f111107d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f110c0d23e0 0x7f110c0ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:41.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f111107d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f110c0d2e20 0x7f110c0abe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:41.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f111107d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0b2730 con 0x7f110c06fef0 2023-10-17T06:06:41.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f111107d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0b2a10 con 0x7f110c0d2e20 2023-10-17T06:06:41.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f111107d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0b2cf0 con 0x7f110c0d23e0 2023-10-17T06:06:41.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f110bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f110c06fef0 0x7f110c157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:41.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f111087c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f110c0d2e20 0x7f110c0abe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:41.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f110b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f110c0d23e0 0x7f110c0ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:41.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f111087c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f110c0d2e20 0x7f110c0abe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:60570/0 (socket says 172.21.15.125:60570) 2023-10-17T06:06:41.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f111087c700 1 -- 172.21.15.125:0/1901700859 learned_addr learned my addr 172.21.15.125:0/1901700859 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:06:41.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f110bfff700 1 -- 172.21.15.125:0/1901700859 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f110c0d23e0 msgr2=0x7f110c0ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:41.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f110bfff700 1 --2- 172.21.15.125:0/1901700859 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f110c0d23e0 0x7f110c0ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:41.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f110bfff700 1 -- 172.21.15.125:0/1901700859 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f110c0d2e20 msgr2=0x7f110c0abe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:41.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f110bfff700 1 --2- 172.21.15.125:0/1901700859 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f110c0d2e20 0x7f110c0abe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:41.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f110bfff700 1 -- 172.21.15.125:0/1901700859 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc0095f0 con 0x7f110c06fef0 2023-10-17T06:06:41.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f111087c700 1 --2- 172.21.15.125:0/1901700859 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f110c0d2e20 0x7f110c0abe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:06:41.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f110bfff700 1 --2- 172.21.15.125:0/1901700859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f110c06fef0 0x7f110c157830 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f10fc018000 tx=0x7f10fc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:41.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f1108ff9700 1 -- 172.21.15.125:0/1901700859 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc021070 con 0x7f110c06fef0 2023-10-17T06:06:41.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f1108ff9700 1 -- 172.21.15.125:0/1901700859 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc00e470 con 0x7f110c06fef0 2023-10-17T06:06:41.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f111107d700 1 -- 172.21.15.125:0/1901700859 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110c0b2fd0 con 0x7f110c06fef0 2023-10-17T06:06:41.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f1108ff9700 1 -- 172.21.15.125:0/1901700859 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc004270 con 0x7f110c06fef0 2023-10-17T06:06:41.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f111107d700 1 -- 172.21.15.125:0/1901700859 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110c0b3590 con 0x7f110c06fef0 2023-10-17T06:06:41.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f1108ff9700 1 -- 172.21.15.125:0/1901700859 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f10fc025070 con 0x7f110c06fef0 2023-10-17T06:06:41.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.817+0000 7f1108ff9700 1 -- 172.21.15.125:0/1901700859 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f10fc0036c0 con 0x7f110c06fef0 2023-10-17T06:06:41.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.821+0000 7f111107d700 1 -- 172.21.15.125:0/1901700859 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f110c15d780 con 0x7f110c06fef0 2023-10-17T06:06:41.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.821+0000 7f1108ff9700 1 -- 172.21.15.125:0/1901700859 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f10fc017020 con 0x7f110c06fef0 2023-10-17T06:06:41.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.904+0000 7f111107d700 1 -- 172.21.15.125:0/1901700859 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f110c04e910 con 0x7f110c06fef0 2023-10-17T06:06:41.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.908+0000 7f1108ff9700 1 -- 172.21.15.125:0/1901700859 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f10fc00f040 con 0x7f110c06fef0 2023-10-17T06:06:41.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.912+0000 7f111107d700 1 -- 172.21.15.125:0/1901700859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f110c06fef0 msgr2=0x7f110c157830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:41.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.912+0000 7f111107d700 1 --2- 172.21.15.125:0/1901700859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f110c06fef0 0x7f110c157830 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f10fc018000 tx=0x7f10fc0047e0 comp rx=0 tx=0).stop 2023-10-17T06:06:41.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.912+0000 7f111107d700 1 -- 172.21.15.125:0/1901700859 shutdown_connections 2023-10-17T06:06:41.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.912+0000 7f111107d700 1 --2- 172.21.15.125:0/1901700859 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f110c0d2e20 0x7f110c0abe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:41.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.912+0000 7f111107d700 1 --2- 172.21.15.125:0/1901700859 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f110c0d23e0 0x7f110c0ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:41.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.912+0000 7f111107d700 1 --2- 172.21.15.125:0/1901700859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f110c06fef0 0x7f110c157830 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:41.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.912+0000 7f111107d700 1 -- 172.21.15.125:0/1901700859 >> 172.21.15.125:0/1901700859 conn(0x7f110c069f20 msgr2=0x7f110c06f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:41.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.912+0000 7f111107d700 1 -- 172.21.15.125:0/1901700859 shutdown_connections 2023-10-17T06:06:41.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:41.912+0000 7f111107d700 1 -- 172.21.15.125:0/1901700859 wait complete. 2023-10-17T06:06:41.920 INFO:teuthology.orchestra.run.smithi125.stderr:adjusted tunables profile to default 2023-10-17T06:06:41.939 INFO:tasks.ceph:check_enable_crimson: False 2023-10-17T06:06:41.939 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-17T06:06:41.940 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:41.940 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-17T06:06:41.977 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:41.977 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-17T06:06:42.033 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:42.028+0000 7fed95aa72c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-17T06:06:42.040 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:42.036+0000 7f84e17c62c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-17T06:06:42.056 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:42.057 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-17T06:06:42.132 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:06:42.133 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-17T06:06:42.213 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:06:42.214 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-17T06:06:42.246 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:06:42.247 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-17T06:06:42.320 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:06:42.320 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-17T06:06:42.392 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:06:42.392 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-17T06:06:42.468 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 6f504062-4853-4e2a-98d4-ca58d83fb96b 0 2023-10-17T06:06:42.678 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.676+0000 7f7fef9e8700 1 Processor -- start 2023-10-17T06:06:42.679 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.676+0000 7f7fef9e8700 1 -- start start 2023-10-17T06:06:42.681 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fef9e8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7fe80afb00 0x7f7fe8070670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:42.682 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fef9e8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7fe8070bb0 0x7f7fe80cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:42.682 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fef9e8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe806f5d0 con 0x7f7fe80b61f0 2023-10-17T06:06:42.682 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fef9e8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe806f8b0 con 0x7f7fe8070bb0 2023-10-17T06:06:42.682 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fef9e8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe806fb90 con 0x7f7fe80afb00 2023-10-17T06:06:42.684 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fecf83700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7fe80afb00 0x7f7fe8070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:42.684 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fecf83700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7fe80afb00 0x7f7fe8070670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:33608/0 (socket says 172.21.15.184:33608) 2023-10-17T06:06:42.684 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fecf83700 1 -- 172.21.15.184:0/3460976325 learned_addr learned my addr 172.21.15.184:0/3460976325 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-17T06:06:42.685 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fedf85700 1 --2- 172.21.15.184:0/3460976325 >> v2:172.21.15.125:3300/0 conn(0x7f7fe8070bb0 0x7f7fe80cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:42.685 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fecf83700 1 -- 172.21.15.184:0/3460976325 >> v2:172.21.15.125:3300/0 conn(0x7f7fe8070bb0 msgr2=0x7f7fe80cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:06:42.685 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fecf83700 1 --2- 172.21.15.184:0/3460976325 >> v2:172.21.15.125:3300/0 conn(0x7f7fe8070bb0 0x7f7fe80cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:42.685 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fecf83700 1 -- 172.21.15.184:0/3460976325 >> v1:172.21.15.125:6789/0 conn(0x7f7fe80b61f0 legacy=0x7f7fe815bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:42.685 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fecf83700 1 -- 172.21.15.184:0/3460976325 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe806fe70 con 0x7f7fe80afb00 2023-10-17T06:06:42.686 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fecf83700 1 --2- 172.21.15.184:0/3460976325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7fe80afb00 0x7f7fe8070670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8009910 tx=0x7f7fd8009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff29937f0882b93a server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:42.686 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fdffff700 1 -- 172.21.15.184:0/3460976325 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd800ba60 con 0x7f7fe80afb00 2023-10-17T06:06:42.686 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fdffff700 1 -- 172.21.15.184:0/3460976325 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd800bbc0 con 0x7f7fe80afb00 2023-10-17T06:06:42.686 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fdffff700 1 -- 172.21.15.184:0/3460976325 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8009e60 con 0x7f7fe80afb00 2023-10-17T06:06:42.687 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fef9e8700 1 -- 172.21.15.184:0/3460976325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7fe80afb00 msgr2=0x7f7fe8070670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:42.687 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fef9e8700 1 --2- 172.21.15.184:0/3460976325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7fe80afb00 0x7f7fe8070670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8009910 tx=0x7f7fd8009c20 comp rx=0 tx=0).stop 2023-10-17T06:06:42.688 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fef9e8700 1 -- 172.21.15.184:0/3460976325 shutdown_connections 2023-10-17T06:06:42.688 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fef9e8700 1 --2- 172.21.15.184:0/3460976325 >> v2:172.21.15.125:3300/0 conn(0x7f7fe8070bb0 0x7f7fe80cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:42.688 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fef9e8700 1 --2- 172.21.15.184:0/3460976325 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7fe80afb00 0x7f7fe8070670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:42.688 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fef9e8700 1 -- 172.21.15.184:0/3460976325 >> 172.21.15.184:0/3460976325 conn(0x7f7fe80d0990 msgr2=0x7f7fe80d0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:42.688 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.680+0000 7f7fef9e8700 1 -- 172.21.15.184:0/3460976325 shutdown_connections 2023-10-17T06:06:42.689 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.684+0000 7f7fef9e8700 1 -- 172.21.15.184:0/3460976325 wait complete. 2023-10-17T06:06:42.690 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.684+0000 7f7fef9e8700 1 Processor -- start 2023-10-17T06:06:42.690 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.684+0000 7f7fef9e8700 1 -- start start 2023-10-17T06:06:42.690 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fef9e8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fe8070bb0 0x7f7fe81f0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:42.691 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fef9e8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7fe80afb00 0x7f7fe81ed900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:42.691 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fef9e8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fe80b61f0 0x7f7fe8154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:42.691 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fef9e8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80cb060 con 0x7f7fe8070bb0 2023-10-17T06:06:42.691 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fef9e8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80c5880 con 0x7f7fe80b61f0 2023-10-17T06:06:42.692 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fef9e8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe81f0a70 con 0x7f7fe80afb00 2023-10-17T06:06:42.692 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fecf83700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7fe80afb00 0x7f7fe81ed900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:42.692 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fedf85700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fe80b61f0 0x7f7fe8154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:42.692 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fecf83700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7fe80afb00 0x7f7fe81ed900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:33612/0 (socket says 172.21.15.184:33612) 2023-10-17T06:06:42.692 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fedf85700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fe80b61f0 0x7f7fe8154290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:59246/0 (socket says 172.21.15.184:59246) 2023-10-17T06:06:42.693 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fecf83700 1 -- 172.21.15.184:0/4067744352 learned_addr learned my addr 172.21.15.184:0/4067744352 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-17T06:06:42.693 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fed784700 1 --2- 172.21.15.184:0/4067744352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fe8070bb0 0x7f7fe81f0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:42.694 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fecf83700 1 -- 172.21.15.184:0/4067744352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fe80b61f0 msgr2=0x7f7fe8154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:42.695 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fecf83700 1 --2- 172.21.15.184:0/4067744352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fe80b61f0 0x7f7fe8154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:42.695 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fecf83700 1 -- 172.21.15.184:0/4067744352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fe8070bb0 msgr2=0x7f7fe81f0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:42.695 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fecf83700 1 --2- 172.21.15.184:0/4067744352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fe8070bb0 0x7f7fe81f0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:42.695 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fecf83700 1 -- 172.21.15.184:0/4067744352 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd8009570 con 0x7f7fe80afb00 2023-10-17T06:06:42.696 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fecf83700 1 --2- 172.21.15.184:0/4067744352 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7fe80afb00 0x7f7fe81ed900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8013000 tx=0x7f7fd8004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:42.696 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fddffb700 1 -- 172.21.15.184:0/4067744352 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8004510 con 0x7f7fe80afb00 2023-10-17T06:06:42.696 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fddffb700 1 -- 172.21.15.184:0/4067744352 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd801f070 con 0x7f7fe80afb00 2023-10-17T06:06:42.696 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fef9e8700 1 -- 172.21.15.184:0/4067744352 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe81ede40 con 0x7f7fe80afb00 2023-10-17T06:06:42.696 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fddffb700 1 -- 172.21.15.184:0/4067744352 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8003900 con 0x7f7fe80afb00 2023-10-17T06:06:42.697 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fef9e8700 1 -- 172.21.15.184:0/4067744352 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe81f1000 con 0x7f7fe80afb00 2023-10-17T06:06:42.697 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fddffb700 1 -- 172.21.15.184:0/4067744352 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7fd8026480 con 0x7f7fe80afb00 2023-10-17T06:06:42.697 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.688+0000 7f7fddffb700 1 -- 172.21.15.184:0/4067744352 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7fd8021070 con 0x7f7fe80afb00 2023-10-17T06:06:42.697 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.692+0000 7f7fef9e8700 1 -- 172.21.15.184:0/4067744352 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe8072e60 con 0x7f7fe80afb00 2023-10-17T06:06:42.698 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.696+0000 7f7fddffb700 1 -- 172.21.15.184:0/4067744352 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f7fd802b020 con 0x7f7fe80afb00 2023-10-17T06:06:42.777 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:42.772+0000 7fed95aa72c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-17T06:06:42.813 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:42.808+0000 7f84e17c62c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-17T06:06:42.851 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.848+0000 7f7fef9e8700 1 -- 172.21.15.184:0/4067744352 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6f504062-4853-4e2a-98d4-ca58d83fb96b", "id": 0} v 0) v1 -- 0x7f7fe80b6910 con 0x7f7fe80afb00 2023-10-17T06:06:42.861 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.856+0000 7f7fddffb700 1 -- 172.21.15.184:0/4067744352 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6f504062-4853-4e2a-98d4-ca58d83fb96b", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7fd8015020 con 0x7f7fe80afb00 2023-10-17T06:06:42.861 INFO:teuthology.orchestra.run.smithi184.stdout:0 2023-10-17T06:06:42.862 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:42.856+0000 7fed95aa72c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-17T06:06:42.863 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.860+0000 7f7fef9e8700 1 -- 172.21.15.184:0/4067744352 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7fe80afb00 msgr2=0x7f7fe81ed900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:42.863 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.860+0000 7f7fef9e8700 1 --2- 172.21.15.184:0/4067744352 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7fe80afb00 0x7f7fe81ed900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8013000 tx=0x7f7fd8004770 comp rx=0 tx=0).stop 2023-10-17T06:06:42.864 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.860+0000 7f7fef9e8700 1 -- 172.21.15.184:0/4067744352 shutdown_connections 2023-10-17T06:06:42.864 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.860+0000 7f7fef9e8700 1 --2- 172.21.15.184:0/4067744352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fe80b61f0 0x7f7fe8154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:42.864 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.860+0000 7f7fef9e8700 1 --2- 172.21.15.184:0/4067744352 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7fe80afb00 0x7f7fe81ed900 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:42.864 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.860+0000 7f7fef9e8700 1 --2- 172.21.15.184:0/4067744352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7fe8070bb0 0x7f7fe81f0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:42.864 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.860+0000 7f7fef9e8700 1 -- 172.21.15.184:0/4067744352 >> 172.21.15.184:0/4067744352 conn(0x7f7fe80d0990 msgr2=0x7f7fe80b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:42.865 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.860+0000 7f7fef9e8700 1 -- 172.21.15.184:0/4067744352 shutdown_connections 2023-10-17T06:06:42.865 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:42.860+0000 7f7fef9e8700 1 -- 172.21.15.184:0/4067744352 wait complete. 2023-10-17T06:06:42.882 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 26798ccb-c865-459d-98b7-90a9ce8ab6ce 1 2023-10-17T06:06:42.894 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:42.892+0000 7f84e17c62c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-17T06:06:43.040 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:43.032+0000 7fed95aa72c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-17T06:06:43.040 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.036+0000 7f7049435700 1 Processor -- start 2023-10-17T06:06:43.041 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.036+0000 7f7049435700 1 -- start start 2023-10-17T06:06:43.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.040+0000 7f7049435700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f704415da90 0x7f704406ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:43.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.040+0000 7f7049435700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f704415df40 0x7f704406e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:43.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.040+0000 7f7049435700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7044070820 con 0x7f704415d6b0 2023-10-17T06:06:43.043 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.040+0000 7f7049435700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7044070b00 con 0x7f704415da90 2023-10-17T06:06:43.044 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.040+0000 7f7049435700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7044070de0 con 0x7f704415df40 2023-10-17T06:06:43.045 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.040+0000 7f7048c34700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f704415df40 0x7f704406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:43.045 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.040+0000 7f7048c34700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f704415df40 0x7f704406e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:33616/0 (socket says 172.21.15.184:33616) 2023-10-17T06:06:43.045 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.040+0000 7f7048c34700 1 -- 172.21.15.184:0/137011022 learned_addr learned my addr 172.21.15.184:0/137011022 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-17T06:06:43.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.040+0000 7f70437fe700 1 --2- 172.21.15.184:0/137011022 >> v2:172.21.15.125:3300/0 conn(0x7f704415da90 0x7f704406ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:43.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.040+0000 7f7048c34700 1 -- 172.21.15.184:0/137011022 >> v2:172.21.15.125:3300/0 conn(0x7f704415da90 msgr2=0x7f704406ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:06:43.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.040+0000 7f7048c34700 1 --2- 172.21.15.184:0/137011022 >> v2:172.21.15.125:3300/0 conn(0x7f704415da90 0x7f704406ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.040+0000 7f7048c34700 1 -- 172.21.15.184:0/137011022 >> v1:172.21.15.125:6789/0 conn(0x7f704415d6b0 legacy=0x7f7044070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:06:43.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.040+0000 7f7048c34700 1 -- 172.21.15.184:0/137011022 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70440710c0 con 0x7f704415df40 2023-10-17T06:06:43.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.040+0000 7f7048c34700 1 --2- 172.21.15.184:0/137011022 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f704415df40 0x7f704406e410 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f703c009e50 tx=0x7f703c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=915802b58cd60998 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:43.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.040+0000 7f7042ffd700 1 -- 172.21.15.184:0/137011022 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c00e070 con 0x7f704415df40 2023-10-17T06:06:43.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.040+0000 7f7042ffd700 1 -- 172.21.15.184:0/137011022 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703c00b9c0 con 0x7f704415df40 2023-10-17T06:06:43.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.040+0000 7f7042ffd700 1 -- 172.21.15.184:0/137011022 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c00bd70 con 0x7f704415df40 2023-10-17T06:06:43.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.044+0000 7f7049435700 1 -- 172.21.15.184:0/137011022 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f704415df40 msgr2=0x7f704406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:43.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.044+0000 7f7049435700 1 --2- 172.21.15.184:0/137011022 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f704415df40 0x7f704406e410 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f703c009e50 tx=0x7f703c00b330 comp rx=0 tx=0).stop 2023-10-17T06:06:43.049 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.044+0000 7f7049435700 1 -- 172.21.15.184:0/137011022 shutdown_connections 2023-10-17T06:06:43.049 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.044+0000 7f7049435700 1 --2- 172.21.15.184:0/137011022 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f704415df40 0x7f704406e410 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.049 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.044+0000 7f7049435700 1 --2- 172.21.15.184:0/137011022 >> v2:172.21.15.125:3300/0 conn(0x7f704415da90 0x7f704406ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.049 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.044+0000 7f7049435700 1 -- 172.21.15.184:0/137011022 >> 172.21.15.184:0/137011022 conn(0x7f70440cc1b0 msgr2=0x7f70440cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:43.049 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.044+0000 7f7049435700 1 -- 172.21.15.184:0/137011022 shutdown_connections 2023-10-17T06:06:43.050 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.044+0000 7f7049435700 1 -- 172.21.15.184:0/137011022 wait complete. 2023-10-17T06:06:43.050 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.048+0000 7f7049435700 1 Processor -- start 2023-10-17T06:06:43.051 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.048+0000 7f7049435700 1 -- start start 2023-10-17T06:06:43.052 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.048+0000 7f7049435700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f704415d6b0 0x7f7044152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:43.053 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.048+0000 7f7049435700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f704415da90 0x7f70440b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:43.053 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.048+0000 7f7049435700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f704415df40 0x7f7044152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:43.053 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.048+0000 7f7049435700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7044157cf0 con 0x7f704415da90 2023-10-17T06:06:43.053 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.048+0000 7f7049435700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7044157fd0 con 0x7f704415d6b0 2023-10-17T06:06:43.053 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.048+0000 7f7049435700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70440af920 con 0x7f704415df40 2023-10-17T06:06:43.055 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.048+0000 7f7043fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f704415d6b0 0x7f7044152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:43.055 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.048+0000 7f7043fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f704415d6b0 0x7f7044152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:59254/0 (socket says 172.21.15.184:59254) 2023-10-17T06:06:43.056 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.048+0000 7f7043fff700 1 -- 172.21.15.184:0/3960188072 learned_addr learned my addr 172.21.15.184:0/3960188072 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-17T06:06:43.056 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.048+0000 7f7048c34700 1 --2- 172.21.15.184:0/3960188072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f704415df40 0x7f7044152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:43.056 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.052+0000 7f70437fe700 1 --2- 172.21.15.184:0/3960188072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f704415da90 0x7f70440b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:43.056 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.052+0000 7f7043fff700 1 -- 172.21.15.184:0/3960188072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f704415df40 msgr2=0x7f7044152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:43.056 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.052+0000 7f7043fff700 1 --2- 172.21.15.184:0/3960188072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f704415df40 0x7f7044152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.057 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.052+0000 7f7043fff700 1 -- 172.21.15.184:0/3960188072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f704415da90 msgr2=0x7f70440b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:43.057 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.052+0000 7f7043fff700 1 --2- 172.21.15.184:0/3960188072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f704415da90 0x7f70440b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.057 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.052+0000 7f7043fff700 1 -- 172.21.15.184:0/3960188072 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c009b30 con 0x7f704415d6b0 2023-10-17T06:06:43.057 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.052+0000 7f7043fff700 1 --2- 172.21.15.184:0/3960188072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f704415d6b0 0x7f7044152af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f703400c4e0 tx=0x7f703400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:43.057 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.052+0000 7f7040ff9700 1 -- 172.21.15.184:0/3960188072 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70340052d0 con 0x7f704415d6b0 2023-10-17T06:06:43.057 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.052+0000 7f7040ff9700 1 -- 172.21.15.184:0/3960188072 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7034005430 con 0x7f704415d6b0 2023-10-17T06:06:43.058 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.052+0000 7f7049435700 1 -- 172.21.15.184:0/3960188072 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70440afc00 con 0x7f704415d6b0 2023-10-17T06:06:43.058 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.052+0000 7f7040ff9700 1 -- 172.21.15.184:0/3960188072 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70340055a0 con 0x7f704415d6b0 2023-10-17T06:06:43.058 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.052+0000 7f7049435700 1 -- 172.21.15.184:0/3960188072 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70441582b0 con 0x7f704415d6b0 2023-10-17T06:06:43.058 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.052+0000 7f7040ff9700 1 -- 172.21.15.184:0/3960188072 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7034003c00 con 0x7f704415d6b0 2023-10-17T06:06:43.058 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.052+0000 7f7040ff9700 1 -- 172.21.15.184:0/3960188072 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f7034011e30 con 0x7f704415d6b0 2023-10-17T06:06:43.059 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.052+0000 7f7049435700 1 -- 172.21.15.184:0/3960188072 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7044071d80 con 0x7f704415d6b0 2023-10-17T06:06:43.060 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.056+0000 7f7040ff9700 1 -- 172.21.15.184:0/3960188072 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f7034017070 con 0x7f704415d6b0 2023-10-17T06:06:43.101 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:43.100+0000 7f84e17c62c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-17T06:06:43.165 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.160+0000 7f7049435700 1 -- 172.21.15.184:0/3960188072 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "26798ccb-c865-459d-98b7-90a9ce8ab6ce", "id": 1} v 0) v1 -- 0x7f704404e910 con 0x7f704415d6b0 2023-10-17T06:06:43.176 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.172+0000 7f7040ff9700 1 -- 172.21.15.184:0/3960188072 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "26798ccb-c865-459d-98b7-90a9ce8ab6ce", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7034011590 con 0x7f704415d6b0 2023-10-17T06:06:43.176 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-17T06:06:43.177 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.176+0000 7f7049435700 1 -- 172.21.15.184:0/3960188072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f704415d6b0 msgr2=0x7f7044152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:43.177 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.176+0000 7f7049435700 1 --2- 172.21.15.184:0/3960188072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f704415d6b0 0x7f7044152af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f703400c4e0 tx=0x7f703400c7f0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.178 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.176+0000 7f7049435700 1 -- 172.21.15.184:0/3960188072 shutdown_connections 2023-10-17T06:06:43.178 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.176+0000 7f7049435700 1 --2- 172.21.15.184:0/3960188072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f704415df40 0x7f7044152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.178 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.176+0000 7f7049435700 1 --2- 172.21.15.184:0/3960188072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f704415da90 0x7f70440b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.179 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.176+0000 7f7049435700 1 --2- 172.21.15.184:0/3960188072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f704415d6b0 0x7f7044152af0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.179 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.176+0000 7f7049435700 1 -- 172.21.15.184:0/3960188072 >> 172.21.15.184:0/3960188072 conn(0x7f70440cc1b0 msgr2=0x7f70440ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:43.179 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.176+0000 7f7049435700 1 -- 172.21.15.184:0/3960188072 shutdown_connections 2023-10-17T06:06:43.179 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.176+0000 7f7049435700 1 -- 172.21.15.184:0/3960188072 wait complete. 2023-10-17T06:06:43.199 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 997c2657-8b51-437c-85b1-2c2b5ec0b149 2 2023-10-17T06:06:43.297 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:43.292+0000 7fed95aa72c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-17T06:06:43.373 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:43.364+0000 7fed95aa72c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-17T06:06:43.400 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:43.396+0000 7f84e17c62c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-17T06:06:43.408 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.404+0000 7f7c4f047700 1 Processor -- start 2023-10-17T06:06:43.408 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.404+0000 7f7c4f047700 1 -- start start 2023-10-17T06:06:43.415 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.408+0000 7f7c4f047700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7c4815cdb0 0x7f7c480caf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:43.415 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.408+0000 7f7c4f047700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7c4806f450 0x7f7c48069fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:43.415 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.408+0000 7f7c4f047700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c480ce6c0 con 0x7f7c4806f8c0 2023-10-17T06:06:43.416 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.408+0000 7f7c4f047700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4806fe60 con 0x7f7c4806f450 2023-10-17T06:06:43.416 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.408+0000 7f7c4f047700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c48070140 con 0x7f7c4815cdb0 2023-10-17T06:06:43.416 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.408+0000 7f7c4e846700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f7c4806f8c0 0x7f7c480cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:40222/0 (socket says 172.21.15.184:40222) 2023-10-17T06:06:43.416 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.408+0000 7f7c4e846700 1 -- 172.21.15.184:0/1506766812 learned_addr learned my addr 172.21.15.184:0/1506766812 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-10-17T06:06:43.416 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.408+0000 7f7c4e045700 1 --2- 172.21.15.184:0/1506766812 >> v2:172.21.15.184:3300/0 conn(0x7f7c4815cdb0 0x7f7c480caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:43.417 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.408+0000 7f7c4d844700 1 --2- 172.21.15.184:0/1506766812 >> v2:172.21.15.125:3300/0 conn(0x7f7c4806f450 0x7f7c48069fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:43.417 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.408+0000 7f7c4e045700 1 -- 172.21.15.184:0/1506766812 >> v2:172.21.15.125:3300/0 conn(0x7f7c4806f450 msgr2=0x7f7c48069fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:06:43.417 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.408+0000 7f7c4e045700 1 --2- 172.21.15.184:0/1506766812 >> v2:172.21.15.125:3300/0 conn(0x7f7c4806f450 0x7f7c48069fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.417 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.408+0000 7f7c4e045700 1 -- 172.21.15.184:0/1506766812 >> v1:172.21.15.184:6789/0 conn(0x7f7c4806f8c0 legacy=0x7f7c480cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:43.417 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.408+0000 7f7c4d043700 1 -- 172.21.15.184:0/1506766812 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348317300 0 0) 0x7f7c480ce6c0 con 0x7f7c4806f8c0 2023-10-17T06:06:43.418 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.408+0000 7f7c4e045700 1 -- 172.21.15.184:0/1506766812 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c48070420 con 0x7f7c4815cdb0 2023-10-17T06:06:43.418 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.408+0000 7f7c4e045700 1 --2- 172.21.15.184:0/1506766812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4815cdb0 0x7f7c480caf20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7c48072090 tx=0x7f7c44009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d42ad0c13d5966 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:43.418 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.408+0000 7f7c4d043700 1 -- 172.21.15.184:0/1506766812 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44011830 con 0x7f7c4815cdb0 2023-10-17T06:06:43.418 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.408+0000 7f7c4d043700 1 -- 172.21.15.184:0/1506766812 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c44011990 con 0x7f7c4815cdb0 2023-10-17T06:06:43.418 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.408+0000 7f7c4d043700 1 -- 172.21.15.184:0/1506766812 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44011d20 con 0x7f7c4815cdb0 2023-10-17T06:06:43.419 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.412+0000 7f7c4f047700 1 -- 172.21.15.184:0/1506766812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4815cdb0 msgr2=0x7f7c480caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:43.419 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.412+0000 7f7c4f047700 1 --2- 172.21.15.184:0/1506766812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4815cdb0 0x7f7c480caf20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7c48072090 tx=0x7f7c44009b30 comp rx=0 tx=0).stop 2023-10-17T06:06:43.419 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.412+0000 7f7c4f047700 1 -- 172.21.15.184:0/1506766812 shutdown_connections 2023-10-17T06:06:43.419 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.412+0000 7f7c4f047700 1 --2- 172.21.15.184:0/1506766812 >> v2:172.21.15.125:3300/0 conn(0x7f7c4806f450 0x7f7c48069fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.419 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.412+0000 7f7c4f047700 1 --2- 172.21.15.184:0/1506766812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4815cdb0 0x7f7c480caf20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.420 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.412+0000 7f7c4f047700 1 -- 172.21.15.184:0/1506766812 >> 172.21.15.184:0/1506766812 conn(0x7f7c480cd240 msgr2=0x7f7c480cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:43.420 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.412+0000 7f7c4f047700 1 -- 172.21.15.184:0/1506766812 shutdown_connections 2023-10-17T06:06:43.420 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.412+0000 7f7c4f047700 1 -- 172.21.15.184:0/1506766812 wait complete. 2023-10-17T06:06:43.422 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.416+0000 7f7c4f047700 1 Processor -- start 2023-10-17T06:06:43.422 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.416+0000 7f7c4f047700 1 -- start start 2023-10-17T06:06:43.422 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.416+0000 7f7c4f047700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4806f450 0x7f7c48149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:43.423 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.416+0000 7f7c4f047700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c4806f8c0 0x7f7c480c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:43.423 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.416+0000 7f7c4f047700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c4815cdb0 0x7f7c4815b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:43.423 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.416+0000 7f7c4f047700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4814a1a0 con 0x7f7c4806f8c0 2023-10-17T06:06:43.423 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.416+0000 7f7c4f047700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480b63f0 con 0x7f7c4806f450 2023-10-17T06:06:43.423 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.416+0000 7f7c4f047700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480b5f60 con 0x7f7c4815cdb0 2023-10-17T06:06:43.424 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.416+0000 7f7c4e045700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4806f450 0x7f7c48149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:43.424 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.416+0000 7f7c4e045700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4806f450 0x7f7c48149c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:59276/0 (socket says 172.21.15.184:59276) 2023-10-17T06:06:43.424 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.416+0000 7f7c4e045700 1 -- 172.21.15.184:0/1928418490 learned_addr learned my addr 172.21.15.184:0/1928418490 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-17T06:06:43.424 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.420+0000 7f7c4e846700 1 --2- 172.21.15.184:0/1928418490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c4815cdb0 0x7f7c4815b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:43.424 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.420+0000 7f7c4e045700 1 -- 172.21.15.184:0/1928418490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c4815cdb0 msgr2=0x7f7c4815b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:43.425 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.420+0000 7f7c4e045700 1 --2- 172.21.15.184:0/1928418490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c4815cdb0 0x7f7c4815b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.425 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.420+0000 7f7c4e045700 1 -- 172.21.15.184:0/1928418490 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c4806f8c0 msgr2=0x7f7c480c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:43.425 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.420+0000 7f7c4e045700 1 --2- 172.21.15.184:0/1928418490 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c4806f8c0 0x7f7c480c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.425 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.420+0000 7f7c4e045700 1 -- 172.21.15.184:0/1928418490 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c440094b0 con 0x7f7c4806f450 2023-10-17T06:06:43.425 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.420+0000 7f7c4e045700 1 --2- 172.21.15.184:0/1928418490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4806f450 0x7f7c48149c60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7c44014040 tx=0x7f7c44004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:43.426 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.420+0000 7f7c3effd700 1 -- 172.21.15.184:0/1928418490 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440038c0 con 0x7f7c4806f450 2023-10-17T06:06:43.426 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.420+0000 7f7c3effd700 1 -- 172.21.15.184:0/1928418490 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4401e070 con 0x7f7c4806f450 2023-10-17T06:06:43.426 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.420+0000 7f7c3effd700 1 -- 172.21.15.184:0/1928418490 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44003c80 con 0x7f7c4806f450 2023-10-17T06:06:43.426 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.420+0000 7f7c4f047700 1 -- 172.21.15.184:0/1928418490 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c48158e50 con 0x7f7c4806f450 2023-10-17T06:06:43.426 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.420+0000 7f7c4f047700 1 -- 172.21.15.184:0/1928418490 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c480c6db0 con 0x7f7c4806f450 2023-10-17T06:06:43.427 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.420+0000 7f7c3effd700 1 -- 172.21.15.184:0/1928418490 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7c4402d750 con 0x7f7c4806f450 2023-10-17T06:06:43.427 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.420+0000 7f7c3effd700 1 -- 172.21.15.184:0/1928418490 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f7c44003e30 con 0x7f7c4806f450 2023-10-17T06:06:43.428 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.420+0000 7f7c4f047700 1 -- 172.21.15.184:0/1928418490 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c480cac60 con 0x7f7c4806f450 2023-10-17T06:06:43.428 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.424+0000 7f7c3effd700 1 -- 172.21.15.184:0/1928418490 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f7c44020070 con 0x7f7c4806f450 2023-10-17T06:06:43.483 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:43.480+0000 7f84e17c62c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-17T06:06:43.527 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.524+0000 7f7c4f047700 1 -- 172.21.15.184:0/1928418490 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "997c2657-8b51-437c-85b1-2c2b5ec0b149", "id": 2} v 0) v1 -- 0x7f7c4804e910 con 0x7f7c4806f450 2023-10-17T06:06:43.536 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.532+0000 7f7c3effd700 1 -- 172.21.15.184:0/1928418490 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "997c2657-8b51-437c-85b1-2c2b5ec0b149", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7c44015020 con 0x7f7c4806f450 2023-10-17T06:06:43.536 INFO:teuthology.orchestra.run.smithi184.stdout:2 2023-10-17T06:06:43.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.532+0000 7f7c4f047700 1 -- 172.21.15.184:0/1928418490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4806f450 msgr2=0x7f7c48149c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:43.537 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.532+0000 7f7c4f047700 1 --2- 172.21.15.184:0/1928418490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4806f450 0x7f7c48149c60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7c44014040 tx=0x7f7c44004770 comp rx=0 tx=0).stop 2023-10-17T06:06:43.538 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.532+0000 7f7c4f047700 1 -- 172.21.15.184:0/1928418490 shutdown_connections 2023-10-17T06:06:43.538 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.532+0000 7f7c4f047700 1 --2- 172.21.15.184:0/1928418490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c4815cdb0 0x7f7c4815b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.538 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.532+0000 7f7c4f047700 1 --2- 172.21.15.184:0/1928418490 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c4806f8c0 0x7f7c480c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.538 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.532+0000 7f7c4f047700 1 --2- 172.21.15.184:0/1928418490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c4806f450 0x7f7c48149c60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.538 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.532+0000 7f7c4f047700 1 -- 172.21.15.184:0/1928418490 >> 172.21.15.184:0/1928418490 conn(0x7f7c480cd240 msgr2=0x7f7c4815a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:43.539 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.532+0000 7f7c4f047700 1 -- 172.21.15.184:0/1928418490 shutdown_connections 2023-10-17T06:06:43.539 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.536+0000 7f7c4f047700 1 -- 172.21.15.184:0/1928418490 wait complete. 2023-10-17T06:06:43.555 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 49e6bd08-4c16-4eb4-b523-162d4cfe0dd5 3 2023-10-17T06:06:43.607 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:43.600+0000 7fed95aa72c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-17T06:06:43.697 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:43.692+0000 7fed95aa72c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-17T06:06:43.725 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.720+0000 7fb0d3f41700 1 Processor -- start 2023-10-17T06:06:43.726 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.724+0000 7fb0d3f41700 1 -- start start 2023-10-17T06:06:43.728 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.724+0000 7fb0d3f41700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0cc1467c0 0x7fb0cc0b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:43.728 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.724+0000 7fb0d3f41700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0cc146ba0 con 0x7fb0cc06f9a0 2023-10-17T06:06:43.728 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.724+0000 7fb0d3f41700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0cc0d0920 con 0x7fb0cc1612e0 2023-10-17T06:06:43.729 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.724+0000 7fb0d3f41700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc0b6160 con 0x7fb0cc1467c0 2023-10-17T06:06:43.729 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.724+0000 7fb0d1cdd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0cc1467c0 0x7fb0cc0b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:43.729 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.724+0000 7fb0d1cdd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0cc1467c0 0x7fb0cc0b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:33652/0 (socket says 172.21.15.184:33652) 2023-10-17T06:06:43.729 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.724+0000 7fb0d1cdd700 1 -- 172.21.15.184:0/2988485145 learned_addr learned my addr 172.21.15.184:0/2988485145 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-17T06:06:43.731 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.724+0000 7fb0d1cdd700 1 -- 172.21.15.184:0/2988485145 >> v1:172.21.15.184:6789/0 conn(0x7fb0cc1612e0 legacy=0x7fb0cc15d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:06:43.731 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.724+0000 7fb0d1cdd700 1 -- 172.21.15.184:0/2988485145 >> v1:172.21.15.125:6789/0 conn(0x7fb0cc06f9a0 legacy=0x7fb0cc0d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:06:43.731 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.724+0000 7fb0d1cdd700 1 -- 172.21.15.184:0/2988485145 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc0b6440 con 0x7fb0cc1467c0 2023-10-17T06:06:43.731 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.724+0000 7fb0d1cdd700 1 --2- 172.21.15.184:0/2988485145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0cc1467c0 0x7fb0cc0b5b80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009940 tx=0x7fb0c8009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=666f29f9fe9ec195 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:43.732 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.728+0000 7fb0d0cdb700 1 -- 172.21.15.184:0/2988485145 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8004230 con 0x7fb0cc1467c0 2023-10-17T06:06:43.732 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.728+0000 7fb0d0cdb700 1 -- 172.21.15.184:0/2988485145 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c8009e90 con 0x7fb0cc1467c0 2023-10-17T06:06:43.732 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.728+0000 7fb0d0cdb700 1 -- 172.21.15.184:0/2988485145 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c80045b0 con 0x7fb0cc1467c0 2023-10-17T06:06:43.732 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.728+0000 7fb0d3f41700 1 -- 172.21.15.184:0/2988485145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0cc1467c0 msgr2=0x7fb0cc0b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:43.732 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.728+0000 7fb0d3f41700 1 --2- 172.21.15.184:0/2988485145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0cc1467c0 0x7fb0cc0b5b80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009940 tx=0x7fb0c8009c50 comp rx=0 tx=0).stop 2023-10-17T06:06:43.733 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.728+0000 7fb0d3f41700 1 -- 172.21.15.184:0/2988485145 shutdown_connections 2023-10-17T06:06:43.733 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.728+0000 7fb0d3f41700 1 --2- 172.21.15.184:0/2988485145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0cc1467c0 0x7fb0cc0b5b80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.733 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.728+0000 7fb0d3f41700 1 -- 172.21.15.184:0/2988485145 >> 172.21.15.184:0/2988485145 conn(0x7fb0cc06a130 msgr2=0x7fb0cc06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:43.733 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.728+0000 7fb0d3f41700 1 -- 172.21.15.184:0/2988485145 shutdown_connections 2023-10-17T06:06:43.733 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.728+0000 7fb0d3f41700 1 -- 172.21.15.184:0/2988485145 wait complete. 2023-10-17T06:06:43.734 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.732+0000 7fb0d3f41700 1 Processor -- start 2023-10-17T06:06:43.734 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.732+0000 7fb0d3f41700 1 -- start start 2023-10-17T06:06:43.735 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:43.732+0000 7f84e17c62c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-17T06:06:43.736 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.732+0000 7fb0d3f41700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0cc06f9a0 0x7fb0cc15c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:43.736 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.732+0000 7fb0d3f41700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0cc1467c0 0x7fb0cc1f2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:43.736 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.732+0000 7fb0d3f41700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0cc1612e0 0x7fb0cc15f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:43.736 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.732+0000 7fb0d3f41700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc13fa00 con 0x7fb0cc1612e0 2023-10-17T06:06:43.736 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.732+0000 7fb0d3f41700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc15cdb0 con 0x7fb0cc06f9a0 2023-10-17T06:06:43.736 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.732+0000 7fb0d3f41700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc1f2ed0 con 0x7fb0cc1467c0 2023-10-17T06:06:43.737 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.732+0000 7fb0d1cdd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0cc06f9a0 0x7fb0cc15c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:43.737 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.732+0000 7fb0d1cdd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0cc06f9a0 0x7fb0cc15c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:59282/0 (socket says 172.21.15.184:59282) 2023-10-17T06:06:43.737 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.732+0000 7fb0d1cdd700 1 -- 172.21.15.184:0/3379190803 learned_addr learned my addr 172.21.15.184:0/3379190803 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-17T06:06:43.737 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.732+0000 7fb0d14dc700 1 --2- 172.21.15.184:0/3379190803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0cc1467c0 0x7fb0cc1f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:43.739 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.732+0000 7fb0d1cdd700 1 -- 172.21.15.184:0/3379190803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0cc1467c0 msgr2=0x7fb0cc1f2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:43.739 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.732+0000 7fb0d1cdd700 1 --2- 172.21.15.184:0/3379190803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0cc1467c0 0x7fb0cc1f2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.739 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.732+0000 7fb0d1cdd700 1 -- 172.21.15.184:0/3379190803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0cc1612e0 msgr2=0x7fb0cc15f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:43.739 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.732+0000 7fb0d1cdd700 1 --2- 172.21.15.184:0/3379190803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0cc1612e0 0x7fb0cc15f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.739 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.732+0000 7fb0d1cdd700 1 -- 172.21.15.184:0/3379190803 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c8009570 con 0x7fb0cc06f9a0 2023-10-17T06:06:43.740 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.732+0000 7fb0d1cdd700 1 --2- 172.21.15.184:0/3379190803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0cc06f9a0 0x7fb0cc15c870 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb0c800b3c0 tx=0x7fb0c8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:43.740 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.736+0000 7fb0c27fc700 1 -- 172.21.15.184:0/3379190803 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c800bc80 con 0x7fb0cc06f9a0 2023-10-17T06:06:43.740 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.736+0000 7fb0c27fc700 1 -- 172.21.15.184:0/3379190803 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c801f070 con 0x7fb0cc06f9a0 2023-10-17T06:06:43.740 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.736+0000 7fb0c27fc700 1 -- 172.21.15.184:0/3379190803 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c80036c0 con 0x7fb0cc06f9a0 2023-10-17T06:06:43.740 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.736+0000 7fb0d3f41700 1 -- 172.21.15.184:0/3379190803 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0cc13be40 con 0x7fb0cc06f9a0 2023-10-17T06:06:43.741 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.736+0000 7fb0d3f41700 1 -- 172.21.15.184:0/3379190803 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0cc141190 con 0x7fb0cc06f9a0 2023-10-17T06:06:43.741 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.736+0000 7fb0c27fc700 1 -- 172.21.15.184:0/3379190803 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb0c8021030 con 0x7fb0cc06f9a0 2023-10-17T06:06:43.741 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.736+0000 7fb0c27fc700 1 -- 172.21.15.184:0/3379190803 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fb0c801a440 con 0x7fb0cc06f9a0 2023-10-17T06:06:43.741 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.736+0000 7fb0d3f41700 1 -- 172.21.15.184:0/3379190803 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0cc161720 con 0x7fb0cc06f9a0 2023-10-17T06:06:43.742 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.740+0000 7fb0c27fc700 1 -- 172.21.15.184:0/3379190803 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb0cc161720 con 0x7fb0cc06f9a0 2023-10-17T06:06:43.785 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:43.780+0000 7fed95aa72c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-17T06:06:43.832 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:43.828+0000 7f84e17c62c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-17T06:06:43.843 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.840+0000 7fb0d3f41700 1 -- 172.21.15.184:0/3379190803 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "49e6bd08-4c16-4eb4-b523-162d4cfe0dd5", "id": 3} v 0) v1 -- 0x7fb0cc0b66f0 con 0x7fb0cc06f9a0 2023-10-17T06:06:43.853 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.848+0000 7fb0c27fc700 1 -- 172.21.15.184:0/3379190803 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "49e6bd08-4c16-4eb4-b523-162d4cfe0dd5", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb0c8003b20 con 0x7fb0cc06f9a0 2023-10-17T06:06:43.853 INFO:teuthology.orchestra.run.smithi184.stdout:3 2023-10-17T06:06:43.854 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.852+0000 7fb0d3f41700 1 -- 172.21.15.184:0/3379190803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0cc06f9a0 msgr2=0x7fb0cc15c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:43.855 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.852+0000 7fb0d3f41700 1 --2- 172.21.15.184:0/3379190803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0cc06f9a0 0x7fb0cc15c870 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb0c800b3c0 tx=0x7fb0c8004770 comp rx=0 tx=0).stop 2023-10-17T06:06:43.855 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.852+0000 7fb0d3f41700 1 -- 172.21.15.184:0/3379190803 shutdown_connections 2023-10-17T06:06:43.855 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.852+0000 7fb0d3f41700 1 --2- 172.21.15.184:0/3379190803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0cc1612e0 0x7fb0cc15f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.855 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.852+0000 7fb0d3f41700 1 --2- 172.21.15.184:0/3379190803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0cc1467c0 0x7fb0cc1f2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.855 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.852+0000 7fb0d3f41700 1 --2- 172.21.15.184:0/3379190803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0cc06f9a0 0x7fb0cc15c870 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:43.856 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.852+0000 7fb0d3f41700 1 -- 172.21.15.184:0/3379190803 >> 172.21.15.184:0/3379190803 conn(0x7fb0cc06a130 msgr2=0x7fb0cc0b7420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:43.856 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.852+0000 7fb0d3f41700 1 -- 172.21.15.184:0/3379190803 shutdown_connections 2023-10-17T06:06:43.856 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:43.852+0000 7fb0d3f41700 1 -- 172.21.15.184:0/3379190803 wait complete. 2023-10-17T06:06:43.874 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new d7b21bd2-a06e-4e5e-bce1-4af4bc33d066 4 2023-10-17T06:06:43.934 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:43.932+0000 7f84e17c62c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-17T06:06:44.037 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.032+0000 7fb254637700 1 Processor -- start 2023-10-17T06:06:44.038 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.036+0000 7fb254637700 1 -- start start 2023-10-17T06:06:44.040 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.036+0000 7fb254637700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb24c0d2610 0x7fb24c06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:44.040 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.036+0000 7fb254637700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24c0d29f0 con 0x7fb24c0d36b0 2023-10-17T06:06:44.041 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.036+0000 7fb254637700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24c0b64b0 con 0x7fb24c15e7d0 2023-10-17T06:06:44.041 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.036+0000 7fb254637700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24c0b6750 con 0x7fb24c0d2610 2023-10-17T06:06:44.041 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.036+0000 7fb251bd2700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fb24c15e7d0 0x7fb24c0d2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:40238/0 (socket says 172.21.15.184:40238) 2023-10-17T06:06:44.041 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.036+0000 7fb251bd2700 1 -- 172.21.15.184:0/2970577768 learned_addr learned my addr 172.21.15.184:0/2970577768 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-10-17T06:06:44.044 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.036+0000 7fb2523d3700 1 --2- 172.21.15.184:0/2970577768 >> v2:172.21.15.125:3300/0 conn(0x7fb24c0d2610 0x7fb24c06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:44.044 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.036+0000 7fb2513d1700 1 -- 172.21.15.184:0/2970577768 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883227347 0 0) 0x7fb24c0b64b0 con 0x7fb24c15e7d0 2023-10-17T06:06:44.044 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.036+0000 7fb2513d1700 1 -- 172.21.15.184:0/2970577768 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2380035d0 con 0x7fb24c15e7d0 2023-10-17T06:06:44.044 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb2513d1700 1 -- 172.21.15.184:0/2970577768 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 223015629 0 0) 0x7fb2380035d0 con 0x7fb24c15e7d0 2023-10-17T06:06:44.045 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb2513d1700 1 -- 172.21.15.184:0/2970577768 >> v2:172.21.15.125:3300/0 conn(0x7fb24c0d2610 msgr2=0x7fb24c06e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:06:44.045 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb2513d1700 1 --2- 172.21.15.184:0/2970577768 >> v2:172.21.15.125:3300/0 conn(0x7fb24c0d2610 0x7fb24c06e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.045 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb2513d1700 1 -- 172.21.15.184:0/2970577768 >> v1:172.21.15.125:6789/0 conn(0x7fb24c0d36b0 legacy=0x7fb24c15d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:44.045 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb2513d1700 1 -- 172.21.15.184:0/2970577768 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c0b6a30 con 0x7fb24c15e7d0 2023-10-17T06:06:44.045 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb2513d1700 1 -- 172.21.15.184:0/2970577768 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7fb23c001670 con 0x7fb24c15e7d0 2023-10-17T06:06:44.045 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb2513d1700 1 -- 172.21.15.184:0/2970577768 >> v1:172.21.15.184:6789/0 conn(0x7fb24c15e7d0 legacy=0x7fb24c0d2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:44.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb2513d1700 1 --2- 172.21.15.184:0/2970577768 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb238003ae0 0x7fb238003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:44.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb2513d1700 1 --2- 172.21.15.184:0/2970577768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb238004870 0x7fb238004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:44.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb2513d1700 1 --2- 172.21.15.184:0/2970577768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb238005280 0x7fb23800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:44.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb2513d1700 1 -- 172.21.15.184:0/2970577768 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c0b6750 con 0x7fb238004870 2023-10-17T06:06:44.046 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb2513d1700 1 -- 172.21.15.184:0/2970577768 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23800c1b0 con 0x7fb238005280 2023-10-17T06:06:44.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb2513d1700 1 -- 172.21.15.184:0/2970577768 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23800c370 con 0x7fb238003ae0 2023-10-17T06:06:44.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb2523d3700 1 --2- 172.21.15.184:0/2970577768 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb238003ae0 0x7fb238003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:44.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb252bd4700 1 --2- 172.21.15.184:0/2970577768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb238005280 0x7fb23800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:44.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb251bd2700 1 --2- 172.21.15.184:0/2970577768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb238004870 0x7fb238004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:44.047 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb252bd4700 1 -- 172.21.15.184:0/2970577768 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb238003ae0 msgr2=0x7fb238003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:06:44.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb252bd4700 1 --2- 172.21.15.184:0/2970577768 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb238003ae0 0x7fb238003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb252bd4700 1 -- 172.21.15.184:0/2970577768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb238004870 msgr2=0x7fb238004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:06:44.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb252bd4700 1 --2- 172.21.15.184:0/2970577768 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb238004870 0x7fb238004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb252bd4700 1 -- 172.21.15.184:0/2970577768 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2380035d0 con 0x7fb238005280 2023-10-17T06:06:44.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb252bd4700 1 -- 172.21.15.184:0/2970577768 reap_dead start 2023-10-17T06:06:44.048 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb252bd4700 1 --2- 172.21.15.184:0/2970577768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb238005280 0x7fb23800ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb24400c190 tx=0x7fb2380058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2185acea18205f53 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:44.049 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb2513d1700 1 -- 172.21.15.184:0/2970577768 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb244001db0 con 0x7fb238005280 2023-10-17T06:06:44.049 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb2513d1700 1 -- 172.21.15.184:0/2970577768 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24400ccf0 con 0x7fb238005280 2023-10-17T06:06:44.049 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb2513d1700 1 -- 172.21.15.184:0/2970577768 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb244003c60 con 0x7fb238005280 2023-10-17T06:06:44.051 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb254637700 1 -- 172.21.15.184:0/2970577768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb238005280 msgr2=0x7fb23800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:44.051 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb254637700 1 --2- 172.21.15.184:0/2970577768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb238005280 0x7fb23800ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb24400c190 tx=0x7fb2380058a0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.051 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb254637700 1 -- 172.21.15.184:0/2970577768 shutdown_connections 2023-10-17T06:06:44.051 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb254637700 1 --2- 172.21.15.184:0/2970577768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb238005280 0x7fb23800ba30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.052 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb254637700 1 -- 172.21.15.184:0/2970577768 >> 172.21.15.184:0/2970577768 conn(0x7fb24c069f20 msgr2=0x7fb24c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:44.052 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb254637700 1 -- 172.21.15.184:0/2970577768 shutdown_connections 2023-10-17T06:06:44.052 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.040+0000 7fb254637700 1 -- 172.21.15.184:0/2970577768 wait complete. 2023-10-17T06:06:44.052 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.044+0000 7fb254637700 1 Processor -- start 2023-10-17T06:06:44.052 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.044+0000 7fb254637700 1 -- start start 2023-10-17T06:06:44.053 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb254637700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb238005280 0x7fb24c1f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:44.053 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb254637700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb24c0ac2f0 0x7fb24c0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:44.053 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb254637700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb24c1f3a80 0x7fb24c1f3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:44.053 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb254637700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c0ad2e0 con 0x7fb24c0ac2f0 2023-10-17T06:06:44.053 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb254637700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c0aca40 con 0x7fb24c1f3a80 2023-10-17T06:06:44.054 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb254637700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c0acd20 con 0x7fb238005280 2023-10-17T06:06:44.054 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb252bd4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb24c1f3a80 0x7fb24c1f3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:44.054 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb252bd4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb24c1f3a80 0x7fb24c1f3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:59300/0 (socket says 172.21.15.184:59300) 2023-10-17T06:06:44.054 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb2523d3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb238005280 0x7fb24c1f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:44.055 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb252bd4700 1 -- 172.21.15.184:0/2394289934 learned_addr learned my addr 172.21.15.184:0/2394289934 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-17T06:06:44.055 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb251bd2700 1 --2- 172.21.15.184:0/2394289934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb24c0ac2f0 0x7fb24c0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:44.055 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb252bd4700 1 -- 172.21.15.184:0/2394289934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb238005280 msgr2=0x7fb24c1f6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:44.055 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb252bd4700 1 --2- 172.21.15.184:0/2394289934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb238005280 0x7fb24c1f6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.055 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb252bd4700 1 -- 172.21.15.184:0/2394289934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb24c0ac2f0 msgr2=0x7fb24c0b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:44.056 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb252bd4700 1 --2- 172.21.15.184:0/2394289934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb24c0ac2f0 0x7fb24c0b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.056 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb252bd4700 1 -- 172.21.15.184:0/2394289934 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c0ad000 con 0x7fb24c1f3a80 2023-10-17T06:06:44.057 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb252bd4700 1 --2- 172.21.15.184:0/2394289934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb24c1f3a80 0x7fb24c1f3f30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb244005040 tx=0x7fb2440014a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:44.057 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb242ffd700 1 -- 172.21.15.184:0/2394289934 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2440052d0 con 0x7fb24c1f3a80 2023-10-17T06:06:44.057 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb242ffd700 1 -- 172.21.15.184:0/2394289934 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb244005430 con 0x7fb24c1f3a80 2023-10-17T06:06:44.057 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb254637700 1 -- 172.21.15.184:0/2394289934 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24c1f3560 con 0x7fb24c1f3a80 2023-10-17T06:06:44.058 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb242ffd700 1 -- 172.21.15.184:0/2394289934 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2440057a0 con 0x7fb24c1f3a80 2023-10-17T06:06:44.058 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb254637700 1 -- 172.21.15.184:0/2394289934 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24c0b07c0 con 0x7fb24c1f3a80 2023-10-17T06:06:44.058 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb242ffd700 1 -- 172.21.15.184:0/2394289934 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb24401d780 con 0x7fb24c1f3a80 2023-10-17T06:06:44.058 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.048+0000 7fb242ffd700 1 -- 172.21.15.184:0/2394289934 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fb244029670 con 0x7fb24c1f3a80 2023-10-17T06:06:44.058 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.052+0000 7fb254637700 1 -- 172.21.15.184:0/2394289934 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24c072e60 con 0x7fb24c1f3a80 2023-10-17T06:06:44.060 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.056+0000 7fb242ffd700 1 -- 172.21.15.184:0/2394289934 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb24402e060 con 0x7fb24c1f3a80 2023-10-17T06:06:44.160 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.156+0000 7fb254637700 1 -- 172.21.15.184:0/2394289934 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d7b21bd2-a06e-4e5e-bce1-4af4bc33d066", "id": 4} v 0) v1 -- 0x7fb24c0d33e0 con 0x7fb24c1f3a80 2023-10-17T06:06:44.170 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.168+0000 7fb242ffd700 1 -- 172.21.15.184:0/2394289934 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d7b21bd2-a06e-4e5e-bce1-4af4bc33d066", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb244024070 con 0x7fb24c1f3a80 2023-10-17T06:06:44.170 INFO:teuthology.orchestra.run.smithi184.stdout:4 2023-10-17T06:06:44.172 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.168+0000 7fb254637700 1 -- 172.21.15.184:0/2394289934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb24c1f3a80 msgr2=0x7fb24c1f3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:44.172 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.168+0000 7fb254637700 1 --2- 172.21.15.184:0/2394289934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb24c1f3a80 0x7fb24c1f3f30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb244005040 tx=0x7fb2440014a0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.172 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.168+0000 7fb254637700 1 -- 172.21.15.184:0/2394289934 shutdown_connections 2023-10-17T06:06:44.172 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.168+0000 7fb254637700 1 --2- 172.21.15.184:0/2394289934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb24c1f3a80 0x7fb24c1f3f30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.172 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.168+0000 7fb254637700 1 --2- 172.21.15.184:0/2394289934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb24c0ac2f0 0x7fb24c0b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.173 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.168+0000 7fb254637700 1 --2- 172.21.15.184:0/2394289934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb238005280 0x7fb24c1f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.173 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.168+0000 7fb254637700 1 -- 172.21.15.184:0/2394289934 >> 172.21.15.184:0/2394289934 conn(0x7fb24c069f20 msgr2=0x7fb24c0b3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:44.173 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.168+0000 7fb254637700 1 -- 172.21.15.184:0/2394289934 shutdown_connections 2023-10-17T06:06:44.173 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.168+0000 7fb254637700 1 -- 172.21.15.184:0/2394289934 wait complete. 2023-10-17T06:06:44.192 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new d65d03d2-9afe-4473-8e10-76d8926bbd1c 5 2023-10-17T06:06:44.293 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:44.288+0000 7fed95aa72c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-17T06:06:44.366 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.364+0000 7fb43422c700 1 Processor -- start 2023-10-17T06:06:44.366 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.364+0000 7fb43422c700 1 -- start start 2023-10-17T06:06:44.369 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb43422c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb42c0d2610 0x7fb42c06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:44.370 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb43422c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb42c0d36b0 0x7fb42c15d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:44.371 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb43422c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb42c0d29f0 con 0x7fb42c15e7d0 2023-10-17T06:06:44.371 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb43422c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb42c0b64b0 con 0x7fb42c0d36b0 2023-10-17T06:06:44.371 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb43422c700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb42c0b6750 con 0x7fb42c0d2610 2023-10-17T06:06:44.371 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb4317c7700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fb42c15e7d0 0x7fb42c0d2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:40244/0 (socket says 172.21.15.184:40244) 2023-10-17T06:06:44.371 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb4317c7700 1 -- 172.21.15.184:0/926714212 learned_addr learned my addr 172.21.15.184:0/926714212 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-10-17T06:06:44.372 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb431fc8700 1 --2- 172.21.15.184:0/926714212 >> v2:172.21.15.184:3300/0 conn(0x7fb42c0d2610 0x7fb42c06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:44.372 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb4327c9700 1 --2- 172.21.15.184:0/926714212 >> v2:172.21.15.125:3300/0 conn(0x7fb42c0d36b0 0x7fb42c15d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:44.372 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb431fc8700 1 -- 172.21.15.184:0/926714212 >> v2:172.21.15.125:3300/0 conn(0x7fb42c0d36b0 msgr2=0x7fb42c15d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:06:44.372 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb431fc8700 1 --2- 172.21.15.184:0/926714212 >> v2:172.21.15.125:3300/0 conn(0x7fb42c0d36b0 0x7fb42c15d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.373 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb431fc8700 1 -- 172.21.15.184:0/926714212 >> v1:172.21.15.184:6789/0 conn(0x7fb42c15e7d0 legacy=0x7fb42c0d2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:44.373 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb431fc8700 1 -- 172.21.15.184:0/926714212 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42c0b6a30 con 0x7fb42c0d2610 2023-10-17T06:06:44.374 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb431fc8700 1 --2- 172.21.15.184:0/926714212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb42c0d2610 0x7fb42c06e6f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb42c06dce0 tx=0x7fb428009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2faf9987a4536be1 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:44.374 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb430fc6700 1 -- 172.21.15.184:0/926714212 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb428011830 con 0x7fb42c0d2610 2023-10-17T06:06:44.374 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb430fc6700 1 -- 172.21.15.184:0/926714212 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb428011990 con 0x7fb42c0d2610 2023-10-17T06:06:44.375 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb430fc6700 1 -- 172.21.15.184:0/926714212 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb428011d40 con 0x7fb42c0d2610 2023-10-17T06:06:44.375 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb43422c700 1 -- 172.21.15.184:0/926714212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb42c0d2610 msgr2=0x7fb42c06e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:44.375 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb43422c700 1 --2- 172.21.15.184:0/926714212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb42c0d2610 0x7fb42c06e6f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb42c06dce0 tx=0x7fb428009b30 comp rx=0 tx=0).stop 2023-10-17T06:06:44.375 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb43422c700 1 -- 172.21.15.184:0/926714212 shutdown_connections 2023-10-17T06:06:44.375 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb43422c700 1 --2- 172.21.15.184:0/926714212 >> v2:172.21.15.125:3300/0 conn(0x7fb42c0d36b0 0x7fb42c15d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.376 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb43422c700 1 --2- 172.21.15.184:0/926714212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb42c0d2610 0x7fb42c06e6f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.376 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb43422c700 1 -- 172.21.15.184:0/926714212 >> 172.21.15.184:0/926714212 conn(0x7fb42c069f20 msgr2=0x7fb42c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:44.376 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb43422c700 1 -- 172.21.15.184:0/926714212 shutdown_connections 2023-10-17T06:06:44.376 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.368+0000 7fb43422c700 1 -- 172.21.15.184:0/926714212 wait complete. 2023-10-17T06:06:44.377 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.372+0000 7fb43422c700 1 Processor -- start 2023-10-17T06:06:44.377 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.372+0000 7fb43422c700 1 -- start start 2023-10-17T06:06:44.379 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb43422c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb42c0d2610 0x7fb42c1f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:44.379 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb43422c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb42c0d36b0 0x7fb42c1f3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:44.379 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb43422c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb42c15e7d0 0x7fb42c0d1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:44.379 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb43422c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c1f6ad0 con 0x7fb42c0d36b0 2023-10-17T06:06:44.380 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb43422c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c1f6230 con 0x7fb42c0d2610 2023-10-17T06:06:44.380 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb43422c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c1f6510 con 0x7fb42c15e7d0 2023-10-17T06:06:44.380 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb431fc8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb42c0d2610 0x7fb42c1f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:44.380 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb431fc8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb42c0d2610 0x7fb42c1f5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:59326/0 (socket says 172.21.15.184:59326) 2023-10-17T06:06:44.381 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb431fc8700 1 -- 172.21.15.184:0/2592752357 learned_addr learned my addr 172.21.15.184:0/2592752357 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-17T06:06:44.381 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb4327c9700 1 --2- 172.21.15.184:0/2592752357 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb42c15e7d0 0x7fb42c0d1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:44.381 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb4317c7700 1 --2- 172.21.15.184:0/2592752357 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb42c0d36b0 0x7fb42c1f3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:44.381 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb431fc8700 1 -- 172.21.15.184:0/2592752357 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb42c15e7d0 msgr2=0x7fb42c0d1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:44.381 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb431fc8700 1 --2- 172.21.15.184:0/2592752357 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb42c15e7d0 0x7fb42c0d1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.382 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb431fc8700 1 -- 172.21.15.184:0/2592752357 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb42c0d36b0 msgr2=0x7fb42c1f3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:44.382 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb431fc8700 1 --2- 172.21.15.184:0/2592752357 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb42c0d36b0 0x7fb42c1f3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.382 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb431fc8700 1 -- 172.21.15.184:0/2592752357 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4280094b0 con 0x7fb42c0d2610 2023-10-17T06:06:44.382 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb4317c7700 1 --2- 172.21.15.184:0/2592752357 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb42c0d36b0 0x7fb42c1f3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:06:44.382 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb431fc8700 1 --2- 172.21.15.184:0/2592752357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb42c0d2610 0x7fb42c1f5b70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb4280090b0 tx=0x7fb428004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:44.383 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb4227fc700 1 -- 172.21.15.184:0/2592752357 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4280045d0 con 0x7fb42c0d2610 2023-10-17T06:06:44.384 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb4227fc700 1 -- 172.21.15.184:0/2592752357 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4280036c0 con 0x7fb42c0d2610 2023-10-17T06:06:44.384 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb4227fc700 1 -- 172.21.15.184:0/2592752357 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb428003a70 con 0x7fb42c0d2610 2023-10-17T06:06:44.384 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb43422c700 1 -- 172.21.15.184:0/2592752357 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42c1f67f0 con 0x7fb42c0d2610 2023-10-17T06:06:44.384 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb43422c700 1 -- 172.21.15.184:0/2592752357 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42c1f3560 con 0x7fb42c0d2610 2023-10-17T06:06:44.385 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb4227fc700 1 -- 172.21.15.184:0/2592752357 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb428025460 con 0x7fb42c0d2610 2023-10-17T06:06:44.385 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.376+0000 7fb4227fc700 1 -- 172.21.15.184:0/2592752357 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fb428025c90 con 0x7fb42c0d2610 2023-10-17T06:06:44.385 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.380+0000 7fb43422c700 1 -- 172.21.15.184:0/2592752357 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb42c1f3a90 con 0x7fb42c0d2610 2023-10-17T06:06:44.385 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.380+0000 7fb4227fc700 1 -- 172.21.15.184:0/2592752357 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb42c1f3a90 con 0x7fb42c0d2610 2023-10-17T06:06:44.465 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:44.460+0000 7fed95aa72c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-17T06:06:44.486 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.484+0000 7fb43422c700 1 -- 172.21.15.184:0/2592752357 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d65d03d2-9afe-4473-8e10-76d8926bbd1c", "id": 5} v 0) v1 -- 0x7fb42c072e60 con 0x7fb42c0d2610 2023-10-17T06:06:44.486 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:44.484+0000 7f84e17c62c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-17T06:06:44.495 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.492+0000 7fb4227fc700 1 -- 172.21.15.184:0/2592752357 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d65d03d2-9afe-4473-8e10-76d8926bbd1c", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb42802a020 con 0x7fb42c0d2610 2023-10-17T06:06:44.496 INFO:teuthology.orchestra.run.smithi184.stdout:5 2023-10-17T06:06:44.497 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.492+0000 7fb43422c700 1 -- 172.21.15.184:0/2592752357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb42c0d2610 msgr2=0x7fb42c1f5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:44.497 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.492+0000 7fb43422c700 1 --2- 172.21.15.184:0/2592752357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb42c0d2610 0x7fb42c1f5b70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb4280090b0 tx=0x7fb428004770 comp rx=0 tx=0).stop 2023-10-17T06:06:44.497 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.492+0000 7fb43422c700 1 -- 172.21.15.184:0/2592752357 shutdown_connections 2023-10-17T06:06:44.497 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.492+0000 7fb43422c700 1 --2- 172.21.15.184:0/2592752357 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb42c15e7d0 0x7fb42c0d1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.498 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.492+0000 7fb43422c700 1 --2- 172.21.15.184:0/2592752357 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb42c0d36b0 0x7fb42c1f3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.498 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.492+0000 7fb43422c700 1 --2- 172.21.15.184:0/2592752357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb42c0d2610 0x7fb42c1f5b70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.498 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.492+0000 7fb43422c700 1 -- 172.21.15.184:0/2592752357 >> 172.21.15.184:0/2592752357 conn(0x7fb42c069f20 msgr2=0x7fb42c0b3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:44.498 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.492+0000 7fb43422c700 1 -- 172.21.15.184:0/2592752357 shutdown_connections 2023-10-17T06:06:44.498 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.492+0000 7fb43422c700 1 -- 172.21.15.184:0/2592752357 wait complete. 2023-10-17T06:06:44.518 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 787e64b7-283d-43f8-bb1b-87d47e562be7 6 2023-10-17T06:06:44.673 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:44.672+0000 7f84e17c62c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-17T06:06:44.681 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.676+0000 7fcdd4e7b700 1 Processor -- start 2023-10-17T06:06:44.681 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.676+0000 7fcdd4e7b700 1 -- start start 2023-10-17T06:06:44.683 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.680+0000 7fcdd4e7b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdd00b5b80 0x7fcdd015d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:44.683 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.680+0000 7fcdd4e7b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcdd006f9a0 0x7fcdd006fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:44.683 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.680+0000 7fcdd4e7b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd0146ba0 con 0x7fcdd01467c0 2023-10-17T06:06:44.684 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.680+0000 7fcdd4e7b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd0070350 con 0x7fcdd006f9a0 2023-10-17T06:06:44.684 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.680+0000 7fcdd4e7b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd00d0920 con 0x7fcdd00b5b80 2023-10-17T06:06:44.685 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.680+0000 7fcdcdd9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdd00b5b80 0x7fcdd015d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:44.685 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.680+0000 7fcdcdd9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdd00b5b80 0x7fcdd015d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:33690/0 (socket says 172.21.15.184:33690) 2023-10-17T06:06:44.685 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.680+0000 7fcdcdd9b700 1 -- 172.21.15.184:0/2007979328 learned_addr learned my addr 172.21.15.184:0/2007979328 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-17T06:06:44.686 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.680+0000 7fcdce59c700 1 --1- 172.21.15.184:0/2007979328 >> v1:172.21.15.184:6789/0 conn(0x7fcdd01467c0 0x7fcdd01612e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:40246/0 (socket says 172.21.15.184:40246) 2023-10-17T06:06:44.686 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.680+0000 7fcdced9d700 1 --2- 172.21.15.184:0/2007979328 >> v2:172.21.15.184:3300/0 conn(0x7fcdd006f9a0 0x7fcdd006fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:44.686 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.680+0000 7fcdcdd9b700 1 -- 172.21.15.184:0/2007979328 >> v2:172.21.15.184:3300/0 conn(0x7fcdd006f9a0 msgr2=0x7fcdd006fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:06:44.686 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.680+0000 7fcdcdd9b700 1 --2- 172.21.15.184:0/2007979328 >> v2:172.21.15.184:3300/0 conn(0x7fcdd006f9a0 0x7fcdd006fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.687 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.680+0000 7fcdcdd9b700 1 -- 172.21.15.184:0/2007979328 >> v1:172.21.15.184:6789/0 conn(0x7fcdd01467c0 legacy=0x7fcdd01612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:44.687 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.680+0000 7fcdcdd9b700 1 -- 172.21.15.184:0/2007979328 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd00b6160 con 0x7fcdd00b5b80 2023-10-17T06:06:44.687 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.680+0000 7fcdcdd9b700 1 --2- 172.21.15.184:0/2007979328 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdd00b5b80 0x7fcdd015d310 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009910 tx=0x7fcdc4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd58d5ddb124911 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:44.687 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.684+0000 7fcdcd59a700 1 -- 172.21.15.184:0/2007979328 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc400ba60 con 0x7fcdd00b5b80 2023-10-17T06:06:44.687 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.684+0000 7fcdcd59a700 1 -- 172.21.15.184:0/2007979328 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc400bbc0 con 0x7fcdd00b5b80 2023-10-17T06:06:44.687 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.684+0000 7fcdcd59a700 1 -- 172.21.15.184:0/2007979328 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4009e60 con 0x7fcdd00b5b80 2023-10-17T06:06:44.688 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.684+0000 7fcdd4e7b700 1 -- 172.21.15.184:0/2007979328 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdd00b5b80 msgr2=0x7fcdd015d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:44.688 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.684+0000 7fcdd4e7b700 1 --2- 172.21.15.184:0/2007979328 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdd00b5b80 0x7fcdd015d310 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009910 tx=0x7fcdc4009c20 comp rx=0 tx=0).stop 2023-10-17T06:06:44.689 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.684+0000 7fcdd4e7b700 1 -- 172.21.15.184:0/2007979328 shutdown_connections 2023-10-17T06:06:44.689 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.684+0000 7fcdd4e7b700 1 --2- 172.21.15.184:0/2007979328 >> v2:172.21.15.184:3300/0 conn(0x7fcdd006f9a0 0x7fcdd006fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.689 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.684+0000 7fcdd4e7b700 1 --2- 172.21.15.184:0/2007979328 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdd00b5b80 0x7fcdd015d310 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.689 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.684+0000 7fcdd4e7b700 1 -- 172.21.15.184:0/2007979328 >> 172.21.15.184:0/2007979328 conn(0x7fcdd006a130 msgr2=0x7fcdd006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:44.689 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.684+0000 7fcdd4e7b700 1 -- 172.21.15.184:0/2007979328 shutdown_connections 2023-10-17T06:06:44.690 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.684+0000 7fcdd4e7b700 1 -- 172.21.15.184:0/2007979328 wait complete. 2023-10-17T06:06:44.691 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.684+0000 7fcdd4e7b700 1 Processor -- start 2023-10-17T06:06:44.691 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdd4e7b700 1 -- start start 2023-10-17T06:06:44.691 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdd4e7b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdd006f9a0 0x7fcdd013d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:44.691 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdd4e7b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdd00b5b80 0x7fcdd015c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:44.691 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdd4e7b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdd01467c0 0x7fcdd01f41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:44.692 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdd4e7b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd015cce0 con 0x7fcdd00b5b80 2023-10-17T06:06:44.692 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdd4e7b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd01f65f0 con 0x7fcdd006f9a0 2023-10-17T06:06:44.692 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdd4e7b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd01f35b0 con 0x7fcdd01467c0 2023-10-17T06:06:44.693 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdce59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdd006f9a0 0x7fcdd013d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:44.694 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdced9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdd01467c0 0x7fcdd01f41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:44.694 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdce59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdd006f9a0 0x7fcdd013d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:59356/0 (socket says 172.21.15.184:59356) 2023-10-17T06:06:44.694 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdce59c700 1 -- 172.21.15.184:0/1777236732 learned_addr learned my addr 172.21.15.184:0/1777236732 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-17T06:06:44.694 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdcdd9b700 1 --2- 172.21.15.184:0/1777236732 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdd00b5b80 0x7fcdd015c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:44.695 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdce59c700 1 -- 172.21.15.184:0/1777236732 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdd01467c0 msgr2=0x7fcdd01f41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:44.695 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdce59c700 1 --2- 172.21.15.184:0/1777236732 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdd01467c0 0x7fcdd01f41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.695 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdce59c700 1 -- 172.21.15.184:0/1777236732 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdd00b5b80 msgr2=0x7fcdd015c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:44.695 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdce59c700 1 --2- 172.21.15.184:0/1777236732 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdd00b5b80 0x7fcdd015c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.695 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdce59c700 1 -- 172.21.15.184:0/1777236732 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc4009570 con 0x7fcdd006f9a0 2023-10-17T06:06:44.696 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdcdd9b700 1 --2- 172.21.15.184:0/1777236732 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdd00b5b80 0x7fcdd015c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:06:44.696 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdce59c700 1 --2- 172.21.15.184:0/1777236732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdd006f9a0 0x7fcdd013d680 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000c4d0 tx=0x7fcdc000c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:44.696 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdbeffd700 1 -- 172.21.15.184:0/1777236732 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0005cd0 con 0x7fcdd006f9a0 2023-10-17T06:06:44.696 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdbeffd700 1 -- 172.21.15.184:0/1777236732 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc0005e30 con 0x7fcdd006f9a0 2023-10-17T06:06:44.696 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdbeffd700 1 -- 172.21.15.184:0/1777236732 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc00072d0 con 0x7fcdd006f9a0 2023-10-17T06:06:44.696 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdd4e7b700 1 -- 172.21.15.184:0/1777236732 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd01f3890 con 0x7fcdd006f9a0 2023-10-17T06:06:44.697 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.688+0000 7fcdd4e7b700 1 -- 172.21.15.184:0/1777236732 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd01f3e50 con 0x7fcdd006f9a0 2023-10-17T06:06:44.697 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.692+0000 7fcdbeffd700 1 -- 172.21.15.184:0/1777236732 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcdc0012400 con 0x7fcdd006f9a0 2023-10-17T06:06:44.697 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.692+0000 7fcdbeffd700 1 -- 172.21.15.184:0/1777236732 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fcdc0012d00 con 0x7fcdd006f9a0 2023-10-17T06:06:44.697 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.692+0000 7fcdd4e7b700 1 -- 172.21.15.184:0/1777236732 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd01f3fe0 con 0x7fcdd006f9a0 2023-10-17T06:06:44.698 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.696+0000 7fcdbeffd700 1 -- 172.21.15.184:0/1777236732 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fcdc0021060 con 0x7fcdd006f9a0 2023-10-17T06:06:44.805 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.800+0000 7fcdd4e7b700 1 -- 172.21.15.184:0/1777236732 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "787e64b7-283d-43f8-bb1b-87d47e562be7", "id": 6} v 0) v1 -- 0x7fcdd00b69b0 con 0x7fcdd006f9a0 2023-10-17T06:06:44.814 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.812+0000 7fcdbeffd700 1 -- 172.21.15.184:0/1777236732 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "787e64b7-283d-43f8-bb1b-87d47e562be7", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcdc0017070 con 0x7fcdd006f9a0 2023-10-17T06:06:44.814 INFO:teuthology.orchestra.run.smithi184.stdout:6 2023-10-17T06:06:44.816 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.812+0000 7fcdd4e7b700 1 -- 172.21.15.184:0/1777236732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdd006f9a0 msgr2=0x7fcdd013d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:44.816 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.812+0000 7fcdd4e7b700 1 --2- 172.21.15.184:0/1777236732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdd006f9a0 0x7fcdd013d680 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000c4d0 tx=0x7fcdc000c7e0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.816 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.812+0000 7fcdd4e7b700 1 -- 172.21.15.184:0/1777236732 shutdown_connections 2023-10-17T06:06:44.817 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.812+0000 7fcdd4e7b700 1 --2- 172.21.15.184:0/1777236732 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdd01467c0 0x7fcdd01f41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.817 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.812+0000 7fcdd4e7b700 1 --2- 172.21.15.184:0/1777236732 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdd00b5b80 0x7fcdd015c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.817 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.812+0000 7fcdd4e7b700 1 --2- 172.21.15.184:0/1777236732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdd006f9a0 0x7fcdd013d680 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:44.817 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.812+0000 7fcdd4e7b700 1 -- 172.21.15.184:0/1777236732 >> 172.21.15.184:0/1777236732 conn(0x7fcdd006a130 msgr2=0x7fcdd0145a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:44.817 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.812+0000 7fcdd4e7b700 1 -- 172.21.15.184:0/1777236732 shutdown_connections 2023-10-17T06:06:44.818 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:44.812+0000 7fcdd4e7b700 1 -- 172.21.15.184:0/1777236732 wait complete. 2023-10-17T06:06:44.836 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 913cd35a-b9e5-408b-8a63-ca6883ecb020 7 2023-10-17T06:06:44.866 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:44.860+0000 7fed95aa72c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-17T06:06:45.010 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.008+0000 7fceb07ae700 1 Processor -- start 2023-10-17T06:06:45.010 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.008+0000 7fceb07ae700 1 -- start start 2023-10-17T06:06:45.012 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.008+0000 7fceb07ae700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcea80d36b0 0x7fcea806e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:45.012 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.008+0000 7fceb07ae700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcea815e7d0 0x7fcea815d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:45.013 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.008+0000 7fceb07ae700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea80d29f0 con 0x7fcea80d2610 2023-10-17T06:06:45.013 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.008+0000 7fceb07ae700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea80b64b0 con 0x7fcea80d36b0 2023-10-17T06:06:45.013 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.008+0000 7fceb07ae700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea80b6750 con 0x7fcea815e7d0 2023-10-17T06:06:45.014 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.008+0000 7fceaed4b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcea815e7d0 0x7fcea815d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:45.014 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.008+0000 7fceaed4b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcea815e7d0 0x7fcea815d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:33716/0 (socket says 172.21.15.184:33716) 2023-10-17T06:06:45.014 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.008+0000 7fceaed4b700 1 -- 172.21.15.184:0/3115304910 learned_addr learned my addr 172.21.15.184:0/3115304910 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-17T06:06:45.015 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.008+0000 7fceadd49700 1 --2- 172.21.15.184:0/3115304910 >> v2:172.21.15.125:3300/0 conn(0x7fcea80d36b0 0x7fcea806e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:45.015 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.008+0000 7fceaed4b700 1 -- 172.21.15.184:0/3115304910 >> v2:172.21.15.125:3300/0 conn(0x7fcea80d36b0 msgr2=0x7fcea806e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:06:45.015 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.012+0000 7fceaed4b700 1 --2- 172.21.15.184:0/3115304910 >> v2:172.21.15.125:3300/0 conn(0x7fcea80d36b0 0x7fcea806e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:45.015 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.012+0000 7fceaed4b700 1 -- 172.21.15.184:0/3115304910 >> v1:172.21.15.184:6789/0 conn(0x7fcea80d2610 legacy=0x7fcea80d2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:06:45.015 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.012+0000 7fceaed4b700 1 -- 172.21.15.184:0/3115304910 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea80b6a30 con 0x7fcea815e7d0 2023-10-17T06:06:45.015 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.012+0000 7fceaed4b700 1 --2- 172.21.15.184:0/3115304910 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcea815e7d0 0x7fcea815d5f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009e50 tx=0x7fcea000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46474207c7643b5a server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:45.016 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.012+0000 7fcead548700 1 -- 172.21.15.184:0/3115304910 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea000e070 con 0x7fcea815e7d0 2023-10-17T06:06:45.017 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.012+0000 7fcead548700 1 -- 172.21.15.184:0/3115304910 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea000b9c0 con 0x7fcea815e7d0 2023-10-17T06:06:45.017 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.012+0000 7fcead548700 1 -- 172.21.15.184:0/3115304910 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea000bd70 con 0x7fcea815e7d0 2023-10-17T06:06:45.017 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.012+0000 7fceb07ae700 1 -- 172.21.15.184:0/3115304910 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcea815e7d0 msgr2=0x7fcea815d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:45.017 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.012+0000 7fceb07ae700 1 --2- 172.21.15.184:0/3115304910 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcea815e7d0 0x7fcea815d5f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009e50 tx=0x7fcea000b330 comp rx=0 tx=0).stop 2023-10-17T06:06:45.018 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.012+0000 7fceb07ae700 1 -- 172.21.15.184:0/3115304910 shutdown_connections 2023-10-17T06:06:45.018 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.012+0000 7fceb07ae700 1 --2- 172.21.15.184:0/3115304910 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcea815e7d0 0x7fcea815d5f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:45.018 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.012+0000 7fceb07ae700 1 --2- 172.21.15.184:0/3115304910 >> v2:172.21.15.125:3300/0 conn(0x7fcea80d36b0 0x7fcea806e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:45.018 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.012+0000 7fceb07ae700 1 -- 172.21.15.184:0/3115304910 >> 172.21.15.184:0/3115304910 conn(0x7fcea8069f20 msgr2=0x7fcea806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:45.018 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.012+0000 7fceb07ae700 1 -- 172.21.15.184:0/3115304910 shutdown_connections 2023-10-17T06:06:45.019 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.012+0000 7fceb07ae700 1 -- 172.21.15.184:0/3115304910 wait complete. 2023-10-17T06:06:45.021 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceb07ae700 1 Processor -- start 2023-10-17T06:06:45.021 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceb07ae700 1 -- start start 2023-10-17T06:06:45.021 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceb07ae700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcea80d2610 0x7fcea8142450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:45.021 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceb07ae700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcea80d36b0 0x7fcea8158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:45.021 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceb07ae700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcea815e7d0 0x7fcea8142bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:45.022 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceb07ae700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8142990 con 0x7fcea815e7d0 2023-10-17T06:06:45.022 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceb07ae700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea81583d0 con 0x7fcea80d36b0 2023-10-17T06:06:45.022 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceb07ae700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea81577c0 con 0x7fcea80d2610 2023-10-17T06:06:45.022 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceadd49700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcea80d36b0 0x7fcea8158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:45.022 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceae54a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcea80d2610 0x7fcea8142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:45.023 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceadd49700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcea80d36b0 0x7fcea8158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:59364/0 (socket says 172.21.15.184:59364) 2023-10-17T06:06:45.023 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceadd49700 1 -- 172.21.15.184:0/2304229927 learned_addr learned my addr 172.21.15.184:0/2304229927 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-10-17T06:06:45.023 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceaed4b700 1 --2- 172.21.15.184:0/2304229927 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcea815e7d0 0x7fcea8142bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:45.023 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceae54a700 1 -- 172.21.15.184:0/2304229927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcea80d36b0 msgr2=0x7fcea8158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:45.023 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceae54a700 1 --2- 172.21.15.184:0/2304229927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcea80d36b0 0x7fcea8158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:45.023 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceae54a700 1 -- 172.21.15.184:0/2304229927 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcea815e7d0 msgr2=0x7fcea8142bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:45.024 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceae54a700 1 --2- 172.21.15.184:0/2304229927 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcea815e7d0 0x7fcea8142bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:45.024 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceae54a700 1 -- 172.21.15.184:0/2304229927 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea0009b30 con 0x7fcea80d2610 2023-10-17T06:06:45.024 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceae54a700 1 --2- 172.21.15.184:0/2304229927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcea80d2610 0x7fcea8142450 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcea400c4b0 tx=0x7fcea400c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:45.024 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fce9effd700 1 -- 172.21.15.184:0/2304229927 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea40052d0 con 0x7fcea80d2610 2023-10-17T06:06:45.024 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fce9effd700 1 -- 172.21.15.184:0/2304229927 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea4005430 con 0x7fcea80d2610 2023-10-17T06:06:45.025 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceb07ae700 1 -- 172.21.15.184:0/2304229927 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea8157aa0 con 0x7fcea80d2610 2023-10-17T06:06:45.025 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fce9effd700 1 -- 172.21.15.184:0/2304229927 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea40055a0 con 0x7fcea80d2610 2023-10-17T06:06:45.025 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fceb07ae700 1 -- 172.21.15.184:0/2304229927 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea8158060 con 0x7fcea80d2610 2023-10-17T06:06:45.025 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fce9effd700 1 -- 172.21.15.184:0/2304229927 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcea4003be0 con 0x7fcea80d2610 2023-10-17T06:06:45.025 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.016+0000 7fce9effd700 1 -- 172.21.15.184:0/2304229927 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fcea400ce40 con 0x7fcea80d2610 2023-10-17T06:06:45.026 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.020+0000 7fceb07ae700 1 -- 172.21.15.184:0/2304229927 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea8148b20 con 0x7fcea80d2610 2023-10-17T06:06:45.026 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.020+0000 7fce9effd700 1 -- 172.21.15.184:0/2304229927 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fcea8148b20 con 0x7fcea80d2610 2023-10-17T06:06:45.093 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:45.088+0000 7fed95aa72c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-17T06:06:45.130 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.128+0000 7fceb07ae700 1 -- 172.21.15.184:0/2304229927 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "913cd35a-b9e5-408b-8a63-ca6883ecb020", "id": 7} v 0) v1 -- 0x7fcea80b6cc0 con 0x7fcea80d2610 2023-10-17T06:06:45.131 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:45.128+0000 7f84e17c62c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-17T06:06:45.141 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.136+0000 7fce9effd700 1 -- 172.21.15.184:0/2304229927 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "913cd35a-b9e5-408b-8a63-ca6883ecb020", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcea4017070 con 0x7fcea80d2610 2023-10-17T06:06:45.141 INFO:teuthology.orchestra.run.smithi184.stdout:7 2023-10-17T06:06:45.142 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.140+0000 7fceb07ae700 1 -- 172.21.15.184:0/2304229927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcea80d2610 msgr2=0x7fcea8142450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:45.142 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.140+0000 7fceb07ae700 1 --2- 172.21.15.184:0/2304229927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcea80d2610 0x7fcea8142450 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcea400c4b0 tx=0x7fcea400c7c0 comp rx=0 tx=0).stop 2023-10-17T06:06:45.143 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.140+0000 7fceb07ae700 1 -- 172.21.15.184:0/2304229927 shutdown_connections 2023-10-17T06:06:45.143 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.140+0000 7fceb07ae700 1 --2- 172.21.15.184:0/2304229927 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcea815e7d0 0x7fcea8142bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:45.144 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.140+0000 7fceb07ae700 1 --2- 172.21.15.184:0/2304229927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcea80d36b0 0x7fcea8158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:45.144 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.140+0000 7fceb07ae700 1 --2- 172.21.15.184:0/2304229927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcea80d2610 0x7fcea8142450 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:45.144 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.140+0000 7fceb07ae700 1 -- 172.21.15.184:0/2304229927 >> 172.21.15.184:0/2304229927 conn(0x7fcea8069f20 msgr2=0x7fcea80cfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:45.144 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.140+0000 7fceb07ae700 1 -- 172.21.15.184:0/2304229927 shutdown_connections 2023-10-17T06:06:45.144 INFO:teuthology.orchestra.run.smithi184.stderr:2023-10-17T06:06:45.140+0000 7fceb07ae700 1 -- 172.21.15.184:0/2304229927 wait complete. 2023-10-17T06:06:45.168 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-17T06:06:45.169 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-17T06:06:45.176 INFO:tasks.ceph.osd.0:Started 2023-10-17T06:06:45.176 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-17T06:06:45.177 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-17T06:06:45.181 INFO:tasks.ceph.osd.1:Started 2023-10-17T06:06:45.181 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-17T06:06:45.181 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-17T06:06:45.185 INFO:tasks.ceph.osd.2:Started 2023-10-17T06:06:45.185 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-17T06:06:45.186 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-17T06:06:45.192 INFO:tasks.ceph.osd.3:Started 2023-10-17T06:06:45.192 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-17T06:06:45.193 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-17T06:06:45.193 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:45.184+0000 7fed95aa72c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-17T06:06:45.199 INFO:tasks.ceph.osd.4:Started 2023-10-17T06:06:45.200 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-17T06:06:45.200 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-17T06:06:45.204 INFO:tasks.ceph.osd.5:Started 2023-10-17T06:06:45.205 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-17T06:06:45.205 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-17T06:06:45.209 INFO:tasks.ceph.osd.6:Started 2023-10-17T06:06:45.209 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-17T06:06:45.210 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-17T06:06:45.216 INFO:tasks.ceph.osd.7:Started 2023-10-17T06:06:45.216 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:06:45.284 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:45.272+0000 7fed95aa72c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-17T06:06:45.402 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:45.396+0000 7f84e17c62c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-17T06:06:45.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.400+0000 7f0cef7ed700 1 Processor -- start 2023-10-17T06:06:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.400+0000 7f0cef7ed700 1 -- start start 2023-10-17T06:06:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.400+0000 7f0cef7ed700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ce815cc10 0x7f0ce8070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.400+0000 7f0cef7ed700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce80d0460 con 0x7f0ce80b1e60 2023-10-17T06:06:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.400+0000 7f0cef7ed700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce806d220 con 0x7f0ce80d2f20 2023-10-17T06:06:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.400+0000 7f0cef7ed700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce806eef0 con 0x7f0ce815cc10 2023-10-17T06:06:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.400+0000 7f0ced589700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ce815cc10 0x7f0ce8070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:45.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.400+0000 7f0cecd88700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0ce80b1e60 0x7f0ce80cfd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36396/0 (socket says 172.21.15.125:36396) 2023-10-17T06:06:45.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.400+0000 7f0cecd88700 1 -- 172.21.15.125:0/3517564031 learned_addr learned my addr 172.21.15.125:0/3517564031 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:06:45.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.400+0000 7f0ced589700 1 -- 172.21.15.125:0/3517564031 >> v1:172.21.15.184:6789/0 conn(0x7f0ce80d2f20 legacy=0x7f0ce80d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:06:45.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.400+0000 7f0ced589700 1 -- 172.21.15.125:0/3517564031 >> v1:172.21.15.125:6789/0 conn(0x7f0ce80b1e60 legacy=0x7f0ce80cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:45.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.400+0000 7f0ced589700 1 -- 172.21.15.125:0/3517564031 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce806ec10 con 0x7f0ce815cc10 2023-10-17T06:06:45.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.400+0000 7f0ced589700 1 --2- 172.21.15.125:0/3517564031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce815cc10 0x7f0ce8070a00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009850 tx=0x7f0ce4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c3317abac16389 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:45.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.404+0000 7f0cdffff700 1 -- 172.21.15.125:0/3517564031 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4004230 con 0x7f0ce815cc10 2023-10-17T06:06:45.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.404+0000 7f0cdffff700 1 -- 172.21.15.125:0/3517564031 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce4004390 con 0x7f0ce815cc10 2023-10-17T06:06:45.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.404+0000 7f0cdffff700 1 -- 172.21.15.125:0/3517564031 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40036c0 con 0x7f0ce815cc10 2023-10-17T06:06:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.404+0000 7f0cef7ed700 1 -- 172.21.15.125:0/3517564031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce815cc10 msgr2=0x7f0ce8070a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.404+0000 7f0cef7ed700 1 --2- 172.21.15.125:0/3517564031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce815cc10 0x7f0ce8070a00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009850 tx=0x7f0ce4009b60 comp rx=0 tx=0).stop 2023-10-17T06:06:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.404+0000 7f0cef7ed700 1 -- 172.21.15.125:0/3517564031 shutdown_connections 2023-10-17T06:06:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.404+0000 7f0cef7ed700 1 --2- 172.21.15.125:0/3517564031 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce815cc10 0x7f0ce8070a00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.404+0000 7f0cef7ed700 1 -- 172.21.15.125:0/3517564031 >> 172.21.15.125:0/3517564031 conn(0x7f0ce8069ef0 msgr2=0x7f0ce806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:45.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.404+0000 7f0cef7ed700 1 -- 172.21.15.125:0/3517564031 shutdown_connections 2023-10-17T06:06:45.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.404+0000 7f0cef7ed700 1 -- 172.21.15.125:0/3517564031 wait complete. 2023-10-17T06:06:45.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cef7ed700 1 Processor -- start 2023-10-17T06:06:45.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cef7ed700 1 -- start start 2023-10-17T06:06:45.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cef7ed700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ce80b1e60 0x7f0ce81f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:45.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cef7ed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce80d2f20 0x7f0ce80ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:45.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cef7ed700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ce815cc10 0x7f0ce815b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:45.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cef7ed700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce81608f0 con 0x7f0ce80d2f20 2023-10-17T06:06:45.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cef7ed700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce815fa60 con 0x7f0ce80b1e60 2023-10-17T06:06:45.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cef7ed700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce81f5600 con 0x7f0ce815cc10 2023-10-17T06:06:45.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cecd88700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce80d2f20 0x7f0ce80ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:45.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cecd88700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce80d2f20 0x7f0ce80ac2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54550/0 (socket says 172.21.15.125:54550) 2023-10-17T06:06:45.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cecd88700 1 -- 172.21.15.125:0/1327106800 learned_addr learned my addr 172.21.15.125:0/1327106800 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:06:45.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0ced589700 1 --2- 172.21.15.125:0/1327106800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ce80b1e60 0x7f0ce81f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:45.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cedd8a700 1 --2- 172.21.15.125:0/1327106800 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ce815cc10 0x7f0ce815b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:45.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cecd88700 1 -- 172.21.15.125:0/1327106800 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ce815cc10 msgr2=0x7f0ce815b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:45.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cecd88700 1 --2- 172.21.15.125:0/1327106800 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ce815cc10 0x7f0ce815b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:45.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cecd88700 1 -- 172.21.15.125:0/1327106800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ce80b1e60 msgr2=0x7f0ce81f50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:45.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cecd88700 1 --2- 172.21.15.125:0/1327106800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ce80b1e60 0x7f0ce81f50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:45.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cecd88700 1 -- 172.21.15.125:0/1327106800 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce40094b0 con 0x7f0ce80d2f20 2023-10-17T06:06:45.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cecd88700 1 --2- 172.21.15.125:0/1327106800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce80d2f20 0x7f0ce80ac2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800c500 tx=0x7f0cd800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:45.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cddffb700 1 -- 172.21.15.125:0/1327106800 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8005d90 con 0x7f0ce80d2f20 2023-10-17T06:06:45.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cddffb700 1 -- 172.21.15.125:0/1327106800 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd80070d0 con 0x7f0ce80d2f20 2023-10-17T06:06:45.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cef7ed700 1 -- 172.21.15.125:0/1327106800 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce815fc70 con 0x7f0ce80d2f20 2023-10-17T06:06:45.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cddffb700 1 -- 172.21.15.125:0/1327106800 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8007460 con 0x7f0ce80d2f20 2023-10-17T06:06:45.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.408+0000 7f0cddffb700 1 -- 172.21.15.125:0/1327106800 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0cd8012400 con 0x7f0ce80d2f20 2023-10-17T06:06:45.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.412+0000 7f0cef7ed700 1 -- 172.21.15.125:0/1327106800 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce8160230 con 0x7f0ce80d2f20 2023-10-17T06:06:45.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.412+0000 7f0cddffb700 1 -- 172.21.15.125:0/1327106800 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f0cd801b3b0 con 0x7f0ce80d2f20 2023-10-17T06:06:45.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.412+0000 7f0cef7ed700 1 -- 172.21.15.125:0/1327106800 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce8160a30 con 0x7f0ce80d2f20 2023-10-17T06:06:45.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.416+0000 7f0cddffb700 1 -- 172.21.15.125:0/1327106800 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f0ce8160a30 con 0x7f0ce80d2f20 2023-10-17T06:06:45.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.488+0000 7f0cef7ed700 1 -- 172.21.15.125:0/1327106800 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ce8072e60 con 0x7f0ce80d2f20 2023-10-17T06:06:45.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.488+0000 7f0cddffb700 1 -- 172.21.15.125:0/1327106800 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f0cd8017070 con 0x7f0ce80d2f20 2023-10-17T06:06:45.495 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:06:45.495 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":10,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:06:45.132620+0000","last_up_change":"0.000000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:06:45.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.492+0000 7f0cef7ed700 1 -- 172.21.15.125:0/1327106800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce80d2f20 msgr2=0x7f0ce80ac2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:45.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.492+0000 7f0cef7ed700 1 --2- 172.21.15.125:0/1327106800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce80d2f20 0x7f0ce80ac2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800c500 tx=0x7f0cd800c810 comp rx=0 tx=0).stop 2023-10-17T06:06:45.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.492+0000 7f0cef7ed700 1 -- 172.21.15.125:0/1327106800 shutdown_connections 2023-10-17T06:06:45.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.492+0000 7f0cef7ed700 1 --2- 172.21.15.125:0/1327106800 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ce815cc10 0x7f0ce815b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:45.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.492+0000 7f0cef7ed700 1 --2- 172.21.15.125:0/1327106800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ce80d2f20 0x7f0ce80ac2f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:45.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.492+0000 7f0cef7ed700 1 --2- 172.21.15.125:0/1327106800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ce80b1e60 0x7f0ce81f50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:45.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.492+0000 7f0cef7ed700 1 -- 172.21.15.125:0/1327106800 >> 172.21.15.125:0/1327106800 conn(0x7f0ce8069ef0 msgr2=0x7f0ce80b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:45.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.492+0000 7f0cef7ed700 1 -- 172.21.15.125:0/1327106800 shutdown_connections 2023-10-17T06:06:45.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:06:45.492+0000 7f0cef7ed700 1 -- 172.21.15.125:0/1327106800 wait complete. 2023-10-17T06:06:45.506 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:45.504+0000 7f84e17c62c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-17T06:06:45.520 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-17T06:06:45.520 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-17T06:06:45.595 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:45.592+0000 7f84e17c62c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-17T06:06:45.872 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-10-17T06:06:45.868+0000 7faf7c195700 -1 Falling back to public interface 2023-10-17T06:06:45.879 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-10-17T06:06:45.876+0000 7fe347534700 -1 Falling back to public interface 2023-10-17T06:06:45.881 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-10-17T06:06:45.876+0000 7fb3cd23b700 -1 Falling back to public interface 2023-10-17T06:06:45.883 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-10-17T06:06:45.876+0000 7fb3edd42700 -1 Falling back to public interface 2023-10-17T06:06:45.884 INFO:tasks.ceph.osd.1.smithi125.stderr:2023-10-17T06:06:45.876+0000 7fa9acc87700 -1 Falling back to public interface 2023-10-17T06:06:45.887 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-10-17T06:06:45.884+0000 7f1d349d2700 -1 Falling back to public interface 2023-10-17T06:06:45.898 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-17T06:06:45.892+0000 7f8e6e01a700 -1 Falling back to public interface 2023-10-17T06:06:45.902 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-10-17T06:06:45.900+0000 7f0db4235700 -1 Falling back to public interface 2023-10-17T06:06:46.131 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:46.124+0000 7fed95aa72c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-17T06:06:46.229 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:46.224+0000 7fed95aa72c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-17T06:06:46.326 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-17T06:06:46.433 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:46.428+0000 7fed95aa72c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-17T06:06:46.452 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:46.448+0000 7f84e17c62c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-17T06:06:46.479 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.472+0000 7fbcd4de6700 1 Processor -- start 2023-10-17T06:06:46.479 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.472+0000 7fbcd4de6700 1 -- start start 2023-10-17T06:06:46.481 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.476+0000 7fbcd4de6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbcd0157230 0x7fbcd015d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:46.482 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.476+0000 7fbcd4de6700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbcd00b6130 0x7fbcd006faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:46.483 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.476+0000 7fbcd4de6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd006f330 con 0x7fbcd006ffe0 2023-10-17T06:06:46.483 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.476+0000 7fbcd4de6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd015db50 con 0x7fbcd0157230 2023-10-17T06:06:46.483 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.476+0000 7fbcd4de6700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd015de30 con 0x7fbcd00b6130 2023-10-17T06:06:46.484 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.476+0000 7fbcce59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbcd0157230 0x7fbcd015d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:46.484 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.476+0000 7fbcced9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbcd006ffe0 0x7fbcd006d500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36412/0 (socket says 172.21.15.125:36412) 2023-10-17T06:06:46.484 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.476+0000 7fbcce59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbcd0157230 0x7fbcd015d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54564/0 (socket says 172.21.15.125:54564) 2023-10-17T06:06:46.484 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.476+0000 7fbcced9d700 1 -- 172.21.15.125:0/3761304329 learned_addr learned my addr 172.21.15.125:0/3761304329 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:06:46.484 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.476+0000 7fbccdd9b700 1 --2- 172.21.15.125:0/3761304329 >> v2:172.21.15.184:3300/0 conn(0x7fbcd00b6130 0x7fbcd006faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:46.485 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.476+0000 7fbcce59c700 1 -- 172.21.15.125:0/3761304329 >> v2:172.21.15.184:3300/0 conn(0x7fbcd00b6130 msgr2=0x7fbcd006faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:06:46.485 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.476+0000 7fbcce59c700 1 --2- 172.21.15.125:0/3761304329 >> v2:172.21.15.184:3300/0 conn(0x7fbcd00b6130 0x7fbcd006faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:46.485 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.476+0000 7fbcce59c700 1 -- 172.21.15.125:0/3761304329 >> v1:172.21.15.125:6789/0 conn(0x7fbcd006ffe0 legacy=0x7fbcd006d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:46.485 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.476+0000 7fbcce59c700 1 -- 172.21.15.125:0/3761304329 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd015e110 con 0x7fbcd0157230 2023-10-17T06:06:46.485 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.476+0000 7fbcce59c700 1 --2- 172.21.15.125:0/3761304329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd0157230 0x7fbcd015d280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbcd00b2a30 tx=0x7fbcc0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce735290b09a7bd server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:46.486 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.476+0000 7fbccd59a700 1 -- 172.21.15.125:0/3761304329 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0011830 con 0x7fbcd0157230 2023-10-17T06:06:46.487 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.476+0000 7fbccd59a700 1 -- 172.21.15.125:0/3761304329 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc0011990 con 0x7fbcd0157230 2023-10-17T06:06:46.487 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.476+0000 7fbccd59a700 1 -- 172.21.15.125:0/3761304329 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0011d40 con 0x7fbcd0157230 2023-10-17T06:06:46.487 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.480+0000 7fbcd4de6700 1 -- 172.21.15.125:0/3761304329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd0157230 msgr2=0x7fbcd015d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:46.487 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.480+0000 7fbcd4de6700 1 --2- 172.21.15.125:0/3761304329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd0157230 0x7fbcd015d280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbcd00b2a30 tx=0x7fbcc0009b30 comp rx=0 tx=0).stop 2023-10-17T06:06:46.488 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.480+0000 7fbcd4de6700 1 -- 172.21.15.125:0/3761304329 shutdown_connections 2023-10-17T06:06:46.488 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.480+0000 7fbcd4de6700 1 --2- 172.21.15.125:0/3761304329 >> v2:172.21.15.184:3300/0 conn(0x7fbcd00b6130 0x7fbcd006faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:46.488 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.480+0000 7fbcd4de6700 1 --2- 172.21.15.125:0/3761304329 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd0157230 0x7fbcd015d280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:46.488 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.480+0000 7fbcd4de6700 1 -- 172.21.15.125:0/3761304329 >> 172.21.15.125:0/3761304329 conn(0x7fbcd0069ef0 msgr2=0x7fbcd006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:46.488 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.480+0000 7fbcd4de6700 1 -- 172.21.15.125:0/3761304329 shutdown_connections 2023-10-17T06:06:46.488 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.480+0000 7fbcd4de6700 1 -- 172.21.15.125:0/3761304329 wait complete. 2023-10-17T06:06:46.491 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.480+0000 7fbcd4de6700 1 Processor -- start 2023-10-17T06:06:46.491 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.480+0000 7fbcd4de6700 1 -- start start 2023-10-17T06:06:46.491 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbcd4de6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbcd006ffe0 0x7fbcd01498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:46.491 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbcd4de6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd00b6130 0x7fbcd014cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:46.492 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbcd4de6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcd0157230 0x7fbcd006d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:46.492 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbcd4de6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd014e220 con 0x7fbcd00b6130 2023-10-17T06:06:46.492 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbcd4de6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd0149e20 con 0x7fbcd0157230 2023-10-17T06:06:46.492 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbcd4de6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd014d610 con 0x7fbcd006ffe0 2023-10-17T06:06:46.492 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbccdd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd00b6130 0x7fbcd014cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:46.493 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbccdd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd00b6130 0x7fbcd014cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54568/0 (socket says 172.21.15.125:54568) 2023-10-17T06:06:46.493 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbccdd9b700 1 -- 172.21.15.125:0/784254532 learned_addr learned my addr 172.21.15.125:0/784254532 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:06:46.493 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbcce59c700 1 --2- 172.21.15.125:0/784254532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbcd006ffe0 0x7fbcd01498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:46.493 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbcced9d700 1 --2- 172.21.15.125:0/784254532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcd0157230 0x7fbcd006d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:46.493 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbccdd9b700 1 -- 172.21.15.125:0/784254532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbcd006ffe0 msgr2=0x7fbcd01498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:46.494 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbccdd9b700 1 --2- 172.21.15.125:0/784254532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbcd006ffe0 0x7fbcd01498e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:46.494 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbccdd9b700 1 -- 172.21.15.125:0/784254532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcd0157230 msgr2=0x7fbcd006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:46.494 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbccdd9b700 1 --2- 172.21.15.125:0/784254532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcd0157230 0x7fbcd006d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:46.494 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbccdd9b700 1 -- 172.21.15.125:0/784254532 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc00094b0 con 0x7fbcd00b6130 2023-10-17T06:06:46.494 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbcce59c700 1 --2- 172.21.15.125:0/784254532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbcd006ffe0 0x7fbcd01498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:06:46.495 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbcced9d700 1 --2- 172.21.15.125:0/784254532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcd0157230 0x7fbcd006d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:06:46.495 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbccdd9b700 1 --2- 172.21.15.125:0/784254532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd00b6130 0x7fbcd014cb00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400e760 tx=0x7fbcc400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:46.495 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbcbeffd700 1 -- 172.21.15.125:0/784254532 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4013610 con 0x7fbcd00b6130 2023-10-17T06:06:46.495 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbcbeffd700 1 -- 172.21.15.125:0/784254532 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc4013770 con 0x7fbcd00b6130 2023-10-17T06:06:46.495 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbcd4de6700 1 -- 172.21.15.125:0/784254532 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd014d8f0 con 0x7fbcd00b6130 2023-10-17T06:06:46.496 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbcbeffd700 1 -- 172.21.15.125:0/784254532 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4013ae0 con 0x7fbcd00b6130 2023-10-17T06:06:46.496 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbcd4de6700 1 -- 172.21.15.125:0/784254532 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd014deb0 con 0x7fbcd00b6130 2023-10-17T06:06:46.496 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbcbeffd700 1 -- 172.21.15.125:0/784254532 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbcc401c450 con 0x7fbcd00b6130 2023-10-17T06:06:46.496 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbcbeffd700 1 -- 172.21.15.125:0/784254532 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fbcc4012460 con 0x7fbcd00b6130 2023-10-17T06:06:46.497 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.484+0000 7fbcd4de6700 1 -- 172.21.15.125:0/784254532 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd014e390 con 0x7fbcd00b6130 2023-10-17T06:06:46.497 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.488+0000 7fbcbeffd700 1 -- 172.21.15.125:0/784254532 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fbcc403bb00 con 0x7fbcd00b6130 2023-10-17T06:06:46.520 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:46.512+0000 7fed95aa72c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-17T06:06:46.553 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:46.548+0000 7f84e17c62c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-17T06:06:46.571 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.564+0000 7fbcd4de6700 1 -- 172.21.15.125:0/784254532 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcd015d740 con 0x7fbcd00b6130 2023-10-17T06:06:46.572 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.568+0000 7fbcbeffd700 1 -- 172.21.15.125:0/784254532 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fbcc402a020 con 0x7fbcd00b6130 2023-10-17T06:06:46.573 INFO:teuthology.misc.health.smithi125.stdout: 2023-10-17T06:06:46.573 INFO:teuthology.misc.health.smithi125.stdout:{"epoch":10,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:06:45.132620+0000","last_up_change":"0.000000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:06:46.574 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.568+0000 7fbcd4de6700 1 -- 172.21.15.125:0/784254532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd00b6130 msgr2=0x7fbcd014cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:46.574 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.568+0000 7fbcd4de6700 1 --2- 172.21.15.125:0/784254532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd00b6130 0x7fbcd014cb00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400e760 tx=0x7fbcc400eb20 comp rx=0 tx=0).stop 2023-10-17T06:06:46.574 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.568+0000 7fbcd4de6700 1 -- 172.21.15.125:0/784254532 shutdown_connections 2023-10-17T06:06:46.575 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.568+0000 7fbcd4de6700 1 --2- 172.21.15.125:0/784254532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcd0157230 0x7fbcd006d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:46.575 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.568+0000 7fbcd4de6700 1 --2- 172.21.15.125:0/784254532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbcd00b6130 0x7fbcd014cb00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:46.575 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.568+0000 7fbcd4de6700 1 --2- 172.21.15.125:0/784254532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbcd006ffe0 0x7fbcd01498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:46.575 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.568+0000 7fbcd4de6700 1 -- 172.21.15.125:0/784254532 >> 172.21.15.125:0/784254532 conn(0x7fbcd0069ef0 msgr2=0x7fbcd00b4780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:46.575 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.568+0000 7fbcd4de6700 1 -- 172.21.15.125:0/784254532 shutdown_connections 2023-10-17T06:06:46.575 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:46.568+0000 7fbcd4de6700 1 -- 172.21.15.125:0/784254532 wait complete. 2023-10-17T06:06:46.591 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-17T06:06:46.627 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:46.620+0000 7fed95aa72c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-17T06:06:46.755 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:46.752+0000 7f84e17c62c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-17T06:06:46.844 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:46.840+0000 7f84e17c62c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-17T06:06:46.851 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:46.844+0000 7fed95aa72c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-17T06:06:46.945 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:46.940+0000 7f84e17c62c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-17T06:06:47.122 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:47.116+0000 7fed95aa72c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-17T06:06:47.160 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:47.156+0000 7f84e17c62c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-17T06:06:47.428 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:47.424+0000 7f84e17c62c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-17T06:06:47.918 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:47.912+0000 7fed95aa72c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-17T06:06:48.237 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-10-17T06:06:48.232+0000 7f84e17c62c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-17T06:06:48.954 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:48.948+0000 7fed7cac8700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-17T06:06:48.955 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-17T06:06:48.948+0000 7fed7cac8700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-17T06:06:49.854 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-17T06:06:49.848+0000 7f8e6e01a700 -1 osd.0 0 log_to_monitors true 2023-10-17T06:06:49.874 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-10-17T06:06:49.868+0000 7fb3edd42700 -1 osd.2 0 log_to_monitors true 2023-10-17T06:06:49.887 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-10-17T06:06:49.884+0000 7fe347534700 -1 osd.7 0 log_to_monitors true 2023-10-17T06:06:49.965 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-10-17T06:06:49.960+0000 7f0db4235700 -1 osd.5 0 log_to_monitors true 2023-10-17T06:06:50.082 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-10-17T06:06:50.076+0000 7fb3cd23b700 -1 osd.3 0 log_to_monitors true 2023-10-17T06:06:50.083 INFO:tasks.ceph.osd.1.smithi125.stderr:2023-10-17T06:06:50.076+0000 7fa9acc87700 -1 osd.1 0 log_to_monitors true 2023-10-17T06:06:50.125 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-10-17T06:06:50.120+0000 7f1d349d2700 -1 osd.6 0 log_to_monitors true 2023-10-17T06:06:50.173 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-10-17T06:06:50.168+0000 7faf7c195700 -1 osd.4 0 log_to_monitors true 2023-10-17T06:06:52.550 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-10-17T06:06:52.544+0000 7fe343373700 -1 osd.7 0 waiting for initial osdmap 2023-10-17T06:06:52.728 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-10-17T06:06:52.724+0000 7fb3e9b81700 -1 osd.2 0 waiting for initial osdmap 2023-10-17T06:06:52.730 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-10-17T06:06:52.728+0000 7fe33adf0700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-17T06:06:52.754 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-10-17T06:06:52.748+0000 7fb3e15f0700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-17T06:06:52.810 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-17T06:06:52.804+0000 7f8e69e59700 -1 osd.0 0 waiting for initial osdmap 2023-10-17T06:06:52.825 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-17T06:06:52.820+0000 7f8e617f0700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-17T06:06:53.398 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-17T06:06:53.549 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.544+0000 7f5a76af4700 1 Processor -- start 2023-10-17T06:06:53.550 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.544+0000 7f5a76af4700 1 -- start start 2023-10-17T06:06:53.551 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.544+0000 7f5a76af4700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5a700cdf20 0x7f5a7015d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:53.551 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.544+0000 7f5a76af4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7015ddf0 con 0x7f5a7015ce80 2023-10-17T06:06:53.551 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.544+0000 7f5a76af4700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7015e0d0 con 0x7f5a7015d260 2023-10-17T06:06:53.551 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.544+0000 7f5a76af4700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a700d1c10 con 0x7f5a700cdf20 2023-10-17T06:06:53.553 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.544+0000 7f5a75af2700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5a7015ce80 0x7f5a7006d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47230/0 (socket says 172.21.15.125:47230) 2023-10-17T06:06:53.553 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.544+0000 7f5a75af2700 1 -- 172.21.15.125:0/2278483947 learned_addr learned my addr 172.21.15.125:0/2278483947 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:06:53.553 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.544+0000 7f5a762f3700 1 --2- 172.21.15.125:0/2278483947 >> v2:172.21.15.184:3300/0 conn(0x7f5a700cdf20 0x7f5a7015d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:53.553 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.544+0000 7f5a74af0700 1 -- 172.21.15.125:0/2278483947 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029323933 0 0) 0x7f5a7015ddf0 con 0x7f5a7015ce80 2023-10-17T06:06:53.554 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.544+0000 7f5a74af0700 1 -- 172.21.15.125:0/2278483947 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a5c0035d0 con 0x7f5a7015ce80 2023-10-17T06:06:53.554 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a74af0700 1 -- 172.21.15.125:0/2278483947 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 618109973 0 0) 0x7f5a5c0035d0 con 0x7f5a7015ce80 2023-10-17T06:06:53.554 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a74af0700 1 -- 172.21.15.125:0/2278483947 >> v2:172.21.15.184:3300/0 conn(0x7f5a700cdf20 msgr2=0x7f5a7015d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:06:53.554 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a74af0700 1 --2- 172.21.15.125:0/2278483947 >> v2:172.21.15.184:3300/0 conn(0x7f5a700cdf20 0x7f5a7015d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:53.554 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a74af0700 1 -- 172.21.15.125:0/2278483947 >> v1:172.21.15.184:6789/0 conn(0x7f5a7015d260 legacy=0x7f5a700cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:53.555 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a74af0700 1 -- 172.21.15.125:0/2278483947 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7015e3b0 con 0x7f5a7015ce80 2023-10-17T06:06:53.555 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a74af0700 1 -- 172.21.15.125:0/2278483947 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7f5a6c001670 con 0x7f5a7015ce80 2023-10-17T06:06:53.555 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a74af0700 1 -- 172.21.15.125:0/2278483947 >> v1:172.21.15.125:6789/0 conn(0x7f5a7015ce80 legacy=0x7f5a7006d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:53.555 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a74af0700 1 --2- 172.21.15.125:0/2278483947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a5c003a20 0x7f5a5c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:53.555 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a74af0700 1 --2- 172.21.15.125:0/2278483947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a5c004870 0x7f5a5c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:53.556 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a74af0700 1 --2- 172.21.15.125:0/2278483947 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a5c005230 0x7f5a5c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:53.556 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a74af0700 1 -- 172.21.15.125:0/2278483947 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c00c0a0 con 0x7f5a5c003a20 2023-10-17T06:06:53.556 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a74af0700 1 -- 172.21.15.125:0/2278483947 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c00c210 con 0x7f5a5c004870 2023-10-17T06:06:53.556 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a74af0700 1 -- 172.21.15.125:0/2278483947 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c00c3d0 con 0x7f5a5c005230 2023-10-17T06:06:53.557 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a75af2700 1 --2- 172.21.15.125:0/2278483947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a5c003a20 0x7f5a5c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:53.557 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a752f1700 1 --2- 172.21.15.125:0/2278483947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a5c004870 0x7f5a5c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:53.557 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a762f3700 1 --2- 172.21.15.125:0/2278483947 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a5c005230 0x7f5a5c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:53.558 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a75af2700 1 -- 172.21.15.125:0/2278483947 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a5c005230 msgr2=0x7f5a5c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:06:53.558 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a75af2700 1 --2- 172.21.15.125:0/2278483947 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a5c005230 0x7f5a5c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:53.558 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a75af2700 1 -- 172.21.15.125:0/2278483947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a5c004870 msgr2=0x7f5a5c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:06:53.558 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a75af2700 1 --2- 172.21.15.125:0/2278483947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a5c004870 0x7f5a5c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:53.558 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a75af2700 1 -- 172.21.15.125:0/2278483947 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c0035d0 con 0x7f5a5c003a20 2023-10-17T06:06:53.559 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a762f3700 1 -- 172.21.15.125:0/2278483947 reap_dead start 2023-10-17T06:06:53.559 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.548+0000 7f5a75af2700 1 --2- 172.21.15.125:0/2278483947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a5c003a20 0x7f5a5c003e40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00c320 tx=0x7f5a5c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a99d539e895b44c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:53.559 INFO:tasks.ceph.osd.1.smithi125.stderr:2023-10-17T06:06:53.548+0000 7fa9a8ac6700 -1 osd.1 0 waiting for initial osdmap 2023-10-17T06:06:53.560 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.552+0000 7f5a74af0700 1 -- 172.21.15.125:0/2278483947 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c007c30 con 0x7f5a5c003a20 2023-10-17T06:06:53.560 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.552+0000 7f5a74af0700 1 -- 172.21.15.125:0/2278483947 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c00ce00 con 0x7f5a5c003a20 2023-10-17T06:06:53.561 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.552+0000 7f5a74af0700 1 -- 172.21.15.125:0/2278483947 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c005bc0 con 0x7f5a5c003a20 2023-10-17T06:06:53.561 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.552+0000 7f5a76af4700 1 -- 172.21.15.125:0/2278483947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a5c003a20 msgr2=0x7f5a5c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:53.561 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.552+0000 7f5a76af4700 1 --2- 172.21.15.125:0/2278483947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a5c003a20 0x7f5a5c003e40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00c320 tx=0x7f5a5c0058a0 comp rx=0 tx=0).stop 2023-10-17T06:06:53.561 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.552+0000 7f5a76af4700 1 -- 172.21.15.125:0/2278483947 shutdown_connections 2023-10-17T06:06:53.561 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.552+0000 7f5a76af4700 1 --2- 172.21.15.125:0/2278483947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a5c003a20 0x7f5a5c003e40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:53.562 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.552+0000 7f5a76af4700 1 -- 172.21.15.125:0/2278483947 >> 172.21.15.125:0/2278483947 conn(0x7f5a700cf6f0 msgr2=0x7f5a700cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:53.562 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.552+0000 7f5a76af4700 1 -- 172.21.15.125:0/2278483947 shutdown_connections 2023-10-17T06:06:53.562 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.552+0000 7f5a76af4700 1 -- 172.21.15.125:0/2278483947 wait complete. 2023-10-17T06:06:53.562 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.556+0000 7f5a76af4700 1 Processor -- start 2023-10-17T06:06:53.563 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.556+0000 7f5a76af4700 1 -- start start 2023-10-17T06:06:53.564 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.556+0000 7f5a76af4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a5c003a20 0x7f5a700b5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:53.564 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.556+0000 7f5a76af4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a701f67c0 0x7f5a701f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:53.564 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.556+0000 7f5a76af4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a70070080 0x7f5a70070500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:53.564 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.556+0000 7f5a76af4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7014d8f0 con 0x7f5a701f67c0 2023-10-17T06:06:53.564 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.556+0000 7f5a76af4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a70070a40 con 0x7f5a70070080 2023-10-17T06:06:53.565 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.556+0000 7f5a76af4700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7014cc70 con 0x7f5a5c003a20 2023-10-17T06:06:53.565 INFO:tasks.ceph.osd.1.smithi125.stderr:2023-10-17T06:06:53.556+0000 7fa9a03f0700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-17T06:06:53.567 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.556+0000 7f5a752f1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a701f67c0 0x7f5a701f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:53.567 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.556+0000 7f5a752f1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a701f67c0 0x7f5a701f1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45156/0 (socket says 172.21.15.125:45156) 2023-10-17T06:06:53.567 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.556+0000 7f5a752f1700 1 -- 172.21.15.125:0/3339479195 learned_addr learned my addr 172.21.15.125:0/3339479195 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:06:53.567 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.556+0000 7f5a75af2700 1 --2- 172.21.15.125:0/3339479195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a5c003a20 0x7f5a700b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:53.567 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.556+0000 7f5a762f3700 1 --2- 172.21.15.125:0/3339479195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a70070080 0x7f5a70070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:53.568 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.560+0000 7f5a752f1700 1 -- 172.21.15.125:0/3339479195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a5c003a20 msgr2=0x7f5a700b5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:53.568 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.560+0000 7f5a752f1700 1 --2- 172.21.15.125:0/3339479195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a5c003a20 0x7f5a700b5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:53.568 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.560+0000 7f5a752f1700 1 -- 172.21.15.125:0/3339479195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a70070080 msgr2=0x7f5a70070500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:53.568 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.560+0000 7f5a752f1700 1 --2- 172.21.15.125:0/3339479195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a70070080 0x7f5a70070500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:53.568 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.560+0000 7f5a752f1700 1 -- 172.21.15.125:0/3339479195 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7014cf50 con 0x7f5a701f67c0 2023-10-17T06:06:53.569 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.560+0000 7f5a75af2700 1 --2- 172.21.15.125:0/3339479195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a5c003a20 0x7f5a700b5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:06:53.569 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.560+0000 7f5a752f1700 1 --2- 172.21.15.125:0/3339479195 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a701f67c0 0x7f5a701f1fa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5a6000f7a0 tx=0x7f5a6000fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:53.569 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.560+0000 7f5a667fc700 1 -- 172.21.15.125:0/3339479195 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a600052e0 con 0x7f5a701f67c0 2023-10-17T06:06:53.569 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.560+0000 7f5a667fc700 1 -- 172.21.15.125:0/3339479195 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a60005440 con 0x7f5a701f67c0 2023-10-17T06:06:53.569 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.560+0000 7f5a667fc700 1 -- 172.21.15.125:0/3339479195 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a600038e0 con 0x7f5a701f67c0 2023-10-17T06:06:53.570 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.560+0000 7f5a76af4700 1 -- 172.21.15.125:0/3339479195 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7014d230 con 0x7f5a701f67c0 2023-10-17T06:06:53.570 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.560+0000 7f5a76af4700 1 -- 172.21.15.125:0/3339479195 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a701f6c00 con 0x7f5a701f67c0 2023-10-17T06:06:53.570 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.560+0000 7f5a76af4700 1 -- 172.21.15.125:0/3339479195 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a7004e910 con 0x7f5a701f67c0 2023-10-17T06:06:53.570 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.560+0000 7f5a667fc700 1 -- 172.21.15.125:0/3339479195 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 84906+0+0 (secure 0 0 0) 0x7f5a60003a40 con 0x7f5a701f67c0 2023-10-17T06:06:53.571 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.560+0000 7f5a667fc700 1 --2- 172.21.15.125:0/3339479195 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5a54065690 0x7f5a54067b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:06:53.571 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.560+0000 7f5a667fc700 1 -- 172.21.15.125:0/3339479195 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f5a60081a30 con 0x7f5a701f67c0 2023-10-17T06:06:53.571 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.564+0000 7f5a75af2700 1 --2- 172.21.15.125:0/3339479195 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5a54065690 0x7f5a54067b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:06:53.572 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.564+0000 7f5a75af2700 1 --2- 172.21.15.125:0/3339479195 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5a54065690 0x7f5a54067b50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c000c00 tx=0x7f5a6c007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:06:53.573 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.568+0000 7f5a667fc700 1 -- 172.21.15.125:0/3339479195 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f5a60050550 con 0x7f5a701f67c0 2023-10-17T06:06:53.578 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-10-17T06:06:53.572+0000 7fb3c907a700 -1 osd.3 0 waiting for initial osdmap 2023-10-17T06:06:53.590 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-10-17T06:06:53.584+0000 7fb3c09f0700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-17T06:06:53.779 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.772+0000 7f5a76af4700 1 -- 172.21.15.125:0/3339479195 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a700d04b0 con 0x7f5a701f67c0 2023-10-17T06:06:53.780 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.776+0000 7f5a667fc700 1 -- 172.21.15.125:0/3339479195 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9498 (secure 0 0 0) 0x7f5a60053b70 con 0x7f5a701f67c0 2023-10-17T06:06:53.781 INFO:teuthology.misc.health.smithi125.stdout: 2023-10-17T06:06:53.781 INFO:teuthology.misc.health.smithi125.stdout:{"epoch":14,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:06:53.653729+0000","last_up_change":"2023-10-17T06:06:53.653729+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:06:53.785 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.780+0000 7f5a76af4700 1 -- 172.21.15.125:0/3339479195 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5a54065690 msgr2=0x7f5a54067b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:53.786 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.780+0000 7f5a76af4700 1 --2- 172.21.15.125:0/3339479195 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5a54065690 0x7f5a54067b50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c000c00 tx=0x7f5a6c007000 comp rx=0 tx=0).stop 2023-10-17T06:06:53.786 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.780+0000 7f5a76af4700 1 -- 172.21.15.125:0/3339479195 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a701f67c0 msgr2=0x7f5a701f1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:06:53.787 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.780+0000 7f5a76af4700 1 --2- 172.21.15.125:0/3339479195 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a701f67c0 0x7f5a701f1fa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5a6000f7a0 tx=0x7f5a6000fb60 comp rx=0 tx=0).stop 2023-10-17T06:06:53.787 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.780+0000 7f5a76af4700 1 -- 172.21.15.125:0/3339479195 shutdown_connections 2023-10-17T06:06:53.787 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.780+0000 7f5a76af4700 1 --2- 172.21.15.125:0/3339479195 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5a54065690 0x7f5a54067b50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:53.788 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.780+0000 7f5a76af4700 1 --2- 172.21.15.125:0/3339479195 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a70070080 0x7f5a70070500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:53.788 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.780+0000 7f5a76af4700 1 --2- 172.21.15.125:0/3339479195 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a701f67c0 0x7f5a701f1fa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:53.788 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.780+0000 7f5a76af4700 1 --2- 172.21.15.125:0/3339479195 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a5c003a20 0x7f5a700b5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:06:53.789 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.780+0000 7f5a76af4700 1 -- 172.21.15.125:0/3339479195 >> 172.21.15.125:0/3339479195 conn(0x7f5a700cf6f0 msgr2=0x7f5a700b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:06:53.789 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.780+0000 7f5a76af4700 1 -- 172.21.15.125:0/3339479195 shutdown_connections 2023-10-17T06:06:53.789 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:06:53.780+0000 7f5a76af4700 1 -- 172.21.15.125:0/3339479195 wait complete. 2023-10-17T06:06:53.805 DEBUG:teuthology.misc:5 of 8 OSDs are up 2023-10-17T06:06:53.886 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-10-17T06:06:53.884+0000 7faf77fd4700 -1 osd.4 0 waiting for initial osdmap 2023-10-17T06:06:53.899 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-10-17T06:06:53.896+0000 7faf6f9f0700 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-17T06:06:53.941 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-10-17T06:06:53.936+0000 7f0db0074700 -1 osd.5 0 waiting for initial osdmap 2023-10-17T06:06:53.949 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-10-17T06:06:53.948+0000 7f1d30811700 -1 osd.6 0 waiting for initial osdmap 2023-10-17T06:06:53.954 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-10-17T06:06:53.952+0000 7f0da79f0700 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-17T06:06:53.960 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-10-17T06:06:53.956+0000 7f1d281f0700 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-17T06:07:00.612 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-17T06:07:00.771 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.764+0000 7fcd85c1d700 1 Processor -- start 2023-10-17T06:07:00.771 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.764+0000 7fcd85c1d700 1 -- start start 2023-10-17T06:07:00.774 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd85c1d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcd8015aed0 0x7fcd800b63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:00.774 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd85c1d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd8015e9a0 0x7fcd8015ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:00.774 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd85c1d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcd8006f330 0x7fcd8006f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:00.774 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd85c1d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8015f340 con 0x7fcd8006f330 2023-10-17T06:07:00.775 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd85c1d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd800cefe0 con 0x7fcd8015aed0 2023-10-17T06:07:00.775 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd85c1d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8015b2b0 con 0x7fcd8015e9a0 2023-10-17T06:07:00.775 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd7ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcd8006f330 0x7fcd8006f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:00.775 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd7ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcd8006f330 0x7fcd8006f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45198/0 (socket says 172.21.15.125:45198) 2023-10-17T06:07:00.776 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd7ffff700 1 -- 172.21.15.125:0/1130907661 learned_addr learned my addr 172.21.15.125:0/1130907661 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:00.776 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd7effd700 1 --2- 172.21.15.125:0/1130907661 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd8015e9a0 0x7fcd8015ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:00.776 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd7f7fe700 1 --2- 172.21.15.125:0/1130907661 >> v2:172.21.15.184:3300/0 conn(0x7fcd8015aed0 0x7fcd800b63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:00.778 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd7ffff700 1 -- 172.21.15.125:0/1130907661 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd8015e9a0 msgr2=0x7fcd8015ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:00.778 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd7ffff700 1 --2- 172.21.15.125:0/1130907661 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd8015e9a0 0x7fcd8015ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:00.778 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd7ffff700 1 -- 172.21.15.125:0/1130907661 >> v2:172.21.15.184:3300/0 conn(0x7fcd8015aed0 msgr2=0x7fcd800b63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:00.778 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd7ffff700 1 --2- 172.21.15.125:0/1130907661 >> v2:172.21.15.184:3300/0 conn(0x7fcd8015aed0 0x7fcd800b63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:00.779 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd7ffff700 1 -- 172.21.15.125:0/1130907661 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd80070620 con 0x7fcd8006f330 2023-10-17T06:07:00.779 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd7f7fe700 1 --2- 172.21.15.125:0/1130907661 >> v2:172.21.15.184:3300/0 conn(0x7fcd8015aed0 0x7fcd800b63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:00.779 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd7ffff700 1 --2- 172.21.15.125:0/1130907661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd8006f330 0x7fcd8006f7a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcd800671c0 tx=0x7fcd7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d144f01644cc5127 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:00.779 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd7e7fc700 1 -- 172.21.15.125:0/1130907661 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7800e070 con 0x7fcd8006f330 2023-10-17T06:07:00.780 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd7e7fc700 1 -- 172.21.15.125:0/1130907661 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7800b9c0 con 0x7fcd8006f330 2023-10-17T06:07:00.780 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd7e7fc700 1 -- 172.21.15.125:0/1130907661 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7800bd70 con 0x7fcd8006f330 2023-10-17T06:07:00.780 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd85c1d700 1 -- 172.21.15.125:0/1130907661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd8006f330 msgr2=0x7fcd8006f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:00.780 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd85c1d700 1 --2- 172.21.15.125:0/1130907661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd8006f330 0x7fcd8006f7a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcd800671c0 tx=0x7fcd7800b330 comp rx=0 tx=0).stop 2023-10-17T06:07:00.781 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd85c1d700 1 -- 172.21.15.125:0/1130907661 shutdown_connections 2023-10-17T06:07:00.781 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd85c1d700 1 --2- 172.21.15.125:0/1130907661 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd8015e9a0 0x7fcd8015ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:00.781 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd85c1d700 1 --2- 172.21.15.125:0/1130907661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd8006f330 0x7fcd8006f7a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:00.781 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd85c1d700 1 --2- 172.21.15.125:0/1130907661 >> v2:172.21.15.184:3300/0 conn(0x7fcd8015aed0 0x7fcd800b63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:00.781 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.768+0000 7fcd85c1d700 1 -- 172.21.15.125:0/1130907661 >> 172.21.15.125:0/1130907661 conn(0x7fcd800d0ac0 msgr2=0x7fcd800d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:00.782 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.772+0000 7fcd85c1d700 1 -- 172.21.15.125:0/1130907661 shutdown_connections 2023-10-17T06:07:00.782 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.772+0000 7fcd85c1d700 1 -- 172.21.15.125:0/1130907661 wait complete. 2023-10-17T06:07:00.782 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.772+0000 7fcd85c1d700 1 Processor -- start 2023-10-17T06:07:00.784 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.772+0000 7fcd85c1d700 1 -- start start 2023-10-17T06:07:00.785 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.772+0000 7fcd85c1d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd8006f330 0x7fcd801efe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:00.785 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.772+0000 7fcd85c1d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd8015aed0 0x7fcd800c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:00.785 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.772+0000 7fcd85c1d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd8015e9a0 0x7fcd80157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:00.785 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.772+0000 7fcd85c1d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8015ced0 con 0x7fcd8006f330 2023-10-17T06:07:00.786 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.772+0000 7fcd85c1d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8015c250 con 0x7fcd8015aed0 2023-10-17T06:07:00.786 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.772+0000 7fcd85c1d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8015c530 con 0x7fcd8015e9a0 2023-10-17T06:07:00.786 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.772+0000 7fcd7effd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd8015aed0 0x7fcd800c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:00.786 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.772+0000 7fcd7f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd8006f330 0x7fcd801efe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:00.786 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.776+0000 7fcd7effd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd8015aed0 0x7fcd800c5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:37220/0 (socket says 172.21.15.125:37220) 2023-10-17T06:07:00.787 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.776+0000 7fcd7effd700 1 -- 172.21.15.125:0/2258134406 learned_addr learned my addr 172.21.15.125:0/2258134406 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:00.787 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.776+0000 7fcd7ffff700 1 --2- 172.21.15.125:0/2258134406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd8015e9a0 0x7fcd80157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:00.787 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.776+0000 7fcd7effd700 1 -- 172.21.15.125:0/2258134406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd8015e9a0 msgr2=0x7fcd80157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:00.787 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.776+0000 7fcd7effd700 1 --2- 172.21.15.125:0/2258134406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd8015e9a0 0x7fcd80157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:00.787 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.776+0000 7fcd7effd700 1 -- 172.21.15.125:0/2258134406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd8006f330 msgr2=0x7fcd801efe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:00.788 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.776+0000 7fcd7effd700 1 --2- 172.21.15.125:0/2258134406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd8006f330 0x7fcd801efe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:00.788 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.776+0000 7fcd7effd700 1 -- 172.21.15.125:0/2258134406 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd78009b30 con 0x7fcd8015aed0 2023-10-17T06:07:00.788 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.776+0000 7fcd7effd700 1 --2- 172.21.15.125:0/2258134406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd8015aed0 0x7fcd800c5fc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400d830 tx=0x7fcd7400db40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:00.788 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.776+0000 7fcd67fff700 1 -- 172.21.15.125:0/2258134406 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd740125f0 con 0x7fcd8015aed0 2023-10-17T06:07:00.789 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.776+0000 7fcd85c1d700 1 -- 172.21.15.125:0/2258134406 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8015c810 con 0x7fcd8015aed0 2023-10-17T06:07:00.789 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.776+0000 7fcd67fff700 1 -- 172.21.15.125:0/2258134406 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd74012750 con 0x7fcd8015aed0 2023-10-17T06:07:00.789 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.776+0000 7fcd67fff700 1 -- 172.21.15.125:0/2258134406 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74012b00 con 0x7fcd8015aed0 2023-10-17T06:07:00.789 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.776+0000 7fcd85c1d700 1 -- 172.21.15.125:0/2258134406 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd801f03d0 con 0x7fcd8015aed0 2023-10-17T06:07:00.789 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.776+0000 7fcd85c1d700 1 -- 172.21.15.125:0/2258134406 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8015d010 con 0x7fcd8015aed0 2023-10-17T06:07:00.790 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.780+0000 7fcd67fff700 1 -- 172.21.15.125:0/2258134406 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fcd74012c60 con 0x7fcd8015aed0 2023-10-17T06:07:00.790 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.780+0000 7fcd67fff700 1 --2- 172.21.15.125:0/2258134406 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fcd6c0656f0 0x7fcd6c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:00.791 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.780+0000 7fcd67fff700 1 -- 172.21.15.125:0/2258134406 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcd74082950 con 0x7fcd8015aed0 2023-10-17T06:07:00.791 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.780+0000 7fcd7f7fe700 1 --2- 172.21.15.125:0/2258134406 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fcd6c0656f0 0x7fcd6c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:00.791 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.780+0000 7fcd7f7fe700 1 --2- 172.21.15.125:0/2258134406 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fcd6c0656f0 0x7fcd6c067bb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcd700044b0 tx=0x7fcd70008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:00.794 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.788+0000 7fcd67fff700 1 -- 172.21.15.125:0/2258134406 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fcd740508b0 con 0x7fcd8015aed0 2023-10-17T06:07:01.003 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:00.996+0000 7fcd85c1d700 1 -- 172.21.15.125:0/2258134406 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd8015d010 con 0x7fcd8015aed0 2023-10-17T06:07:01.005 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:01.000+0000 7fcd67fff700 1 -- 172.21.15.125:0/2258134406 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12886 (secure 0 0 0) 0x7fcd8015d010 con 0x7fcd8015aed0 2023-10-17T06:07:01.006 INFO:teuthology.misc.health.smithi125.stdout: 2023-10-17T06:07:01.006 INFO:teuthology.misc.health.smithi125.stdout:{"epoch":17,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:06:56.669326+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:07:01.011 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:01.004+0000 7fcd85c1d700 1 -- 172.21.15.125:0/2258134406 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fcd6c0656f0 msgr2=0x7fcd6c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:01.011 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:01.004+0000 7fcd85c1d700 1 --2- 172.21.15.125:0/2258134406 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fcd6c0656f0 0x7fcd6c067bb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcd700044b0 tx=0x7fcd70008040 comp rx=0 tx=0).stop 2023-10-17T06:07:01.011 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:01.004+0000 7fcd85c1d700 1 -- 172.21.15.125:0/2258134406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd8015aed0 msgr2=0x7fcd800c5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:01.011 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:01.004+0000 7fcd85c1d700 1 --2- 172.21.15.125:0/2258134406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd8015aed0 0x7fcd800c5fc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400d830 tx=0x7fcd7400db40 comp rx=0 tx=0).stop 2023-10-17T06:07:01.012 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:01.004+0000 7fcd85c1d700 1 -- 172.21.15.125:0/2258134406 shutdown_connections 2023-10-17T06:07:01.012 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:01.004+0000 7fcd85c1d700 1 --2- 172.21.15.125:0/2258134406 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fcd6c0656f0 0x7fcd6c067bb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:01.012 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:01.004+0000 7fcd85c1d700 1 --2- 172.21.15.125:0/2258134406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd8015e9a0 0x7fcd80157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:01.012 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:01.004+0000 7fcd85c1d700 1 --2- 172.21.15.125:0/2258134406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd8015aed0 0x7fcd800c5fc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:01.012 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:01.004+0000 7fcd85c1d700 1 --2- 172.21.15.125:0/2258134406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcd8006f330 0x7fcd801efe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:01.013 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:01.004+0000 7fcd85c1d700 1 -- 172.21.15.125:0/2258134406 >> 172.21.15.125:0/2258134406 conn(0x7fcd800d0ac0 msgr2=0x7fcd800d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:01.013 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:01.004+0000 7fcd85c1d700 1 -- 172.21.15.125:0/2258134406 shutdown_connections 2023-10-17T06:07:01.013 INFO:teuthology.misc.health.smithi125.stderr:2023-10-17T06:07:01.004+0000 7fcd85c1d700 1 -- 172.21.15.125:0/2258134406 wait complete. 2023-10-17T06:07:01.031 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-17T06:07:01.031 INFO:tasks.ceph:Creating RBD pool 2023-10-17T06:07:01.031 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-17T06:07:01.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.192+0000 7f1c7eb1a700 1 Processor -- start 2023-10-17T06:07:01.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.192+0000 7f1c7eb1a700 1 -- start start 2023-10-17T06:07:01.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.192+0000 7f1c7eb1a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c7815ce30 0x7f1c78160a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:01.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.192+0000 7f1c7eb1a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1c7806f450 0x7f1c78160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:01.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.192+0000 7f1c7eb1a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c780ca840 con 0x7f1c780caa10 2023-10-17T06:07:01.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.196+0000 7f1c7eb1a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c780ca560 con 0x7f1c7806f450 2023-10-17T06:07:01.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.196+0000 7f1c7eb1a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780ccf30 con 0x7f1c7815ce30 2023-10-17T06:07:01.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.196+0000 7f1c7d0b7700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1c780caa10 0x7f1c7806e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47240/0 (socket says 172.21.15.125:47240) 2023-10-17T06:07:01.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.196+0000 7f1c7d0b7700 1 -- 172.21.15.125:0/1259051336 learned_addr learned my addr 172.21.15.125:0/1259051336 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:01.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.196+0000 7f1c6ffff700 1 --2- 172.21.15.125:0/1259051336 >> v2:172.21.15.125:3300/0 conn(0x7f1c7806f450 0x7f1c78160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:01.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.196+0000 7f1c7c8b6700 1 --2- 172.21.15.125:0/1259051336 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c7815ce30 0x7f1c78160a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:01.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.196+0000 7f1c6f7fe700 1 -- 172.21.15.125:0/1259051336 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129308725 0 0) 0x7f1c780ca840 con 0x7f1c780caa10 2023-10-17T06:07:01.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.196+0000 7f1c6f7fe700 1 -- 172.21.15.125:0/1259051336 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c600035d0 con 0x7f1c780caa10 2023-10-17T06:07:01.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.196+0000 7f1c6ffff700 1 -- 172.21.15.125:0/1259051336 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c7815ce30 msgr2=0x7f1c78160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:01.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.196+0000 7f1c6ffff700 1 --2- 172.21.15.125:0/1259051336 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c7815ce30 0x7f1c78160a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:01.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.196+0000 7f1c6ffff700 1 -- 172.21.15.125:0/1259051336 >> v1:172.21.15.125:6789/0 conn(0x7f1c780caa10 legacy=0x7f1c7806e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:01.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.196+0000 7f1c6ffff700 1 -- 172.21.15.125:0/1259051336 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c780cd210 con 0x7f1c7806f450 2023-10-17T06:07:01.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.196+0000 7f1c6ffff700 1 --2- 172.21.15.125:0/1259051336 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c7806f450 0x7f1c78160f50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1c68009850 tx=0x7f1c68009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab307036c56f100a server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:01.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.196+0000 7f1c6f7fe700 1 -- 172.21.15.125:0/1259051336 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68011830 con 0x7f1c7806f450 2023-10-17T06:07:01.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.196+0000 7f1c6f7fe700 1 -- 172.21.15.125:0/1259051336 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c68011990 con 0x7f1c7806f450 2023-10-17T06:07:01.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.196+0000 7f1c6f7fe700 1 -- 172.21.15.125:0/1259051336 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68011d40 con 0x7f1c7806f450 2023-10-17T06:07:01.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.196+0000 7f1c7eb1a700 1 -- 172.21.15.125:0/1259051336 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c7806f450 msgr2=0x7f1c78160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:01.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.200+0000 7f1c7eb1a700 1 --2- 172.21.15.125:0/1259051336 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c7806f450 0x7f1c78160f50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1c68009850 tx=0x7f1c68009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:01.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.200+0000 7f1c7eb1a700 1 -- 172.21.15.125:0/1259051336 shutdown_connections 2023-10-17T06:07:01.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.200+0000 7f1c7eb1a700 1 --2- 172.21.15.125:0/1259051336 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c7806f450 0x7f1c78160f50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:01.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.200+0000 7f1c7eb1a700 1 --2- 172.21.15.125:0/1259051336 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c7815ce30 0x7f1c78160a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:01.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.200+0000 7f1c7eb1a700 1 -- 172.21.15.125:0/1259051336 >> 172.21.15.125:0/1259051336 conn(0x7f1c780ce820 msgr2=0x7f1c780cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:01.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.200+0000 7f1c7eb1a700 1 -- 172.21.15.125:0/1259051336 shutdown_connections 2023-10-17T06:07:01.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.200+0000 7f1c7eb1a700 1 -- 172.21.15.125:0/1259051336 wait complete. 2023-10-17T06:07:01.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.200+0000 7f1c7eb1a700 1 Processor -- start 2023-10-17T06:07:01.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.200+0000 7f1c7eb1a700 1 -- start start 2023-10-17T06:07:01.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c7eb1a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c7806f450 0x7f1c7815e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:01.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c7eb1a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c780caa10 0x7f1c78146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:01.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c7eb1a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c7815ce30 0x7f1c7815af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:01.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c7eb1a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c781f68d0 con 0x7f1c780caa10 2023-10-17T06:07:01.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c7eb1a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7815d430 con 0x7f1c7815ce30 2023-10-17T06:07:01.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c7eb1a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7815d710 con 0x7f1c7806f450 2023-10-17T06:07:01.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c6ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c780caa10 0x7f1c78146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:01.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c6ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c780caa10 0x7f1c78146880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45228/0 (socket says 172.21.15.125:45228) 2023-10-17T06:07:01.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c6ffff700 1 -- 172.21.15.125:0/2253380970 learned_addr learned my addr 172.21.15.125:0/2253380970 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:01.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c7c8b6700 1 --2- 172.21.15.125:0/2253380970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c7806f450 0x7f1c7815e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:01.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c7d0b7700 1 --2- 172.21.15.125:0/2253380970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c7815ce30 0x7f1c7815af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:01.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c6ffff700 1 -- 172.21.15.125:0/2253380970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c7806f450 msgr2=0x7f1c7815e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:01.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c6ffff700 1 --2- 172.21.15.125:0/2253380970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c7806f450 0x7f1c7815e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:01.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c6ffff700 1 -- 172.21.15.125:0/2253380970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c7815ce30 msgr2=0x7f1c7815af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:01.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c6ffff700 1 --2- 172.21.15.125:0/2253380970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c7815ce30 0x7f1c7815af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:01.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c6ffff700 1 -- 172.21.15.125:0/2253380970 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c680094b0 con 0x7f1c780caa10 2023-10-17T06:07:01.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c6ffff700 1 --2- 172.21.15.125:0/2253380970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c780caa10 0x7f1c78146880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1c68014040 tx=0x7f1c68004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:01.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c6d7fa700 1 -- 172.21.15.125:0/2253380970 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68004510 con 0x7f1c780caa10 2023-10-17T06:07:01.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c7eb1a700 1 -- 172.21.15.125:0/2253380970 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c7815d9f0 con 0x7f1c780caa10 2023-10-17T06:07:01.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c6d7fa700 1 -- 172.21.15.125:0/2253380970 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6801e070 con 0x7f1c780caa10 2023-10-17T06:07:01.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c6d7fa700 1 -- 172.21.15.125:0/2253380970 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68003900 con 0x7f1c780caa10 2023-10-17T06:07:01.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.204+0000 7f1c7eb1a700 1 -- 172.21.15.125:0/2253380970 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c78146dc0 con 0x7f1c780caa10 2023-10-17T06:07:01.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.208+0000 7f1c7eb1a700 1 -- 172.21.15.125:0/2253380970 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7815df10 con 0x7f1c780caa10 2023-10-17T06:07:01.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.208+0000 7f1c6d7fa700 1 -- 172.21.15.125:0/2253380970 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1c68003a60 con 0x7f1c780caa10 2023-10-17T06:07:01.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.208+0000 7f1c6d7fa700 1 --2- 172.21.15.125:0/2253380970 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1c640656f0 0x7f1c64067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:01.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.208+0000 7f1c6d7fa700 1 -- 172.21.15.125:0/2253380970 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1c68020070 con 0x7f1c780caa10 2023-10-17T06:07:01.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.208+0000 7f1c7c8b6700 1 --2- 172.21.15.125:0/2253380970 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1c640656f0 0x7f1c64067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:01.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.208+0000 7f1c7c8b6700 1 --2- 172.21.15.125:0/2253380970 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1c640656f0 0x7f1c64067bb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1c740113e0 tx=0x7f1c7400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:01.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.216+0000 7f1c6d7fa700 1 -- 172.21.15.125:0/2253380970 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f1c7815df10 con 0x7f1c780caa10 2023-10-17T06:07:01.288 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:07:01.296 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:07:01.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.396+0000 7f1c7eb1a700 1 -- 172.21.15.125:0/2253380970 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f1c7815df10 con 0x7f1c780caa10 2023-10-17T06:07:01.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.716+0000 7f1c6d7fa700 1 -- 172.21.15.125:0/2253380970 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7f1c7815df10 con 0x7f1c780caa10 2023-10-17T06:07:01.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.720+0000 7f1c7eb1a700 1 -- 172.21.15.125:0/2253380970 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1c640656f0 msgr2=0x7f1c64067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:01.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.720+0000 7f1c7eb1a700 1 --2- 172.21.15.125:0/2253380970 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1c640656f0 0x7f1c64067bb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1c740113e0 tx=0x7f1c7400b040 comp rx=0 tx=0).stop 2023-10-17T06:07:01.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.720+0000 7f1c7eb1a700 1 -- 172.21.15.125:0/2253380970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c780caa10 msgr2=0x7f1c78146880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:01.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.720+0000 7f1c7eb1a700 1 --2- 172.21.15.125:0/2253380970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c780caa10 0x7f1c78146880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1c68014040 tx=0x7f1c68004770 comp rx=0 tx=0).stop 2023-10-17T06:07:01.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.724+0000 7f1c7eb1a700 1 -- 172.21.15.125:0/2253380970 shutdown_connections 2023-10-17T06:07:01.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.724+0000 7f1c7eb1a700 1 --2- 172.21.15.125:0/2253380970 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1c640656f0 0x7f1c64067bb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:01.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.724+0000 7f1c7eb1a700 1 --2- 172.21.15.125:0/2253380970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c7815ce30 0x7f1c7815af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:01.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.724+0000 7f1c7eb1a700 1 --2- 172.21.15.125:0/2253380970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c780caa10 0x7f1c78146880 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:01.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.724+0000 7f1c7eb1a700 1 --2- 172.21.15.125:0/2253380970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c7806f450 0x7f1c7815e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:01.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.724+0000 7f1c7eb1a700 1 -- 172.21.15.125:0/2253380970 >> 172.21.15.125:0/2253380970 conn(0x7f1c780ce820 msgr2=0x7f1c780ced20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:01.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.724+0000 7f1c7eb1a700 1 -- 172.21.15.125:0/2253380970 shutdown_connections 2023-10-17T06:07:01.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.724+0000 7f1c7eb1a700 1 -- 172.21.15.125:0/2253380970 wait complete. 2023-10-17T06:07:01.732 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'rbd' created 2023-10-17T06:07:01.750 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-17T06:07:01.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.912+0000 7fe7701e6700 1 Processor -- start 2023-10-17T06:07:01.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.912+0000 7fe7701e6700 1 -- start start 2023-10-17T06:07:01.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.916+0000 7fe7701e6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe76815cde0 0x7fe7680708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:01.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.916+0000 7fe7701e6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe76806e8d0 0x7fe7680cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:01.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.916+0000 7fe7701e6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76815d1c0 con 0x7fe76806e440 2023-10-17T06:07:01.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.916+0000 7fe7701e6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe768070df0 con 0x7fe76815cde0 2023-10-17T06:07:01.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.916+0000 7fe7701e6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76806f810 con 0x7fe76806e8d0 2023-10-17T06:07:01.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.916+0000 7fe76df82700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe76815cde0 0x7fe7680708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:01.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.916+0000 7fe76d781700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe76806e440 0x7fe7680b64d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47244/0 (socket says 172.21.15.125:47244) 2023-10-17T06:07:01.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.916+0000 7fe76d781700 1 -- 172.21.15.125:0/2724761238 learned_addr learned my addr 172.21.15.125:0/2724761238 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:01.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.916+0000 7fe76e783700 1 --2- 172.21.15.125:0/2724761238 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe76806e8d0 0x7fe7680cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:01.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.916+0000 7fe76cf80700 1 -- 172.21.15.125:0/2724761238 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205187309 0 0) 0x7fe76815d1c0 con 0x7fe76806e440 2023-10-17T06:07:01.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.916+0000 7fe76cf80700 1 -- 172.21.15.125:0/2724761238 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7540035d0 con 0x7fe76806e440 2023-10-17T06:07:01.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.916+0000 7fe76df82700 1 -- 172.21.15.125:0/2724761238 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe76806e8d0 msgr2=0x7fe7680cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:01.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.916+0000 7fe76df82700 1 --2- 172.21.15.125:0/2724761238 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe76806e8d0 0x7fe7680cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:01.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.916+0000 7fe76df82700 1 -- 172.21.15.125:0/2724761238 >> v1:172.21.15.125:6789/0 conn(0x7fe76806e440 legacy=0x7fe7680b64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:01.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.916+0000 7fe76df82700 1 -- 172.21.15.125:0/2724761238 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76806faf0 con 0x7fe76815cde0 2023-10-17T06:07:01.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.916+0000 7fe76df82700 1 --2- 172.21.15.125:0/2724761238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe76815cde0 0x7fe7680708b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe764009850 tx=0x7fe764009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936fa93a41e23d30 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:01.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.920+0000 7fe76cf80700 1 -- 172.21.15.125:0/2724761238 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe764011830 con 0x7fe76815cde0 2023-10-17T06:07:01.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.920+0000 7fe76cf80700 1 -- 172.21.15.125:0/2724761238 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe764011990 con 0x7fe76815cde0 2023-10-17T06:07:01.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.920+0000 7fe76cf80700 1 -- 172.21.15.125:0/2724761238 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe764011d40 con 0x7fe76815cde0 2023-10-17T06:07:01.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.920+0000 7fe7701e6700 1 -- 172.21.15.125:0/2724761238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe76815cde0 msgr2=0x7fe7680708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:01.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.920+0000 7fe7701e6700 1 --2- 172.21.15.125:0/2724761238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe76815cde0 0x7fe7680708b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe764009850 tx=0x7fe764009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:01.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.920+0000 7fe7701e6700 1 -- 172.21.15.125:0/2724761238 shutdown_connections 2023-10-17T06:07:01.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.920+0000 7fe7701e6700 1 --2- 172.21.15.125:0/2724761238 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe76806e8d0 0x7fe7680cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:01.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.920+0000 7fe7701e6700 1 --2- 172.21.15.125:0/2724761238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe76815cde0 0x7fe7680708b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:01.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.920+0000 7fe7701e6700 1 -- 172.21.15.125:0/2724761238 >> 172.21.15.125:0/2724761238 conn(0x7fe76806a130 msgr2=0x7fe76806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:01.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.920+0000 7fe7701e6700 1 -- 172.21.15.125:0/2724761238 shutdown_connections 2023-10-17T06:07:01.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.920+0000 7fe7701e6700 1 -- 172.21.15.125:0/2724761238 wait complete. 2023-10-17T06:07:01.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.924+0000 7fe7701e6700 1 Processor -- start 2023-10-17T06:07:01.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.924+0000 7fe7701e6700 1 -- start start 2023-10-17T06:07:01.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.924+0000 7fe7701e6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe76806e440 0x7fe7681f3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:01.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.924+0000 7fe7701e6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe76806e8d0 0x7fe76814f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:01.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.924+0000 7fe7701e6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe76815cde0 0x7fe76814fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:01.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.924+0000 7fe7701e6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7681f3650 con 0x7fe76815cde0 2023-10-17T06:07:01.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.924+0000 7fe7701e6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76815e210 con 0x7fe76806e440 2023-10-17T06:07:01.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.924+0000 7fe7701e6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76815e7d0 con 0x7fe76806e8d0 2023-10-17T06:07:01.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.924+0000 7fe76e783700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe76815cde0 0x7fe76814fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:01.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.924+0000 7fe76e783700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe76815cde0 0x7fe76814fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45254/0 (socket says 172.21.15.125:45254) 2023-10-17T06:07:01.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.924+0000 7fe76e783700 1 -- 172.21.15.125:0/1213442309 learned_addr learned my addr 172.21.15.125:0/1213442309 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:01.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.924+0000 7fe76df82700 1 --2- 172.21.15.125:0/1213442309 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe76806e440 0x7fe7681f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:01.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.924+0000 7fe76d781700 1 --2- 172.21.15.125:0/1213442309 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe76806e8d0 0x7fe76814f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:01.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.924+0000 7fe76e783700 1 -- 172.21.15.125:0/1213442309 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe76806e8d0 msgr2=0x7fe76814f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:01.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.924+0000 7fe76e783700 1 --2- 172.21.15.125:0/1213442309 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe76806e8d0 0x7fe76814f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:01.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.924+0000 7fe76e783700 1 -- 172.21.15.125:0/1213442309 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe76806e440 msgr2=0x7fe7681f3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:01.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.924+0000 7fe76e783700 1 --2- 172.21.15.125:0/1213442309 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe76806e440 0x7fe7681f3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:01.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.924+0000 7fe76e783700 1 -- 172.21.15.125:0/1213442309 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7640094b0 con 0x7fe76815cde0 2023-10-17T06:07:01.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.924+0000 7fe76e783700 1 --2- 172.21.15.125:0/1213442309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe76815cde0 0x7fe76814fa40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe76000efc0 tx=0x7fe76000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:01.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.924+0000 7fe75e7fc700 1 -- 172.21.15.125:0/1213442309 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760009ea0 con 0x7fe76815cde0 2023-10-17T06:07:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.928+0000 7fe75e7fc700 1 -- 172.21.15.125:0/1213442309 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76000f040 con 0x7fe76815cde0 2023-10-17T06:07:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.928+0000 7fe75e7fc700 1 -- 172.21.15.125:0/1213442309 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760014480 con 0x7fe76815cde0 2023-10-17T06:07:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.928+0000 7fe7701e6700 1 -- 172.21.15.125:0/1213442309 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7681522e0 con 0x7fe76815cde0 2023-10-17T06:07:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.928+0000 7fe7701e6700 1 -- 172.21.15.125:0/1213442309 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76815e460 con 0x7fe76815cde0 2023-10-17T06:07:01.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.928+0000 7fe7701e6700 1 -- 172.21.15.125:0/1213442309 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7680d3ae0 con 0x7fe76815cde0 2023-10-17T06:07:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.928+0000 7fe75e7fc700 1 -- 172.21.15.125:0/1213442309 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe7600145e0 con 0x7fe76815cde0 2023-10-17T06:07:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.932+0000 7fe75e7fc700 1 --2- 172.21.15.125:0/1213442309 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe74c065720 0x7fe74c067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:01.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.932+0000 7fe75e7fc700 1 -- 172.21.15.125:0/1213442309 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fe760083570 con 0x7fe76815cde0 2023-10-17T06:07:01.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.932+0000 7fe76df82700 1 --2- 172.21.15.125:0/1213442309 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe74c065720 0x7fe74c067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:01.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.932+0000 7fe76df82700 1 --2- 172.21.15.125:0/1213442309 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe74c065720 0x7fe74c067be0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe7640090b0 tx=0x7fe76401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:01.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:01.936+0000 7fe75e7fc700 1 -- 172.21.15.125:0/1213442309 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe760051380 con 0x7fe76815cde0 2023-10-17T06:07:02.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.204+0000 7fe7701e6700 1 -- 172.21.15.125:0/1213442309 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe768073f00 con 0x7fe76815cde0 2023-10-17T06:07:02.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.732+0000 7fe75e7fc700 1 -- 172.21.15.125:0/1213442309 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7fe7600549a0 con 0x7fe76815cde0 2023-10-17T06:07:02.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.736+0000 7fe7701e6700 1 -- 172.21.15.125:0/1213442309 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe74c065720 msgr2=0x7fe74c067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:02.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.736+0000 7fe7701e6700 1 --2- 172.21.15.125:0/1213442309 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe74c065720 0x7fe74c067be0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe7640090b0 tx=0x7fe76401c040 comp rx=0 tx=0).stop 2023-10-17T06:07:02.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.736+0000 7fe7701e6700 1 -- 172.21.15.125:0/1213442309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe76815cde0 msgr2=0x7fe76814fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:02.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.736+0000 7fe7701e6700 1 --2- 172.21.15.125:0/1213442309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe76815cde0 0x7fe76814fa40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe76000efc0 tx=0x7fe76000c3a0 comp rx=0 tx=0).stop 2023-10-17T06:07:02.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.740+0000 7fe7701e6700 1 -- 172.21.15.125:0/1213442309 shutdown_connections 2023-10-17T06:07:02.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.740+0000 7fe7701e6700 1 --2- 172.21.15.125:0/1213442309 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe74c065720 0x7fe74c067be0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:02.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.740+0000 7fe7701e6700 1 --2- 172.21.15.125:0/1213442309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe76815cde0 0x7fe76814fa40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:02.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.740+0000 7fe7701e6700 1 --2- 172.21.15.125:0/1213442309 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe76806e8d0 0x7fe76814f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:02.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.740+0000 7fe7701e6700 1 --2- 172.21.15.125:0/1213442309 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe76806e440 0x7fe7681f3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:02.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.740+0000 7fe7701e6700 1 -- 172.21.15.125:0/1213442309 >> 172.21.15.125:0/1213442309 conn(0x7fe76806a130 msgr2=0x7fe7681579f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:02.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.740+0000 7fe7701e6700 1 -- 172.21.15.125:0/1213442309 shutdown_connections 2023-10-17T06:07:02.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.740+0000 7fe7701e6700 1 -- 172.21.15.125:0/1213442309 wait complete. 2023-10-17T06:07:02.749 INFO:teuthology.orchestra.run.smithi125.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-17T06:07:02.767 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-17T06:07:02.767 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-17T06:07:02.768 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-17T06:07:02.774 INFO:tasks.ceph.mds.a:Started 2023-10-17T06:07:02.775 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-17T06:07:02.775 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-17T06:07:02.781 INFO:tasks.ceph.mds.c:Started 2023-10-17T06:07:02.782 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-17T06:07:02.782 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-17T06:07:02.790 INFO:tasks.ceph.mds.b:Started 2023-10-17T06:07:02.790 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-17T06:07:02.790 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-17T06:07:02.794 INFO:tasks.ceph.mds.d:Started 2023-10-17T06:07:02.795 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-17T06:07:02.795 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:07:02.886 INFO:tasks.ceph.mds.a.smithi125.stdout:starting mds.a at 2023-10-17T06:07:02.889 INFO:tasks.ceph.mds.c.smithi125.stdout:starting mds.c at 2023-10-17T06:07:02.911 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-10-17T06:07:02.920 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-17T06:07:02.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.972+0000 7f2846b6e700 1 Processor -- start 2023-10-17T06:07:02.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.972+0000 7f2846b6e700 1 -- start start 2023-10-17T06:07:02.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.972+0000 7f2846b6e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f284015cc10 0x7f2840070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:02.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f2846b6e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f28400d2f20 0x7f28400d3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:02.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f2846b6e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28400d0460 con 0x7f28400b1e60 2023-10-17T06:07:02.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f2846b6e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284006eef0 con 0x7f284015cc10 2023-10-17T06:07:02.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f2846b6e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28400d3880 con 0x7f28400d2f20 2023-10-17T06:07:02.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f284490a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f284015cc10 0x7f2840070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:02.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f284490a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f284015cc10 0x7f2840070a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45278/0 (socket says 172.21.15.125:45278) 2023-10-17T06:07:02.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f284490a700 1 -- 172.21.15.125:0/3533204436 learned_addr learned my addr 172.21.15.125:0/3533204436 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:02.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f284510b700 1 --2- 172.21.15.125:0/3533204436 >> v2:172.21.15.184:3300/0 conn(0x7f28400d2f20 0x7f28400d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:02.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f284490a700 1 -- 172.21.15.125:0/3533204436 >> v2:172.21.15.184:3300/0 conn(0x7f28400d2f20 msgr2=0x7f28400d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:02.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f284490a700 1 --2- 172.21.15.125:0/3533204436 >> v2:172.21.15.184:3300/0 conn(0x7f28400d2f20 0x7f28400d3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:02.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f284490a700 1 -- 172.21.15.125:0/3533204436 >> v1:172.21.15.184:6789/0 conn(0x7f28400b1e60 legacy=0x7f28400cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:02.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f284490a700 1 -- 172.21.15.125:0/3533204436 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284006d220 con 0x7f284015cc10 2023-10-17T06:07:02.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f284490a700 1 --2- 172.21.15.125:0/3533204436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f284015cc10 0x7f2840070a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f28400d3a20 tx=0x7f2834009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449e651be387996e server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:02.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f283f7fe700 1 -- 172.21.15.125:0/3533204436 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2834004230 con 0x7f284015cc10 2023-10-17T06:07:02.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f283f7fe700 1 -- 172.21.15.125:0/3533204436 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2834004390 con 0x7f284015cc10 2023-10-17T06:07:02.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f283f7fe700 1 -- 172.21.15.125:0/3533204436 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28340036c0 con 0x7f284015cc10 2023-10-17T06:07:02.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f2846b6e700 1 -- 172.21.15.125:0/3533204436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f284015cc10 msgr2=0x7f2840070a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:02.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f2846b6e700 1 --2- 172.21.15.125:0/3533204436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f284015cc10 0x7f2840070a00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f28400d3a20 tx=0x7f2834009bf0 comp rx=0 tx=0).stop 2023-10-17T06:07:02.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f2846b6e700 1 -- 172.21.15.125:0/3533204436 shutdown_connections 2023-10-17T06:07:02.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f2846b6e700 1 --2- 172.21.15.125:0/3533204436 >> v2:172.21.15.184:3300/0 conn(0x7f28400d2f20 0x7f28400d3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:02.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f2846b6e700 1 --2- 172.21.15.125:0/3533204436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f284015cc10 0x7f2840070a00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:02.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f2846b6e700 1 -- 172.21.15.125:0/3533204436 >> 172.21.15.125:0/3533204436 conn(0x7f2840069ef0 msgr2=0x7f284006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:02.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f2846b6e700 1 -- 172.21.15.125:0/3533204436 shutdown_connections 2023-10-17T06:07:02.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.976+0000 7f2846b6e700 1 -- 172.21.15.125:0/3533204436 wait complete. 2023-10-17T06:07:02.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.980+0000 7f2846b6e700 1 Processor -- start 2023-10-17T06:07:02.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.980+0000 7f2846b6e700 1 -- start start 2023-10-17T06:07:02.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.984+0000 7f2846b6e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28400b1e60 0x7f2840153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:02.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.984+0000 7f2846b6e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28400d2f20 0x7f284015bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:02.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.984+0000 7f2846b6e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f284015cc10 0x7f284015cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:02.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.984+0000 7f2846b6e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2840153580 con 0x7f28400d2f20 2023-10-17T06:07:02.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.984+0000 7f2846b6e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284015de50 con 0x7f28400b1e60 2023-10-17T06:07:02.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.984+0000 7f2846b6e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284015c490 con 0x7f284015cc10 2023-10-17T06:07:02.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.984+0000 7f283ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28400d2f20 0x7f284015bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:02.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.984+0000 7f283ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28400d2f20 0x7f284015bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45280/0 (socket says 172.21.15.125:45280) 2023-10-17T06:07:02.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.984+0000 7f283ffff700 1 -- 172.21.15.125:0/477341318 learned_addr learned my addr 172.21.15.125:0/477341318 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:02.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.984+0000 7f284490a700 1 --2- 172.21.15.125:0/477341318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28400b1e60 0x7f2840153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:02.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.984+0000 7f284510b700 1 --2- 172.21.15.125:0/477341318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f284015cc10 0x7f284015cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:02.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.984+0000 7f283ffff700 1 -- 172.21.15.125:0/477341318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f284015cc10 msgr2=0x7f284015cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:02.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.984+0000 7f283ffff700 1 --2- 172.21.15.125:0/477341318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f284015cc10 0x7f284015cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:02.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.984+0000 7f283ffff700 1 -- 172.21.15.125:0/477341318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28400b1e60 msgr2=0x7f2840153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:02.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.984+0000 7f283ffff700 1 --2- 172.21.15.125:0/477341318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28400b1e60 0x7f2840153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:02.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.984+0000 7f283ffff700 1 -- 172.21.15.125:0/477341318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2834009570 con 0x7f28400d2f20 2023-10-17T06:07:02.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.984+0000 7f283ffff700 1 --2- 172.21.15.125:0/477341318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28400d2f20 0x7f284015bf50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f282c00c560 tx=0x7f282c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:02.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.988+0000 7f283d7fa700 1 -- 172.21.15.125:0/477341318 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c0052d0 con 0x7f28400d2f20 2023-10-17T06:07:02.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.988+0000 7f2846b6e700 1 -- 172.21.15.125:0/477341318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28400b3a00 con 0x7f28400d2f20 2023-10-17T06:07:02.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.988+0000 7f283d7fa700 1 -- 172.21.15.125:0/477341318 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282c005430 con 0x7f28400d2f20 2023-10-17T06:07:02.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.988+0000 7f283d7fa700 1 -- 172.21.15.125:0/477341318 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c0055a0 con 0x7f28400d2f20 2023-10-17T06:07:02.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.988+0000 7f2846b6e700 1 -- 172.21.15.125:0/477341318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284015f4f0 con 0x7f28400d2f20 2023-10-17T06:07:02.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.988+0000 7f2846b6e700 1 -- 172.21.15.125:0/477341318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28400b3b90 con 0x7f28400d2f20 2023-10-17T06:07:02.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.988+0000 7f283d7fa700 1 -- 172.21.15.125:0/477341318 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f282c0038e0 con 0x7f28400d2f20 2023-10-17T06:07:02.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.992+0000 7f283d7fa700 1 --2- 172.21.15.125:0/477341318 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2824065720 0x7f2824067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:02.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.992+0000 7f283d7fa700 1 -- 172.21.15.125:0/477341318 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f282c081f20 con 0x7f28400d2f20 2023-10-17T06:07:02.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.992+0000 7f284490a700 1 --2- 172.21.15.125:0/477341318 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2824065720 0x7f2824067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:02.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:02.992+0000 7f284490a700 1 --2- 172.21.15.125:0/477341318 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2824065720 0x7f2824067be0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f28400d3a20 tx=0x7f2834008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:03.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.000+0000 7f283d7fa700 1 -- 172.21.15.125:0/477341318 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f282c04fcb0 con 0x7f28400d2f20 2023-10-17T06:07:03.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.172+0000 7f2846b6e700 1 -- 172.21.15.125:0/477341318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2840072e60 con 0x7f28400d2f20 2023-10-17T06:07:03.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.176+0000 7f283d7fa700 1 -- 172.21.15.125:0/477341318 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14685 (secure 0 0 0) 0x7f282c0532d0 con 0x7f28400d2f20 2023-10-17T06:07:03.182 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:03.182 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":19,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:02.719351+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:07:03.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.176+0000 7f2846b6e700 1 -- 172.21.15.125:0/477341318 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2824065720 msgr2=0x7f2824067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:03.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.176+0000 7f2846b6e700 1 --2- 172.21.15.125:0/477341318 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2824065720 0x7f2824067be0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f28400d3a20 tx=0x7f2834008030 comp rx=0 tx=0).stop 2023-10-17T06:07:03.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.176+0000 7f2846b6e700 1 -- 172.21.15.125:0/477341318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28400d2f20 msgr2=0x7f284015bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:03.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.176+0000 7f2846b6e700 1 --2- 172.21.15.125:0/477341318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28400d2f20 0x7f284015bf50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f282c00c560 tx=0x7f282c00c870 comp rx=0 tx=0).stop 2023-10-17T06:07:03.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.176+0000 7f2846b6e700 1 -- 172.21.15.125:0/477341318 shutdown_connections 2023-10-17T06:07:03.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.176+0000 7f2846b6e700 1 --2- 172.21.15.125:0/477341318 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2824065720 0x7f2824067be0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:03.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.176+0000 7f2846b6e700 1 --2- 172.21.15.125:0/477341318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f284015cc10 0x7f284015cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:03.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.176+0000 7f2846b6e700 1 --2- 172.21.15.125:0/477341318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28400d2f20 0x7f284015bf50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:03.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.176+0000 7f2846b6e700 1 --2- 172.21.15.125:0/477341318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28400b1e60 0x7f2840153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:03.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.176+0000 7f2846b6e700 1 -- 172.21.15.125:0/477341318 >> 172.21.15.125:0/477341318 conn(0x7f2840069ef0 msgr2=0x7f2840156f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:03.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.176+0000 7f2846b6e700 1 -- 172.21.15.125:0/477341318 shutdown_connections 2023-10-17T06:07:03.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.176+0000 7f2846b6e700 1 -- 172.21.15.125:0/477341318 wait complete. 2023-10-17T06:07:03.205 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-17T06:07:03.205 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:07:03.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.376+0000 7f10f6bbb700 1 Processor -- start 2023-10-17T06:07:03.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.376+0000 7f10f6bbb700 1 -- start start 2023-10-17T06:07:03.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.380+0000 7f10f6bbb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f10f0160710 0x7f10f00b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:03.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.380+0000 7f10f6bbb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10f00b5ae0 0x7f10f006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:03.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.380+0000 7f10f6bbb700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f015d0d0 con 0x7f10f00d2e00 2023-10-17T06:07:03.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.380+0000 7f10f6bbb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f015df90 con 0x7f10f0160710 2023-10-17T06:07:03.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.380+0000 7f10f6bbb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f006f0f0 con 0x7f10f00b5ae0 2023-10-17T06:07:03.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.380+0000 7f10f53b8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f10f0160710 0x7f10f00b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:03.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.380+0000 7f10f5bb9700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f10f00d2e00 0x7f10f00d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:50992/0 (socket says 172.21.15.125:50992) 2023-10-17T06:07:03.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.380+0000 7f10f5bb9700 1 -- 172.21.15.125:0/817399803 learned_addr learned my addr 172.21.15.125:0/817399803 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:03.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.380+0000 7f10f63ba700 1 --2- 172.21.15.125:0/817399803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10f00b5ae0 0x7f10f006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:03.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.380+0000 7f10f53b8700 1 -- 172.21.15.125:0/817399803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10f00b5ae0 msgr2=0x7f10f006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:03.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.380+0000 7f10f53b8700 1 --2- 172.21.15.125:0/817399803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10f00b5ae0 0x7f10f006db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:03.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.380+0000 7f10f53b8700 1 -- 172.21.15.125:0/817399803 >> v1:172.21.15.184:6789/0 conn(0x7f10f00d2e00 legacy=0x7f10f00d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:03.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.380+0000 7f10f53b8700 1 -- 172.21.15.125:0/817399803 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f015d310 con 0x7f10f0160710 2023-10-17T06:07:03.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.380+0000 7f10f53b8700 1 --2- 172.21.15.125:0/817399803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10f0160710 0x7f10f00b6e00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009850 tx=0x7f10e0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de580c4bd3c1e687 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:03.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.380+0000 7f10f4bb7700 1 -- 172.21.15.125:0/817399803 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e0011830 con 0x7f10f0160710 2023-10-17T06:07:03.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.380+0000 7f10f4bb7700 1 -- 172.21.15.125:0/817399803 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e0011990 con 0x7f10f0160710 2023-10-17T06:07:03.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.380+0000 7f10f4bb7700 1 -- 172.21.15.125:0/817399803 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e0011d40 con 0x7f10f0160710 2023-10-17T06:07:03.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.384+0000 7f10f6bbb700 1 -- 172.21.15.125:0/817399803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10f0160710 msgr2=0x7f10f00b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:03.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.384+0000 7f10f6bbb700 1 --2- 172.21.15.125:0/817399803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10f0160710 0x7f10f00b6e00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009850 tx=0x7f10e0009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:03.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.384+0000 7f10f6bbb700 1 -- 172.21.15.125:0/817399803 shutdown_connections 2023-10-17T06:07:03.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.384+0000 7f10f6bbb700 1 --2- 172.21.15.125:0/817399803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10f00b5ae0 0x7f10f006db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:03.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.384+0000 7f10f6bbb700 1 --2- 172.21.15.125:0/817399803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10f0160710 0x7f10f00b6e00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:03.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.384+0000 7f10f6bbb700 1 -- 172.21.15.125:0/817399803 >> 172.21.15.125:0/817399803 conn(0x7f10f0069f20 msgr2=0x7f10f006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:03.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.384+0000 7f10f6bbb700 1 -- 172.21.15.125:0/817399803 shutdown_connections 2023-10-17T06:07:03.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.384+0000 7f10f6bbb700 1 -- 172.21.15.125:0/817399803 wait complete. 2023-10-17T06:07:03.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.384+0000 7f10f6bbb700 1 Processor -- start 2023-10-17T06:07:03.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.384+0000 7f10f6bbb700 1 -- start start 2023-10-17T06:07:03.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10f6bbb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10f00b5ae0 0x7f10f00b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:03.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10f6bbb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10f00d2e00 0x7f10f00ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:03.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10f6bbb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10f0160710 0x7f10f015f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:03.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10f6bbb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f01f5cd0 con 0x7f10f00d2e00 2023-10-17T06:07:03.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10f6bbb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f00b1790 con 0x7f10f0160710 2023-10-17T06:07:03.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10f6bbb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f00ae800 con 0x7f10f00b5ae0 2023-10-17T06:07:03.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10f53b8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10f00d2e00 0x7f10f00ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:03.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10f53b8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10f00d2e00 0x7f10f00ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:45298/0 (socket says 172.21.15.125:45298) 2023-10-17T06:07:03.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10f53b8700 1 -- 172.21.15.125:0/2044229341 learned_addr learned my addr 172.21.15.125:0/2044229341 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:03.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10f63ba700 1 --2- 172.21.15.125:0/2044229341 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10f0160710 0x7f10f015f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:03.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10f5bb9700 1 --2- 172.21.15.125:0/2044229341 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10f00b5ae0 0x7f10f00b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:03.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10f53b8700 1 -- 172.21.15.125:0/2044229341 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10f00b5ae0 msgr2=0x7f10f00b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:03.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10f53b8700 1 --2- 172.21.15.125:0/2044229341 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10f00b5ae0 0x7f10f00b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:03.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10f53b8700 1 -- 172.21.15.125:0/2044229341 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10f0160710 msgr2=0x7f10f015f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:03.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10f53b8700 1 --2- 172.21.15.125:0/2044229341 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10f0160710 0x7f10f015f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:03.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10f53b8700 1 -- 172.21.15.125:0/2044229341 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e00094b0 con 0x7f10f00d2e00 2023-10-17T06:07:03.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10f5bb9700 1 --2- 172.21.15.125:0/2044229341 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10f00b5ae0 0x7f10f00b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:03.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10f53b8700 1 --2- 172.21.15.125:0/2044229341 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10f00d2e00 0x7f10f00ae2c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f10e00090b0 tx=0x7f10e0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:03.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10e67fc700 1 -- 172.21.15.125:0/2044229341 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e00036c0 con 0x7f10f00d2e00 2023-10-17T06:07:03.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10e67fc700 1 -- 172.21.15.125:0/2044229341 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e001e070 con 0x7f10f00d2e00 2023-10-17T06:07:03.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10e67fc700 1 -- 172.21.15.125:0/2044229341 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e0003a80 con 0x7f10f00d2e00 2023-10-17T06:07:03.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10f6bbb700 1 -- 172.21.15.125:0/2044229341 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f01f5f20 con 0x7f10f00d2e00 2023-10-17T06:07:03.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.388+0000 7f10f6bbb700 1 -- 172.21.15.125:0/2044229341 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f01f64e0 con 0x7f10f00d2e00 2023-10-17T06:07:03.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.392+0000 7f10f6bbb700 1 -- 172.21.15.125:0/2044229341 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f004e910 con 0x7f10f00d2e00 2023-10-17T06:07:03.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.392+0000 7f10e67fc700 1 -- 172.21.15.125:0/2044229341 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f10e0003be0 con 0x7f10f00d2e00 2023-10-17T06:07:03.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.392+0000 7f10e67fc700 1 --2- 172.21.15.125:0/2044229341 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f10d4065720 0x7f10d4067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:03.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.392+0000 7f10e67fc700 1 -- 172.21.15.125:0/2044229341 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f10e0020070 con 0x7f10f00d2e00 2023-10-17T06:07:03.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.392+0000 7f10f5bb9700 1 --2- 172.21.15.125:0/2044229341 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f10d4065720 0x7f10d4067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:03.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.396+0000 7f10f5bb9700 1 --2- 172.21.15.125:0/2044229341 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f10d4065720 0x7f10d4067be0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f10ec005cb0 tx=0x7f10ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:03.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.400+0000 7f10e67fc700 1 -- 172.21.15.125:0/2044229341 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f10e0051d40 con 0x7f10f00d2e00 2023-10-17T06:07:03.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.576+0000 7f10f6bbb700 1 -- 172.21.15.125:0/2044229341 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10f006d3e0 con 0x7f10f00d2e00 2023-10-17T06:07:03.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.580+0000 7f10e67fc700 1 -- 172.21.15.125:0/2044229341 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f10e0055360 con 0x7f10f00d2e00 2023-10-17T06:07:03.585 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:07:03.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.580+0000 7f10f6bbb700 1 -- 172.21.15.125:0/2044229341 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f10d4065720 msgr2=0x7f10d4067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:03.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.580+0000 7f10f6bbb700 1 --2- 172.21.15.125:0/2044229341 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f10d4065720 0x7f10d4067be0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f10ec005cb0 tx=0x7f10ec009040 comp rx=0 tx=0).stop 2023-10-17T06:07:03.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.580+0000 7f10f6bbb700 1 -- 172.21.15.125:0/2044229341 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10f00d2e00 msgr2=0x7f10f00ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:03.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.580+0000 7f10f6bbb700 1 --2- 172.21.15.125:0/2044229341 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10f00d2e00 0x7f10f00ae2c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f10e00090b0 tx=0x7f10e0004770 comp rx=0 tx=0).stop 2023-10-17T06:07:03.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.580+0000 7f10f6bbb700 1 -- 172.21.15.125:0/2044229341 shutdown_connections 2023-10-17T06:07:03.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.580+0000 7f10f6bbb700 1 --2- 172.21.15.125:0/2044229341 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f10d4065720 0x7f10d4067be0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:03.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.580+0000 7f10f6bbb700 1 --2- 172.21.15.125:0/2044229341 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10f0160710 0x7f10f015f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:03.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.580+0000 7f10f6bbb700 1 --2- 172.21.15.125:0/2044229341 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f10f00d2e00 0x7f10f00ae2c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:03.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.580+0000 7f10f6bbb700 1 --2- 172.21.15.125:0/2044229341 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10f00b5ae0 0x7f10f00b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:03.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.580+0000 7f10f6bbb700 1 -- 172.21.15.125:0/2044229341 >> 172.21.15.125:0/2044229341 conn(0x7f10f0069f20 msgr2=0x7f10f00b47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:03.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.580+0000 7f10f6bbb700 1 -- 172.21.15.125:0/2044229341 shutdown_connections 2023-10-17T06:07:03.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.580+0000 7f10f6bbb700 1 -- 172.21.15.125:0/2044229341 wait complete. 2023-10-17T06:07:03.608 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:07:03.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.784+0000 7faf272df700 1 Processor -- start 2023-10-17T06:07:03.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.784+0000 7faf272df700 1 -- start start 2023-10-17T06:07:03.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf272df700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf20160710 0x7faf200b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:03.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf272df700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faf200b5ae0 0x7faf2006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:03.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf272df700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf2015d0d0 con 0x7faf200d2e00 2023-10-17T06:07:03.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf272df700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2015df90 con 0x7faf20160710 2023-10-17T06:07:03.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf272df700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2006f0f0 con 0x7faf200b5ae0 2023-10-17T06:07:03.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf25adc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf20160710 0x7faf200b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:03.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf25adc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf20160710 0x7faf200b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35072/0 (socket says 172.21.15.125:35072) 2023-10-17T06:07:03.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf25adc700 1 -- 172.21.15.125:0/1355203193 learned_addr learned my addr 172.21.15.125:0/1355203193 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:03.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf26ade700 1 --2- 172.21.15.125:0/1355203193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faf200b5ae0 0x7faf2006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:03.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf25adc700 1 -- 172.21.15.125:0/1355203193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faf200b5ae0 msgr2=0x7faf2006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:03.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf25adc700 1 --2- 172.21.15.125:0/1355203193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faf200b5ae0 0x7faf2006db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:03.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf25adc700 1 -- 172.21.15.125:0/1355203193 >> v1:172.21.15.125:6789/0 conn(0x7faf200d2e00 legacy=0x7faf200d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:03.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf25adc700 1 -- 172.21.15.125:0/1355203193 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2015d310 con 0x7faf20160710 2023-10-17T06:07:03.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf26ade700 1 --2- 172.21.15.125:0/1355203193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faf200b5ae0 0x7faf2006db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:03.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf25adc700 1 --2- 172.21.15.125:0/1355203193 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf20160710 0x7faf200b6e00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faf10009910 tx=0x7faf10009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7183c6843eaeec7c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:03.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf252db700 1 -- 172.21.15.125:0/1355203193 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1000ba60 con 0x7faf20160710 2023-10-17T06:07:03.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf252db700 1 -- 172.21.15.125:0/1355203193 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1000bbc0 con 0x7faf20160710 2023-10-17T06:07:03.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf252db700 1 -- 172.21.15.125:0/1355203193 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf10009e60 con 0x7faf20160710 2023-10-17T06:07:03.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf272df700 1 -- 172.21.15.125:0/1355203193 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf20160710 msgr2=0x7faf200b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:03.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf272df700 1 --2- 172.21.15.125:0/1355203193 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf20160710 0x7faf200b6e00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faf10009910 tx=0x7faf10009c20 comp rx=0 tx=0).stop 2023-10-17T06:07:03.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf272df700 1 -- 172.21.15.125:0/1355203193 shutdown_connections 2023-10-17T06:07:03.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf272df700 1 --2- 172.21.15.125:0/1355203193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faf200b5ae0 0x7faf2006db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:03.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf272df700 1 --2- 172.21.15.125:0/1355203193 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf20160710 0x7faf200b6e00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:03.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf272df700 1 -- 172.21.15.125:0/1355203193 >> 172.21.15.125:0/1355203193 conn(0x7faf20069f20 msgr2=0x7faf2006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:03.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf272df700 1 -- 172.21.15.125:0/1355203193 shutdown_connections 2023-10-17T06:07:03.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.788+0000 7faf272df700 1 -- 172.21.15.125:0/1355203193 wait complete. 2023-10-17T06:07:03.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.792+0000 7faf272df700 1 Processor -- start 2023-10-17T06:07:03.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.792+0000 7faf272df700 1 -- start start 2023-10-17T06:07:03.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.792+0000 7faf272df700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf200b5ae0 0x7faf2015a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:03.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.792+0000 7faf272df700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf200d2e00 0x7faf201f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:03.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.792+0000 7faf272df700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faf20160710 0x7faf201f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:03.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.792+0000 7faf272df700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf200af520 con 0x7faf200d2e00 2023-10-17T06:07:03.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.792+0000 7faf272df700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf201f6850 con 0x7faf200b5ae0 2023-10-17T06:07:03.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.792+0000 7faf272df700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf201f6b30 con 0x7faf20160710 2023-10-17T06:07:03.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.792+0000 7faf25adc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf200d2e00 0x7faf201f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:03.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.792+0000 7faf25adc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf200d2e00 0x7faf201f5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35084/0 (socket says 172.21.15.125:35084) 2023-10-17T06:07:03.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.792+0000 7faf25adc700 1 -- 172.21.15.125:0/995645609 learned_addr learned my addr 172.21.15.125:0/995645609 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:03.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.792+0000 7faf26ade700 1 --2- 172.21.15.125:0/995645609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faf20160710 0x7faf201f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:03.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.792+0000 7faf262dd700 1 --2- 172.21.15.125:0/995645609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf200b5ae0 0x7faf2015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:03.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.792+0000 7faf25adc700 1 -- 172.21.15.125:0/995645609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faf20160710 msgr2=0x7faf201f6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:03.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.792+0000 7faf25adc700 1 --2- 172.21.15.125:0/995645609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faf20160710 0x7faf201f6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:03.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.792+0000 7faf25adc700 1 -- 172.21.15.125:0/995645609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf200b5ae0 msgr2=0x7faf2015a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:03.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.792+0000 7faf25adc700 1 --2- 172.21.15.125:0/995645609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf200b5ae0 0x7faf2015a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:03.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.792+0000 7faf25adc700 1 -- 172.21.15.125:0/995645609 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf10009570 con 0x7faf200d2e00 2023-10-17T06:07:03.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.796+0000 7faf262dd700 1 --2- 172.21.15.125:0/995645609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf200b5ae0 0x7faf2015a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:03.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.796+0000 7faf25adc700 1 --2- 172.21.15.125:0/995645609 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf200d2e00 0x7faf201f5ce0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faf10009150 tx=0x7faf10004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:03.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.796+0000 7faf16ffd700 1 -- 172.21.15.125:0/995645609 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf10004610 con 0x7faf200d2e00 2023-10-17T06:07:03.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.796+0000 7faf16ffd700 1 -- 172.21.15.125:0/995645609 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1001e070 con 0x7faf200d2e00 2023-10-17T06:07:03.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.796+0000 7faf16ffd700 1 -- 172.21.15.125:0/995645609 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf100038e0 con 0x7faf200d2e00 2023-10-17T06:07:03.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.796+0000 7faf272df700 1 -- 172.21.15.125:0/995645609 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf200acb90 con 0x7faf200d2e00 2023-10-17T06:07:03.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.796+0000 7faf272df700 1 -- 172.21.15.125:0/995645609 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf200ad150 con 0x7faf200d2e00 2023-10-17T06:07:03.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.796+0000 7faf272df700 1 -- 172.21.15.125:0/995645609 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf200b7f20 con 0x7faf200d2e00 2023-10-17T06:07:03.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.800+0000 7faf16ffd700 1 -- 172.21.15.125:0/995645609 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7faf10003a40 con 0x7faf200d2e00 2023-10-17T06:07:03.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.800+0000 7faf16ffd700 1 --2- 172.21.15.125:0/995645609 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7faf04065770 0x7faf04067c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:03.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.800+0000 7faf16ffd700 1 -- 172.21.15.125:0/995645609 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7faf10020070 con 0x7faf200d2e00 2023-10-17T06:07:03.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.800+0000 7faf262dd700 1 --2- 172.21.15.125:0/995645609 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7faf04065770 0x7faf04067c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:03.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.804+0000 7faf262dd700 1 --2- 172.21.15.125:0/995645609 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7faf04065770 0x7faf04067c30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faf1c000f60 tx=0x7faf1c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:03.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.808+0000 7faf16ffd700 1 -- 172.21.15.125:0/995645609 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7faf10051cb0 con 0x7faf200d2e00 2023-10-17T06:07:03.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.992+0000 7faf272df700 1 -- 172.21.15.125:0/995645609 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faf200ad340 con 0x7faf200d2e00 2023-10-17T06:07:03.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.992+0000 7faf16ffd700 1 -- 172.21.15.125:0/995645609 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7faf100552d0 con 0x7faf200d2e00 2023-10-17T06:07:03.999 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:07:04.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.996+0000 7faf272df700 1 -- 172.21.15.125:0/995645609 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7faf04065770 msgr2=0x7faf04067c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:04.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.996+0000 7faf272df700 1 --2- 172.21.15.125:0/995645609 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7faf04065770 0x7faf04067c30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7faf1c000f60 tx=0x7faf1c009040 comp rx=0 tx=0).stop 2023-10-17T06:07:04.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.996+0000 7faf272df700 1 -- 172.21.15.125:0/995645609 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf200d2e00 msgr2=0x7faf201f5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:04.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.996+0000 7faf272df700 1 --2- 172.21.15.125:0/995645609 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf200d2e00 0x7faf201f5ce0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faf10009150 tx=0x7faf10004770 comp rx=0 tx=0).stop 2023-10-17T06:07:04.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.996+0000 7faf272df700 1 -- 172.21.15.125:0/995645609 shutdown_connections 2023-10-17T06:07:04.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.996+0000 7faf272df700 1 --2- 172.21.15.125:0/995645609 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7faf04065770 0x7faf04067c30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.996+0000 7faf272df700 1 --2- 172.21.15.125:0/995645609 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faf20160710 0x7faf201f6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.996+0000 7faf272df700 1 --2- 172.21.15.125:0/995645609 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf200d2e00 0x7faf201f5ce0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.996+0000 7faf272df700 1 --2- 172.21.15.125:0/995645609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faf200b5ae0 0x7faf2015a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.996+0000 7faf272df700 1 -- 172.21.15.125:0/995645609 >> 172.21.15.125:0/995645609 conn(0x7faf20069f20 msgr2=0x7faf2015c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:04.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.996+0000 7faf272df700 1 -- 172.21.15.125:0/995645609 shutdown_connections 2023-10-17T06:07:04.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:03.996+0000 7faf272df700 1 -- 172.21.15.125:0/995645609 wait complete. 2023-10-17T06:07:04.022 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:07:04.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.188+0000 7f284359e700 1 Processor -- start 2023-10-17T06:07:04.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.188+0000 7f284359e700 1 -- start start 2023-10-17T06:07:04.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.188+0000 7f284359e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2844159750 0x7f2844070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:04.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.188+0000 7f284359e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f28440ce040 0x7f284406cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:04.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.188+0000 7f284359e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2844070f00 con 0x7f2844070aa0 2023-10-17T06:07:04.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.188+0000 7f284359e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28440c9aa0 con 0x7f28440ce040 2023-10-17T06:07:04.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.188+0000 7f284359e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28440b14f0 con 0x7f2844159750 2023-10-17T06:07:04.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.188+0000 7f284259c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2844159750 0x7f2844070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:04.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.188+0000 7f284259c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2844159750 0x7f2844070560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:49720/0 (socket says 172.21.15.125:49720) 2023-10-17T06:07:04.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.188+0000 7f284259c700 1 -- 172.21.15.125:0/2564080695 learned_addr learned my addr 172.21.15.125:0/2564080695 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:04.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.188+0000 7f283bfff700 1 --1- 172.21.15.125:0/2564080695 >> v1:172.21.15.184:6789/0 conn(0x7f2844070aa0 0x7f28440cd930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:47532/0 (socket says 172.21.15.125:47532) 2023-10-17T06:07:04.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.188+0000 7f2842d9d700 1 --2- 172.21.15.125:0/2564080695 >> v2:172.21.15.184:3300/0 conn(0x7f28440ce040 0x7f284406cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:04.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.192+0000 7f284259c700 1 -- 172.21.15.125:0/2564080695 >> v2:172.21.15.184:3300/0 conn(0x7f28440ce040 msgr2=0x7f284406cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:04.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.192+0000 7f284259c700 1 --2- 172.21.15.125:0/2564080695 >> v2:172.21.15.184:3300/0 conn(0x7f28440ce040 0x7f284406cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.192+0000 7f284259c700 1 -- 172.21.15.125:0/2564080695 >> v1:172.21.15.184:6789/0 conn(0x7f2844070aa0 legacy=0x7f28440cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:04.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.192+0000 7f284259c700 1 -- 172.21.15.125:0/2564080695 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284415d590 con 0x7f2844159750 2023-10-17T06:07:04.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.192+0000 7f284259c700 1 --2- 172.21.15.125:0/2564080695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2844159750 0x7f2844070560 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2834009910 tx=0x7f2834009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed7344611f532cbd server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:04.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.192+0000 7f2841d9b700 1 -- 172.21.15.125:0/2564080695 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2834011830 con 0x7f2844159750 2023-10-17T06:07:04.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.192+0000 7f2841d9b700 1 -- 172.21.15.125:0/2564080695 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2834011990 con 0x7f2844159750 2023-10-17T06:07:04.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.192+0000 7f2841d9b700 1 -- 172.21.15.125:0/2564080695 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2834011d40 con 0x7f2844159750 2023-10-17T06:07:04.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.192+0000 7f284359e700 1 -- 172.21.15.125:0/2564080695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2844159750 msgr2=0x7f2844070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:04.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.192+0000 7f284359e700 1 --2- 172.21.15.125:0/2564080695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2844159750 0x7f2844070560 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2834009910 tx=0x7f2834009c20 comp rx=0 tx=0).stop 2023-10-17T06:07:04.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.192+0000 7f284359e700 1 -- 172.21.15.125:0/2564080695 shutdown_connections 2023-10-17T06:07:04.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.192+0000 7f284359e700 1 --2- 172.21.15.125:0/2564080695 >> v2:172.21.15.184:3300/0 conn(0x7f28440ce040 0x7f284406cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.192+0000 7f284359e700 1 --2- 172.21.15.125:0/2564080695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2844159750 0x7f2844070560 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.192+0000 7f284359e700 1 -- 172.21.15.125:0/2564080695 >> 172.21.15.125:0/2564080695 conn(0x7f28440ce5c0 msgr2=0x7f28440ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:04.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.192+0000 7f284359e700 1 -- 172.21.15.125:0/2564080695 shutdown_connections 2023-10-17T06:07:04.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.192+0000 7f284359e700 1 -- 172.21.15.125:0/2564080695 wait complete. 2023-10-17T06:07:04.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.196+0000 7f284359e700 1 Processor -- start 2023-10-17T06:07:04.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.196+0000 7f284359e700 1 -- start start 2023-10-17T06:07:04.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.196+0000 7f284359e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2844070aa0 0x7f284414bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:04.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.196+0000 7f284359e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28440ce040 0x7f284414f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:04.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.196+0000 7f284359e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2844159750 0x7f28440c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:04.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.196+0000 7f284359e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284414b9d0 con 0x7f28440ce040 2023-10-17T06:07:04.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.196+0000 7f284359e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284414ad50 con 0x7f2844159750 2023-10-17T06:07:04.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.196+0000 7f284359e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284414b030 con 0x7f2844070aa0 2023-10-17T06:07:04.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.196+0000 7f283bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28440ce040 0x7f284414f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:04.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.196+0000 7f283bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28440ce040 0x7f284414f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35086/0 (socket says 172.21.15.125:35086) 2023-10-17T06:07:04.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.196+0000 7f283bfff700 1 -- 172.21.15.125:0/3414186700 learned_addr learned my addr 172.21.15.125:0/3414186700 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:04.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.196+0000 7f284259c700 1 --2- 172.21.15.125:0/3414186700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2844070aa0 0x7f284414bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.200+0000 7f2842d9d700 1 --2- 172.21.15.125:0/3414186700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2844159750 0x7f28440c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.200+0000 7f283bfff700 1 -- 172.21.15.125:0/3414186700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2844070aa0 msgr2=0x7f284414bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.200+0000 7f283bfff700 1 --2- 172.21.15.125:0/3414186700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2844070aa0 0x7f284414bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.200+0000 7f283bfff700 1 -- 172.21.15.125:0/3414186700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2844159750 msgr2=0x7f28440c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.200+0000 7f283bfff700 1 --2- 172.21.15.125:0/3414186700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2844159750 0x7f28440c3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.200+0000 7f283bfff700 1 -- 172.21.15.125:0/3414186700 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2834009570 con 0x7f28440ce040 2023-10-17T06:07:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.200+0000 7f2842d9d700 1 --2- 172.21.15.125:0/3414186700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2844159750 0x7f28440c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:04.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.200+0000 7f283bfff700 1 --2- 172.21.15.125:0/3414186700 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28440ce040 0x7f284414f560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f282c00c4d0 tx=0x7f282c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:04.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.200+0000 7f283affd700 1 -- 172.21.15.125:0/3414186700 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c005cd0 con 0x7f28440ce040 2023-10-17T06:07:04.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.200+0000 7f283affd700 1 -- 172.21.15.125:0/3414186700 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282c005e30 con 0x7f28440ce040 2023-10-17T06:07:04.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.200+0000 7f284359e700 1 -- 172.21.15.125:0/3414186700 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284414b310 con 0x7f28440ce040 2023-10-17T06:07:04.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.200+0000 7f283affd700 1 -- 172.21.15.125:0/3414186700 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c0072d0 con 0x7f28440ce040 2023-10-17T06:07:04.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.200+0000 7f284359e700 1 -- 172.21.15.125:0/3414186700 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284414a2e0 con 0x7f28440ce040 2023-10-17T06:07:04.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.200+0000 7f284359e700 1 -- 172.21.15.125:0/3414186700 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2844072e60 con 0x7f28440ce040 2023-10-17T06:07:04.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.204+0000 7f283affd700 1 -- 172.21.15.125:0/3414186700 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f282c007430 con 0x7f28440ce040 2023-10-17T06:07:04.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.204+0000 7f283affd700 1 --2- 172.21.15.125:0/3414186700 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f28240656f0 0x7f2824067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:04.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.204+0000 7f283affd700 1 -- 172.21.15.125:0/3414186700 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f282c081e70 con 0x7f28440ce040 2023-10-17T06:07:04.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.204+0000 7f284259c700 1 --2- 172.21.15.125:0/3414186700 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f28240656f0 0x7f2824067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:04.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.208+0000 7f284259c700 1 --2- 172.21.15.125:0/3414186700 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f28240656f0 0x7f2824067bb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f284414f4d0 tx=0x7f2834008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:04.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.212+0000 7f283affd700 1 -- 172.21.15.125:0/3414186700 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f282c04fc10 con 0x7f28440ce040 2023-10-17T06:07:04.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.440+0000 7f284359e700 1 -- 172.21.15.125:0/3414186700 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28440ca240 con 0x7f28440ce040 2023-10-17T06:07:04.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.440+0000 7f283affd700 1 -- 172.21.15.125:0/3414186700 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7f282c053230 con 0x7f28440ce040 2023-10-17T06:07:04.448 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:04.449 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/3744648044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3744648044},{"type":"v1","addr":"172.21.15.184:6833","nonce":3744648044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/181458401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181458401},{"type":"v1","addr":"172.21.15.184:6835","nonce":181458401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/908363262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":908363262},{"type":"v1","addr":"172.21.15.125:6835","nonce":908363262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/3617198893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":3617198893},{"type":"v1","addr":"172.21.15.125:6837","nonce":3617198893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-17T06:07:04.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.444+0000 7f284359e700 1 -- 172.21.15.125:0/3414186700 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f28240656f0 msgr2=0x7f2824067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:04.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.444+0000 7f284359e700 1 --2- 172.21.15.125:0/3414186700 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f28240656f0 0x7f2824067bb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f284414f4d0 tx=0x7f2834008030 comp rx=0 tx=0).stop 2023-10-17T06:07:04.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.444+0000 7f284359e700 1 -- 172.21.15.125:0/3414186700 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28440ce040 msgr2=0x7f284414f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:04.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.444+0000 7f284359e700 1 --2- 172.21.15.125:0/3414186700 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28440ce040 0x7f284414f560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f282c00c4d0 tx=0x7f282c00c890 comp rx=0 tx=0).stop 2023-10-17T06:07:04.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.444+0000 7f284359e700 1 -- 172.21.15.125:0/3414186700 shutdown_connections 2023-10-17T06:07:04.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.444+0000 7f284359e700 1 --2- 172.21.15.125:0/3414186700 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f28240656f0 0x7f2824067bb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.444+0000 7f284359e700 1 --2- 172.21.15.125:0/3414186700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2844159750 0x7f28440c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.444+0000 7f284359e700 1 --2- 172.21.15.125:0/3414186700 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28440ce040 0x7f284414f560 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.444+0000 7f284359e700 1 --2- 172.21.15.125:0/3414186700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2844070aa0 0x7f284414bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.444+0000 7f284359e700 1 -- 172.21.15.125:0/3414186700 >> 172.21.15.125:0/3414186700 conn(0x7f28440ce5c0 msgr2=0x7f28440cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:04.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.444+0000 7f284359e700 1 -- 172.21.15.125:0/3414186700 shutdown_connections 2023-10-17T06:07:04.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.444+0000 7f284359e700 1 -- 172.21.15.125:0/3414186700 wait complete. 2023-10-17T06:07:04.454 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 3 2023-10-17T06:07:04.475 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:07:04.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.644+0000 7fd50933a700 1 Processor -- start 2023-10-17T06:07:04.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.644+0000 7fd50933a700 1 -- start start 2023-10-17T06:07:04.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.648+0000 7fd50933a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd50415cc10 0x7fd504070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:04.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.648+0000 7fd50933a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd5040b1e60 0x7fd5040cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:04.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.648+0000 7fd50933a700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50406d220 con 0x7fd5040d2f20 2023-10-17T06:07:04.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.648+0000 7fd50933a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd50406eef0 con 0x7fd5040b1e60 2023-10-17T06:07:04.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.648+0000 7fd50933a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50406ec10 con 0x7fd50415cc10 2023-10-17T06:07:04.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.648+0000 7fd5037fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fd5040d2f20 0x7fd5040d0a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:47540/0 (socket says 172.21.15.125:47540) 2023-10-17T06:07:04.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.648+0000 7fd4fbfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd5040b1e60 0x7fd5040cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:04.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.648+0000 7fd5037fe700 1 -- 172.21.15.125:0/4081017695 learned_addr learned my addr 172.21.15.125:0/4081017695 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:04.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.648+0000 7fd502ffd700 1 --2- 172.21.15.125:0/4081017695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd50415cc10 0x7fd504070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:04.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.652+0000 7fd4fbfff700 1 -- 172.21.15.125:0/4081017695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd50415cc10 msgr2=0x7fd504070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:04.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.652+0000 7fd4fbfff700 1 --2- 172.21.15.125:0/4081017695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd50415cc10 0x7fd504070a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.652+0000 7fd4fbfff700 1 -- 172.21.15.125:0/4081017695 >> v1:172.21.15.184:6789/0 conn(0x7fd5040d2f20 legacy=0x7fd5040d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:04.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.652+0000 7fd4fbfff700 1 -- 172.21.15.125:0/4081017695 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5040d24e0 con 0x7fd5040b1e60 2023-10-17T06:07:04.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.652+0000 7fd5027fc700 1 -- 172.21.15.125:0/4081017695 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511637945 0 0) 0x7fd50406d220 con 0x7fd5040d2f20 2023-10-17T06:07:04.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.652+0000 7fd4fbfff700 1 --2- 172.21.15.125:0/4081017695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5040b1e60 0x7fd5040cfd50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009850 tx=0x7fd4ec009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6643322bf21ab5dc server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:04.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.652+0000 7fd5027fc700 1 -- 172.21.15.125:0/4081017695 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec011830 con 0x7fd5040b1e60 2023-10-17T06:07:04.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.652+0000 7fd5027fc700 1 -- 172.21.15.125:0/4081017695 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec011990 con 0x7fd5040b1e60 2023-10-17T06:07:04.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.652+0000 7fd5027fc700 1 -- 172.21.15.125:0/4081017695 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec011d40 con 0x7fd5040b1e60 2023-10-17T06:07:04.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.652+0000 7fd50933a700 1 -- 172.21.15.125:0/4081017695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5040b1e60 msgr2=0x7fd5040cfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:04.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.652+0000 7fd50933a700 1 --2- 172.21.15.125:0/4081017695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5040b1e60 0x7fd5040cfd50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009850 tx=0x7fd4ec009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:04.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.652+0000 7fd50933a700 1 -- 172.21.15.125:0/4081017695 shutdown_connections 2023-10-17T06:07:04.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.652+0000 7fd50933a700 1 --2- 172.21.15.125:0/4081017695 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5040b1e60 0x7fd5040cfd50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.652+0000 7fd50933a700 1 --2- 172.21.15.125:0/4081017695 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd50415cc10 0x7fd504070a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.652+0000 7fd50933a700 1 -- 172.21.15.125:0/4081017695 >> 172.21.15.125:0/4081017695 conn(0x7fd504069ef0 msgr2=0x7fd50406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:04.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.652+0000 7fd50933a700 1 -- 172.21.15.125:0/4081017695 shutdown_connections 2023-10-17T06:07:04.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.652+0000 7fd50933a700 1 -- 172.21.15.125:0/4081017695 wait complete. 2023-10-17T06:07:04.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.656+0000 7fd50933a700 1 Processor -- start 2023-10-17T06:07:04.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.656+0000 7fd50933a700 1 -- start start 2023-10-17T06:07:04.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.656+0000 7fd50933a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5040b1e60 0x7fd504154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:04.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.656+0000 7fd50933a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5040d2f20 0x7fd50415cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:04.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.656+0000 7fd50933a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd50415cc10 0x7fd50415d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:04.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.656+0000 7fd50933a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd504154230 con 0x7fd5040d2f20 2023-10-17T06:07:04.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.656+0000 7fd50933a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd504145800 con 0x7fd5040b1e60 2023-10-17T06:07:04.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.656+0000 7fd50933a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd504145ae0 con 0x7fd50415cc10 2023-10-17T06:07:04.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.656+0000 7fd4fbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5040d2f20 0x7fd50415cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:04.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.656+0000 7fd4fbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5040d2f20 0x7fd50415cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35090/0 (socket says 172.21.15.125:35090) 2023-10-17T06:07:04.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.656+0000 7fd4fbfff700 1 -- 172.21.15.125:0/530091254 learned_addr learned my addr 172.21.15.125:0/530091254 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:04.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.656+0000 7fd5037fe700 1 --2- 172.21.15.125:0/530091254 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd50415cc10 0x7fd50415d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:04.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.656+0000 7fd502ffd700 1 --2- 172.21.15.125:0/530091254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5040b1e60 0x7fd504154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:04.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.656+0000 7fd4fbfff700 1 -- 172.21.15.125:0/530091254 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd50415cc10 msgr2=0x7fd50415d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:04.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.656+0000 7fd4fbfff700 1 --2- 172.21.15.125:0/530091254 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd50415cc10 0x7fd50415d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.656+0000 7fd4fbfff700 1 -- 172.21.15.125:0/530091254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5040b1e60 msgr2=0x7fd504154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:04.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.656+0000 7fd4fbfff700 1 --2- 172.21.15.125:0/530091254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5040b1e60 0x7fd504154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.656+0000 7fd4fbfff700 1 -- 172.21.15.125:0/530091254 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec0094b0 con 0x7fd5040d2f20 2023-10-17T06:07:04.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.656+0000 7fd502ffd700 1 --2- 172.21.15.125:0/530091254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5040b1e60 0x7fd504154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:04.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.660+0000 7fd4fbfff700 1 --2- 172.21.15.125:0/530091254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5040d2f20 0x7fd50415cff0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec000c00 tx=0x7fd4ec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:04.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.660+0000 7fd4fb7fe700 1 -- 172.21.15.125:0/530091254 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec01aac0 con 0x7fd5040d2f20 2023-10-17T06:07:04.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.660+0000 7fd4fb7fe700 1 -- 172.21.15.125:0/530091254 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec01f070 con 0x7fd5040d2f20 2023-10-17T06:07:04.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.660+0000 7fd50933a700 1 -- 172.21.15.125:0/530091254 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd504154440 con 0x7fd5040d2f20 2023-10-17T06:07:04.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.660+0000 7fd4fb7fe700 1 -- 172.21.15.125:0/530091254 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec01ae60 con 0x7fd5040d2f20 2023-10-17T06:07:04.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.660+0000 7fd50933a700 1 -- 172.21.15.125:0/530091254 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd504155ef0 con 0x7fd5040d2f20 2023-10-17T06:07:04.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.660+0000 7fd50933a700 1 -- 172.21.15.125:0/530091254 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd504145cf0 con 0x7fd5040d2f20 2023-10-17T06:07:04.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.664+0000 7fd4fb7fe700 1 -- 172.21.15.125:0/530091254 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd4ec02e450 con 0x7fd5040d2f20 2023-10-17T06:07:04.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.664+0000 7fd4fb7fe700 1 --2- 172.21.15.125:0/530091254 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd4e80656f0 0x7fd4e8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:04.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.664+0000 7fd4fb7fe700 1 -- 172.21.15.125:0/530091254 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd4ec083c00 con 0x7fd5040d2f20 2023-10-17T06:07:04.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.664+0000 7fd502ffd700 1 --2- 172.21.15.125:0/530091254 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd4e80656f0 0x7fd4e8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:04.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.664+0000 7fd502ffd700 1 --2- 172.21.15.125:0/530091254 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd4e80656f0 0x7fd4e8067bb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009ad0 tx=0x7fd4f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:04.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.668+0000 7fd4fb7fe700 1 -- 172.21.15.125:0/530091254 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fd504145cf0 con 0x7fd5040d2f20 2023-10-17T06:07:04.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.848+0000 7fd50933a700 1 -- 172.21.15.125:0/530091254 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd504154960 con 0x7fd5040d2f20 2023-10-17T06:07:04.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.848+0000 7fd4fb7fe700 1 -- 172.21.15.125:0/530091254 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14672 (secure 0 0 0) 0x7fd504154960 con 0x7fd5040d2f20 2023-10-17T06:07:04.855 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:04.856 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":20,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:03.731546+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:07:04.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.852+0000 7fd50933a700 1 -- 172.21.15.125:0/530091254 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd4e80656f0 msgr2=0x7fd4e8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:04.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.852+0000 7fd50933a700 1 --2- 172.21.15.125:0/530091254 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd4e80656f0 0x7fd4e8067bb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009ad0 tx=0x7fd4f4008040 comp rx=0 tx=0).stop 2023-10-17T06:07:04.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.852+0000 7fd50933a700 1 -- 172.21.15.125:0/530091254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5040d2f20 msgr2=0x7fd50415cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:04.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.852+0000 7fd50933a700 1 --2- 172.21.15.125:0/530091254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5040d2f20 0x7fd50415cff0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec000c00 tx=0x7fd4ec004770 comp rx=0 tx=0).stop 2023-10-17T06:07:04.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.852+0000 7fd50933a700 1 -- 172.21.15.125:0/530091254 shutdown_connections 2023-10-17T06:07:04.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.852+0000 7fd50933a700 1 --2- 172.21.15.125:0/530091254 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd4e80656f0 0x7fd4e8067bb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.852+0000 7fd50933a700 1 --2- 172.21.15.125:0/530091254 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd50415cc10 0x7fd50415d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.852+0000 7fd50933a700 1 --2- 172.21.15.125:0/530091254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5040d2f20 0x7fd50415cff0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.852+0000 7fd50933a700 1 --2- 172.21.15.125:0/530091254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5040b1e60 0x7fd504154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:04.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.852+0000 7fd50933a700 1 -- 172.21.15.125:0/530091254 >> 172.21.15.125:0/530091254 conn(0x7fd504069ef0 msgr2=0x7fd504158730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:04.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.852+0000 7fd50933a700 1 -- 172.21.15.125:0/530091254 shutdown_connections 2023-10-17T06:07:04.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:04.852+0000 7fd50933a700 1 -- 172.21.15.125:0/530091254 wait complete. 2023-10-17T06:07:04.879 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-17T06:07:04.880 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:07:05.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9c08cc700 1 Processor -- start 2023-10-17T06:07:05.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9c08cc700 1 -- start start 2023-10-17T06:07:05.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9c08cc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff9bc1590d0 0x7ff9bc0cd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:05.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9c08cc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff9bc0cd240 0x7ff9bc0cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:05.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9c08cc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9bc0cccf0 con 0x7ff9bc070b00 2023-10-17T06:07:05.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9c08cc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9bc0ce550 con 0x7ff9bc1590d0 2023-10-17T06:07:05.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9c08cc700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9bc070670 con 0x7ff9bc0cd240 2023-10-17T06:07:05.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9bad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff9bc1590d0 0x7ff9bc0cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:05.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9bad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff9bc1590d0 0x7ff9bc0cd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35092/0 (socket says 172.21.15.125:35092) 2023-10-17T06:07:05.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9bad9d700 1 -- 172.21.15.125:0/2878785995 learned_addr learned my addr 172.21.15.125:0/2878785995 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:05.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9ba59c700 1 --2- 172.21.15.125:0/2878785995 >> v2:172.21.15.184:3300/0 conn(0x7ff9bc0cd240 0x7ff9bc0cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:05.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9bad9d700 1 -- 172.21.15.125:0/2878785995 >> v2:172.21.15.184:3300/0 conn(0x7ff9bc0cd240 msgr2=0x7ff9bc0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:05.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9bad9d700 1 --2- 172.21.15.125:0/2878785995 >> v2:172.21.15.184:3300/0 conn(0x7ff9bc0cd240 0x7ff9bc0cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9bad9d700 1 -- 172.21.15.125:0/2878785995 >> v1:172.21.15.184:6789/0 conn(0x7ff9bc070b00 legacy=0x7ff9bc06f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:05.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9bad9d700 1 -- 172.21.15.125:0/2878785995 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc0ccf40 con 0x7ff9bc1590d0 2023-10-17T06:07:05.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9bad9d700 1 --2- 172.21.15.125:0/2878785995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9bc1590d0 0x7ff9bc0cd790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc06d030 tx=0x7ff9ac009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1105a87cd43f0b server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:05.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9b9d9b700 1 -- 172.21.15.125:0/2878785995 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac00b8a0 con 0x7ff9bc1590d0 2023-10-17T06:07:05.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9b9d9b700 1 -- 172.21.15.125:0/2878785995 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac00ba00 con 0x7ff9bc1590d0 2023-10-17T06:07:05.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9b9d9b700 1 -- 172.21.15.125:0/2878785995 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac00bd90 con 0x7ff9bc1590d0 2023-10-17T06:07:05.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9c08cc700 1 -- 172.21.15.125:0/2878785995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9bc1590d0 msgr2=0x7ff9bc0cd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:05.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9c08cc700 1 --2- 172.21.15.125:0/2878785995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9bc1590d0 0x7ff9bc0cd790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc06d030 tx=0x7ff9ac009bf0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9c08cc700 1 -- 172.21.15.125:0/2878785995 shutdown_connections 2023-10-17T06:07:05.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9c08cc700 1 --2- 172.21.15.125:0/2878785995 >> v2:172.21.15.184:3300/0 conn(0x7ff9bc0cd240 0x7ff9bc0cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9c08cc700 1 --2- 172.21.15.125:0/2878785995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9bc1590d0 0x7ff9bc0cd790 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9c08cc700 1 -- 172.21.15.125:0/2878785995 >> 172.21.15.125:0/2878785995 conn(0x7ff9bc0cb9f0 msgr2=0x7ff9bc0cbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:05.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9c08cc700 1 -- 172.21.15.125:0/2878785995 shutdown_connections 2023-10-17T06:07:05.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.060+0000 7ff9c08cc700 1 -- 172.21.15.125:0/2878785995 wait complete. 2023-10-17T06:07:05.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9c08cc700 1 Processor -- start 2023-10-17T06:07:05.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9c08cc700 1 -- start start 2023-10-17T06:07:05.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9c08cc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff9bc070b00 0x7ff9bc1f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:05.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9c08cc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9bc1590d0 0x7ff9bc14b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:05.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9c08cc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9bc1f1f00 0x7ff9bc0acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:05.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9c08cc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc1e2400 con 0x7ff9bc1590d0 2023-10-17T06:07:05.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9c08cc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc1e2600 con 0x7ff9bc1f1f00 2023-10-17T06:07:05.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9c08cc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc1f6470 con 0x7ff9bc070b00 2023-10-17T06:07:05.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9ba59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9bc1590d0 0x7ff9bc14b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:05.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9ba59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9bc1590d0 0x7ff9bc14b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35098/0 (socket says 172.21.15.125:35098) 2023-10-17T06:07:05.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9ba59c700 1 -- 172.21.15.125:0/510417642 learned_addr learned my addr 172.21.15.125:0/510417642 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:05.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9bad9d700 1 --2- 172.21.15.125:0/510417642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff9bc070b00 0x7ff9bc1f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:05.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9bb59e700 1 --2- 172.21.15.125:0/510417642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9bc1f1f00 0x7ff9bc0acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:05.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9ba59c700 1 -- 172.21.15.125:0/510417642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff9bc070b00 msgr2=0x7ff9bc1f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:05.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9ba59c700 1 --2- 172.21.15.125:0/510417642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff9bc070b00 0x7ff9bc1f5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9ba59c700 1 -- 172.21.15.125:0/510417642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9bc1f1f00 msgr2=0x7ff9bc0acb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:05.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9ba59c700 1 --2- 172.21.15.125:0/510417642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9bc1f1f00 0x7ff9bc0acb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9ba59c700 1 -- 172.21.15.125:0/510417642 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac009570 con 0x7ff9bc1590d0 2023-10-17T06:07:05.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9bb59e700 1 --2- 172.21.15.125:0/510417642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9bc1f1f00 0x7ff9bc0acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:05.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9ba59c700 1 --2- 172.21.15.125:0/510417642 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9bc1590d0 0x7ff9bc14b360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000d7c0 tx=0x7ff9b000dad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:05.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9a37fe700 1 -- 172.21.15.125:0/510417642 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0005e50 con 0x7ff9bc1590d0 2023-10-17T06:07:05.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9a37fe700 1 -- 172.21.15.125:0/510417642 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b00070d0 con 0x7ff9bc1590d0 2023-10-17T06:07:05.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9a37fe700 1 -- 172.21.15.125:0/510417642 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0007460 con 0x7ff9bc1590d0 2023-10-17T06:07:05.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.068+0000 7ff9c08cc700 1 -- 172.21.15.125:0/510417642 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9bc1f2490 con 0x7ff9bc1590d0 2023-10-17T06:07:05.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.072+0000 7ff9c08cc700 1 -- 172.21.15.125:0/510417642 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9bc1f2a50 con 0x7ff9bc1590d0 2023-10-17T06:07:05.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.072+0000 7ff9c08cc700 1 -- 172.21.15.125:0/510417642 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9bc1e27b0 con 0x7ff9bc1590d0 2023-10-17T06:07:05.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.072+0000 7ff9a37fe700 1 -- 172.21.15.125:0/510417642 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff9b00075c0 con 0x7ff9bc1590d0 2023-10-17T06:07:05.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.080+0000 7ff9a37fe700 1 --2- 172.21.15.125:0/510417642 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff9a80656f0 0x7ff9a8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:05.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.080+0000 7ff9a37fe700 1 -- 172.21.15.125:0/510417642 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff9b00828e0 con 0x7ff9bc1590d0 2023-10-17T06:07:05.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.080+0000 7ff9bad9d700 1 --2- 172.21.15.125:0/510417642 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff9a80656f0 0x7ff9a8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:05.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.080+0000 7ff9bad9d700 1 --2- 172.21.15.125:0/510417642 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff9a80656f0 0x7ff9a8067bb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac000c00 tx=0x7ff9ac008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:05.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.080+0000 7ff9a37fe700 1 -- 172.21.15.125:0/510417642 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff9bc1e27b0 con 0x7ff9bc1590d0 2023-10-17T06:07:05.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.252+0000 7ff9c08cc700 1 -- 172.21.15.125:0/510417642 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff9bc1e2770 con 0x7ff9bc1590d0 2023-10-17T06:07:05.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.256+0000 7ff9a37fe700 1 -- 172.21.15.125:0/510417642 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff9b00506e0 con 0x7ff9bc1590d0 2023-10-17T06:07:05.260 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:07:05.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.256+0000 7ff9c08cc700 1 -- 172.21.15.125:0/510417642 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff9a80656f0 msgr2=0x7ff9a8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:05.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.256+0000 7ff9c08cc700 1 --2- 172.21.15.125:0/510417642 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff9a80656f0 0x7ff9a8067bb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac000c00 tx=0x7ff9ac008030 comp rx=0 tx=0).stop 2023-10-17T06:07:05.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.256+0000 7ff9c08cc700 1 -- 172.21.15.125:0/510417642 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9bc1590d0 msgr2=0x7ff9bc14b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:05.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.256+0000 7ff9c08cc700 1 --2- 172.21.15.125:0/510417642 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9bc1590d0 0x7ff9bc14b360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000d7c0 tx=0x7ff9b000dad0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.256+0000 7ff9c08cc700 1 -- 172.21.15.125:0/510417642 shutdown_connections 2023-10-17T06:07:05.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.256+0000 7ff9c08cc700 1 --2- 172.21.15.125:0/510417642 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff9a80656f0 0x7ff9a8067bb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.256+0000 7ff9c08cc700 1 --2- 172.21.15.125:0/510417642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9bc1f1f00 0x7ff9bc0acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.256+0000 7ff9c08cc700 1 --2- 172.21.15.125:0/510417642 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9bc1590d0 0x7ff9bc14b360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.256+0000 7ff9c08cc700 1 --2- 172.21.15.125:0/510417642 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff9bc070b00 0x7ff9bc1f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.256+0000 7ff9c08cc700 1 -- 172.21.15.125:0/510417642 >> 172.21.15.125:0/510417642 conn(0x7ff9bc0cb9f0 msgr2=0x7ff9bc154b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:05.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.256+0000 7ff9c08cc700 1 -- 172.21.15.125:0/510417642 shutdown_connections 2023-10-17T06:07:05.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.256+0000 7ff9c08cc700 1 -- 172.21.15.125:0/510417642 wait complete. 2023-10-17T06:07:05.282 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:07:05.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.460+0000 7f25db07d700 1 Processor -- start 2023-10-17T06:07:05.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.460+0000 7f25db07d700 1 -- start start 2023-10-17T06:07:05.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25db07d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25d40d2e00 0x7f25d40b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:05.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25db07d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f25d4160710 0x7f25d40d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:05.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25db07d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25d415d0d0 con 0x7f25d40b5ae0 2023-10-17T06:07:05.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25db07d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25d415df90 con 0x7f25d4160710 2023-10-17T06:07:05.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25db07d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d406f0f0 con 0x7f25d40d2e00 2023-10-17T06:07:05.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25da87c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f25d40b5ae0 0x7f25d406db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47910/0 (socket says 172.21.15.125:47910) 2023-10-17T06:07:05.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25da87c700 1 -- 172.21.15.125:0/324313593 learned_addr learned my addr 172.21.15.125:0/324313593 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:05.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25da07b700 1 --2- 172.21.15.125:0/324313593 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25d40d2e00 0x7f25d40b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:05.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25d987a700 1 --2- 172.21.15.125:0/324313593 >> v2:172.21.15.184:3300/0 conn(0x7f25d4160710 0x7f25d40d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:05.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25d9079700 1 -- 172.21.15.125:0/324313593 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4050137557 0 0) 0x7f25cc0014e0 con 0x7f25d40b5ae0 2023-10-17T06:07:05.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25d9079700 1 -- 172.21.15.125:0/324313593 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25c00035d0 con 0x7f25d40b5ae0 2023-10-17T06:07:05.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25da07b700 1 -- 172.21.15.125:0/324313593 >> v2:172.21.15.184:3300/0 conn(0x7f25d4160710 msgr2=0x7f25d40d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:05.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25da07b700 1 --2- 172.21.15.125:0/324313593 >> v2:172.21.15.184:3300/0 conn(0x7f25d4160710 0x7f25d40d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25da07b700 1 -- 172.21.15.125:0/324313593 >> v1:172.21.15.125:6789/0 conn(0x7f25d40b5ae0 legacy=0x7f25d406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:05.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25da07b700 1 -- 172.21.15.125:0/324313593 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d40d3720 con 0x7f25d40d2e00 2023-10-17T06:07:05.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25da07b700 1 --2- 172.21.15.125:0/324313593 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25d40d2e00 0x7f25d40b6e00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009880 tx=0x7f25d0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e4bab3b7a7f526d server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:05.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25d9079700 1 -- 172.21.15.125:0/324313593 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0011830 con 0x7f25d40d2e00 2023-10-17T06:07:05.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25d9079700 1 -- 172.21.15.125:0/324313593 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d0011990 con 0x7f25d40d2e00 2023-10-17T06:07:05.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25d9079700 1 -- 172.21.15.125:0/324313593 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0011d20 con 0x7f25d40d2e00 2023-10-17T06:07:05.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25db07d700 1 -- 172.21.15.125:0/324313593 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25d40d2e00 msgr2=0x7f25d40b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:05.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.464+0000 7f25db07d700 1 --2- 172.21.15.125:0/324313593 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25d40d2e00 0x7f25d40b6e00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009880 tx=0x7f25d0009b90 comp rx=0 tx=0).stop 2023-10-17T06:07:05.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.468+0000 7f25db07d700 1 -- 172.21.15.125:0/324313593 shutdown_connections 2023-10-17T06:07:05.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.468+0000 7f25db07d700 1 --2- 172.21.15.125:0/324313593 >> v2:172.21.15.184:3300/0 conn(0x7f25d4160710 0x7f25d40d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.468+0000 7f25db07d700 1 --2- 172.21.15.125:0/324313593 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25d40d2e00 0x7f25d40b6e00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.468+0000 7f25db07d700 1 -- 172.21.15.125:0/324313593 >> 172.21.15.125:0/324313593 conn(0x7f25d4069f20 msgr2=0x7f25d406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:05.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.468+0000 7f25db07d700 1 -- 172.21.15.125:0/324313593 shutdown_connections 2023-10-17T06:07:05.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.468+0000 7f25db07d700 1 -- 172.21.15.125:0/324313593 wait complete. 2023-10-17T06:07:05.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.468+0000 7f25db07d700 1 Processor -- start 2023-10-17T06:07:05.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.468+0000 7f25db07d700 1 -- start start 2023-10-17T06:07:05.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.468+0000 7f25db07d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25d40b5ae0 0x7f25d41f8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:05.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.468+0000 7f25db07d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25d40d2e00 0x7f25d40d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:05.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.468+0000 7f25db07d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25d4160710 0x7f25d408d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:05.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.468+0000 7f25db07d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d41f9250 con 0x7f25d4160710 2023-10-17T06:07:05.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.468+0000 7f25db07d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d41f8640 con 0x7f25d40d2e00 2023-10-17T06:07:05.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.468+0000 7f25db07d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d41f8920 con 0x7f25d40b5ae0 2023-10-17T06:07:05.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.472+0000 7f25da87c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25d4160710 0x7f25d408d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:05.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.472+0000 7f25da87c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25d4160710 0x7f25d408d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35104/0 (socket says 172.21.15.125:35104) 2023-10-17T06:07:05.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.472+0000 7f25da87c700 1 -- 172.21.15.125:0/3048961268 learned_addr learned my addr 172.21.15.125:0/3048961268 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:05.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.472+0000 7f25da07b700 1 --2- 172.21.15.125:0/3048961268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25d40b5ae0 0x7f25d41f8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:05.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.472+0000 7f25d987a700 1 --2- 172.21.15.125:0/3048961268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25d40d2e00 0x7f25d40d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:05.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.472+0000 7f25da87c700 1 -- 172.21.15.125:0/3048961268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25d40b5ae0 msgr2=0x7f25d41f8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:05.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.472+0000 7f25da87c700 1 --2- 172.21.15.125:0/3048961268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25d40b5ae0 0x7f25d41f8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.472+0000 7f25da87c700 1 -- 172.21.15.125:0/3048961268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25d40d2e00 msgr2=0x7f25d40d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:05.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.472+0000 7f25da87c700 1 --2- 172.21.15.125:0/3048961268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25d40d2e00 0x7f25d40d0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.472+0000 7f25da87c700 1 -- 172.21.15.125:0/3048961268 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d00094b0 con 0x7f25d4160710 2023-10-17T06:07:05.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.472+0000 7f25da87c700 1 --2- 172.21.15.125:0/3048961268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25d4160710 0x7f25d408d570 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f25cc002280 tx=0x7f25cc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:05.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.472+0000 7f25caffd700 1 -- 172.21.15.125:0/3048961268 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc00a9e0 con 0x7f25d4160710 2023-10-17T06:07:05.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.472+0000 7f25caffd700 1 -- 172.21.15.125:0/3048961268 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25cc00ab40 con 0x7f25d4160710 2023-10-17T06:07:05.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.472+0000 7f25caffd700 1 -- 172.21.15.125:0/3048961268 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc012400 con 0x7f25d4160710 2023-10-17T06:07:05.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.472+0000 7f25db07d700 1 -- 172.21.15.125:0/3048961268 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d41f8c00 con 0x7f25d4160710 2023-10-17T06:07:05.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.472+0000 7f25db07d700 1 -- 172.21.15.125:0/3048961268 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d40d11d0 con 0x7f25d4160710 2023-10-17T06:07:05.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.476+0000 7f25db07d700 1 -- 172.21.15.125:0/3048961268 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d404e910 con 0x7f25d4160710 2023-10-17T06:07:05.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.476+0000 7f25caffd700 1 -- 172.21.15.125:0/3048961268 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f25cc005d50 con 0x7f25d4160710 2023-10-17T06:07:05.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.476+0000 7f25caffd700 1 --2- 172.21.15.125:0/3048961268 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f25b80656f0 0x7f25b8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:05.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.476+0000 7f25caffd700 1 -- 172.21.15.125:0/3048961268 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f25cc0821f0 con 0x7f25d4160710 2023-10-17T06:07:05.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.476+0000 7f25da07b700 1 --2- 172.21.15.125:0/3048961268 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f25b80656f0 0x7f25b8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:05.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.480+0000 7f25da07b700 1 --2- 172.21.15.125:0/3048961268 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f25b80656f0 0x7f25b8067bb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f25d00090b0 tx=0x7f25d0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:05.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.484+0000 7f25caffd700 1 -- 172.21.15.125:0/3048961268 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f25cc04ff60 con 0x7f25d4160710 2023-10-17T06:07:05.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.660+0000 7f25db07d700 1 -- 172.21.15.125:0/3048961268 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f25d415d0d0 con 0x7f25d4160710 2023-10-17T06:07:05.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.660+0000 7f25caffd700 1 -- 172.21.15.125:0/3048961268 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f25d415d0d0 con 0x7f25d4160710 2023-10-17T06:07:05.663 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:07:05.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.664+0000 7f25db07d700 1 -- 172.21.15.125:0/3048961268 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f25b80656f0 msgr2=0x7f25b8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:05.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.664+0000 7f25db07d700 1 --2- 172.21.15.125:0/3048961268 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f25b80656f0 0x7f25b8067bb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f25d00090b0 tx=0x7f25d0008030 comp rx=0 tx=0).stop 2023-10-17T06:07:05.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.664+0000 7f25db07d700 1 -- 172.21.15.125:0/3048961268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25d4160710 msgr2=0x7f25d408d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:05.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.664+0000 7f25db07d700 1 --2- 172.21.15.125:0/3048961268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25d4160710 0x7f25d408d570 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f25cc002280 tx=0x7f25cc00cd50 comp rx=0 tx=0).stop 2023-10-17T06:07:05.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.664+0000 7f25db07d700 1 -- 172.21.15.125:0/3048961268 shutdown_connections 2023-10-17T06:07:05.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.664+0000 7f25db07d700 1 --2- 172.21.15.125:0/3048961268 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f25b80656f0 0x7f25b8067bb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.664+0000 7f25db07d700 1 --2- 172.21.15.125:0/3048961268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25d4160710 0x7f25d408d570 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.664+0000 7f25db07d700 1 --2- 172.21.15.125:0/3048961268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25d40d2e00 0x7f25d40d0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.664+0000 7f25db07d700 1 --2- 172.21.15.125:0/3048961268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f25d40b5ae0 0x7f25d41f8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.664+0000 7f25db07d700 1 -- 172.21.15.125:0/3048961268 >> 172.21.15.125:0/3048961268 conn(0x7f25d4069f20 msgr2=0x7f25d415b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:05.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.664+0000 7f25db07d700 1 -- 172.21.15.125:0/3048961268 shutdown_connections 2023-10-17T06:07:05.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.664+0000 7f25db07d700 1 -- 172.21.15.125:0/3048961268 wait complete. 2023-10-17T06:07:05.690 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-17T06:07:05.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.868+0000 7f536cdd2700 1 Processor -- start 2023-10-17T06:07:05.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.868+0000 7f536cdd2700 1 -- start start 2023-10-17T06:07:05.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.872+0000 7f536cdd2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5368155420 0x7f53680cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:05.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.872+0000 7f536cdd2700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f53680ce320 0x7f53680cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:05.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.872+0000 7f536cdd2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53680cbc80 con 0x7f536815bf00 2023-10-17T06:07:05.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.872+0000 7f536cdd2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5368155800 con 0x7f5368155420 2023-10-17T06:07:05.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.872+0000 7f536cdd2700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53680cb9a0 con 0x7f53680ce320 2023-10-17T06:07:05.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.872+0000 7f5365d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f536815bf00 0x7f53680cdc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47914/0 (socket says 172.21.15.125:47914) 2023-10-17T06:07:05.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.872+0000 7f5365d9b700 1 -- 172.21.15.125:0/87333463 learned_addr learned my addr 172.21.15.125:0/87333463 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:05.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.872+0000 7f536659c700 1 --2- 172.21.15.125:0/87333463 >> v2:172.21.15.125:3300/0 conn(0x7f5368155420 0x7f53680cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:05.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.872+0000 7f5366d9d700 1 --2- 172.21.15.125:0/87333463 >> v2:172.21.15.184:3300/0 conn(0x7f53680ce320 0x7f53680cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:05.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.872+0000 7f536559a700 1 -- 172.21.15.125:0/87333463 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 217581940 0 0) 0x7f53680cbc80 con 0x7f536815bf00 2023-10-17T06:07:05.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.872+0000 7f536559a700 1 -- 172.21.15.125:0/87333463 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53500035d0 con 0x7f536815bf00 2023-10-17T06:07:05.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.872+0000 7f536659c700 1 -- 172.21.15.125:0/87333463 >> v2:172.21.15.184:3300/0 conn(0x7f53680ce320 msgr2=0x7f53680cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:05.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.872+0000 7f536659c700 1 --2- 172.21.15.125:0/87333463 >> v2:172.21.15.184:3300/0 conn(0x7f53680ce320 0x7f53680cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.872+0000 7f536659c700 1 -- 172.21.15.125:0/87333463 >> v1:172.21.15.125:6789/0 conn(0x7f536815bf00 legacy=0x7f53680cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:05.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.872+0000 7f536659c700 1 -- 172.21.15.125:0/87333463 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536815b420 con 0x7f5368155420 2023-10-17T06:07:05.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.876+0000 7f536659c700 1 --2- 172.21.15.125:0/87333463 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5368155420 0x7f53680cb150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f536806cc90 tx=0x7f5358009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f86c342d309c84 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:05.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.876+0000 7f536559a700 1 -- 172.21.15.125:0/87333463 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5358011830 con 0x7f5368155420 2023-10-17T06:07:05.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.876+0000 7f536559a700 1 -- 172.21.15.125:0/87333463 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5358011990 con 0x7f5368155420 2023-10-17T06:07:05.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.876+0000 7f536559a700 1 -- 172.21.15.125:0/87333463 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5358011d20 con 0x7f5368155420 2023-10-17T06:07:05.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.876+0000 7f536cdd2700 1 -- 172.21.15.125:0/87333463 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5368155420 msgr2=0x7f53680cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:05.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.876+0000 7f536cdd2700 1 --2- 172.21.15.125:0/87333463 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5368155420 0x7f53680cb150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f536806cc90 tx=0x7f5358009b30 comp rx=0 tx=0).stop 2023-10-17T06:07:05.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.876+0000 7f536cdd2700 1 -- 172.21.15.125:0/87333463 shutdown_connections 2023-10-17T06:07:05.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.876+0000 7f536cdd2700 1 --2- 172.21.15.125:0/87333463 >> v2:172.21.15.184:3300/0 conn(0x7f53680ce320 0x7f53680cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.876+0000 7f536cdd2700 1 --2- 172.21.15.125:0/87333463 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5368155420 0x7f53680cb150 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.876+0000 7f536cdd2700 1 -- 172.21.15.125:0/87333463 >> 172.21.15.125:0/87333463 conn(0x7f536806a340 msgr2=0x7f53680b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:05.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.876+0000 7f536cdd2700 1 -- 172.21.15.125:0/87333463 shutdown_connections 2023-10-17T06:07:05.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.876+0000 7f536cdd2700 1 -- 172.21.15.125:0/87333463 wait complete. 2023-10-17T06:07:05.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f536cdd2700 1 Processor -- start 2023-10-17T06:07:05.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f536cdd2700 1 -- start start 2023-10-17T06:07:05.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f536cdd2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53680ce320 0x7f5368142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:05.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f536cdd2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5368155420 0x7f53681f2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:05.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f536cdd2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f536815bf00 0x7f536806f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:05.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f536cdd2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53680ab610 con 0x7f5368155420 2023-10-17T06:07:05.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f536cdd2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53680ab8f0 con 0x7f53680ce320 2023-10-17T06:07:05.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f536cdd2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53680abbd0 con 0x7f536815bf00 2023-10-17T06:07:05.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f5365d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5368155420 0x7f53681f2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:05.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f5365d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5368155420 0x7f53681f2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35120/0 (socket says 172.21.15.125:35120) 2023-10-17T06:07:05.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f5365d9b700 1 -- 172.21.15.125:0/4015898593 learned_addr learned my addr 172.21.15.125:0/4015898593 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:05.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f536659c700 1 --2- 172.21.15.125:0/4015898593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53680ce320 0x7f5368142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:05.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f5366d9d700 1 --2- 172.21.15.125:0/4015898593 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f536815bf00 0x7f536806f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:05.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f5365d9b700 1 -- 172.21.15.125:0/4015898593 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f536815bf00 msgr2=0x7f536806f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:05.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f5365d9b700 1 --2- 172.21.15.125:0/4015898593 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f536815bf00 0x7f536806f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f5365d9b700 1 -- 172.21.15.125:0/4015898593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53680ce320 msgr2=0x7f5368142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:05.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f5365d9b700 1 --2- 172.21.15.125:0/4015898593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53680ce320 0x7f5368142c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:05.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f5365d9b700 1 -- 172.21.15.125:0/4015898593 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53580094b0 con 0x7f5368155420 2023-10-17T06:07:05.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f5365d9b700 1 --2- 172.21.15.125:0/4015898593 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5368155420 0x7f53681f2d90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f535c00c4f0 tx=0x7f535c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:05.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f5356ffd700 1 -- 172.21.15.125:0/4015898593 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c005d90 con 0x7f5368155420 2023-10-17T06:07:05.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f5356ffd700 1 -- 172.21.15.125:0/4015898593 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c0070d0 con 0x7f5368155420 2023-10-17T06:07:05.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f536cdd2700 1 -- 172.21.15.125:0/4015898593 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53680abeb0 con 0x7f5368155420 2023-10-17T06:07:05.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f5356ffd700 1 -- 172.21.15.125:0/4015898593 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c007440 con 0x7f5368155420 2023-10-17T06:07:05.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.880+0000 7f536cdd2700 1 -- 172.21.15.125:0/4015898593 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53681431c0 con 0x7f5368155420 2023-10-17T06:07:05.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.884+0000 7f536cdd2700 1 -- 172.21.15.125:0/4015898593 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f536815b9c0 con 0x7f5368155420 2023-10-17T06:07:05.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.884+0000 7f5356ffd700 1 -- 172.21.15.125:0/4015898593 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f535c0075a0 con 0x7f5368155420 2023-10-17T06:07:05.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.888+0000 7f5356ffd700 1 --2- 172.21.15.125:0/4015898593 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f53480656f0 0x7f5348067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:05.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.888+0000 7f5356ffd700 1 -- 172.21.15.125:0/4015898593 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f535c081f50 con 0x7f5368155420 2023-10-17T06:07:05.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.888+0000 7f536659c700 1 --2- 172.21.15.125:0/4015898593 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f53480656f0 0x7f5348067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:05.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.888+0000 7f536659c700 1 --2- 172.21.15.125:0/4015898593 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f53480656f0 0x7f5348067bb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5358000c00 tx=0x7f5358008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:05.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:05.892+0000 7f5356ffd700 1 -- 172.21.15.125:0/4015898593 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f536815b9c0 con 0x7f5368155420 2023-10-17T06:07:06.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.076+0000 7f536cdd2700 1 -- 172.21.15.125:0/4015898593 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f536815b9c0 con 0x7f5368155420 2023-10-17T06:07:06.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.076+0000 7f5356ffd700 1 -- 172.21.15.125:0/4015898593 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7f536815b9c0 con 0x7f5368155420 2023-10-17T06:07:06.079 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:06.079 INFO:teuthology.orchestra.run.smithi125.stdout:[ 2023-10-17T06:07:06.079 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:07:06.079 INFO:teuthology.orchestra.run.smithi125.stdout: "poolnum": 1, 2023-10-17T06:07:06.080 INFO:teuthology.orchestra.run.smithi125.stdout: "poolname": ".mgr" 2023-10-17T06:07:06.080 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:07:06.080 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:07:06.080 INFO:teuthology.orchestra.run.smithi125.stdout: "poolnum": 2, 2023-10-17T06:07:06.080 INFO:teuthology.orchestra.run.smithi125.stdout: "poolname": "rbd" 2023-10-17T06:07:06.081 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:07:06.081 INFO:teuthology.orchestra.run.smithi125.stdout:] 2023-10-17T06:07:06.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.080+0000 7f536cdd2700 1 -- 172.21.15.125:0/4015898593 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f53480656f0 msgr2=0x7f5348067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:06.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.080+0000 7f536cdd2700 1 --2- 172.21.15.125:0/4015898593 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f53480656f0 0x7f5348067bb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5358000c00 tx=0x7f5358008030 comp rx=0 tx=0).stop 2023-10-17T06:07:06.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.080+0000 7f536cdd2700 1 -- 172.21.15.125:0/4015898593 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5368155420 msgr2=0x7f53681f2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:06.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.080+0000 7f536cdd2700 1 --2- 172.21.15.125:0/4015898593 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5368155420 0x7f53681f2d90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f535c00c4f0 tx=0x7f535c00c8b0 comp rx=0 tx=0).stop 2023-10-17T06:07:06.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.080+0000 7f536cdd2700 1 -- 172.21.15.125:0/4015898593 shutdown_connections 2023-10-17T06:07:06.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.080+0000 7f536cdd2700 1 --2- 172.21.15.125:0/4015898593 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f53480656f0 0x7f5348067bb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:06.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.080+0000 7f536cdd2700 1 --2- 172.21.15.125:0/4015898593 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f536815bf00 0x7f536806f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:06.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.084+0000 7f536cdd2700 1 --2- 172.21.15.125:0/4015898593 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5368155420 0x7f53681f2d90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:06.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.084+0000 7f536cdd2700 1 --2- 172.21.15.125:0/4015898593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53680ce320 0x7f5368142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:06.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.084+0000 7f536cdd2700 1 -- 172.21.15.125:0/4015898593 >> 172.21.15.125:0/4015898593 conn(0x7f536806a340 msgr2=0x7f53680cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:06.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.084+0000 7f536cdd2700 1 -- 172.21.15.125:0/4015898593 shutdown_connections 2023-10-17T06:07:06.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.084+0000 7f536cdd2700 1 -- 172.21.15.125:0/4015898593 wait complete. 2023-10-17T06:07:06.106 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-17T06:07:06.107 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-17T06:07:06.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.284+0000 7f33454d6700 1 Processor -- start 2023-10-17T06:07:06.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.284+0000 7f33454d6700 1 -- start start 2023-10-17T06:07:06.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.288+0000 7f33454d6700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3340160e50 0x7f334006e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:06.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.288+0000 7f33454d6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33400cb500 0x7f33400b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:06.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.288+0000 7f33454d6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f33400b2720 0x7f3340164af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:06.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.288+0000 7f33454d6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33400b1ee0 con 0x7f33400b2720 2023-10-17T06:07:06.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.288+0000 7f33454d6700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33400b2b90 con 0x7f3340160e50 2023-10-17T06:07:06.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.288+0000 7f33454d6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33400b16d0 con 0x7f33400cb500 2023-10-17T06:07:06.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.288+0000 7f333f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f33400b2720 0x7f3340164af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:06.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.288+0000 7f333f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f33400b2720 0x7f3340164af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35136/0 (socket says 172.21.15.125:35136) 2023-10-17T06:07:06.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.288+0000 7f333f7fe700 1 -- 172.21.15.125:0/4132576518 learned_addr learned my addr 172.21.15.125:0/4132576518 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:06.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.288+0000 7f3337fff700 1 --2- 172.21.15.125:0/4132576518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33400cb500 0x7f33400b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:06.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.288+0000 7f333effd700 1 --2- 172.21.15.125:0/4132576518 >> v2:172.21.15.184:3300/0 conn(0x7f3340160e50 0x7f334006e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:06.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.288+0000 7f333f7fe700 1 -- 172.21.15.125:0/4132576518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33400cb500 msgr2=0x7f33400b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:06.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.288+0000 7f333f7fe700 1 --2- 172.21.15.125:0/4132576518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33400cb500 0x7f33400b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:06.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.288+0000 7f333f7fe700 1 -- 172.21.15.125:0/4132576518 >> v2:172.21.15.184:3300/0 conn(0x7f3340160e50 msgr2=0x7f334006e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:06.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.288+0000 7f333f7fe700 1 --2- 172.21.15.125:0/4132576518 >> v2:172.21.15.184:3300/0 conn(0x7f3340160e50 0x7f334006e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:06.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.288+0000 7f333f7fe700 1 -- 172.21.15.125:0/4132576518 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33400ae0f0 con 0x7f33400b2720 2023-10-17T06:07:06.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.288+0000 7f333f7fe700 1 --2- 172.21.15.125:0/4132576518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33400b2720 0x7f3340164af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f334006b000 tx=0x7f333800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141a556849517ffb server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:06.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.292+0000 7f333e7fc700 1 -- 172.21.15.125:0/4132576518 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333800e070 con 0x7f33400b2720 2023-10-17T06:07:06.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.292+0000 7f333e7fc700 1 -- 172.21.15.125:0/4132576518 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333800b8d0 con 0x7f33400b2720 2023-10-17T06:07:06.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.292+0000 7f333e7fc700 1 -- 172.21.15.125:0/4132576518 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333800bc80 con 0x7f33400b2720 2023-10-17T06:07:06.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.292+0000 7f33454d6700 1 -- 172.21.15.125:0/4132576518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33400b2720 msgr2=0x7f3340164af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:06.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.292+0000 7f33454d6700 1 --2- 172.21.15.125:0/4132576518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33400b2720 0x7f3340164af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f334006b000 tx=0x7f333800b330 comp rx=0 tx=0).stop 2023-10-17T06:07:06.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.292+0000 7f33454d6700 1 -- 172.21.15.125:0/4132576518 shutdown_connections 2023-10-17T06:07:06.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.292+0000 7f33454d6700 1 --2- 172.21.15.125:0/4132576518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33400cb500 0x7f33400b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:06.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.292+0000 7f33454d6700 1 --2- 172.21.15.125:0/4132576518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33400b2720 0x7f3340164af0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:06.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.292+0000 7f33454d6700 1 --2- 172.21.15.125:0/4132576518 >> v2:172.21.15.184:3300/0 conn(0x7f3340160e50 0x7f334006e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:06.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.292+0000 7f33454d6700 1 -- 172.21.15.125:0/4132576518 >> 172.21.15.125:0/4132576518 conn(0x7f33400b0bf0 msgr2=0x7f33400ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:06.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.292+0000 7f33454d6700 1 -- 172.21.15.125:0/4132576518 shutdown_connections 2023-10-17T06:07:06.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.292+0000 7f33454d6700 1 -- 172.21.15.125:0/4132576518 wait complete. 2023-10-17T06:07:06.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.292+0000 7f33454d6700 1 Processor -- start 2023-10-17T06:07:06.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.292+0000 7f33454d6700 1 -- start start 2023-10-17T06:07:06.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f33454d6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33400b2720 0x7f33400ab140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:06.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f33454d6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33400cb500 0x7f33400a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:06.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f33454d6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3340160e50 0x7f33400a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:06.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f33454d6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33401f9d90 con 0x7f33400cb500 2023-10-17T06:07:06.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f33454d6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33400ab680 con 0x7f3340160e50 2023-10-17T06:07:06.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f33454d6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33401f9fe0 con 0x7f33400b2720 2023-10-17T06:07:06.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f3337fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33400cb500 0x7f33400a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:06.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f3337fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33400cb500 0x7f33400a92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35138/0 (socket says 172.21.15.125:35138) 2023-10-17T06:07:06.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f333effd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33400b2720 0x7f33400ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:06.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f3337fff700 1 -- 172.21.15.125:0/765786759 learned_addr learned my addr 172.21.15.125:0/765786759 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:06.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f333f7fe700 1 --2- 172.21.15.125:0/765786759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3340160e50 0x7f33400a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:06.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f3337fff700 1 -- 172.21.15.125:0/765786759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33400b2720 msgr2=0x7f33400ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:06.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f3337fff700 1 --2- 172.21.15.125:0/765786759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33400b2720 0x7f33400ab140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:06.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f3337fff700 1 -- 172.21.15.125:0/765786759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3340160e50 msgr2=0x7f33400a9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:06.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f3337fff700 1 --2- 172.21.15.125:0/765786759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3340160e50 0x7f33400a9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:06.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f3337fff700 1 -- 172.21.15.125:0/765786759 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3338009b30 con 0x7f33400cb500 2023-10-17T06:07:06.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f3337fff700 1 --2- 172.21.15.125:0/765786759 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33400cb500 0x7f33400a92c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f332800e9a0 tx=0x7f332800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:06.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f33377fe700 1 -- 172.21.15.125:0/765786759 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3328009720 con 0x7f33400cb500 2023-10-17T06:07:06.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f33377fe700 1 -- 172.21.15.125:0/765786759 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332800c690 con 0x7f33400cb500 2023-10-17T06:07:06.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f33454d6700 1 -- 172.21.15.125:0/765786759 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33401fa2c0 con 0x7f33400cb500 2023-10-17T06:07:06.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f33377fe700 1 -- 172.21.15.125:0/765786759 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332800ca40 con 0x7f33400cb500 2023-10-17T06:07:06.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.296+0000 7f33454d6700 1 -- 172.21.15.125:0/765786759 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33401fa880 con 0x7f33400cb500 2023-10-17T06:07:06.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.300+0000 7f33454d6700 1 -- 172.21.15.125:0/765786759 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3340072e60 con 0x7f33400cb500 2023-10-17T06:07:06.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.300+0000 7f33377fe700 1 -- 172.21.15.125:0/765786759 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f332800cba0 con 0x7f33400cb500 2023-10-17T06:07:06.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.300+0000 7f33377fe700 1 --2- 172.21.15.125:0/765786759 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f33200656f0 0x7f3320067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:06.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.300+0000 7f33377fe700 1 -- 172.21.15.125:0/765786759 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3328082a70 con 0x7f33400cb500 2023-10-17T06:07:06.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.300+0000 7f333effd700 1 --2- 172.21.15.125:0/765786759 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f33200656f0 0x7f3320067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:06.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.304+0000 7f333effd700 1 --2- 172.21.15.125:0/765786759 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f33200656f0 0x7f3320067bb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f334015f1f0 tx=0x7f3330009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:06.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.308+0000 7f33377fe700 1 -- 172.21.15.125:0/765786759 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f3328054310 con 0x7f33400cb500 2023-10-17T06:07:06.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:06.564+0000 7f33454d6700 1 -- 172.21.15.125:0/765786759 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f33401f67a0 con 0x7f33400cb500 2023-10-17T06:07:07.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.556+0000 7f33377fe700 1 -- 172.21.15.125:0/765786759 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3328053ea0 con 0x7f33400cb500 2023-10-17T06:07:07.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.564+0000 7f33454d6700 1 -- 172.21.15.125:0/765786759 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f33200656f0 msgr2=0x7f3320067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:07.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.564+0000 7f33454d6700 1 --2- 172.21.15.125:0/765786759 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f33200656f0 0x7f3320067bb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f334015f1f0 tx=0x7f3330009240 comp rx=0 tx=0).stop 2023-10-17T06:07:07.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.564+0000 7f33454d6700 1 -- 172.21.15.125:0/765786759 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33400cb500 msgr2=0x7f33400a92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:07.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.564+0000 7f33454d6700 1 --2- 172.21.15.125:0/765786759 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33400cb500 0x7f33400a92c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f332800e9a0 tx=0x7f332800ecb0 comp rx=0 tx=0).stop 2023-10-17T06:07:07.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.564+0000 7f33454d6700 1 -- 172.21.15.125:0/765786759 shutdown_connections 2023-10-17T06:07:07.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.564+0000 7f33454d6700 1 --2- 172.21.15.125:0/765786759 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f33200656f0 0x7f3320067bb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:07.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.564+0000 7f33454d6700 1 --2- 172.21.15.125:0/765786759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3340160e50 0x7f33400a9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:07.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.564+0000 7f33454d6700 1 --2- 172.21.15.125:0/765786759 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33400cb500 0x7f33400a92c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:07.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.564+0000 7f33454d6700 1 --2- 172.21.15.125:0/765786759 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33400b2720 0x7f33400ab140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:07.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.564+0000 7f33454d6700 1 -- 172.21.15.125:0/765786759 >> 172.21.15.125:0/765786759 conn(0x7f33400b0bf0 msgr2=0x7f33400ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:07.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.564+0000 7f33454d6700 1 -- 172.21.15.125:0/765786759 shutdown_connections 2023-10-17T06:07:07.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.564+0000 7f33454d6700 1 -- 172.21.15.125:0/765786759 wait complete. 2023-10-17T06:07:07.572 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_metadata' created 2023-10-17T06:07:07.588 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-17T06:07:07.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.772+0000 7f2a64d6e700 1 Processor -- start 2023-10-17T06:07:07.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.772+0000 7f2a64d6e700 1 -- start start 2023-10-17T06:07:07.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a64d6e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a6015ab90 0x7f2a600d0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:07.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a64d6e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2a6015af70 0x7f2a6006fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:07.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a64d6e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2a600cb270 0x7f2a600cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:07.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a64d6e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a600cbc20 con 0x7f2a6015af70 2023-10-17T06:07:07.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a64d6e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a600703a0 con 0x7f2a600cb270 2023-10-17T06:07:07.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a64d6e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600b3a10 con 0x7f2a6015ab90 2023-10-17T06:07:07.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a5ed9d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2a600cb270 0x7f2a600cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:07.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a5e59c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a6015ab90 0x7f2a600d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:07.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a5ed9d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2a600cb270 0x7f2a600cb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:54424/0 (socket says 172.21.15.125:54424) 2023-10-17T06:07:07.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a5ed9d700 1 -- 172.21.15.125:0/2827712679 learned_addr learned my addr 172.21.15.125:0/2827712679 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:07.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a5dd9b700 1 --2- 172.21.15.125:0/2827712679 >> v2:172.21.15.125:3300/0 conn(0x7f2a6015af70 0x7f2a6006fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:07.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a5ed9d700 1 -- 172.21.15.125:0/2827712679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a6015ab90 msgr2=0x7f2a600d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:07.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a5ed9d700 1 --2- 172.21.15.125:0/2827712679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a6015ab90 0x7f2a600d0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:07.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a5ed9d700 1 -- 172.21.15.125:0/2827712679 >> v2:172.21.15.125:3300/0 conn(0x7f2a6015af70 msgr2=0x7f2a6006fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:07.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a5ed9d700 1 --2- 172.21.15.125:0/2827712679 >> v2:172.21.15.125:3300/0 conn(0x7f2a6015af70 0x7f2a6006fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:07.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a5ed9d700 1 -- 172.21.15.125:0/2827712679 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a600705d0 con 0x7f2a600cb270 2023-10-17T06:07:07.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a5dd9b700 1 --2- 172.21.15.125:0/2827712679 >> v2:172.21.15.125:3300/0 conn(0x7f2a6015af70 0x7f2a6006fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:07.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a5ed9d700 1 --2- 172.21.15.125:0/2827712679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a600cb270 0x7f2a600cb6e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2a600b3510 tx=0x7f2a5800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60b94cad47ce5c77 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:07.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a5d59a700 1 -- 172.21.15.125:0/2827712679 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5800e070 con 0x7f2a600cb270 2023-10-17T06:07:07.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a5d59a700 1 -- 172.21.15.125:0/2827712679 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5800b910 con 0x7f2a600cb270 2023-10-17T06:07:07.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.776+0000 7f2a5d59a700 1 -- 172.21.15.125:0/2827712679 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5800bcc0 con 0x7f2a600cb270 2023-10-17T06:07:07.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.780+0000 7f2a64d6e700 1 -- 172.21.15.125:0/2827712679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a600cb270 msgr2=0x7f2a600cb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:07.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.780+0000 7f2a64d6e700 1 --2- 172.21.15.125:0/2827712679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a600cb270 0x7f2a600cb6e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2a600b3510 tx=0x7f2a5800b330 comp rx=0 tx=0).stop 2023-10-17T06:07:07.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.780+0000 7f2a64d6e700 1 -- 172.21.15.125:0/2827712679 shutdown_connections 2023-10-17T06:07:07.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.780+0000 7f2a64d6e700 1 --2- 172.21.15.125:0/2827712679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a600cb270 0x7f2a600cb6e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:07.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.780+0000 7f2a64d6e700 1 --2- 172.21.15.125:0/2827712679 >> v2:172.21.15.125:3300/0 conn(0x7f2a6015af70 0x7f2a6006fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:07.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.780+0000 7f2a64d6e700 1 --2- 172.21.15.125:0/2827712679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a6015ab90 0x7f2a600d0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:07.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.780+0000 7f2a64d6e700 1 -- 172.21.15.125:0/2827712679 >> 172.21.15.125:0/2827712679 conn(0x7f2a600d0a10 msgr2=0x7f2a600d0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:07.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.780+0000 7f2a64d6e700 1 -- 172.21.15.125:0/2827712679 shutdown_connections 2023-10-17T06:07:07.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.780+0000 7f2a64d6e700 1 -- 172.21.15.125:0/2827712679 wait complete. 2023-10-17T06:07:07.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.780+0000 7f2a64d6e700 1 Processor -- start 2023-10-17T06:07:07.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.780+0000 7f2a64d6e700 1 -- start start 2023-10-17T06:07:07.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a64d6e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a600cb270 0x7f2a60151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:07.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a64d6e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a6015ab90 0x7f2a600ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:07.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a64d6e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a6015af70 0x7f2a600c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:07.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a64d6e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600c7930 con 0x7f2a6015ab90 2023-10-17T06:07:07.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a64d6e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600c7510 con 0x7f2a6015af70 2023-10-17T06:07:07.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a64d6e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a600c65f0 con 0x7f2a600cb270 2023-10-17T06:07:07.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a5dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a6015ab90 0x7f2a600ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:07.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a5dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a6015ab90 0x7f2a600ac5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35170/0 (socket says 172.21.15.125:35170) 2023-10-17T06:07:07.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a5dd9b700 1 -- 172.21.15.125:0/1243644343 learned_addr learned my addr 172.21.15.125:0/1243644343 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:07.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a5ed9d700 1 --2- 172.21.15.125:0/1243644343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a6015af70 0x7f2a600c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:07.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a5e59c700 1 --2- 172.21.15.125:0/1243644343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a600cb270 0x7f2a60151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:07.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a5e59c700 1 -- 172.21.15.125:0/1243644343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a6015af70 msgr2=0x7f2a600c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:07.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a5e59c700 1 --2- 172.21.15.125:0/1243644343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a6015af70 0x7f2a600c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:07.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a5e59c700 1 -- 172.21.15.125:0/1243644343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a6015ab90 msgr2=0x7f2a600ac5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:07.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a5e59c700 1 --2- 172.21.15.125:0/1243644343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a6015ab90 0x7f2a600ac5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:07.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a5e59c700 1 -- 172.21.15.125:0/1243644343 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a58009b30 con 0x7f2a600cb270 2023-10-17T06:07:07.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a5dd9b700 1 --2- 172.21.15.125:0/1243644343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a6015ab90 0x7f2a600ac5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:07:07.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a5ed9d700 1 --2- 172.21.15.125:0/1243644343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a6015af70 0x7f2a600c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:07:07.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a5e59c700 1 --2- 172.21.15.125:0/1243644343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a600cb270 0x7f2a60151fc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000e930 tx=0x7f2a5000ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:07.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a4effd700 1 -- 172.21.15.125:0/1243644343 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50013680 con 0x7f2a600cb270 2023-10-17T06:07:07.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a4effd700 1 -- 172.21.15.125:0/1243644343 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a500137e0 con 0x7f2a600cb270 2023-10-17T06:07:07.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a64d6e700 1 -- 172.21.15.125:0/1243644343 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a600c6890 con 0x7f2a600cb270 2023-10-17T06:07:07.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a4effd700 1 -- 172.21.15.125:0/1243644343 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50013b50 con 0x7f2a600cb270 2023-10-17T06:07:07.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.784+0000 7f2a64d6e700 1 -- 172.21.15.125:0/1243644343 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a600c6e50 con 0x7f2a600cb270 2023-10-17T06:07:07.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.788+0000 7f2a64d6e700 1 -- 172.21.15.125:0/1243644343 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a600c7780 con 0x7f2a600cb270 2023-10-17T06:07:07.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.788+0000 7f2a4effd700 1 -- 172.21.15.125:0/1243644343 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2a50013cb0 con 0x7f2a600cb270 2023-10-17T06:07:07.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.788+0000 7f2a4effd700 1 --2- 172.21.15.125:0/1243644343 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2a400656f0 0x7f2a40067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:07.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.788+0000 7f2a4effd700 1 -- 172.21.15.125:0/1243644343 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f2a50082b50 con 0x7f2a600cb270 2023-10-17T06:07:07.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.788+0000 7f2a5dd9b700 1 --2- 172.21.15.125:0/1243644343 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2a400656f0 0x7f2a40067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:07.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.792+0000 7f2a5dd9b700 1 --2- 172.21.15.125:0/1243644343 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2a400656f0 0x7f2a40067bb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2a600ca780 tx=0x7f2a54008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:07.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:07.800+0000 7f2a4effd700 1 -- 172.21.15.125:0/1243644343 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2a500507e0 con 0x7f2a600cb270 2023-10-17T06:07:08.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.080+0000 7f2a64d6e700 1 -- 172.21.15.125:0/1243644343 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f2a60072e60 con 0x7f2a600cb270 2023-10-17T06:07:08.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.572+0000 7f2a4effd700 1 -- 172.21.15.125:0/1243644343 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v22) v1 ==== 171+0+0 (secure 0 0 0) 0x7f2a50053e00 con 0x7f2a600cb270 2023-10-17T06:07:08.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.580+0000 7f2a64d6e700 1 -- 172.21.15.125:0/1243644343 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2a400656f0 msgr2=0x7f2a40067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:08.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.580+0000 7f2a64d6e700 1 --2- 172.21.15.125:0/1243644343 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2a400656f0 0x7f2a40067bb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2a600ca780 tx=0x7f2a54008040 comp rx=0 tx=0).stop 2023-10-17T06:07:08.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.580+0000 7f2a64d6e700 1 -- 172.21.15.125:0/1243644343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a600cb270 msgr2=0x7f2a60151fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:08.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.580+0000 7f2a64d6e700 1 --2- 172.21.15.125:0/1243644343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a600cb270 0x7f2a60151fc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000e930 tx=0x7f2a5000ec40 comp rx=0 tx=0).stop 2023-10-17T06:07:08.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.584+0000 7f2a64d6e700 1 -- 172.21.15.125:0/1243644343 shutdown_connections 2023-10-17T06:07:08.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.584+0000 7f2a64d6e700 1 --2- 172.21.15.125:0/1243644343 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2a400656f0 0x7f2a40067bb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:08.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.584+0000 7f2a64d6e700 1 --2- 172.21.15.125:0/1243644343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a6015af70 0x7f2a600c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:08.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.584+0000 7f2a64d6e700 1 --2- 172.21.15.125:0/1243644343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a6015ab90 0x7f2a600ac5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:08.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.584+0000 7f2a64d6e700 1 --2- 172.21.15.125:0/1243644343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a600cb270 0x7f2a60151fc0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:08.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.584+0000 7f2a64d6e700 1 -- 172.21.15.125:0/1243644343 >> 172.21.15.125:0/1243644343 conn(0x7f2a600d0a10 msgr2=0x7f2a6015bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:08.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.584+0000 7f2a64d6e700 1 -- 172.21.15.125:0/1243644343 shutdown_connections 2023-10-17T06:07:08.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.584+0000 7f2a64d6e700 1 -- 172.21.15.125:0/1243644343 wait complete. 2023-10-17T06:07:08.595 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data' created 2023-10-17T06:07:08.612 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-17T06:07:08.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.780+0000 7fd10f037700 1 Processor -- start 2023-10-17T06:07:08.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.780+0000 7fd10f037700 1 -- start start 2023-10-17T06:07:08.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.784+0000 7fd10f037700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1080d36b0 0x7fd10806e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:08.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.784+0000 7fd10f037700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd10815e7d0 0x7fd10815d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:08.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.784+0000 7fd10f037700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1080d29f0 con 0x7fd1080d2610 2023-10-17T06:07:08.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.784+0000 7fd10f037700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1080b64b0 con 0x7fd10815e7d0 2023-10-17T06:07:08.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.784+0000 7fd10f037700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1080b6750 con 0x7fd1080d36b0 2023-10-17T06:07:08.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.784+0000 7fd10d5d4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd10815e7d0 0x7fd10815d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:08.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.784+0000 7fd107fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1080d36b0 0x7fd10806e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:08.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.784+0000 7fd10d5d4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd10815e7d0 0x7fd10815d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35176/0 (socket says 172.21.15.125:35176) 2023-10-17T06:07:08.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.784+0000 7fd10d5d4700 1 -- 172.21.15.125:0/3964271714 learned_addr learned my addr 172.21.15.125:0/3964271714 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:08.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.784+0000 7fd10cdd3700 1 --1- 172.21.15.125:0/3964271714 >> v1:172.21.15.184:6789/0 conn(0x7fd1080d2610 0x7fd1080d2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:47564/0 (socket says 172.21.15.125:47564) 2023-10-17T06:07:08.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.784+0000 7fd10d5d4700 1 -- 172.21.15.125:0/3964271714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1080d36b0 msgr2=0x7fd10806e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:08.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.784+0000 7fd10d5d4700 1 --2- 172.21.15.125:0/3964271714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1080d36b0 0x7fd10806e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:08.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.784+0000 7fd10d5d4700 1 -- 172.21.15.125:0/3964271714 >> v1:172.21.15.184:6789/0 conn(0x7fd1080d2610 legacy=0x7fd1080d2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:08.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.784+0000 7fd10d5d4700 1 -- 172.21.15.125:0/3964271714 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1080b6a30 con 0x7fd10815e7d0 2023-10-17T06:07:08.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.784+0000 7fd10d5d4700 1 --2- 172.21.15.125:0/3964271714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd10815e7d0 0x7fd10815d5f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd100009e50 tx=0x7fd10000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a276a1012ab0c120 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:08.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.784+0000 7fd1077fe700 1 -- 172.21.15.125:0/3964271714 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10000e070 con 0x7fd10815e7d0 2023-10-17T06:07:08.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.784+0000 7fd1077fe700 1 -- 172.21.15.125:0/3964271714 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10000b910 con 0x7fd10815e7d0 2023-10-17T06:07:08.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.784+0000 7fd1077fe700 1 -- 172.21.15.125:0/3964271714 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10000bcc0 con 0x7fd10815e7d0 2023-10-17T06:07:08.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.788+0000 7fd10f037700 1 -- 172.21.15.125:0/3964271714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd10815e7d0 msgr2=0x7fd10815d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:08.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.788+0000 7fd10f037700 1 --2- 172.21.15.125:0/3964271714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd10815e7d0 0x7fd10815d5f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd100009e50 tx=0x7fd10000b330 comp rx=0 tx=0).stop 2023-10-17T06:07:08.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.788+0000 7fd10f037700 1 -- 172.21.15.125:0/3964271714 shutdown_connections 2023-10-17T06:07:08.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.788+0000 7fd10f037700 1 --2- 172.21.15.125:0/3964271714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd10815e7d0 0x7fd10815d5f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:08.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.788+0000 7fd10f037700 1 --2- 172.21.15.125:0/3964271714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1080d36b0 0x7fd10806e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:08.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.788+0000 7fd10f037700 1 -- 172.21.15.125:0/3964271714 >> 172.21.15.125:0/3964271714 conn(0x7fd108069f20 msgr2=0x7fd10806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:08.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.788+0000 7fd10f037700 1 -- 172.21.15.125:0/3964271714 shutdown_connections 2023-10-17T06:07:08.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.788+0000 7fd10f037700 1 -- 172.21.15.125:0/3964271714 wait complete. 2023-10-17T06:07:08.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.792+0000 7fd10f037700 1 Processor -- start 2023-10-17T06:07:08.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.792+0000 7fd10f037700 1 -- start start 2023-10-17T06:07:08.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.792+0000 7fd10f037700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1080d2610 0x7fd1081e5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:08.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.792+0000 7fd10f037700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1080d36b0 0x7fd108157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:08.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.792+0000 7fd10f037700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd10815e7d0 0x7fd1081f5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:08.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.792+0000 7fd10f037700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1081e8700 con 0x7fd1080d2610 2023-10-17T06:07:08.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.792+0000 7fd10f037700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1081e8270 con 0x7fd10815e7d0 2023-10-17T06:07:08.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.792+0000 7fd10f037700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd108154d80 con 0x7fd1080d36b0 2023-10-17T06:07:08.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.792+0000 7fd10cdd3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1080d2610 0x7fd1081e5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:08.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.792+0000 7fd10cdd3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1080d2610 0x7fd1081e5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35186/0 (socket says 172.21.15.125:35186) 2023-10-17T06:07:08.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.792+0000 7fd10cdd3700 1 -- 172.21.15.125:0/1510121951 learned_addr learned my addr 172.21.15.125:0/1510121951 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:08.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.792+0000 7fd107fff700 1 --2- 172.21.15.125:0/1510121951 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1080d36b0 0x7fd108157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:08.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.792+0000 7fd10d5d4700 1 --2- 172.21.15.125:0/1510121951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd10815e7d0 0x7fd1081f5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:08.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.792+0000 7fd10cdd3700 1 -- 172.21.15.125:0/1510121951 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1080d36b0 msgr2=0x7fd108157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:08.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.792+0000 7fd10cdd3700 1 --2- 172.21.15.125:0/1510121951 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1080d36b0 0x7fd108157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:08.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.792+0000 7fd10cdd3700 1 -- 172.21.15.125:0/1510121951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd10815e7d0 msgr2=0x7fd1081f5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:08.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.792+0000 7fd10cdd3700 1 --2- 172.21.15.125:0/1510121951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd10815e7d0 0x7fd1081f5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:08.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.792+0000 7fd10cdd3700 1 -- 172.21.15.125:0/1510121951 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd100009b30 con 0x7fd1080d2610 2023-10-17T06:07:08.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.796+0000 7fd10cdd3700 1 --2- 172.21.15.125:0/1510121951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1080d2610 0x7fd1081e5250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00c730 tx=0x7fd0fc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:08.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.796+0000 7fd1057fa700 1 -- 172.21.15.125:0/1510121951 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc005cd0 con 0x7fd1080d2610 2023-10-17T06:07:08.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.796+0000 7fd1057fa700 1 -- 172.21.15.125:0/1510121951 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0fc005e30 con 0x7fd1080d2610 2023-10-17T06:07:08.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.796+0000 7fd10f037700 1 -- 172.21.15.125:0/1510121951 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1081e7980 con 0x7fd1080d2610 2023-10-17T06:07:08.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.796+0000 7fd1057fa700 1 -- 172.21.15.125:0/1510121951 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc0072d0 con 0x7fd1080d2610 2023-10-17T06:07:08.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.796+0000 7fd10f037700 1 -- 172.21.15.125:0/1510121951 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1081e7f00 con 0x7fd1080d2610 2023-10-17T06:07:08.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.796+0000 7fd10f037700 1 -- 172.21.15.125:0/1510121951 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd108072e60 con 0x7fd1080d2610 2023-10-17T06:07:08.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.800+0000 7fd1057fa700 1 -- 172.21.15.125:0/1510121951 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd0fc007430 con 0x7fd1080d2610 2023-10-17T06:07:08.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.800+0000 7fd1057fa700 1 --2- 172.21.15.125:0/1510121951 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd0f4065720 0x7fd0f4067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:08.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.800+0000 7fd1057fa700 1 -- 172.21.15.125:0/1510121951 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fd0fc081f80 con 0x7fd1080d2610 2023-10-17T06:07:08.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.800+0000 7fd107fff700 1 --2- 172.21.15.125:0/1510121951 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd0f4065720 0x7fd0f4067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:08.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.800+0000 7fd107fff700 1 --2- 172.21.15.125:0/1510121951 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd0f4065720 0x7fd0f4067be0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd10815f8f0 tx=0x7fd0f8009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:08.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:08.808+0000 7fd1057fa700 1 -- 172.21.15.125:0/1510121951 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fd0fc04fb40 con 0x7fd1080d2610 2023-10-17T06:07:09.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:09.032+0000 7fd10f037700 1 -- 172.21.15.125:0/1510121951 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd10806d590 con 0x7fd1080d2610 2023-10-17T06:07:09.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:09.796+0000 7fd1057fa700 1 -- 172.21.15.125:0/1510121951 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd0fc0170c0 con 0x7fd1080d2610 2023-10-17T06:07:09.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:09.808+0000 7fd10f037700 1 -- 172.21.15.125:0/1510121951 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd0f4065720 msgr2=0x7fd0f4067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:09.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:09.808+0000 7fd10f037700 1 --2- 172.21.15.125:0/1510121951 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd0f4065720 0x7fd0f4067be0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd10815f8f0 tx=0x7fd0f8009240 comp rx=0 tx=0).stop 2023-10-17T06:07:09.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:09.808+0000 7fd10f037700 1 -- 172.21.15.125:0/1510121951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1080d2610 msgr2=0x7fd1081e5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:09.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:09.808+0000 7fd10f037700 1 --2- 172.21.15.125:0/1510121951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1080d2610 0x7fd1081e5250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00c730 tx=0x7fd0fc00ca40 comp rx=0 tx=0).stop 2023-10-17T06:07:09.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:09.812+0000 7fd10f037700 1 -- 172.21.15.125:0/1510121951 shutdown_connections 2023-10-17T06:07:09.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:09.812+0000 7fd10f037700 1 --2- 172.21.15.125:0/1510121951 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd0f4065720 0x7fd0f4067be0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:09.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:09.812+0000 7fd10f037700 1 --2- 172.21.15.125:0/1510121951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd10815e7d0 0x7fd1081f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:09.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:09.812+0000 7fd10f037700 1 --2- 172.21.15.125:0/1510121951 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd1080d36b0 0x7fd108157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:09.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:09.812+0000 7fd10f037700 1 --2- 172.21.15.125:0/1510121951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1080d2610 0x7fd1081e5250 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:09.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:09.812+0000 7fd10f037700 1 -- 172.21.15.125:0/1510121951 >> 172.21.15.125:0/1510121951 conn(0x7fd108069f20 msgr2=0x7fd1080b58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:09.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:09.816+0000 7fd10f037700 1 -- 172.21.15.125:0/1510121951 shutdown_connections 2023-10-17T06:07:09.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:09.820+0000 7fd10f037700 1 -- 172.21.15.125:0/1510121951 wait complete. 2023-10-17T06:07:09.831 INFO:teuthology.orchestra.run.smithi125.stderr:new fs with metadata pool 3 and data pool 4 2023-10-17T06:07:09.852 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-17T06:07:09.852 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-17T06:07:10.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.032+0000 7f2fde071700 1 Processor -- start 2023-10-17T06:07:10.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.036+0000 7f2fde071700 1 -- start start 2023-10-17T06:07:10.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.036+0000 7f2fde071700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2fd815ce90 0x7f2fd80b7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:10.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.036+0000 7f2fde071700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd80b3540 0x7f2fd806fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:10.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.036+0000 7f2fde071700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd80701c0 con 0x7f2fd806f7f0 2023-10-17T06:07:10.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.036+0000 7f2fde071700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd80cfd40 con 0x7f2fd815ce90 2023-10-17T06:07:10.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.036+0000 7f2fde071700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd80b3b80 con 0x7f2fd80b3540 2023-10-17T06:07:10.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fd6ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2fd806f7f0 0x7f2fd81608f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47918/0 (socket says 172.21.15.125:47918) 2023-10-17T06:07:10.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fd6ffd700 1 -- 172.21.15.125:0/137456351 learned_addr learned my addr 172.21.15.125:0/137456351 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:10.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fd77fe700 1 --2- 172.21.15.125:0/137456351 >> v2:172.21.15.125:3300/0 conn(0x7f2fd815ce90 0x7f2fd80b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:10.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fd7fff700 1 --2- 172.21.15.125:0/137456351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd80b3540 0x7f2fd806fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:10.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fd67fc700 1 -- 172.21.15.125:0/137456351 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071498591 0 0) 0x7f2fd80701c0 con 0x7f2fd806f7f0 2023-10-17T06:07:10.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fd67fc700 1 -- 172.21.15.125:0/137456351 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc00035d0 con 0x7f2fd806f7f0 2023-10-17T06:07:10.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fd77fe700 1 -- 172.21.15.125:0/137456351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd80b3540 msgr2=0x7f2fd806fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:10.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fd77fe700 1 --2- 172.21.15.125:0/137456351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd80b3540 0x7f2fd806fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:10.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fd77fe700 1 -- 172.21.15.125:0/137456351 >> v1:172.21.15.125:6789/0 conn(0x7f2fd806f7f0 legacy=0x7f2fd81608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:10.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fd67fc700 1 -- 172.21.15.125:0/137456351 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 130646672 0 0) 0x7f2fc00035d0 con 0x7f2fd806f7f0 2023-10-17T06:07:10.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fd77fe700 1 -- 172.21.15.125:0/137456351 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd80b3e60 con 0x7f2fd815ce90 2023-10-17T06:07:10.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fd77fe700 1 --2- 172.21.15.125:0/137456351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fd815ce90 0x7f2fd80b7980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8009850 tx=0x7f2fc8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec73ac838aeba67 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:10.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fd67fc700 1 -- 172.21.15.125:0/137456351 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc001670 con 0x7f2fd815ce90 2023-10-17T06:07:10.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fd67fc700 1 -- 172.21.15.125:0/137456351 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc8004030 con 0x7f2fd815ce90 2023-10-17T06:07:10.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fd67fc700 1 -- 172.21.15.125:0/137456351 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc80043e0 con 0x7f2fd815ce90 2023-10-17T06:07:10.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fde071700 1 -- 172.21.15.125:0/137456351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fd815ce90 msgr2=0x7f2fd80b7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:10.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fde071700 1 --2- 172.21.15.125:0/137456351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fd815ce90 0x7f2fd80b7980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8009850 tx=0x7f2fc8009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:10.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fde071700 1 -- 172.21.15.125:0/137456351 shutdown_connections 2023-10-17T06:07:10.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fde071700 1 --2- 172.21.15.125:0/137456351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd80b3540 0x7f2fd806fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:10.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fde071700 1 --2- 172.21.15.125:0/137456351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fd815ce90 0x7f2fd80b7980 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:10.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fde071700 1 -- 172.21.15.125:0/137456351 >> 172.21.15.125:0/137456351 conn(0x7f2fd8069f50 msgr2=0x7f2fd806a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:10.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fde071700 1 -- 172.21.15.125:0/137456351 shutdown_connections 2023-10-17T06:07:10.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.040+0000 7f2fde071700 1 -- 172.21.15.125:0/137456351 wait complete. 2023-10-17T06:07:10.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.044+0000 7f2fde071700 1 Processor -- start 2023-10-17T06:07:10.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.044+0000 7f2fde071700 1 -- start start 2023-10-17T06:07:10.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fde071700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd806f7f0 0x7f2fd814d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:10.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fde071700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fd80b3540 0x7f2fd8151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:10.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fde071700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd815ce90 0x7f2fd8151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:10.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fde071700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd814e710 con 0x7f2fd80b3540 2023-10-17T06:07:10.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fde071700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd8152e70 con 0x7f2fd815ce90 2023-10-17T06:07:10.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fde071700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd81525d0 con 0x7f2fd806f7f0 2023-10-17T06:07:10.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fd6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fd80b3540 0x7f2fd8151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:10.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fd6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fd80b3540 0x7f2fd8151a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35202/0 (socket says 172.21.15.125:35202) 2023-10-17T06:07:10.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fd6ffd700 1 -- 172.21.15.125:0/3976015831 learned_addr learned my addr 172.21.15.125:0/3976015831 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:10.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fd77fe700 1 --2- 172.21.15.125:0/3976015831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd806f7f0 0x7f2fd814d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:10.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fd7fff700 1 --2- 172.21.15.125:0/3976015831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd815ce90 0x7f2fd8151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:10.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fd6ffd700 1 -- 172.21.15.125:0/3976015831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd806f7f0 msgr2=0x7f2fd814d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:10.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fd6ffd700 1 --2- 172.21.15.125:0/3976015831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd806f7f0 0x7f2fd814d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:10.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fd6ffd700 1 -- 172.21.15.125:0/3976015831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd815ce90 msgr2=0x7f2fd8151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:10.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fd6ffd700 1 --2- 172.21.15.125:0/3976015831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd815ce90 0x7f2fd8151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:10.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fd6ffd700 1 -- 172.21.15.125:0/3976015831 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc80094b0 con 0x7f2fd80b3540 2023-10-17T06:07:10.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fd77fe700 1 --2- 172.21.15.125:0/3976015831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd806f7f0 0x7f2fd814d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:10.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fd6ffd700 1 --2- 172.21.15.125:0/3976015831 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fd80b3540 0x7f2fd8151a60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00c520 tx=0x7f2fcc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:10.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fbffff700 1 -- 172.21.15.125:0/3976015831 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc004ca0 con 0x7f2fd80b3540 2023-10-17T06:07:10.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fbffff700 1 -- 172.21.15.125:0/3976015831 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc004e20 con 0x7f2fd80b3540 2023-10-17T06:07:10.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fbffff700 1 -- 172.21.15.125:0/3976015831 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc007310 con 0x7f2fd80b3540 2023-10-17T06:07:10.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fde071700 1 -- 172.21.15.125:0/3976015831 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd81528b0 con 0x7f2fd80b3540 2023-10-17T06:07:10.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fde071700 1 -- 172.21.15.125:0/3976015831 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd81547b0 con 0x7f2fd80b3540 2023-10-17T06:07:10.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.048+0000 7f2fde071700 1 -- 172.21.15.125:0/3976015831 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd814e850 con 0x7f2fd80b3540 2023-10-17T06:07:10.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.052+0000 7f2fbffff700 1 -- 172.21.15.125:0/3976015831 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2fcc007470 con 0x7f2fd80b3540 2023-10-17T06:07:10.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.052+0000 7f2fbffff700 1 --2- 172.21.15.125:0/3976015831 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2fc40656f0 0x7f2fc4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:10.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.052+0000 7f2fbffff700 1 -- 172.21.15.125:0/3976015831 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2fcc082b20 con 0x7f2fd80b3540 2023-10-17T06:07:10.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.052+0000 7f2fd77fe700 1 --2- 172.21.15.125:0/3976015831 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2fc40656f0 0x7f2fc4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:10.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.056+0000 7f2fd77fe700 1 --2- 172.21.15.125:0/3976015831 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2fc40656f0 0x7f2fc4067bb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80090b0 tx=0x7f2fc8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:10.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.060+0000 7f2fbffff700 1 -- 172.21.15.125:0/3976015831 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2fd814e850 con 0x7f2fd80b3540 2023-10-17T06:07:10.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.260+0000 7f2fde071700 1 -- 172.21.15.125:0/3976015831 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f2fd814e850 con 0x7f2fd80b3540 2023-10-17T06:07:10.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.820+0000 7f2fbffff700 1 -- 172.21.15.125:0/3976015831 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 157+0+0 (secure 0 0 0) 0x7f2fd814e850 con 0x7f2fd80b3540 2023-10-17T06:07:10.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.824+0000 7f2fde071700 1 -- 172.21.15.125:0/3976015831 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2fc40656f0 msgr2=0x7f2fc4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:10.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.824+0000 7f2fde071700 1 --2- 172.21.15.125:0/3976015831 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2fc40656f0 0x7f2fc4067bb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80090b0 tx=0x7f2fc8008030 comp rx=0 tx=0).stop 2023-10-17T06:07:10.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.824+0000 7f2fde071700 1 -- 172.21.15.125:0/3976015831 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fd80b3540 msgr2=0x7f2fd8151a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:10.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.824+0000 7f2fde071700 1 --2- 172.21.15.125:0/3976015831 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fd80b3540 0x7f2fd8151a60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc00c520 tx=0x7f2fcc00c8e0 comp rx=0 tx=0).stop 2023-10-17T06:07:10.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.824+0000 7f2fde071700 1 -- 172.21.15.125:0/3976015831 shutdown_connections 2023-10-17T06:07:10.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.824+0000 7f2fde071700 1 --2- 172.21.15.125:0/3976015831 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2fc40656f0 0x7f2fc4067bb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:10.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.824+0000 7f2fde071700 1 --2- 172.21.15.125:0/3976015831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fd815ce90 0x7f2fd8151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:10.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.824+0000 7f2fde071700 1 --2- 172.21.15.125:0/3976015831 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fd80b3540 0x7f2fd8151a60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:10.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.824+0000 7f2fde071700 1 --2- 172.21.15.125:0/3976015831 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fd806f7f0 0x7f2fd814d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:10.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.824+0000 7f2fde071700 1 -- 172.21.15.125:0/3976015831 >> 172.21.15.125:0/3976015831 conn(0x7f2fd8069f50 msgr2=0x7f2fd806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:10.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.824+0000 7f2fde071700 1 -- 172.21.15.125:0/3976015831 shutdown_connections 2023-10-17T06:07:10.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:10.824+0000 7f2fde071700 1 -- 172.21.15.125:0/3976015831 wait complete. 2023-10-17T06:07:10.849 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-17T06:07:11.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.036+0000 7fdbb1d48700 1 Processor -- start 2023-10-17T06:07:11.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.036+0000 7fdbb1d48700 1 -- start start 2023-10-17T06:07:11.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.040+0000 7fdbb1d48700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbac13d9e0 0x7fdbac15e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:11.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.040+0000 7fdbb1d48700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdbac06f450 0x7fdbac06f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:11.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.040+0000 7fdbb1d48700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbac15ae10 con 0x7fdbac0b4320 2023-10-17T06:07:11.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.040+0000 7fdbb1d48700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbac13ddc0 con 0x7fdbac06f450 2023-10-17T06:07:11.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.040+0000 7fdbb1d48700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac0b1900 con 0x7fdbac13d9e0 2023-10-17T06:07:11.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.040+0000 7fdbb0d46700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbac13d9e0 0x7fdbac15e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:11.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.040+0000 7fdbabfff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fdbac0b4320 0x7fdbac15b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:47568/0 (socket says 172.21.15.125:47568) 2023-10-17T06:07:11.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.040+0000 7fdbabfff700 1 -- 172.21.15.125:0/465571707 learned_addr learned my addr 172.21.15.125:0/465571707 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:11.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.040+0000 7fdbb1547700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdbac06f450 0x7fdbac06f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:11.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.040+0000 7fdbab7fe700 1 -- 172.21.15.125:0/465571707 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328128561 0 0) 0x7fdb9c001110 con 0x7fdbac0b4320 2023-10-17T06:07:11.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.040+0000 7fdbab7fe700 1 -- 172.21.15.125:0/465571707 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb940035d0 con 0x7fdbac0b4320 2023-10-17T06:07:11.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.040+0000 7fdbb0d46700 1 -- 172.21.15.125:0/465571707 >> v2:172.21.15.184:3300/0 conn(0x7fdbac06f450 msgr2=0x7fdbac06f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:11.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.040+0000 7fdbb0d46700 1 --2- 172.21.15.125:0/465571707 >> v2:172.21.15.184:3300/0 conn(0x7fdbac06f450 0x7fdbac06f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:11.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.040+0000 7fdbb0d46700 1 -- 172.21.15.125:0/465571707 >> v1:172.21.15.184:6789/0 conn(0x7fdbac0b4320 legacy=0x7fdbac15b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:11.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.040+0000 7fdbb0d46700 1 -- 172.21.15.125:0/465571707 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac15e940 con 0x7fdbac13d9e0 2023-10-17T06:07:11.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.040+0000 7fdbb0d46700 1 --2- 172.21.15.125:0/465571707 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbac13d9e0 0x7fdbac15e400 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009850 tx=0x7fdba0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d988c436ddf44c86 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:11.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.044+0000 7fdbab7fe700 1 -- 172.21.15.125:0/465571707 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0011830 con 0x7fdbac13d9e0 2023-10-17T06:07:11.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.044+0000 7fdbab7fe700 1 -- 172.21.15.125:0/465571707 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba0011990 con 0x7fdbac13d9e0 2023-10-17T06:07:11.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.044+0000 7fdbab7fe700 1 -- 172.21.15.125:0/465571707 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0011d40 con 0x7fdbac13d9e0 2023-10-17T06:07:11.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.044+0000 7fdbb1d48700 1 -- 172.21.15.125:0/465571707 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbac13d9e0 msgr2=0x7fdbac15e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:11.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.044+0000 7fdbb1d48700 1 --2- 172.21.15.125:0/465571707 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbac13d9e0 0x7fdbac15e400 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009850 tx=0x7fdba0009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:11.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.044+0000 7fdbb1d48700 1 -- 172.21.15.125:0/465571707 shutdown_connections 2023-10-17T06:07:11.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.044+0000 7fdbb1d48700 1 --2- 172.21.15.125:0/465571707 >> v2:172.21.15.184:3300/0 conn(0x7fdbac06f450 0x7fdbac06f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:11.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.044+0000 7fdbb1d48700 1 --2- 172.21.15.125:0/465571707 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbac13d9e0 0x7fdbac15e400 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:11.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.044+0000 7fdbb1d48700 1 -- 172.21.15.125:0/465571707 >> 172.21.15.125:0/465571707 conn(0x7fdbac0ce640 msgr2=0x7fdbac0cea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:11.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.044+0000 7fdbb1d48700 1 -- 172.21.15.125:0/465571707 shutdown_connections 2023-10-17T06:07:11.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.044+0000 7fdbb1d48700 1 -- 172.21.15.125:0/465571707 wait complete. 2023-10-17T06:07:11.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.048+0000 7fdbb1d48700 1 Processor -- start 2023-10-17T06:07:11.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.048+0000 7fdbb1d48700 1 -- start start 2023-10-17T06:07:11.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.048+0000 7fdbb1d48700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbac06f450 0x7fdbac159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:11.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.048+0000 7fdbb1d48700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbac0b4320 0x7fdbac06e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:11.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.048+0000 7fdbb1d48700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbac13d9e0 0x7fdbac06e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:11.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.048+0000 7fdbb1d48700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac15a470 con 0x7fdbac06f450 2023-10-17T06:07:11.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.048+0000 7fdbb1d48700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac134b20 con 0x7fdbac13d9e0 2023-10-17T06:07:11.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.048+0000 7fdbb1d48700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac134e00 con 0x7fdbac0b4320 2023-10-17T06:07:11.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.048+0000 7fdbb0d46700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbac06f450 0x7fdbac159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:11.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.048+0000 7fdbb0d46700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbac06f450 0x7fdbac159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35218/0 (socket says 172.21.15.125:35218) 2023-10-17T06:07:11.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.048+0000 7fdbb0d46700 1 -- 172.21.15.125:0/202190099 learned_addr learned my addr 172.21.15.125:0/202190099 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:11.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.048+0000 7fdbb1547700 1 --2- 172.21.15.125:0/202190099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbac13d9e0 0x7fdbac06e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:11.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.048+0000 7fdbb0d46700 1 -- 172.21.15.125:0/202190099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbac0b4320 msgr2=0x7fdbac06e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:11.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.048+0000 7fdbb0d46700 1 --2- 172.21.15.125:0/202190099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbac0b4320 0x7fdbac06e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:11.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.048+0000 7fdbb0d46700 1 -- 172.21.15.125:0/202190099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbac13d9e0 msgr2=0x7fdbac06e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:11.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.048+0000 7fdbb0d46700 1 --2- 172.21.15.125:0/202190099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbac13d9e0 0x7fdbac06e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:11.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.048+0000 7fdbb0d46700 1 -- 172.21.15.125:0/202190099 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba00094b0 con 0x7fdbac06f450 2023-10-17T06:07:11.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.048+0000 7fdbb1547700 1 --2- 172.21.15.125:0/202190099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbac13d9e0 0x7fdbac06e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:11.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.052+0000 7fdbb0d46700 1 --2- 172.21.15.125:0/202190099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbac06f450 0x7fdbac159ad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdba0014040 tx=0x7fdba0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:11.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.052+0000 7fdba97fa700 1 -- 172.21.15.125:0/202190099 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba00036c0 con 0x7fdbac06f450 2023-10-17T06:07:11.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.052+0000 7fdba97fa700 1 -- 172.21.15.125:0/202190099 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba001e070 con 0x7fdbac06f450 2023-10-17T06:07:11.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.052+0000 7fdba97fa700 1 -- 172.21.15.125:0/202190099 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0003a80 con 0x7fdbac06f450 2023-10-17T06:07:11.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.052+0000 7fdbb1d48700 1 -- 172.21.15.125:0/202190099 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbac1350e0 con 0x7fdbac06f450 2023-10-17T06:07:11.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.052+0000 7fdbb1d48700 1 -- 172.21.15.125:0/202190099 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac15a010 con 0x7fdbac06f450 2023-10-17T06:07:11.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.052+0000 7fdbb1d48700 1 -- 172.21.15.125:0/202190099 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbac072e60 con 0x7fdbac06f450 2023-10-17T06:07:11.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.056+0000 7fdba97fa700 1 -- 172.21.15.125:0/202190099 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fdba0003be0 con 0x7fdbac06f450 2023-10-17T06:07:11.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.056+0000 7fdba97fa700 1 --2- 172.21.15.125:0/202190099 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdb980656f0 0x7fdb98067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:11.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.056+0000 7fdba97fa700 1 -- 172.21.15.125:0/202190099 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6288+0+0 (secure 0 0 0) 0x7fdba0020070 con 0x7fdbac06f450 2023-10-17T06:07:11.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.056+0000 7fdbabfff700 1 --2- 172.21.15.125:0/202190099 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdb980656f0 0x7fdb98067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:11.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.056+0000 7fdbabfff700 1 --2- 172.21.15.125:0/202190099 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdb980656f0 0x7fdb98067bb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c005930 tx=0x7fdb9c001150 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:11.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.060+0000 7fdba97fa700 1 -- 172.21.15.125:0/202190099 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fdba0051db0 con 0x7fdbac06f450 2023-10-17T06:07:11.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:11.240+0000 7fdbb1d48700 1 -- 172.21.15.125:0/202190099 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdbac15b040 con 0x7fdbac06f450 2023-10-17T06:07:12.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:12.848+0000 7fdba97fa700 1 -- 172.21.15.125:0/202190099 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v26) v1 ==== 228+0+0 (secure 0 0 0) 0x7fdba0006ce0 con 0x7fdbac06f450 2023-10-17T06:07:12.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:12.860+0000 7fdbb1d48700 1 -- 172.21.15.125:0/202190099 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdb980656f0 msgr2=0x7fdb98067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:12.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:12.860+0000 7fdbb1d48700 1 --2- 172.21.15.125:0/202190099 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdb980656f0 0x7fdb98067bb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c005930 tx=0x7fdb9c001150 comp rx=0 tx=0).stop 2023-10-17T06:07:12.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:12.860+0000 7fdbb1d48700 1 -- 172.21.15.125:0/202190099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbac06f450 msgr2=0x7fdbac159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:12.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:12.860+0000 7fdbb1d48700 1 --2- 172.21.15.125:0/202190099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbac06f450 0x7fdbac159ad0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdba0014040 tx=0x7fdba0004770 comp rx=0 tx=0).stop 2023-10-17T06:07:12.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:12.860+0000 7fdbb1d48700 1 -- 172.21.15.125:0/202190099 shutdown_connections 2023-10-17T06:07:12.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:12.860+0000 7fdbb1d48700 1 --2- 172.21.15.125:0/202190099 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdb980656f0 0x7fdb98067bb0 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c005930 tx=0x7fdb9c001150 comp rx=0 tx=0).stop 2023-10-17T06:07:12.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:12.860+0000 7fdbb1d48700 1 --2- 172.21.15.125:0/202190099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbac13d9e0 0x7fdbac06e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:12.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:12.860+0000 7fdbb1d48700 1 --2- 172.21.15.125:0/202190099 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbac0b4320 0x7fdbac06e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:12.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:12.860+0000 7fdbb1d48700 1 --2- 172.21.15.125:0/202190099 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbac06f450 0x7fdbac159ad0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:12.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:12.860+0000 7fdbb1d48700 1 -- 172.21.15.125:0/202190099 >> 172.21.15.125:0/202190099 conn(0x7fdbac0ce640 msgr2=0x7fdbac06ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:12.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:12.864+0000 7fdbb1d48700 1 -- 172.21.15.125:0/202190099 shutdown_connections 2023-10-17T06:07:12.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:12.864+0000 7fdbb1d48700 1 -- 172.21.15.125:0/202190099 wait complete. 2023-10-17T06:07:12.869 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data_ec' created 2023-10-17T06:07:12.886 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-17T06:07:13.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.080+0000 7feed9f0e700 1 Processor -- start 2023-10-17T06:07:13.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.080+0000 7feed9f0e700 1 -- start start 2023-10-17T06:07:13.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.080+0000 7feed9f0e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7feed41467a0 0x7feed40b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:13.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.080+0000 7feed9f0e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed406f5f0 con 0x7feed40cf490 2023-10-17T06:07:13.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.080+0000 7feed9f0e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed40d1960 con 0x7feed40b5560 2023-10-17T06:07:13.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.080+0000 7feed9f0e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed40cf9f0 con 0x7feed41467a0 2023-10-17T06:07:13.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.080+0000 7feed970d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7feed40cf490 0x7feed406fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:47924/0 (socket says 172.21.15.125:47924) 2023-10-17T06:07:13.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.080+0000 7feed970d700 1 -- 172.21.15.125:0/676059221 learned_addr learned my addr 172.21.15.125:0/676059221 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:13.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed8f0c700 1 --2- 172.21.15.125:0/676059221 >> v2:172.21.15.184:3300/0 conn(0x7feed41467a0 0x7feed40b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:13.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed37fe700 1 -- 172.21.15.125:0/676059221 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073673650 0 0) 0x7feed406f5f0 con 0x7feed40cf490 2023-10-17T06:07:13.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed37fe700 1 -- 172.21.15.125:0/676059221 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feec40035d0 con 0x7feed40cf490 2023-10-17T06:07:13.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed37fe700 1 -- 172.21.15.125:0/676059221 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906149307 0 0) 0x7feed40d1960 con 0x7feed40b5560 2023-10-17T06:07:13.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed37fe700 1 -- 172.21.15.125:0/676059221 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feed406f5f0 con 0x7feed40b5560 2023-10-17T06:07:13.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed37fe700 1 -- 172.21.15.125:0/676059221 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3306663351 0 0) 0x7feec40035d0 con 0x7feed40cf490 2023-10-17T06:07:13.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed37fe700 1 -- 172.21.15.125:0/676059221 >> v2:172.21.15.184:3300/0 conn(0x7feed41467a0 msgr2=0x7feed40b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:13.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed37fe700 1 --2- 172.21.15.125:0/676059221 >> v2:172.21.15.184:3300/0 conn(0x7feed41467a0 0x7feed40b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:13.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed37fe700 1 -- 172.21.15.125:0/676059221 >> v1:172.21.15.184:6789/0 conn(0x7feed40b5560 legacy=0x7feed40ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:13.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed37fe700 1 -- 172.21.15.125:0/676059221 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed40d1c40 con 0x7feed40cf490 2023-10-17T06:07:13.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed37fe700 1 -- 172.21.15.125:0/676059221 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7feecc0019f0 con 0x7feed40cf490 2023-10-17T06:07:13.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed37fe700 1 -- 172.21.15.125:0/676059221 >> v1:172.21.15.125:6789/0 conn(0x7feed40cf490 legacy=0x7feed406fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:13.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed37fe700 1 --2- 172.21.15.125:0/676059221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feec4003bb0 0x7feec4003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:13.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed37fe700 1 --2- 172.21.15.125:0/676059221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feec4004870 0x7feec4004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:13.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed37fe700 1 --2- 172.21.15.125:0/676059221 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec4005230 0x7feec400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:13.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed37fe700 1 -- 172.21.15.125:0/676059221 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed40cf9f0 con 0x7feec4005230 2023-10-17T06:07:13.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed37fe700 1 -- 172.21.15.125:0/676059221 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec400c080 con 0x7feec4003bb0 2023-10-17T06:07:13.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed37fe700 1 -- 172.21.15.125:0/676059221 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec400c240 con 0x7feec4004870 2023-10-17T06:07:13.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed970d700 1 --2- 172.21.15.125:0/676059221 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec4005230 0x7feec400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:13.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed3fff700 1 --2- 172.21.15.125:0/676059221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feec4004870 0x7feec4004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:13.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed8f0c700 1 --2- 172.21.15.125:0/676059221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feec4003bb0 0x7feec4003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:13.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed970d700 1 -- 172.21.15.125:0/676059221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feec4004870 msgr2=0x7feec4004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:13.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed970d700 1 --2- 172.21.15.125:0/676059221 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feec4004870 0x7feec4004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:13.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed970d700 1 -- 172.21.15.125:0/676059221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feec4003bb0 msgr2=0x7feec4003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:13.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed970d700 1 --2- 172.21.15.125:0/676059221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feec4003bb0 0x7feec4003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:13.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed970d700 1 -- 172.21.15.125:0/676059221 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec40035d0 con 0x7feec4005230 2023-10-17T06:07:13.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed970d700 1 -- 172.21.15.125:0/676059221 reap_dead start 2023-10-17T06:07:13.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed970d700 1 --2- 172.21.15.125:0/676059221 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec4005230 0x7feec400ba30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feed4072a60 tx=0x7feec40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983e2457ce91f125 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:13.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed37fe700 1 -- 172.21.15.125:0/676059221 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc0054b0 con 0x7feec4005230 2023-10-17T06:07:13.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed37fe700 1 -- 172.21.15.125:0/676059221 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feecc00dab0 con 0x7feec4005230 2023-10-17T06:07:13.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.084+0000 7feed37fe700 1 -- 172.21.15.125:0/676059221 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc00de60 con 0x7feec4005230 2023-10-17T06:07:13.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.088+0000 7feed9f0e700 1 -- 172.21.15.125:0/676059221 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec4005230 msgr2=0x7feec400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:13.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.088+0000 7feed9f0e700 1 --2- 172.21.15.125:0/676059221 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec4005230 0x7feec400ba30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feed4072a60 tx=0x7feec40058a0 comp rx=0 tx=0).stop 2023-10-17T06:07:13.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.088+0000 7feed9f0e700 1 -- 172.21.15.125:0/676059221 shutdown_connections 2023-10-17T06:07:13.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.088+0000 7feed9f0e700 1 --2- 172.21.15.125:0/676059221 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feec4005230 0x7feec400ba30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:13.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.088+0000 7feed9f0e700 1 -- 172.21.15.125:0/676059221 >> 172.21.15.125:0/676059221 conn(0x7feed406ce90 msgr2=0x7feed40b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:13.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.088+0000 7feed9f0e700 1 -- 172.21.15.125:0/676059221 shutdown_connections 2023-10-17T06:07:13.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.088+0000 7feed9f0e700 1 -- 172.21.15.125:0/676059221 wait complete. 2023-10-17T06:07:13.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.092+0000 7feed9f0e700 1 Processor -- start 2023-10-17T06:07:13.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.092+0000 7feed9f0e700 1 -- start start 2023-10-17T06:07:13.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.092+0000 7feed9f0e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feec4005230 0x7feed413f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:13.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.092+0000 7feed9f0e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feed413be00 0x7feed415c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:13.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.092+0000 7feed9f0e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feed4143b50 0x7feed4143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:13.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.092+0000 7feed9f0e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed4142330 con 0x7feed413be00 2023-10-17T06:07:13.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.092+0000 7feed9f0e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed415c960 con 0x7feed4143b50 2023-10-17T06:07:13.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.092+0000 7feed9f0e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed4144510 con 0x7feec4005230 2023-10-17T06:07:13.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.092+0000 7feed3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feed413be00 0x7feed415c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:13.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.092+0000 7feed970d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feed4143b50 0x7feed4143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:13.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.092+0000 7feed970d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feed4143b50 0x7feed4143fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:54488/0 (socket says 172.21.15.125:54488) 2023-10-17T06:07:13.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.092+0000 7feed970d700 1 -- 172.21.15.125:0/2089493526 learned_addr learned my addr 172.21.15.125:0/2089493526 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:13.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.092+0000 7feed3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feed413be00 0x7feed415c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35240/0 (socket says 172.21.15.125:35240) 2023-10-17T06:07:13.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.092+0000 7feed8f0c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feec4005230 0x7feed413f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:13.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.092+0000 7feed3fff700 1 -- 172.21.15.125:0/2089493526 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feec4005230 msgr2=0x7feed413f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:13.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.092+0000 7feed3fff700 1 --2- 172.21.15.125:0/2089493526 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feec4005230 0x7feed413f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:13.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.092+0000 7feed3fff700 1 -- 172.21.15.125:0/2089493526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feed4143b50 msgr2=0x7feed4143fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:13.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.092+0000 7feed3fff700 1 --2- 172.21.15.125:0/2089493526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feed4143b50 0x7feed4143fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:13.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.092+0000 7feed3fff700 1 -- 172.21.15.125:0/2089493526 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed4143340 con 0x7feed413be00 2023-10-17T06:07:13.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.092+0000 7feed3fff700 1 --2- 172.21.15.125:0/2089493526 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feed413be00 0x7feed415c420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feec000f7a0 tx=0x7feec000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:13.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.096+0000 7feed17fa700 1 -- 172.21.15.125:0/2089493526 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec00053e0 con 0x7feed413be00 2023-10-17T06:07:13.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.096+0000 7feed17fa700 1 -- 172.21.15.125:0/2089493526 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec0005560 con 0x7feed413be00 2023-10-17T06:07:13.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.096+0000 7feed9f0e700 1 -- 172.21.15.125:0/2089493526 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed4142580 con 0x7feed413be00 2023-10-17T06:07:13.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.096+0000 7feed17fa700 1 -- 172.21.15.125:0/2089493526 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0006ac0 con 0x7feed413be00 2023-10-17T06:07:13.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.096+0000 7feed9f0e700 1 -- 172.21.15.125:0/2089493526 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed4142b40 con 0x7feed413be00 2023-10-17T06:07:13.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.096+0000 7feed9f0e700 1 -- 172.21.15.125:0/2089493526 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed4072e60 con 0x7feed413be00 2023-10-17T06:07:13.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.096+0000 7feed17fa700 1 -- 172.21.15.125:0/2089493526 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7feec0006c20 con 0x7feed413be00 2023-10-17T06:07:13.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.100+0000 7feed17fa700 1 --2- 172.21.15.125:0/2089493526 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7feeb80656f0 0x7feeb8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:13.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.100+0000 7feed17fa700 1 -- 172.21.15.125:0/2089493526 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7feec0082710 con 0x7feed413be00 2023-10-17T06:07:13.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.100+0000 7feed8f0c700 1 --2- 172.21.15.125:0/2089493526 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7feeb80656f0 0x7feeb8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:13.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.100+0000 7feed8f0c700 1 --2- 172.21.15.125:0/2089493526 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7feeb80656f0 0x7feeb8067bb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feec8009bf0 tx=0x7feec8009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:13.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.104+0000 7feed17fa700 1 -- 172.21.15.125:0/2089493526 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7feec004fef0 con 0x7feed413be00 2023-10-17T06:07:13.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.280+0000 7feed9f0e700 1 -- 172.21.15.125:0/2089493526 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7feed40b8080 con 0x7feed413be00 2023-10-17T06:07:13.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.856+0000 7feed17fa700 1 -- 172.21.15.125:0/2089493526 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7feec0053510 con 0x7feed413be00 2023-10-17T06:07:13.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.864+0000 7feed9f0e700 1 -- 172.21.15.125:0/2089493526 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7feeb80656f0 msgr2=0x7feeb8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:13.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.864+0000 7feed9f0e700 1 --2- 172.21.15.125:0/2089493526 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7feeb80656f0 0x7feeb8067bb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feec8009bf0 tx=0x7feec8009240 comp rx=0 tx=0).stop 2023-10-17T06:07:13.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.864+0000 7feed9f0e700 1 -- 172.21.15.125:0/2089493526 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feed413be00 msgr2=0x7feed415c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:13.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.864+0000 7feed9f0e700 1 --2- 172.21.15.125:0/2089493526 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feed413be00 0x7feed415c420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feec000f7a0 tx=0x7feec000fab0 comp rx=0 tx=0).stop 2023-10-17T06:07:13.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.864+0000 7feed9f0e700 1 -- 172.21.15.125:0/2089493526 shutdown_connections 2023-10-17T06:07:13.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.864+0000 7feed9f0e700 1 --2- 172.21.15.125:0/2089493526 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7feeb80656f0 0x7feeb8067bb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:13.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.864+0000 7feed9f0e700 1 --2- 172.21.15.125:0/2089493526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feed4143b50 0x7feed4143fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:13.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.864+0000 7feed9f0e700 1 --2- 172.21.15.125:0/2089493526 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feed413be00 0x7feed415c420 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:13.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.864+0000 7feed9f0e700 1 --2- 172.21.15.125:0/2089493526 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feec4005230 0x7feed413f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:13.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.864+0000 7feed9f0e700 1 -- 172.21.15.125:0/2089493526 >> 172.21.15.125:0/2089493526 conn(0x7feed406ce90 msgr2=0x7feed40b6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:13.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.864+0000 7feed9f0e700 1 -- 172.21.15.125:0/2089493526 shutdown_connections 2023-10-17T06:07:13.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:13.864+0000 7feed9f0e700 1 -- 172.21.15.125:0/2089493526 wait complete. 2023-10-17T06:07:13.874 INFO:teuthology.orchestra.run.smithi125.stderr:set pool 5 allow_ec_overwrites to true 2023-10-17T06:07:13.911 INFO:tasks.ceph.mds.c.smithi125.stderr:2023-10-17T06:07:13.908+0000 7fb335c8d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-17T06:07:13.912 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-17T06:07:14.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.096+0000 7f70b75ae700 1 Processor -- start 2023-10-17T06:07:14.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.096+0000 7f70b75ae700 1 -- start start 2023-10-17T06:07:14.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.096+0000 7f70b75ae700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f70b00b2700 0x7f70b006e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:14.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.096+0000 7f70b75ae700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70b006e670 0x7f70b00cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:14.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70b75ae700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b00cd480 con 0x7f70b0159cf0 2023-10-17T06:07:14.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70b75ae700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b006eb00 con 0x7f70b00b2700 2023-10-17T06:07:14.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70b75ae700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b015a0d0 con 0x7f70b006e670 2023-10-17T06:07:14.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70b534a700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f70b0159cf0 0x7f70b00b50b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45440/0 (socket says 172.21.15.125:45440) 2023-10-17T06:07:14.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70b534a700 1 -- 172.21.15.125:0/1501512809 learned_addr learned my addr 172.21.15.125:0/1501512809 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:14.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70b4b49700 1 --2- 172.21.15.125:0/1501512809 >> v2:172.21.15.184:3300/0 conn(0x7f70b00b2700 0x7f70b006e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:14.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70b5b4b700 1 --2- 172.21.15.125:0/1501512809 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70b006e670 0x7f70b00cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:14.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70a7fff700 1 -- 172.21.15.125:0/1501512809 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270804356 0 0) 0x7f70b00cd480 con 0x7f70b0159cf0 2023-10-17T06:07:14.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70a7fff700 1 -- 172.21.15.125:0/1501512809 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f709c0035d0 con 0x7f70b0159cf0 2023-10-17T06:07:14.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70b5b4b700 1 -- 172.21.15.125:0/1501512809 >> v2:172.21.15.184:3300/0 conn(0x7f70b00b2700 msgr2=0x7f70b006e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:14.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70b5b4b700 1 --2- 172.21.15.125:0/1501512809 >> v2:172.21.15.184:3300/0 conn(0x7f70b00b2700 0x7f70b006e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:14.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70b5b4b700 1 -- 172.21.15.125:0/1501512809 >> v1:172.21.15.125:6789/0 conn(0x7f70b0159cf0 legacy=0x7f70b00b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:14.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70b5b4b700 1 -- 172.21.15.125:0/1501512809 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b00cb6c0 con 0x7f70b006e670 2023-10-17T06:07:14.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70b4b49700 1 --2- 172.21.15.125:0/1501512809 >> v2:172.21.15.184:3300/0 conn(0x7f70b00b2700 0x7f70b006e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:07:14.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70b5b4b700 1 --2- 172.21.15.125:0/1501512809 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70b006e670 0x7f70b00cd910 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f70a8009850 tx=0x7f70a8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b878fc1f3c18a9f server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:14.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70a7fff700 1 -- 172.21.15.125:0/1501512809 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8011830 con 0x7f70b006e670 2023-10-17T06:07:14.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70a7fff700 1 -- 172.21.15.125:0/1501512809 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a8011990 con 0x7f70b006e670 2023-10-17T06:07:14.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70a7fff700 1 -- 172.21.15.125:0/1501512809 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a8011d40 con 0x7f70b006e670 2023-10-17T06:07:14.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70b75ae700 1 -- 172.21.15.125:0/1501512809 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70b006e670 msgr2=0x7f70b00cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:14.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70b75ae700 1 --2- 172.21.15.125:0/1501512809 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70b006e670 0x7f70b00cd910 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f70a8009850 tx=0x7f70a8009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:14.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70b75ae700 1 -- 172.21.15.125:0/1501512809 shutdown_connections 2023-10-17T06:07:14.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70b75ae700 1 --2- 172.21.15.125:0/1501512809 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70b006e670 0x7f70b00cd910 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:14.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70b75ae700 1 --2- 172.21.15.125:0/1501512809 >> v2:172.21.15.184:3300/0 conn(0x7f70b00b2700 0x7f70b006e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:14.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.100+0000 7f70b75ae700 1 -- 172.21.15.125:0/1501512809 >> 172.21.15.125:0/1501512809 conn(0x7f70b00cf8b0 msgr2=0x7f70b00cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:14.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.104+0000 7f70b75ae700 1 -- 172.21.15.125:0/1501512809 shutdown_connections 2023-10-17T06:07:14.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.104+0000 7f70b75ae700 1 -- 172.21.15.125:0/1501512809 wait complete. 2023-10-17T06:07:14.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.104+0000 7f70b75ae700 1 Processor -- start 2023-10-17T06:07:14.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.104+0000 7f70b75ae700 1 -- start start 2023-10-17T06:07:14.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.104+0000 7f70b75ae700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70b006e670 0x7f70b00c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:14.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.104+0000 7f70b75ae700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70b00b2700 0x7f70b01580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:14.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.104+0000 7f70b75ae700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70b0159cf0 0x7f70b00ad530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:14.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.104+0000 7f70b75ae700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b00c64f0 con 0x7f70b00b2700 2023-10-17T06:07:14.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.104+0000 7f70b75ae700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b0158630 con 0x7f70b0159cf0 2023-10-17T06:07:14.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.104+0000 7f70b75ae700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b00c5f30 con 0x7f70b006e670 2023-10-17T06:07:14.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.104+0000 7f70b4b49700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70b00b2700 0x7f70b01580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:14.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.104+0000 7f70b4b49700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70b00b2700 0x7f70b01580f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49402/0 (socket says 172.21.15.125:49402) 2023-10-17T06:07:14.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.104+0000 7f70b4b49700 1 -- 172.21.15.125:0/2771934226 learned_addr learned my addr 172.21.15.125:0/2771934226 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:14.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.104+0000 7f70b5b4b700 1 --2- 172.21.15.125:0/2771934226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70b0159cf0 0x7f70b00ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:14.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.104+0000 7f70b534a700 1 --2- 172.21.15.125:0/2771934226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70b006e670 0x7f70b00c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:14.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.108+0000 7f70b4b49700 1 -- 172.21.15.125:0/2771934226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70b006e670 msgr2=0x7f70b00c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:14.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.108+0000 7f70b4b49700 1 --2- 172.21.15.125:0/2771934226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70b006e670 0x7f70b00c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:14.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.108+0000 7f70b4b49700 1 -- 172.21.15.125:0/2771934226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70b0159cf0 msgr2=0x7f70b00ad530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:14.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.108+0000 7f70b4b49700 1 --2- 172.21.15.125:0/2771934226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70b0159cf0 0x7f70b00ad530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:14.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.108+0000 7f70b4b49700 1 -- 172.21.15.125:0/2771934226 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a00094b0 con 0x7f70b00b2700 2023-10-17T06:07:14.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.108+0000 7f70b5b4b700 1 --2- 172.21.15.125:0/2771934226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70b0159cf0 0x7f70b00ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:07:14.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.108+0000 7f70b4b49700 1 --2- 172.21.15.125:0/2771934226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70b00b2700 0x7f70b01580f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f70a000e9b0 tx=0x7f70a000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:14.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.108+0000 7f70a5ffb700 1 -- 172.21.15.125:0/2771934226 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a000ee50 con 0x7f70b00b2700 2023-10-17T06:07:14.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.108+0000 7f70a5ffb700 1 -- 172.21.15.125:0/2771934226 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a000c850 con 0x7f70b00b2700 2023-10-17T06:07:14.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.108+0000 7f70a5ffb700 1 -- 172.21.15.125:0/2771934226 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a000cc00 con 0x7f70b00b2700 2023-10-17T06:07:14.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.108+0000 7f70b75ae700 1 -- 172.21.15.125:0/2771934226 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a80094b0 con 0x7f70b00b2700 2023-10-17T06:07:14.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.108+0000 7f70b75ae700 1 -- 172.21.15.125:0/2771934226 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b00aba90 con 0x7f70b00b2700 2023-10-17T06:07:14.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.108+0000 7f70b75ae700 1 -- 172.21.15.125:0/2771934226 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b00ab8f0 con 0x7f70b00b2700 2023-10-17T06:07:14.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.112+0000 7f70a5ffb700 1 -- 172.21.15.125:0/2771934226 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f70a0013470 con 0x7f70b00b2700 2023-10-17T06:07:14.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.112+0000 7f70a5ffb700 1 --2- 172.21.15.125:0/2771934226 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7094065720 0x7f7094067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:14.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.112+0000 7f70a5ffb700 1 -- 172.21.15.125:0/2771934226 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f70a0082ce0 con 0x7f70b00b2700 2023-10-17T06:07:14.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.112+0000 7f70b534a700 1 --2- 172.21.15.125:0/2771934226 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7094065720 0x7f7094067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:14.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.116+0000 7f70b534a700 1 --2- 172.21.15.125:0/2771934226 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7094065720 0x7f7094067be0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f70ac004db0 tx=0x7f70ac005540 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:14.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.116+0000 7f70a5ffb700 1 -- 172.21.15.125:0/2771934226 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f70b00ab8f0 con 0x7f70b00b2700 2023-10-17T06:07:14.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.572+0000 7f70b75ae700 1 -- 172.21.15.125:0/2771934226 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f70b00ab8f0 con 0x7f70b00b2700 2023-10-17T06:07:14.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.884+0000 7f70a5ffb700 1 -- 172.21.15.125:0/2771934226 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f70b00ab8f0 con 0x7f70b00b2700 2023-10-17T06:07:14.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.884+0000 7f70b75ae700 1 -- 172.21.15.125:0/2771934226 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7094065720 msgr2=0x7f7094067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:14.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.884+0000 7f70b75ae700 1 --2- 172.21.15.125:0/2771934226 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7094065720 0x7f7094067be0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f70ac004db0 tx=0x7f70ac005540 comp rx=0 tx=0).stop 2023-10-17T06:07:14.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.884+0000 7f70b75ae700 1 -- 172.21.15.125:0/2771934226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70b00b2700 msgr2=0x7f70b01580f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:14.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.884+0000 7f70b75ae700 1 --2- 172.21.15.125:0/2771934226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70b00b2700 0x7f70b01580f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f70a000e9b0 tx=0x7f70a000ecc0 comp rx=0 tx=0).stop 2023-10-17T06:07:14.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.884+0000 7f70b75ae700 1 -- 172.21.15.125:0/2771934226 shutdown_connections 2023-10-17T06:07:14.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.884+0000 7f70b75ae700 1 --2- 172.21.15.125:0/2771934226 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7094065720 0x7f7094067be0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:14.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.884+0000 7f70b75ae700 1 --2- 172.21.15.125:0/2771934226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70b0159cf0 0x7f70b00ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:14.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.884+0000 7f70b75ae700 1 --2- 172.21.15.125:0/2771934226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70b00b2700 0x7f70b01580f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:14.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.884+0000 7f70b75ae700 1 --2- 172.21.15.125:0/2771934226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f70b006e670 0x7f70b00c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:14.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.884+0000 7f70b75ae700 1 -- 172.21.15.125:0/2771934226 >> 172.21.15.125:0/2771934226 conn(0x7f70b00cf8b0 msgr2=0x7f70b015a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:14.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.884+0000 7f70b75ae700 1 -- 172.21.15.125:0/2771934226 shutdown_connections 2023-10-17T06:07:14.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:14.884+0000 7f70b75ae700 1 -- 172.21.15.125:0/2771934226 wait complete. 2023-10-17T06:07:14.891 INFO:teuthology.orchestra.run.smithi125.stderr:added data pool 5 to fsmap 2023-10-17T06:07:14.911 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:07:15.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.084+0000 7f90e6a87700 1 Processor -- start 2023-10-17T06:07:15.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.084+0000 7f90e6a87700 1 -- start start 2023-10-17T06:07:15.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.088+0000 7f90e6a87700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90e0146800 0x7f90e00b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:15.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.088+0000 7f90e6a87700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f90e00700b0 0x7f90e015eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:15.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.088+0000 7f90e6a87700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e015e680 con 0x7f90e015dd30 2023-10-17T06:07:15.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.088+0000 7f90e6a87700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e00b6180 con 0x7f90e00700b0 2023-10-17T06:07:15.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.088+0000 7f90e6a87700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e00b6460 con 0x7f90e0146800 2023-10-17T06:07:15.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.088+0000 7f90e5024700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f90e00700b0 0x7f90e015eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:15.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.088+0000 7f90dffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f90e015dd30 0x7f90e006f9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45444/0 (socket says 172.21.15.125:45444) 2023-10-17T06:07:15.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.088+0000 7f90e5024700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f90e00700b0 0x7f90e015eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49412/0 (socket says 172.21.15.125:49412) 2023-10-17T06:07:15.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.088+0000 7f90dffff700 1 -- 172.21.15.125:0/1038919563 learned_addr learned my addr 172.21.15.125:0/1038919563 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:15.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.088+0000 7f90e4823700 1 --2- 172.21.15.125:0/1038919563 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90e0146800 0x7f90e00b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:15.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.088+0000 7f90e5024700 1 -- 172.21.15.125:0/1038919563 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90e0146800 msgr2=0x7f90e00b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:15.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.088+0000 7f90e5024700 1 --2- 172.21.15.125:0/1038919563 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90e0146800 0x7f90e00b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.088+0000 7f90e5024700 1 -- 172.21.15.125:0/1038919563 >> v1:172.21.15.125:6789/0 conn(0x7f90e015dd30 legacy=0x7f90e006f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:15.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.088+0000 7f90e5024700 1 -- 172.21.15.125:0/1038919563 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e00b6740 con 0x7f90e00700b0 2023-10-17T06:07:15.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.088+0000 7f90df7fe700 1 -- 172.21.15.125:0/1038919563 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373601128 0 0) 0x7f90e015e680 con 0x7f90e015dd30 2023-10-17T06:07:15.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.088+0000 7f90e5024700 1 --2- 172.21.15.125:0/1038919563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90e00700b0 0x7f90e015eb10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009d90 tx=0x7f90d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd87620b90922d server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:15.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.088+0000 7f90df7fe700 1 -- 172.21.15.125:0/1038919563 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d800e070 con 0x7f90e00700b0 2023-10-17T06:07:15.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.088+0000 7f90df7fe700 1 -- 172.21.15.125:0/1038919563 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d800bb20 con 0x7f90e00700b0 2023-10-17T06:07:15.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.088+0000 7f90df7fe700 1 -- 172.21.15.125:0/1038919563 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d8012430 con 0x7f90e00700b0 2023-10-17T06:07:15.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.092+0000 7f90e6a87700 1 -- 172.21.15.125:0/1038919563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90e00700b0 msgr2=0x7f90e015eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:15.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.092+0000 7f90e6a87700 1 --2- 172.21.15.125:0/1038919563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90e00700b0 0x7f90e015eb10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f90d8009d90 tx=0x7f90d800b330 comp rx=0 tx=0).stop 2023-10-17T06:07:15.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.092+0000 7f90e6a87700 1 -- 172.21.15.125:0/1038919563 shutdown_connections 2023-10-17T06:07:15.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.092+0000 7f90e6a87700 1 --2- 172.21.15.125:0/1038919563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90e00700b0 0x7f90e015eb10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.092+0000 7f90e6a87700 1 --2- 172.21.15.125:0/1038919563 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90e0146800 0x7f90e00b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.092+0000 7f90e6a87700 1 -- 172.21.15.125:0/1038919563 >> 172.21.15.125:0/1038919563 conn(0x7f90e006a130 msgr2=0x7f90e006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:15.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.092+0000 7f90e6a87700 1 -- 172.21.15.125:0/1038919563 shutdown_connections 2023-10-17T06:07:15.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.092+0000 7f90e6a87700 1 -- 172.21.15.125:0/1038919563 wait complete. 2023-10-17T06:07:15.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.092+0000 7f90e6a87700 1 Processor -- start 2023-10-17T06:07:15.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.092+0000 7f90e6a87700 1 -- start start 2023-10-17T06:07:15.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90e6a87700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90e00700b0 0x7f90e00caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:15.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90e6a87700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90e0146800 0x7f90e014dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:15.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90e6a87700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90e015dd30 0x7f90e014e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:15.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90e6a87700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e014e950 con 0x7f90e00700b0 2023-10-17T06:07:15.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90e6a87700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e014ec30 con 0x7f90e015dd30 2023-10-17T06:07:15.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90e6a87700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e014ef10 con 0x7f90e0146800 2023-10-17T06:07:15.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90e4823700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90e00700b0 0x7f90e00caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:15.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90e4823700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90e00700b0 0x7f90e00caf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49428/0 (socket says 172.21.15.125:49428) 2023-10-17T06:07:15.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90e4823700 1 -- 172.21.15.125:0/3343339155 learned_addr learned my addr 172.21.15.125:0/3343339155 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:15.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90dffff700 1 --2- 172.21.15.125:0/3343339155 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90e0146800 0x7f90e014dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:15.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90e5024700 1 --2- 172.21.15.125:0/3343339155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90e015dd30 0x7f90e014e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90e4823700 1 -- 172.21.15.125:0/3343339155 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90e0146800 msgr2=0x7f90e014dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90e4823700 1 --2- 172.21.15.125:0/3343339155 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90e0146800 0x7f90e014dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90e4823700 1 -- 172.21.15.125:0/3343339155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90e015dd30 msgr2=0x7f90e014e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:15.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90e4823700 1 --2- 172.21.15.125:0/3343339155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90e015dd30 0x7f90e014e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90e4823700 1 -- 172.21.15.125:0/3343339155 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d8009a70 con 0x7f90e00700b0 2023-10-17T06:07:15.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90e4823700 1 --2- 172.21.15.125:0/3343339155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90e00700b0 0x7f90e00caf80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f90d400e9d0 tx=0x7f90d400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:15.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90dd7fa700 1 -- 172.21.15.125:0/3343339155 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d4009720 con 0x7f90e00700b0 2023-10-17T06:07:15.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90dd7fa700 1 -- 172.21.15.125:0/3343339155 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d400c850 con 0x7f90e00700b0 2023-10-17T06:07:15.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90dd7fa700 1 -- 172.21.15.125:0/3343339155 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d400cbc0 con 0x7f90e00700b0 2023-10-17T06:07:15.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90e6a87700 1 -- 172.21.15.125:0/3343339155 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e014f1f0 con 0x7f90e00700b0 2023-10-17T06:07:15.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.096+0000 7f90e6a87700 1 -- 172.21.15.125:0/3343339155 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e014c400 con 0x7f90e00700b0 2023-10-17T06:07:15.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.100+0000 7f90e6a87700 1 -- 172.21.15.125:0/3343339155 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e014f430 con 0x7f90e00700b0 2023-10-17T06:07:15.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.100+0000 7f90dd7fa700 1 -- 172.21.15.125:0/3343339155 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f90d400cd20 con 0x7f90e00700b0 2023-10-17T06:07:15.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.100+0000 7f90dd7fa700 1 --2- 172.21.15.125:0/3343339155 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f90c40656f0 0x7f90c4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:15.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.100+0000 7f90dd7fa700 1 -- 172.21.15.125:0/3343339155 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f90d40831f0 con 0x7f90e00700b0 2023-10-17T06:07:15.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.100+0000 7f90dffff700 1 --2- 172.21.15.125:0/3343339155 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f90c40656f0 0x7f90c4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:15.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.104+0000 7f90dffff700 1 --2- 172.21.15.125:0/3343339155 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f90c40656f0 0x7f90c4067bb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f90e00cf720 tx=0x7f90cc007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:15.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.104+0000 7f90dd7fa700 1 -- 172.21.15.125:0/3343339155 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f90d4050920 con 0x7f90e00700b0 2023-10-17T06:07:15.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.324+0000 7f90e6a87700 1 -- 172.21.15.125:0/3343339155 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90e01616c0 con 0x7f90e00700b0 2023-10-17T06:07:15.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.324+0000 7f90dd7fa700 1 -- 172.21.15.125:0/3343339155 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f90d4053f40 con 0x7f90e00700b0 2023-10-17T06:07:15.329 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:15.329 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/3744648044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3744648044},{"type":"v1","addr":"172.21.15.184:6833","nonce":3744648044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/181458401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181458401},{"type":"v1","addr":"172.21.15.184:6835","nonce":181458401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/908363262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":908363262},{"type":"v1","addr":"172.21.15.125:6835","nonce":908363262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:07:09.036610+0000","modified":"2023-10-17T06:07:14.866677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/3617198893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":3617198893},{"type":"v1","addr":"172.21.15.125:6837","nonce":3617198893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-17T06:07:15.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.328+0000 7f90e6a87700 1 -- 172.21.15.125:0/3343339155 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f90c40656f0 msgr2=0x7f90c4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:15.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.328+0000 7f90e6a87700 1 --2- 172.21.15.125:0/3343339155 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f90c40656f0 0x7f90c4067bb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f90e00cf720 tx=0x7f90cc007e90 comp rx=0 tx=0).stop 2023-10-17T06:07:15.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.328+0000 7f90e6a87700 1 -- 172.21.15.125:0/3343339155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90e00700b0 msgr2=0x7f90e00caf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:15.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.328+0000 7f90e6a87700 1 --2- 172.21.15.125:0/3343339155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90e00700b0 0x7f90e00caf80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f90d400e9d0 tx=0x7f90d400ece0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.328+0000 7f90e6a87700 1 -- 172.21.15.125:0/3343339155 shutdown_connections 2023-10-17T06:07:15.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.328+0000 7f90e6a87700 1 --2- 172.21.15.125:0/3343339155 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f90c40656f0 0x7f90c4067bb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.328+0000 7f90e6a87700 1 --2- 172.21.15.125:0/3343339155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90e015dd30 0x7f90e014e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.328+0000 7f90e6a87700 1 --2- 172.21.15.125:0/3343339155 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90e0146800 0x7f90e014dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.328+0000 7f90e6a87700 1 --2- 172.21.15.125:0/3343339155 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90e00700b0 0x7f90e00caf80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.328+0000 7f90e6a87700 1 -- 172.21.15.125:0/3343339155 >> 172.21.15.125:0/3343339155 conn(0x7f90e006a130 msgr2=0x7f90e006d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:15.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.328+0000 7f90e6a87700 1 -- 172.21.15.125:0/3343339155 shutdown_connections 2023-10-17T06:07:15.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.328+0000 7f90e6a87700 1 -- 172.21.15.125:0/3343339155 wait complete. 2023-10-17T06:07:15.334 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 7 2023-10-17T06:07:15.352 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:07:15.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.520+0000 7ff9419eb700 1 Processor -- start 2023-10-17T06:07:15.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.520+0000 7ff9419eb700 1 -- start start 2023-10-17T06:07:15.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.524+0000 7ff9419eb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff93c06d530 0x7ff93c0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:15.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.524+0000 7ff9419eb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93c0ca4c0 con 0x7ff93c164a20 2023-10-17T06:07:15.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.524+0000 7ff9419eb700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93c0ca7a0 con 0x7ff93c0b3d40 2023-10-17T06:07:15.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.524+0000 7ff9419eb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c06e2d0 con 0x7ff93c06d530 2023-10-17T06:07:15.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.524+0000 7ff933fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff93c164a20 0x7ff93c06ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45454/0 (socket says 172.21.15.125:45454) 2023-10-17T06:07:15.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.524+0000 7ff933fff700 1 -- 172.21.15.125:0/326605039 learned_addr learned my addr 172.21.15.125:0/326605039 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:15.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.524+0000 7ff9411ea700 1 --2- 172.21.15.125:0/326605039 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff93c06d530 0x7ff93c0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:15.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.524+0000 7ff9337fe700 1 -- 172.21.15.125:0/326605039 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114368732 0 0) 0x7ff93c0ca4c0 con 0x7ff93c164a20 2023-10-17T06:07:15.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.528+0000 7ff9337fe700 1 -- 172.21.15.125:0/326605039 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9240035d0 con 0x7ff93c164a20 2023-10-17T06:07:15.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.528+0000 7ff9411ea700 1 -- 172.21.15.125:0/326605039 >> v1:172.21.15.184:6789/0 conn(0x7ff93c0b3d40 legacy=0x7ff93c0c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:15.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.528+0000 7ff9337fe700 1 -- 172.21.15.125:0/326605039 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990365237 0 0) 0x7ff93c0ca7a0 con 0x7ff93c0b3d40 2023-10-17T06:07:15.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.528+0000 7ff9411ea700 1 -- 172.21.15.125:0/326605039 >> v1:172.21.15.125:6789/0 conn(0x7ff93c164a20 legacy=0x7ff93c06ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:15.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.528+0000 7ff9411ea700 1 -- 172.21.15.125:0/326605039 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c0caa80 con 0x7ff93c06d530 2023-10-17T06:07:15.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.528+0000 7ff9411ea700 1 --2- 172.21.15.125:0/326605039 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff93c06d530 0x7ff93c0cc190 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff934009dc0 tx=0x7ff93400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eea04516fdb2848e server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:15.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.528+0000 7ff9337fe700 1 -- 172.21.15.125:0/326605039 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93400e070 con 0x7ff93c06d530 2023-10-17T06:07:15.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.528+0000 7ff9337fe700 1 -- 172.21.15.125:0/326605039 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff934003a40 con 0x7ff93c06d530 2023-10-17T06:07:15.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.528+0000 7ff9337fe700 1 -- 172.21.15.125:0/326605039 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c0015f0 con 0x7ff93c06d530 2023-10-17T06:07:15.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.528+0000 7ff9419eb700 1 -- 172.21.15.125:0/326605039 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff93c06d530 msgr2=0x7ff93c0cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:15.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.528+0000 7ff9419eb700 1 --2- 172.21.15.125:0/326605039 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff93c06d530 0x7ff93c0cc190 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff934009dc0 tx=0x7ff93400b330 comp rx=0 tx=0).stop 2023-10-17T06:07:15.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.528+0000 7ff9419eb700 1 -- 172.21.15.125:0/326605039 shutdown_connections 2023-10-17T06:07:15.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.528+0000 7ff9419eb700 1 --2- 172.21.15.125:0/326605039 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff93c06d530 0x7ff93c0cc190 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.528+0000 7ff9419eb700 1 -- 172.21.15.125:0/326605039 >> 172.21.15.125:0/326605039 conn(0x7ff93c0ce5c0 msgr2=0x7ff93c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:15.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.528+0000 7ff9419eb700 1 -- 172.21.15.125:0/326605039 shutdown_connections 2023-10-17T06:07:15.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.528+0000 7ff9419eb700 1 -- 172.21.15.125:0/326605039 wait complete. 2023-10-17T06:07:15.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.532+0000 7ff9419eb700 1 Processor -- start 2023-10-17T06:07:15.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.532+0000 7ff9419eb700 1 -- start start 2023-10-17T06:07:15.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.532+0000 7ff9419eb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff93c06d530 0x7ff93c0c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:15.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.532+0000 7ff9419eb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff93c0b3d40 0x7ff93c163010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:15.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.532+0000 7ff9419eb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff93c164a20 0x7ff93c158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:15.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.532+0000 7ff9419eb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c164320 con 0x7ff93c164a20 2023-10-17T06:07:15.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.532+0000 7ff9419eb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c163550 con 0x7ff93c06d530 2023-10-17T06:07:15.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.532+0000 7ff9419eb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c162b80 con 0x7ff93c0b3d40 2023-10-17T06:07:15.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.532+0000 7ff9411ea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff93c164a20 0x7ff93c158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:15.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.532+0000 7ff9411ea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff93c164a20 0x7ff93c158ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49434/0 (socket says 172.21.15.125:49434) 2023-10-17T06:07:15.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.532+0000 7ff9411ea700 1 -- 172.21.15.125:0/4067725880 learned_addr learned my addr 172.21.15.125:0/4067725880 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:15.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.532+0000 7ff933fff700 1 --2- 172.21.15.125:0/4067725880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff93c0b3d40 0x7ff93c163010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:15.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.532+0000 7ff9409e9700 1 --2- 172.21.15.125:0/4067725880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff93c06d530 0x7ff93c0c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:15.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.532+0000 7ff9411ea700 1 -- 172.21.15.125:0/4067725880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff93c0b3d40 msgr2=0x7ff93c163010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:15.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.532+0000 7ff9411ea700 1 --2- 172.21.15.125:0/4067725880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff93c0b3d40 0x7ff93c163010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.532+0000 7ff9411ea700 1 -- 172.21.15.125:0/4067725880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff93c06d530 msgr2=0x7ff93c0c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:15.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.532+0000 7ff9411ea700 1 --2- 172.21.15.125:0/4067725880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff93c06d530 0x7ff93c0c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.532+0000 7ff9411ea700 1 -- 172.21.15.125:0/4067725880 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff934009a70 con 0x7ff93c164a20 2023-10-17T06:07:15.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.532+0000 7ff933fff700 1 --2- 172.21.15.125:0/4067725880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff93c0b3d40 0x7ff93c163010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:15.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.532+0000 7ff9411ea700 1 --2- 172.21.15.125:0/4067725880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff93c164a20 0x7ff93c158ca0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0cf100 tx=0x7ff934004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:15.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.536+0000 7ff9317fa700 1 -- 172.21.15.125:0/4067725880 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934004760 con 0x7ff93c164a20 2023-10-17T06:07:15.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.536+0000 7ff9317fa700 1 -- 172.21.15.125:0/4067725880 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9340048c0 con 0x7ff93c164a20 2023-10-17T06:07:15.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.536+0000 7ff9317fa700 1 -- 172.21.15.125:0/4067725880 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934012690 con 0x7ff93c164a20 2023-10-17T06:07:15.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.536+0000 7ff9419eb700 1 -- 172.21.15.125:0/4067725880 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93c1591e0 con 0x7ff93c164a20 2023-10-17T06:07:15.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.536+0000 7ff9419eb700 1 -- 172.21.15.125:0/4067725880 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93c162530 con 0x7ff93c164a20 2023-10-17T06:07:15.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.536+0000 7ff9419eb700 1 -- 172.21.15.125:0/4067725880 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff93c162cf0 con 0x7ff93c164a20 2023-10-17T06:07:15.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.536+0000 7ff9317fa700 1 -- 172.21.15.125:0/4067725880 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff9340127f0 con 0x7ff93c164a20 2023-10-17T06:07:15.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.536+0000 7ff9317fa700 1 --2- 172.21.15.125:0/4067725880 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff9280656f0 0x7ff928067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:15.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.540+0000 7ff9317fa700 1 -- 172.21.15.125:0/4067725880 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff934084c20 con 0x7ff93c164a20 2023-10-17T06:07:15.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.540+0000 7ff9409e9700 1 --2- 172.21.15.125:0/4067725880 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff9280656f0 0x7ff928067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:15.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.540+0000 7ff9409e9700 1 --2- 172.21.15.125:0/4067725880 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff9280656f0 0x7ff928067bb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff938007bd0 tx=0x7ff938009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:15.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.544+0000 7ff9317fa700 1 -- 172.21.15.125:0/4067725880 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff934052360 con 0x7ff93c164a20 2023-10-17T06:07:15.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.716+0000 7ff9419eb700 1 -- 172.21.15.125:0/4067725880 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff93c072e60 con 0x7ff93c164a20 2023-10-17T06:07:15.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.720+0000 7ff9317fa700 1 -- 172.21.15.125:0/4067725880 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7ff934055980 con 0x7ff93c164a20 2023-10-17T06:07:15.722 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:15.722 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":28,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:14.576796+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:07:15.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.724+0000 7ff9419eb700 1 -- 172.21.15.125:0/4067725880 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff9280656f0 msgr2=0x7ff928067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:15.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.724+0000 7ff9419eb700 1 --2- 172.21.15.125:0/4067725880 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff9280656f0 0x7ff928067bb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff938007bd0 tx=0x7ff938009040 comp rx=0 tx=0).stop 2023-10-17T06:07:15.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.724+0000 7ff9419eb700 1 -- 172.21.15.125:0/4067725880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff93c164a20 msgr2=0x7ff93c158ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:15.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.724+0000 7ff9419eb700 1 --2- 172.21.15.125:0/4067725880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff93c164a20 0x7ff93c158ca0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0cf100 tx=0x7ff934004af0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.724+0000 7ff9419eb700 1 -- 172.21.15.125:0/4067725880 shutdown_connections 2023-10-17T06:07:15.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.724+0000 7ff9419eb700 1 --2- 172.21.15.125:0/4067725880 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff9280656f0 0x7ff928067bb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.724+0000 7ff9419eb700 1 --2- 172.21.15.125:0/4067725880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff93c164a20 0x7ff93c158ca0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.724+0000 7ff9419eb700 1 --2- 172.21.15.125:0/4067725880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff93c0b3d40 0x7ff93c163010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.724+0000 7ff9419eb700 1 --2- 172.21.15.125:0/4067725880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff93c06d530 0x7ff93c0c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.724+0000 7ff9419eb700 1 -- 172.21.15.125:0/4067725880 >> 172.21.15.125:0/4067725880 conn(0x7ff93c0ce5c0 msgr2=0x7ff93c0c4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:15.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.724+0000 7ff9419eb700 1 -- 172.21.15.125:0/4067725880 shutdown_connections 2023-10-17T06:07:15.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.724+0000 7ff9419eb700 1 -- 172.21.15.125:0/4067725880 wait complete. 2023-10-17T06:07:15.747 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:07:15.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.888+0000 7f0eb645a700 1 Processor -- start 2023-10-17T06:07:15.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.888+0000 7f0eb645a700 1 -- start start 2023-10-17T06:07:15.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0eb645a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0eb00b3d40 0x7f0eb00cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:15.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0eb645a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0eb0164a20 0x7f0eb00c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:15.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0eb645a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0eb006ce20 0x7f0eb006d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:15.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0eb645a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb006e2d0 con 0x7f0eb00b3d40 2023-10-17T06:07:15.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0eb645a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb006d7d0 con 0x7f0eb006ce20 2023-10-17T06:07:15.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0eb645a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb00ca200 con 0x7f0eb0164a20 2023-10-17T06:07:15.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0eb5458700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0eb00b3d40 0x7f0eb00cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:15.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0eb4c57700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0eb0164a20 0x7f0eb00c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:15.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0eb5458700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0eb00b3d40 0x7f0eb00cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49440/0 (socket says 172.21.15.125:49440) 2023-10-17T06:07:15.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0eb5458700 1 -- 172.21.15.125:0/820889728 learned_addr learned my addr 172.21.15.125:0/820889728 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:15.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0eb5c59700 1 --2- 172.21.15.125:0/820889728 >> v2:172.21.15.184:3300/0 conn(0x7f0eb006ce20 0x7f0eb006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:15.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0eb5458700 1 -- 172.21.15.125:0/820889728 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0eb0164a20 msgr2=0x7f0eb00c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:15.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0eb5458700 1 --2- 172.21.15.125:0/820889728 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0eb0164a20 0x7f0eb00c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0eb5458700 1 -- 172.21.15.125:0/820889728 >> v2:172.21.15.184:3300/0 conn(0x7f0eb006ce20 msgr2=0x7f0eb006d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:15.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0eb5458700 1 --2- 172.21.15.125:0/820889728 >> v2:172.21.15.184:3300/0 conn(0x7f0eb006ce20 0x7f0eb006d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0eb5458700 1 -- 172.21.15.125:0/820889728 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb00ca4c0 con 0x7f0eb00b3d40 2023-10-17T06:07:15.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0eb5c59700 1 --2- 172.21.15.125:0/820889728 >> v2:172.21.15.184:3300/0 conn(0x7f0eb006ce20 0x7f0eb006d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:15.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0eb5458700 1 --2- 172.21.15.125:0/820889728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0eb00b3d40 0x7f0eb00cc190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0164eb0 tx=0x7f0eac009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6304d0ce167bb6c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:15.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0ea7fff700 1 -- 172.21.15.125:0/820889728 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac011830 con 0x7f0eb00b3d40 2023-10-17T06:07:15.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0ea7fff700 1 -- 172.21.15.125:0/820889728 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac011990 con 0x7f0eb00b3d40 2023-10-17T06:07:15.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0ea7fff700 1 -- 172.21.15.125:0/820889728 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac011d20 con 0x7f0eb00b3d40 2023-10-17T06:07:15.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0eb645a700 1 -- 172.21.15.125:0/820889728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0eb00b3d40 msgr2=0x7f0eb00cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:15.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.892+0000 7f0eb645a700 1 --2- 172.21.15.125:0/820889728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0eb00b3d40 0x7f0eb00cc190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0164eb0 tx=0x7f0eac009bf0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb645a700 1 -- 172.21.15.125:0/820889728 shutdown_connections 2023-10-17T06:07:15.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb645a700 1 --2- 172.21.15.125:0/820889728 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0eb0164a20 0x7f0eb00c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb645a700 1 --2- 172.21.15.125:0/820889728 >> v2:172.21.15.184:3300/0 conn(0x7f0eb006ce20 0x7f0eb006d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb645a700 1 --2- 172.21.15.125:0/820889728 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0eb00b3d40 0x7f0eb00cc190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb645a700 1 -- 172.21.15.125:0/820889728 >> 172.21.15.125:0/820889728 conn(0x7f0eb00ce5c0 msgr2=0x7f0eb00ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:15.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb645a700 1 -- 172.21.15.125:0/820889728 shutdown_connections 2023-10-17T06:07:15.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb645a700 1 -- 172.21.15.125:0/820889728 wait complete. 2023-10-17T06:07:15.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb645a700 1 Processor -- start 2023-10-17T06:07:15.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb645a700 1 -- start start 2023-10-17T06:07:15.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb645a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0eb006ce20 0x7f0eb00b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:15.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb645a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0eb00b3d40 0x7f0eb01579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:15.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb645a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0eb0164a20 0x7f0eb015eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:15.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb645a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb00b1580 con 0x7f0eb006ce20 2023-10-17T06:07:15.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb645a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb015dcc0 con 0x7f0eb0164a20 2023-10-17T06:07:15.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb645a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb015dfa0 con 0x7f0eb00b3d40 2023-10-17T06:07:15.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb5458700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0eb006ce20 0x7f0eb00b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:15.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb5458700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0eb006ce20 0x7f0eb00b18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49454/0 (socket says 172.21.15.125:49454) 2023-10-17T06:07:15.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb5458700 1 -- 172.21.15.125:0/1265220071 learned_addr learned my addr 172.21.15.125:0/1265220071 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:15.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb5458700 1 -- 172.21.15.125:0/1265220071 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0eb00b3d40 msgr2=0x7f0eb01579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:15.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb5458700 1 --2- 172.21.15.125:0/1265220071 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0eb00b3d40 0x7f0eb01579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb5458700 1 -- 172.21.15.125:0/1265220071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0eb0164a20 msgr2=0x7f0eb015eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:15.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.896+0000 7f0eb5458700 1 --2- 172.21.15.125:0/1265220071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0eb0164a20 0x7f0eb015eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:15.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.900+0000 7f0eb5458700 1 -- 172.21.15.125:0/1265220071 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac009570 con 0x7f0eb006ce20 2023-10-17T06:07:15.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.900+0000 7f0eb5458700 1 --2- 172.21.15.125:0/1265220071 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0eb006ce20 0x7f0eb00b18c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00cf100 tx=0x7f0eac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:15.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.900+0000 7f0ea5ffb700 1 -- 172.21.15.125:0/1265220071 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0044d0 con 0x7f0eb006ce20 2023-10-17T06:07:15.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.900+0000 7f0ea5ffb700 1 -- 172.21.15.125:0/1265220071 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac01f070 con 0x7f0eb006ce20 2023-10-17T06:07:15.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.900+0000 7f0eb645a700 1 -- 172.21.15.125:0/1265220071 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb015e280 con 0x7f0eb006ce20 2023-10-17T06:07:15.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.900+0000 7f0ea5ffb700 1 -- 172.21.15.125:0/1265220071 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac003900 con 0x7f0eb006ce20 2023-10-17T06:07:15.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.900+0000 7f0eb645a700 1 -- 172.21.15.125:0/1265220071 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb00b1e00 con 0x7f0eb006ce20 2023-10-17T06:07:15.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.900+0000 7f0eb645a700 1 -- 172.21.15.125:0/1265220071 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb0072e60 con 0x7f0eb006ce20 2023-10-17T06:07:15.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.900+0000 7f0ea5ffb700 1 -- 172.21.15.125:0/1265220071 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0eac003a60 con 0x7f0eb006ce20 2023-10-17T06:07:15.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.904+0000 7f0ea5ffb700 1 --2- 172.21.15.125:0/1265220071 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0e940656f0 0x7f0e94067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:15.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.904+0000 7f0ea5ffb700 1 -- 172.21.15.125:0/1265220071 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0eac021070 con 0x7f0eb006ce20 2023-10-17T06:07:15.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.904+0000 7f0eb4c57700 1 --2- 172.21.15.125:0/1265220071 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0e940656f0 0x7f0e94067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:15.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.904+0000 7f0eb4c57700 1 --2- 172.21.15.125:0/1265220071 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0e940656f0 0x7f0e94067bb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0006b40 tx=0x7f0ea0006ad0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:15.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:15.908+0000 7f0ea5ffb700 1 -- 172.21.15.125:0/1265220071 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0eac051d10 con 0x7f0eb006ce20 2023-10-17T06:07:16.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.088+0000 7f0eb645a700 1 -- 172.21.15.125:0/1265220071 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0eb00c9000 con 0x7f0eb006ce20 2023-10-17T06:07:16.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.088+0000 7f0ea5ffb700 1 -- 172.21.15.125:0/1265220071 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f0eac055330 con 0x7f0eb006ce20 2023-10-17T06:07:16.092 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:16.092 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":28,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:14.576796+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:07:16.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.092+0000 7f0eb645a700 1 -- 172.21.15.125:0/1265220071 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0e940656f0 msgr2=0x7f0e94067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:16.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.092+0000 7f0eb645a700 1 --2- 172.21.15.125:0/1265220071 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0e940656f0 0x7f0e94067bb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0006b40 tx=0x7f0ea0006ad0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.092+0000 7f0eb645a700 1 -- 172.21.15.125:0/1265220071 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0eb006ce20 msgr2=0x7f0eb00b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:16.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.092+0000 7f0eb645a700 1 --2- 172.21.15.125:0/1265220071 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0eb006ce20 0x7f0eb00b18c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00cf100 tx=0x7f0eac004770 comp rx=0 tx=0).stop 2023-10-17T06:07:16.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.092+0000 7f0eb645a700 1 -- 172.21.15.125:0/1265220071 shutdown_connections 2023-10-17T06:07:16.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.092+0000 7f0eb645a700 1 --2- 172.21.15.125:0/1265220071 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0e940656f0 0x7f0e94067bb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.092+0000 7f0eb645a700 1 --2- 172.21.15.125:0/1265220071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0eb0164a20 0x7f0eb015eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.092+0000 7f0eb645a700 1 --2- 172.21.15.125:0/1265220071 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0eb00b3d40 0x7f0eb01579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.092+0000 7f0eb645a700 1 --2- 172.21.15.125:0/1265220071 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0eb006ce20 0x7f0eb00b18c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.092+0000 7f0eb645a700 1 -- 172.21.15.125:0/1265220071 >> 172.21.15.125:0/1265220071 conn(0x7f0eb00ce5c0 msgr2=0x7f0eb00cc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:16.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.092+0000 7f0eb645a700 1 -- 172.21.15.125:0/1265220071 shutdown_connections 2023-10-17T06:07:16.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.092+0000 7f0eb645a700 1 -- 172.21.15.125:0/1265220071 wait complete. 2023-10-17T06:07:16.128 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:07:16.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.300+0000 7f2e588b5700 1 Processor -- start 2023-10-17T06:07:16.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.300+0000 7f2e588b5700 1 -- start start 2023-10-17T06:07:16.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.300+0000 7f2e588b5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e540ce320 0x7f2e540cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:16.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.300+0000 7f2e588b5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e540cbc80 con 0x7f2e54155420 2023-10-17T06:07:16.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.300+0000 7f2e588b5700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e540cb9a0 con 0x7f2e5415bf00 2023-10-17T06:07:16.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.300+0000 7f2e588b5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e54155800 con 0x7f2e540ce320 2023-10-17T06:07:16.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.300+0000 7f2e5259c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2e54155420 0x7f2e540cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45466/0 (socket says 172.21.15.125:45466) 2023-10-17T06:07:16.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.300+0000 7f2e5259c700 1 -- 172.21.15.125:0/1756451741 learned_addr learned my addr 172.21.15.125:0/1756451741 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:16.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e52d9d700 1 --2- 172.21.15.125:0/1756451741 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e540ce320 0x7f2e540cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:16.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e51d9b700 1 -- 172.21.15.125:0/1756451741 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842719200 0 0) 0x7f2e540cbc80 con 0x7f2e54155420 2023-10-17T06:07:16.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e51d9b700 1 -- 172.21.15.125:0/1756451741 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e400035d0 con 0x7f2e54155420 2023-10-17T06:07:16.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e51d9b700 1 -- 172.21.15.125:0/1756451741 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 528735543 0 0) 0x7f2e400035d0 con 0x7f2e54155420 2023-10-17T06:07:16.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e51d9b700 1 -- 172.21.15.125:0/1756451741 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e540ce320 msgr2=0x7f2e540cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:16.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e51d9b700 1 --2- 172.21.15.125:0/1756451741 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e540ce320 0x7f2e540cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e51d9b700 1 -- 172.21.15.125:0/1756451741 >> v1:172.21.15.184:6789/0 conn(0x7f2e5415bf00 legacy=0x7f2e540cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:16.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e51d9b700 1 -- 172.21.15.125:0/1756451741 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5415b420 con 0x7f2e54155420 2023-10-17T06:07:16.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e51d9b700 1 -- 172.21.15.125:0/1756451741 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7f2e44001670 con 0x7f2e54155420 2023-10-17T06:07:16.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e51d9b700 1 -- 172.21.15.125:0/1756451741 >> v1:172.21.15.125:6789/0 conn(0x7f2e54155420 legacy=0x7f2e540cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:16.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e51d9b700 1 --2- 172.21.15.125:0/1756451741 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e40003a50 0x7f2e40003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:16.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e51d9b700 1 --2- 172.21.15.125:0/1756451741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e40004870 0x7f2e40004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:16.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e51d9b700 1 --2- 172.21.15.125:0/1756451741 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e40005350 0x7f2e4000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:16.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e51d9b700 1 -- 172.21.15.125:0/1756451741 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e54155800 con 0x7f2e40004870 2023-10-17T06:07:16.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e51d9b700 1 -- 172.21.15.125:0/1756451741 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4000c1d0 con 0x7f2e40005350 2023-10-17T06:07:16.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e51d9b700 1 -- 172.21.15.125:0/1756451741 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4000c390 con 0x7f2e40003a50 2023-10-17T06:07:16.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e49d9b700 1 --2- 172.21.15.125:0/1756451741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e40004870 0x7f2e40004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:16.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e5259c700 1 --2- 172.21.15.125:0/1756451741 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e40003a50 0x7f2e40003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:16.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e52d9d700 1 --2- 172.21.15.125:0/1756451741 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e40005350 0x7f2e4000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:16.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e49d9b700 1 -- 172.21.15.125:0/1756451741 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e40003a50 msgr2=0x7f2e40003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:16.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e49d9b700 1 --2- 172.21.15.125:0/1756451741 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e40003a50 0x7f2e40003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e49d9b700 1 -- 172.21.15.125:0/1756451741 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e40005350 msgr2=0x7f2e4000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:16.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e49d9b700 1 --2- 172.21.15.125:0/1756451741 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e40005350 0x7f2e4000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e49d9b700 1 -- 172.21.15.125:0/1756451741 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e400035d0 con 0x7f2e40004870 2023-10-17T06:07:16.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e52d9d700 1 --2- 172.21.15.125:0/1756451741 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e40005350 0x7f2e4000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:16.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e49d9b700 1 --2- 172.21.15.125:0/1756451741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e40004870 0x7f2e40004cf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0017e0 tx=0x7f2e400058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba8b19231a25e68 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:16.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e51d9b700 1 -- 172.21.15.125:0/1756451741 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c0052d0 con 0x7f2e40004870 2023-10-17T06:07:16.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e51d9b700 1 -- 172.21.15.125:0/1756451741 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c005430 con 0x7f2e40004870 2023-10-17T06:07:16.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e51d9b700 1 -- 172.21.15.125:0/1756451741 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c0055a0 con 0x7f2e40004870 2023-10-17T06:07:16.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e588b5700 1 -- 172.21.15.125:0/1756451741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e40004870 msgr2=0x7f2e40004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:16.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e588b5700 1 --2- 172.21.15.125:0/1756451741 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e40004870 0x7f2e40004cf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0017e0 tx=0x7f2e400058a0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e52d9d700 1 -- 172.21.15.125:0/1756451741 reap_dead start 2023-10-17T06:07:16.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e588b5700 1 -- 172.21.15.125:0/1756451741 shutdown_connections 2023-10-17T06:07:16.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e588b5700 1 -- 172.21.15.125:0/1756451741 >> 172.21.15.125:0/1756451741 conn(0x7f2e5406a340 msgr2=0x7f2e540b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:16.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e588b5700 1 -- 172.21.15.125:0/1756451741 shutdown_connections 2023-10-17T06:07:16.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.304+0000 7f2e588b5700 1 -- 172.21.15.125:0/1756451741 wait complete. 2023-10-17T06:07:16.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.308+0000 7f2e588b5700 1 Processor -- start 2023-10-17T06:07:16.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.308+0000 7f2e588b5700 1 -- start start 2023-10-17T06:07:16.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e588b5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e40004870 0x7f2e54130d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:16.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e588b5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e5415d780 0x7f2e5415dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:16.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e588b5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e54141d00 0x7f2e54142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:16.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e588b5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5415e140 con 0x7f2e5415d780 2023-10-17T06:07:16.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e588b5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e54132170 con 0x7f2e54141d00 2023-10-17T06:07:16.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e588b5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e54134d80 con 0x7f2e40004870 2023-10-17T06:07:16.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e49d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e5415d780 0x7f2e5415dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:16.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e49d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e5415d780 0x7f2e5415dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49470/0 (socket says 172.21.15.125:49470) 2023-10-17T06:07:16.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e49d9b700 1 -- 172.21.15.125:0/1837092523 learned_addr learned my addr 172.21.15.125:0/1837092523 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:16.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e49d9b700 1 -- 172.21.15.125:0/1837092523 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e40004870 msgr2=0x7f2e54130d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:16.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e5259c700 1 --2- 172.21.15.125:0/1837092523 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e40004870 0x7f2e54130d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:16.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e52d9d700 1 --2- 172.21.15.125:0/1837092523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e54141d00 0x7f2e54142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:16.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e49d9b700 1 --2- 172.21.15.125:0/1837092523 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e40004870 0x7f2e54130d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e49d9b700 1 -- 172.21.15.125:0/1837092523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e54141d00 msgr2=0x7f2e54142180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:16.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e49d9b700 1 --2- 172.21.15.125:0/1837092523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e54141d00 0x7f2e54142180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e49d9b700 1 -- 172.21.15.125:0/1837092523 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e54131560 con 0x7f2e5415d780 2023-10-17T06:07:16.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e49d9b700 1 --2- 172.21.15.125:0/1837092523 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e5415d780 0x7f2e5415dc00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c001dd0 tx=0x7f2e3c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:16.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e4b7fe700 1 -- 172.21.15.125:0/1837092523 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c0055a0 con 0x7f2e5415d780 2023-10-17T06:07:16.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e4b7fe700 1 -- 172.21.15.125:0/1837092523 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c007240 con 0x7f2e5415d780 2023-10-17T06:07:16.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e588b5700 1 -- 172.21.15.125:0/1837092523 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e54131840 con 0x7f2e5415d780 2023-10-17T06:07:16.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e4b7fe700 1 -- 172.21.15.125:0/1837092523 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c0075d0 con 0x7f2e5415d780 2023-10-17T06:07:16.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e588b5700 1 -- 172.21.15.125:0/1837092523 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e54131e00 con 0x7f2e5415d780 2023-10-17T06:07:16.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.312+0000 7f2e588b5700 1 -- 172.21.15.125:0/1837092523 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e541337f0 con 0x7f2e5415d780 2023-10-17T06:07:16.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.316+0000 7f2e4b7fe700 1 -- 172.21.15.125:0/1837092523 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2e3c0036a0 con 0x7f2e5415d780 2023-10-17T06:07:16.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.316+0000 7f2e4b7fe700 1 --2- 172.21.15.125:0/1837092523 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2e34065720 0x7f2e34067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:16.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.316+0000 7f2e4b7fe700 1 -- 172.21.15.125:0/1837092523 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2e3c083fe0 con 0x7f2e5415d780 2023-10-17T06:07:16.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.316+0000 7f2e5259c700 1 --2- 172.21.15.125:0/1837092523 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2e34065720 0x7f2e34067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:16.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.316+0000 7f2e5259c700 1 --2- 172.21.15.125:0/1837092523 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2e34065720 0x7f2e34067be0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2e44000c00 tx=0x7f2e44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:16.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.320+0000 7f2e4b7fe700 1 -- 172.21.15.125:0/1837092523 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2e541337f0 con 0x7f2e5415d780 2023-10-17T06:07:16.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.556+0000 7f2e588b5700 1 -- 172.21.15.125:0/1837092523 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e541337f0 con 0x7f2e5415d780 2023-10-17T06:07:16.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.560+0000 7f2e4b7fe700 1 -- 172.21.15.125:0/1837092523 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f2e541337f0 con 0x7f2e5415d780 2023-10-17T06:07:16.561 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:16.561 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/3744648044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3744648044},{"type":"v1","addr":"172.21.15.184:6833","nonce":3744648044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/181458401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181458401},{"type":"v1","addr":"172.21.15.184:6835","nonce":181458401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/908363262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":908363262},{"type":"v1","addr":"172.21.15.125:6835","nonce":908363262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:07:09.036610+0000","modified":"2023-10-17T06:07:14.866677+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/3617198893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":3617198893},{"type":"v1","addr":"172.21.15.125:6837","nonce":3617198893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-17T06:07:16.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.564+0000 7f2e588b5700 1 -- 172.21.15.125:0/1837092523 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2e34065720 msgr2=0x7f2e34067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:16.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.564+0000 7f2e588b5700 1 --2- 172.21.15.125:0/1837092523 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2e34065720 0x7f2e34067be0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2e44000c00 tx=0x7f2e44009040 comp rx=0 tx=0).stop 2023-10-17T06:07:16.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.564+0000 7f2e588b5700 1 -- 172.21.15.125:0/1837092523 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e5415d780 msgr2=0x7f2e5415dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:16.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.564+0000 7f2e588b5700 1 --2- 172.21.15.125:0/1837092523 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e5415d780 0x7f2e5415dc00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c001dd0 tx=0x7f2e3c001120 comp rx=0 tx=0).stop 2023-10-17T06:07:16.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.564+0000 7f2e588b5700 1 -- 172.21.15.125:0/1837092523 shutdown_connections 2023-10-17T06:07:16.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.564+0000 7f2e588b5700 1 --2- 172.21.15.125:0/1837092523 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2e34065720 0x7f2e34067be0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.564+0000 7f2e588b5700 1 --2- 172.21.15.125:0/1837092523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e54141d00 0x7f2e54142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.564+0000 7f2e588b5700 1 --2- 172.21.15.125:0/1837092523 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e5415d780 0x7f2e5415dc00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.564+0000 7f2e588b5700 1 --2- 172.21.15.125:0/1837092523 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e40004870 0x7f2e54130d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.564+0000 7f2e588b5700 1 -- 172.21.15.125:0/1837092523 >> 172.21.15.125:0/1837092523 conn(0x7f2e5406a340 msgr2=0x7f2e540b0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:16.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.564+0000 7f2e588b5700 1 -- 172.21.15.125:0/1837092523 shutdown_connections 2023-10-17T06:07:16.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.564+0000 7f2e588b5700 1 -- 172.21.15.125:0/1837092523 wait complete. 2023-10-17T06:07:16.567 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 7 2023-10-17T06:07:16.586 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:07:16.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.748+0000 7f4e17d91700 1 Processor -- start 2023-10-17T06:07:16.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.752+0000 7f4e17d91700 1 -- start start 2023-10-17T06:07:16.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.752+0000 7f4e17d91700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4e10154040 0x7f4e100cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:16.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.752+0000 7f4e17d91700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4e1006e8a0 0x7f4e100cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:16.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.752+0000 7f4e17d91700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1015e130 con 0x7f4e100cb6d0 2023-10-17T06:07:16.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.752+0000 7f4e17d91700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e100cbb60 con 0x7f4e10154040 2023-10-17T06:07:16.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.752+0000 7f4e17d91700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e100cdfa0 con 0x7f4e1006e8a0 2023-10-17T06:07:16.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.752+0000 7f4e15b2d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4e10154040 0x7f4e100cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:16.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.752+0000 7f4e15b2d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4e10154040 0x7f4e100cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49480/0 (socket says 172.21.15.125:49480) 2023-10-17T06:07:16.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.752+0000 7f4e15b2d700 1 -- 172.21.15.125:0/1366803366 learned_addr learned my addr 172.21.15.125:0/1366803366 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:16.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.752+0000 7f4e1532c700 1 --2- 172.21.15.125:0/1366803366 >> v2:172.21.15.184:3300/0 conn(0x7f4e1006e8a0 0x7f4e100cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:16.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.752+0000 7f4e15b2d700 1 -- 172.21.15.125:0/1366803366 >> v2:172.21.15.184:3300/0 conn(0x7f4e1006e8a0 msgr2=0x7f4e100cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:16.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.752+0000 7f4e15b2d700 1 --2- 172.21.15.125:0/1366803366 >> v2:172.21.15.184:3300/0 conn(0x7f4e1006e8a0 0x7f4e100cb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.752+0000 7f4e15b2d700 1 -- 172.21.15.125:0/1366803366 >> v1:172.21.15.125:6789/0 conn(0x7f4e100cb6d0 legacy=0x7f4e1006f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:16.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.752+0000 7f4e15b2d700 1 -- 172.21.15.125:0/1366803366 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e100ce1b0 con 0x7f4e10154040 2023-10-17T06:07:16.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.752+0000 7f4e1532c700 1 --2- 172.21.15.125:0/1366803366 >> v2:172.21.15.184:3300/0 conn(0x7f4e1006e8a0 0x7f4e100cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:16.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.752+0000 7f4e15b2d700 1 --2- 172.21.15.125:0/1366803366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e10154040 0x7f4e100cc680 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4e1006b010 tx=0x7f4e0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25d598a13d0e829 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:16.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.756+0000 7f4e14b2b700 1 -- 172.21.15.125:0/1366803366 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c00e070 con 0x7f4e10154040 2023-10-17T06:07:16.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.756+0000 7f4e14b2b700 1 -- 172.21.15.125:0/1366803366 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c00b9c0 con 0x7f4e10154040 2023-10-17T06:07:16.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.756+0000 7f4e14b2b700 1 -- 172.21.15.125:0/1366803366 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c00bd70 con 0x7f4e10154040 2023-10-17T06:07:16.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.756+0000 7f4e17d91700 1 -- 172.21.15.125:0/1366803366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e10154040 msgr2=0x7f4e100cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:16.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.756+0000 7f4e17d91700 1 --2- 172.21.15.125:0/1366803366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e10154040 0x7f4e100cc680 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4e1006b010 tx=0x7f4e0c00b330 comp rx=0 tx=0).stop 2023-10-17T06:07:16.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.756+0000 7f4e17d91700 1 -- 172.21.15.125:0/1366803366 shutdown_connections 2023-10-17T06:07:16.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.756+0000 7f4e17d91700 1 --2- 172.21.15.125:0/1366803366 >> v2:172.21.15.184:3300/0 conn(0x7f4e1006e8a0 0x7f4e100cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.756+0000 7f4e17d91700 1 --2- 172.21.15.125:0/1366803366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e10154040 0x7f4e100cc680 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.756+0000 7f4e17d91700 1 -- 172.21.15.125:0/1366803366 >> 172.21.15.125:0/1366803366 conn(0x7f4e1006a340 msgr2=0x7f4e100b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:16.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.756+0000 7f4e17d91700 1 -- 172.21.15.125:0/1366803366 shutdown_connections 2023-10-17T06:07:16.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.756+0000 7f4e17d91700 1 -- 172.21.15.125:0/1366803366 wait complete. 2023-10-17T06:07:16.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.760+0000 7f4e17d91700 1 Processor -- start 2023-10-17T06:07:16.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.760+0000 7f4e17d91700 1 -- start start 2023-10-17T06:07:16.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.760+0000 7f4e17d91700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e1006e8a0 0x7f4e101504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:16.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.760+0000 7f4e17d91700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e100cb6d0 0x7f4e1014d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:16.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.760+0000 7f4e17d91700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e10154040 0x7f4e1015fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:16.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.760+0000 7f4e17d91700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1015ef60 con 0x7f4e10154040 2023-10-17T06:07:16.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.760+0000 7f4e17d91700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1015e370 con 0x7f4e100cb6d0 2023-10-17T06:07:16.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.760+0000 7f4e17d91700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1015e630 con 0x7f4e1006e8a0 2023-10-17T06:07:16.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.760+0000 7f4e1632e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e10154040 0x7f4e1015fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:16.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.760+0000 7f4e1632e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e10154040 0x7f4e1015fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49496/0 (socket says 172.21.15.125:49496) 2023-10-17T06:07:16.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.760+0000 7f4e1632e700 1 -- 172.21.15.125:0/451087511 learned_addr learned my addr 172.21.15.125:0/451087511 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:16.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.760+0000 7f4e1532c700 1 --2- 172.21.15.125:0/451087511 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e100cb6d0 0x7f4e1014d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:16.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.760+0000 7f4e15b2d700 1 --2- 172.21.15.125:0/451087511 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e1006e8a0 0x7f4e101504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:16.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.760+0000 7f4e1632e700 1 -- 172.21.15.125:0/451087511 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e1006e8a0 msgr2=0x7f4e101504d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:16.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.760+0000 7f4e1632e700 1 --2- 172.21.15.125:0/451087511 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e1006e8a0 0x7f4e101504d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.760+0000 7f4e1632e700 1 -- 172.21.15.125:0/451087511 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e100cb6d0 msgr2=0x7f4e1014d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:16.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.760+0000 7f4e1632e700 1 --2- 172.21.15.125:0/451087511 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e100cb6d0 0x7f4e1014d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.760+0000 7f4e1632e700 1 -- 172.21.15.125:0/451087511 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c009b30 con 0x7f4e10154040 2023-10-17T06:07:16.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.760+0000 7f4e15b2d700 1 --2- 172.21.15.125:0/451087511 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e1006e8a0 0x7f4e101504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:16.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.764+0000 7f4e1632e700 1 --2- 172.21.15.125:0/451087511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e10154040 0x7f4e1015fbc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800c480 tx=0x7f4e0800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:16.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.764+0000 7f4e067fc700 1 -- 172.21.15.125:0/451087511 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e080052d0 con 0x7f4e10154040 2023-10-17T06:07:16.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.764+0000 7f4e067fc700 1 -- 172.21.15.125:0/451087511 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e08005430 con 0x7f4e10154040 2023-10-17T06:07:16.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.764+0000 7f4e067fc700 1 -- 172.21.15.125:0/451087511 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e080055a0 con 0x7f4e10154040 2023-10-17T06:07:16.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.764+0000 7f4e17d91700 1 -- 172.21.15.125:0/451087511 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1015e910 con 0x7f4e10154040 2023-10-17T06:07:16.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.764+0000 7f4e17d91700 1 -- 172.21.15.125:0/451087511 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e10160100 con 0x7f4e10154040 2023-10-17T06:07:16.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.764+0000 7f4e17d91700 1 -- 172.21.15.125:0/451087511 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e10072e60 con 0x7f4e10154040 2023-10-17T06:07:16.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.768+0000 7f4e067fc700 1 -- 172.21.15.125:0/451087511 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4e080038e0 con 0x7f4e10154040 2023-10-17T06:07:16.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.768+0000 7f4e067fc700 1 --2- 172.21.15.125:0/451087511 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4df40656f0 0x7f4df4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:16.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.768+0000 7f4e067fc700 1 -- 172.21.15.125:0/451087511 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4e08082640 con 0x7f4e10154040 2023-10-17T06:07:16.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.768+0000 7f4e15b2d700 1 --2- 172.21.15.125:0/451087511 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4df40656f0 0x7f4df4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:16.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.768+0000 7f4e15b2d700 1 --2- 172.21.15.125:0/451087511 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4df40656f0 0x7f4df4067bb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00b370 tx=0x7f4e0c009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:16.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.776+0000 7f4e067fc700 1 -- 172.21.15.125:0/451087511 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f4e0804fe10 con 0x7f4e10154040 2023-10-17T06:07:16.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.956+0000 7f4e17d91700 1 -- 172.21.15.125:0/451087511 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e1015f0a0 con 0x7f4e10154040 2023-10-17T06:07:16.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.960+0000 7f4e067fc700 1 -- 172.21.15.125:0/451087511 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f4e0806ae60 con 0x7f4e10154040 2023-10-17T06:07:16.961 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:16.961 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":28,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:14.576796+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:07:16.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.964+0000 7f4e17d91700 1 -- 172.21.15.125:0/451087511 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4df40656f0 msgr2=0x7f4df4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:16.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.964+0000 7f4e17d91700 1 --2- 172.21.15.125:0/451087511 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4df40656f0 0x7f4df4067bb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00b370 tx=0x7f4e0c009000 comp rx=0 tx=0).stop 2023-10-17T06:07:16.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.964+0000 7f4e17d91700 1 -- 172.21.15.125:0/451087511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e10154040 msgr2=0x7f4e1015fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:16.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.964+0000 7f4e17d91700 1 --2- 172.21.15.125:0/451087511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e10154040 0x7f4e1015fbc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800c480 tx=0x7f4e0800c840 comp rx=0 tx=0).stop 2023-10-17T06:07:16.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.964+0000 7f4e17d91700 1 -- 172.21.15.125:0/451087511 shutdown_connections 2023-10-17T06:07:16.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.964+0000 7f4e17d91700 1 --2- 172.21.15.125:0/451087511 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4df40656f0 0x7f4df4067bb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.964+0000 7f4e17d91700 1 --2- 172.21.15.125:0/451087511 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e10154040 0x7f4e1015fbc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.964+0000 7f4e17d91700 1 --2- 172.21.15.125:0/451087511 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e100cb6d0 0x7f4e1014d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.964+0000 7f4e17d91700 1 --2- 172.21.15.125:0/451087511 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e1006e8a0 0x7f4e101504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:16.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.964+0000 7f4e17d91700 1 -- 172.21.15.125:0/451087511 >> 172.21.15.125:0/451087511 conn(0x7f4e1006a340 msgr2=0x7f4e100afae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:16.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.964+0000 7f4e17d91700 1 -- 172.21.15.125:0/451087511 shutdown_connections 2023-10-17T06:07:16.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:16.964+0000 7f4e17d91700 1 -- 172.21.15.125:0/451087511 wait complete. 2023-10-17T06:07:17.390 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-17T06:07:09.036610+0000', 'modified': '2023-10-17T06:07:14.866677+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.125:6837/3617198893', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6836', 'nonce': 3617198893}, {'type': 'v1', 'addr': '172.21.15.125:6837', 'nonce': 3617198893}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-10-17T06:07:17.390 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-17T06:07:17.391 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-17T06:07:17.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.576+0000 7ff2e9040700 1 Processor -- start 2023-10-17T06:07:17.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.580+0000 7ff2e9040700 1 -- start start 2023-10-17T06:07:17.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.580+0000 7ff2e9040700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2e4144150 0x7ff2e40cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.580+0000 7ff2e9040700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff2e40ce1a0 0x7ff2e40cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.580+0000 7ff2e9040700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e4070de0 con 0x7ff2e40cbde0 2023-10-17T06:07:17.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.580+0000 7ff2e9040700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e40cc270 con 0x7ff2e40ce1a0 2023-10-17T06:07:17.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.580+0000 7ff2e9040700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e40701d0 con 0x7ff2e4144150 2023-10-17T06:07:17.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.580+0000 7ff2db7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff2e40ce1a0 0x7ff2e40cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.580+0000 7ff2db7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff2e40ce1a0 0x7ff2e40cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49508/0 (socket says 172.21.15.125:49508) 2023-10-17T06:07:17.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.580+0000 7ff2db7fe700 1 -- 172.21.15.125:0/1160153370 learned_addr learned my addr 172.21.15.125:0/1160153370 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:17.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.580+0000 7ff2e3fff700 1 --2- 172.21.15.125:0/1160153370 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2e4144150 0x7ff2e40cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.580+0000 7ff2db7fe700 1 -- 172.21.15.125:0/1160153370 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2e4144150 msgr2=0x7ff2e40cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:17.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.580+0000 7ff2db7fe700 1 --2- 172.21.15.125:0/1160153370 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2e4144150 0x7ff2e40cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.580+0000 7ff2db7fe700 1 -- 172.21.15.125:0/1160153370 >> v1:172.21.15.184:6789/0 conn(0x7ff2e40cbde0 legacy=0x7ff2e415e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:17.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.580+0000 7ff2db7fe700 1 -- 172.21.15.125:0/1160153370 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e40704b0 con 0x7ff2e40ce1a0 2023-10-17T06:07:17.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.580+0000 7ff2db7fe700 1 --2- 172.21.15.125:0/1160153370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e40ce1a0 0x7ff2e40cb8a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009910 tx=0x7ff2cc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719fb1f01038fc2b server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:17.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.580+0000 7ff2e37fe700 1 -- 172.21.15.125:0/1160153370 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc011830 con 0x7ff2e40ce1a0 2023-10-17T06:07:17.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.580+0000 7ff2e37fe700 1 -- 172.21.15.125:0/1160153370 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc011990 con 0x7ff2e40ce1a0 2023-10-17T06:07:17.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.580+0000 7ff2e37fe700 1 -- 172.21.15.125:0/1160153370 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc011d40 con 0x7ff2e40ce1a0 2023-10-17T06:07:17.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.584+0000 7ff2e9040700 1 -- 172.21.15.125:0/1160153370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e40ce1a0 msgr2=0x7ff2e40cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:17.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.584+0000 7ff2e9040700 1 --2- 172.21.15.125:0/1160153370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e40ce1a0 0x7ff2e40cb8a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009910 tx=0x7ff2cc009c20 comp rx=0 tx=0).stop 2023-10-17T06:07:17.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.584+0000 7ff2e9040700 1 -- 172.21.15.125:0/1160153370 shutdown_connections 2023-10-17T06:07:17.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.584+0000 7ff2e9040700 1 --2- 172.21.15.125:0/1160153370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e40ce1a0 0x7ff2e40cb8a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.584+0000 7ff2e9040700 1 --2- 172.21.15.125:0/1160153370 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2e4144150 0x7ff2e40cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.584+0000 7ff2e9040700 1 -- 172.21.15.125:0/1160153370 >> 172.21.15.125:0/1160153370 conn(0x7ff2e40b0bf0 msgr2=0x7ff2e40ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:17.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.584+0000 7ff2e9040700 1 -- 172.21.15.125:0/1160153370 shutdown_connections 2023-10-17T06:07:17.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.584+0000 7ff2e9040700 1 -- 172.21.15.125:0/1160153370 wait complete. 2023-10-17T06:07:17.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.584+0000 7ff2e9040700 1 Processor -- start 2023-10-17T06:07:17.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.584+0000 7ff2e9040700 1 -- start start 2023-10-17T06:07:17.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e9040700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e40cbde0 0x7ff2e41f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e9040700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2e40ce1a0 0x7ff2e40af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e9040700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2e4144150 0x7ff2e41f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e9040700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e40c5730 con 0x7ff2e40cbde0 2023-10-17T06:07:17.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e9040700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e41f34e0 con 0x7ff2e4144150 2023-10-17T06:07:17.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e9040700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e41f6700 con 0x7ff2e40ce1a0 2023-10-17T06:07:17.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e40cbde0 0x7ff2e41f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e40cbde0 0x7ff2e41f61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49518/0 (socket says 172.21.15.125:49518) 2023-10-17T06:07:17.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e3fff700 1 -- 172.21.15.125:0/2533918053 learned_addr learned my addr 172.21.15.125:0/2533918053 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:17.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e883f700 1 --2- 172.21.15.125:0/2533918053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2e4144150 0x7ff2e41f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2db7fe700 1 --2- 172.21.15.125:0/2533918053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2e40ce1a0 0x7ff2e40af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e3fff700 1 -- 172.21.15.125:0/2533918053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2e40ce1a0 msgr2=0x7ff2e40af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:17.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e3fff700 1 --2- 172.21.15.125:0/2533918053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2e40ce1a0 0x7ff2e40af990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e3fff700 1 -- 172.21.15.125:0/2533918053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2e4144150 msgr2=0x7ff2e41f3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:17.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e3fff700 1 --2- 172.21.15.125:0/2533918053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2e4144150 0x7ff2e41f3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e3fff700 1 -- 172.21.15.125:0/2533918053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc009570 con 0x7ff2e40cbde0 2023-10-17T06:07:17.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2db7fe700 1 --2- 172.21.15.125:0/2533918053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2e40ce1a0 0x7ff2e40af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:17.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e883f700 1 --2- 172.21.15.125:0/2533918053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2e4144150 0x7ff2e41f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:17.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e3fff700 1 --2- 172.21.15.125:0/2533918053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e40cbde0 0x7ff2e41f61c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400e840 tx=0x7ff2d400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:17.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e17fa700 1 -- 172.21.15.125:0/2533918053 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d40095a0 con 0x7ff2e40cbde0 2023-10-17T06:07:17.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e17fa700 1 -- 172.21.15.125:0/2533918053 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d400c690 con 0x7ff2e40cbde0 2023-10-17T06:07:17.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e17fa700 1 -- 172.21.15.125:0/2533918053 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d400ca00 con 0x7ff2e40cbde0 2023-10-17T06:07:17.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.588+0000 7ff2e9040700 1 -- 172.21.15.125:0/2533918053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e40c4180 con 0x7ff2e40cbde0 2023-10-17T06:07:17.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.592+0000 7ff2e9040700 1 -- 172.21.15.125:0/2533918053 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e41f3780 con 0x7ff2e40cbde0 2023-10-17T06:07:17.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.592+0000 7ff2e17fa700 1 -- 172.21.15.125:0/2533918053 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff2d400cb60 con 0x7ff2e40cbde0 2023-10-17T06:07:17.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.596+0000 7ff2e17fa700 1 --2- 172.21.15.125:0/2533918053 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2c40656f0 0x7ff2c4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.596+0000 7ff2e17fa700 1 -- 172.21.15.125:0/2533918053 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff2d40830c0 con 0x7ff2e40cbde0 2023-10-17T06:07:17.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.596+0000 7ff2db7fe700 1 --2- 172.21.15.125:0/2533918053 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2c40656f0 0x7ff2c4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.596+0000 7ff2ed53c740 1 Processor -- start 2023-10-17T06:07:17.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.596+0000 7ff2ed53c740 1 -- start start 2023-10-17T06:07:17.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.596+0000 7ff2db7fe700 1 --2- 172.21.15.125:0/2533918053 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2c40656f0 0x7ff2c4067bb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc014040 tx=0x7ff2cc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:17.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.596+0000 7ff2ed53c740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1a632b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.596+0000 7ff2ed53c740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1a8d220 0x1a637f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.596+0000 7ff2ed53c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1aa9bf0 0x1aa9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.596+0000 7ff2ed53c740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x19d5f90 con 0x1a8ce40 2023-10-17T06:07:17.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.596+0000 7ff2ed53c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x19d3680 con 0x1aa9bf0 2023-10-17T06:07:17.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.596+0000 7ff2ed53c740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x19cef70 con 0x1a8d220 2023-10-17T06:07:17.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.596+0000 7ff2e3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1a632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.596+0000 7ff2e3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1a632b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49534/0 (socket says 172.21.15.125:49534) 2023-10-17T06:07:17.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.596+0000 7ff2e3fff700 1 -- 172.21.15.125:0/4220122404 learned_addr learned my addr 172.21.15.125:0/4220122404 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:17.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.600+0000 7ff2e3fff700 1 -- 172.21.15.125:0/4220122404 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1a8d220 msgr2=0x1a637f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:17.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.600+0000 7ff2e3fff700 1 --2- 172.21.15.125:0/4220122404 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1a8d220 0x1a637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.600+0000 7ff2e3fff700 1 -- 172.21.15.125:0/4220122404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1aa9bf0 msgr2=0x1aa9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:17.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.600+0000 7ff2e3fff700 1 --2- 172.21.15.125:0/4220122404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1aa9bf0 0x1aa9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.600+0000 7ff2e3fff700 1 -- 172.21.15.125:0/4220122404 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x19f41a0 con 0x1a8ce40 2023-10-17T06:07:17.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.600+0000 7ff2e3fff700 1 --2- 172.21.15.125:0/4220122404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1a632b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40810d0 tx=0x7ff2d4053fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990ae621d0ec545b server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:17.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.600+0000 7ff2d9ffb700 1 -- 172.21.15.125:0/4220122404 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4058120 con 0x1a8ce40 2023-10-17T06:07:17.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.600+0000 7ff2d9ffb700 1 -- 172.21.15.125:0/4220122404 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d40528e0 con 0x1a8ce40 2023-10-17T06:07:17.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.600+0000 7ff2d9ffb700 1 -- 172.21.15.125:0/4220122404 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4053a30 con 0x1a8ce40 2023-10-17T06:07:17.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.600+0000 7ff2ed53c740 1 -- 172.21.15.125:0/4220122404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 msgr2=0x1a632b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:17.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.600+0000 7ff2ed53c740 1 --2- 172.21.15.125:0/4220122404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1a632b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40810d0 tx=0x7ff2d4053fd0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.600+0000 7ff2ed53c740 1 -- 172.21.15.125:0/4220122404 shutdown_connections 2023-10-17T06:07:17.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.600+0000 7ff2ed53c740 1 --2- 172.21.15.125:0/4220122404 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1aa9bf0 0x1aa9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.600+0000 7ff2ed53c740 1 --2- 172.21.15.125:0/4220122404 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1a8d220 0x1a637f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.600+0000 7ff2ed53c740 1 --2- 172.21.15.125:0/4220122404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1a632b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.600+0000 7ff2ed53c740 1 -- 172.21.15.125:0/4220122404 >> 172.21.15.125:0/4220122404 conn(0x17f5550 msgr2=0x1a8fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:17.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.600+0000 7ff2ed53c740 1 -- 172.21.15.125:0/4220122404 shutdown_connections 2023-10-17T06:07:17.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.600+0000 7ff2ed53c740 1 -- 172.21.15.125:0/4220122404 wait complete. 2023-10-17T06:07:17.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.600+0000 7ff2ed53c740 1 -- start start 2023-10-17T06:07:17.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.600+0000 7ff2ed53c740 1 Processor -- start 2023-10-17T06:07:17.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2ed53c740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1a8c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2ed53c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1a8d220 0x1a90fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2ed53c740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1aa9bf0 0x1aad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2ed53c740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x198fb00 con 0x1a8ce40 2023-10-17T06:07:17.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2ed53c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x198e470 con 0x1a8d220 2023-10-17T06:07:17.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2ed53c740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x1879b20 con 0x1aa9bf0 2023-10-17T06:07:17.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2ed53c740 10 client.0 _ll_register_callbacks cb 0x19c8810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-17T06:07:17.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2e3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1a8c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2e3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1a8c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49544/0 (socket says 172.21.15.125:49544) 2023-10-17T06:07:17.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2e3fff700 1 -- 172.21.15.125:0/1572077437 learned_addr learned my addr 172.21.15.125:0/1572077437 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:17.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2db7fe700 1 --2- 172.21.15.125:0/1572077437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1a8d220 0x1a90fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2e3fff700 1 -- 172.21.15.125:0/1572077437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1aa9bf0 msgr2=0x1aad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:17.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2e3fff700 1 --2- 172.21.15.125:0/1572077437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1aa9bf0 0x1aad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2e3fff700 1 -- 172.21.15.125:0/1572077437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1a8d220 msgr2=0x1a90fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:17.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2e3fff700 1 --2- 172.21.15.125:0/1572077437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1a8d220 0x1a90fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2e3fff700 1 -- 172.21.15.125:0/1572077437 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e41f3780 con 0x1a8ce40 2023-10-17T06:07:17.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2e3fff700 1 --2- 172.21.15.125:0/1572077437 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1a8c0b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4050f60 tx=0x7ff2d4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e350b94406065e server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:17.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-17T06:07:17.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2c2ffd700 1 -- 172.21.15.125:0/1572077437 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d405bfc0 con 0x1a8ce40 2023-10-17T06:07:17.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2c2ffd700 1 -- 172.21.15.125:0/1572077437 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff2d4071d00 con 0x1a8ce40 2023-10-17T06:07:17.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2ed53c740 1 -- 172.21.15.125:0/1572077437 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x19c7f50 con 0x1a8ce40 2023-10-17T06:07:17.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2c2ffd700 1 -- 172.21.15.125:0/1572077437 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2d4050880 con 0x1a8ce40 2023-10-17T06:07:17.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2ed53c740 10 client.4440 fetch_fsmap learned FSMap version 7 2023-10-17T06:07:17.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2ed53c740 1 -- 172.21.15.125:0/1572077437 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x18409e0 con 0x1a8ce40 2023-10-17T06:07:17.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2c2ffd700 1 -- 172.21.15.125:0/1572077437 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x19c7f50 con 0x1a8ce40 2023-10-17T06:07:17.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2c2ffd700 1 -- 172.21.15.125:0/1572077437 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7ff2d4067b00 con 0x1a8ce40 2023-10-17T06:07:17.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2ed53c740 10 client.4440 fetch_fsmap finished waiting for FSMap version 7 2023-10-17T06:07:17.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2ed53c740 10 client.4440 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-17T06:07:17.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2ed53c740 20 client.4440 populate_metadata read hostname 'smithi125' 2023-10-17T06:07:17.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2ed53c740 1 --2- 172.21.15.125:0/1572077437 >> [v2:172.21.15.125:6836/3617198893,v1:172.21.15.125:6837/3617198893] conn(0x1aadd50 0x1a66240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2ed53c740 4 client.4440 mds_command: new command op to 4290 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-17T06:07:17.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2ed53c740 1 -- 172.21.15.125:0/1572077437 --> [v2:172.21.15.125:6836/3617198893,v1:172.21.15.125:6837/3617198893] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x19c7c70 con 0x1aadd50 2023-10-17T06:07:17.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.604+0000 7ff2db7fe700 1 --2- 172.21.15.125:0/1572077437 >> [v2:172.21.15.125:6836/3617198893,v1:172.21.15.125:6837/3617198893] conn(0x1aadd50 0x1a66240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.608+0000 7ff2c2ffd700 10 client.4440 ms_handle_connect on v2:172.21.15.125:6836/3617198893 2023-10-17T06:07:17.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.608+0000 7ff2db7fe700 1 --2- 172.21.15.125:0/1572077437 >> [v2:172.21.15.125:6836/3617198893,v1:172.21.15.125:6837/3617198893] conn(0x1aadd50 0x1a66240 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=962115bfd3b3ef0a server_cookie=e62aec5fff6131fb in_seq=0 out_seq=0 2023-10-17T06:07:17.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.608+0000 7ff2c2ffd700 1 -- 172.21.15.125:0/1572077437 <== mds.0 v2:172.21.15.125:6836/3617198893 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x19c7c70 con 0x1aadd50 2023-10-17T06:07:17.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.608+0000 7ff2c2ffd700 10 client.4440 handle_command_reply: tid=0 2023-10-17T06:07:17.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.608+0000 7ff2ed53c740 1 client.4440 shutdown 2023-10-17T06:07:17.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.608+0000 7ff2ed53c740 1 -- 172.21.15.125:0/1572077437 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 msgr2=0x1a8c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:17.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.608+0000 7ff2ed53c740 1 --2- 172.21.15.125:0/1572077437 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1a8c0b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4050f60 tx=0x7ff2d4000bc0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.608+0000 7ff2ed53c740 1 -- 172.21.15.125:0/1572077437 shutdown_connections 2023-10-17T06:07:17.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.608+0000 7ff2ed53c740 1 --2- 172.21.15.125:0/1572077437 >> [v2:172.21.15.125:6836/3617198893,v1:172.21.15.125:6837/3617198893] conn(0x1aadd50 0x1a66240 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.608+0000 7ff2ed53c740 1 --2- 172.21.15.125:0/1572077437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1aa9bf0 0x1aad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.608+0000 7ff2ed53c740 1 --2- 172.21.15.125:0/1572077437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1a8d220 0x1a90fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.608+0000 7ff2c2ffd700 0 client.4440 ms_handle_reset on v2:172.21.15.125:6836/3617198893 2023-10-17T06:07:17.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.608+0000 7ff2ed53c740 1 --2- 172.21.15.125:0/1572077437 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1a8c0b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.608+0000 7ff2ed53c740 1 -- 172.21.15.125:0/1572077437 >> 172.21.15.125:0/1572077437 conn(0x17f5550 msgr2=0x1a622a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:17.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.608+0000 7ff2ed53c740 1 -- 172.21.15.125:0/1572077437 shutdown_connections 2023-10-17T06:07:17.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.608+0000 7ff2ed53c740 1 -- 172.21.15.125:0/1572077437 wait complete. 2023-10-17T06:07:17.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.608+0000 7ff2ed53c740 20 client.4440 trim_cache size 0 max 16384 2023-10-17T06:07:17.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2ed53c740 1 Processor -- start 2023-10-17T06:07:17.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2ed53c740 1 -- start start 2023-10-17T06:07:17.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2ed53c740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1a64070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2ed53c740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1a8d220 0x1a645b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2ed53c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1aa9bf0 0x1a61a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2ed53c740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x19d4990 con 0x1a8ce40 2023-10-17T06:07:17.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2ed53c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x19cc370 con 0x1aa9bf0 2023-10-17T06:07:17.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2ed53c740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x19d7560 con 0x1a8d220 2023-10-17T06:07:17.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2e883f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1aa9bf0 0x1a61a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2e3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1a64070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2e883f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1aa9bf0 0x1a61a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:58918/0 (socket says 172.21.15.125:58918) 2023-10-17T06:07:17.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2e883f700 1 -- 172.21.15.125:0/71105515 learned_addr learned my addr 172.21.15.125:0/71105515 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:17.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2e3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1a64070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49550/0 (socket says 172.21.15.125:49550) 2023-10-17T06:07:17.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2db7fe700 1 --2- 172.21.15.125:0/71105515 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1a8d220 0x1a645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2e883f700 1 -- 172.21.15.125:0/71105515 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1a8d220 msgr2=0x1a645b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:17.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2e883f700 1 --2- 172.21.15.125:0/71105515 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1a8d220 0x1a645b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2e883f700 1 -- 172.21.15.125:0/71105515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 msgr2=0x1a64070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:17.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2e883f700 1 --2- 172.21.15.125:0/71105515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1a64070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2e883f700 1 -- 172.21.15.125:0/71105515 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e4143320 con 0x1aa9bf0 2023-10-17T06:07:17.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2e3fff700 1 --2- 172.21.15.125:0/71105515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1a64070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:07:17.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2e883f700 1 --2- 172.21.15.125:0/71105515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1aa9bf0 0x1a61a10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc001e00 tx=0x7ff2dc002110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46768329036133ba server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:17.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.632+0000 7ff2da7fc700 1 -- 172.21.15.125:0/71105515 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc003c30 con 0x1aa9bf0 2023-10-17T06:07:17.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.636+0000 7ff2da7fc700 1 -- 172.21.15.125:0/71105515 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc003db0 con 0x1aa9bf0 2023-10-17T06:07:17.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.636+0000 7ff2da7fc700 1 -- 172.21.15.125:0/71105515 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc00e950 con 0x1aa9bf0 2023-10-17T06:07:17.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.636+0000 7ff2ed53c740 1 -- 172.21.15.125:0/71105515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1aa9bf0 msgr2=0x1a61a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:17.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.636+0000 7ff2ed53c740 1 --2- 172.21.15.125:0/71105515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1aa9bf0 0x1a61a10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc001e00 tx=0x7ff2dc002110 comp rx=0 tx=0).stop 2023-10-17T06:07:17.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.636+0000 7ff2ed53c740 1 -- 172.21.15.125:0/71105515 shutdown_connections 2023-10-17T06:07:17.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.636+0000 7ff2ed53c740 1 --2- 172.21.15.125:0/71105515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1aa9bf0 0x1a61a10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.636+0000 7ff2ed53c740 1 --2- 172.21.15.125:0/71105515 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1a8d220 0x1a645b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.636+0000 7ff2ed53c740 1 --2- 172.21.15.125:0/71105515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1a64070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.636+0000 7ff2ed53c740 1 -- 172.21.15.125:0/71105515 >> 172.21.15.125:0/71105515 conn(0x17f5550 msgr2=0x1a8bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:17.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.636+0000 7ff2ed53c740 1 -- 172.21.15.125:0/71105515 shutdown_connections 2023-10-17T06:07:17.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.636+0000 7ff2ed53c740 1 -- 172.21.15.125:0/71105515 wait complete. 2023-10-17T06:07:17.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.636+0000 7ff2ed53c740 1 -- start start 2023-10-17T06:07:17.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.636+0000 7ff2ed53c740 1 Processor -- start 2023-10-17T06:07:17.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2ed53c740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1ac4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2ed53c740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1a8d220 0x1ac4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2ed53c740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1aa9bf0 0x1ac5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2ed53c740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x1973330 con 0x1a8ce40 2023-10-17T06:07:17.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2ed53c740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x199cd50 con 0x1aa9bf0 2023-10-17T06:07:17.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2ed53c740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x1987720 con 0x1a8d220 2023-10-17T06:07:17.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2ed53c740 10 client.0 _ll_register_callbacks cb 0x7ff2d4054390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-17T06:07:17.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2e3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1ac4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2e3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1ac4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49562/0 (socket says 172.21.15.125:49562) 2023-10-17T06:07:17.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2e3fff700 1 -- 172.21.15.125:0/1703796693 learned_addr learned my addr 172.21.15.125:0/1703796693 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:17.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2e883f700 1 --2- 172.21.15.125:0/1703796693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1aa9bf0 0x1ac5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2db7fe700 1 --2- 172.21.15.125:0/1703796693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1a8d220 0x1ac4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2e3fff700 1 -- 172.21.15.125:0/1703796693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1a8d220 msgr2=0x1ac4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:17.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2e3fff700 1 --2- 172.21.15.125:0/1703796693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1a8d220 0x1ac4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2e3fff700 1 -- 172.21.15.125:0/1703796693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1aa9bf0 msgr2=0x1ac5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:17.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2e3fff700 1 --2- 172.21.15.125:0/1703796693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1aa9bf0 0x1ac5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2e3fff700 1 -- 172.21.15.125:0/1703796693 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x18409e0 con 0x1a8ce40 2023-10-17T06:07:17.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2db7fe700 1 --2- 172.21.15.125:0/1703796693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1a8d220 0x1ac4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:17.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2e3fff700 1 --2- 172.21.15.125:0/1703796693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1ac4030 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4050a40 tx=0x7ff2d4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe30b9b7e94bb5d server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:17.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2c2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-17T06:07:17.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2c2ffd700 1 -- 172.21.15.125:0/1703796693 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4071f10 con 0x1a8ce40 2023-10-17T06:07:17.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2c2ffd700 1 -- 172.21.15.125:0/1703796693 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff2d4073030 con 0x1a8ce40 2023-10-17T06:07:17.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2ed53c740 1 -- 172.21.15.125:0/1703796693 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff2d40528e0 con 0x1a8ce40 2023-10-17T06:07:17.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2c2ffd700 1 -- 172.21.15.125:0/1703796693 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2d4058120 con 0x1a8ce40 2023-10-17T06:07:17.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2ed53c740 10 client.4446 fetch_fsmap learned FSMap version 7 2023-10-17T06:07:17.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.640+0000 7ff2ed53c740 1 -- 172.21.15.125:0/1703796693 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x7ff2dc00f040 con 0x1a8ce40 2023-10-17T06:07:17.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2c2ffd700 1 -- 172.21.15.125:0/1703796693 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d40528e0 con 0x1a8ce40 2023-10-17T06:07:17.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2c2ffd700 1 -- 172.21.15.125:0/1703796693 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7ff2d4050330 con 0x1a8ce40 2023-10-17T06:07:17.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2ed53c740 10 client.4446 fetch_fsmap finished waiting for FSMap version 7 2023-10-17T06:07:17.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2ed53c740 10 client.4446 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-17T06:07:17.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2ed53c740 20 client.4446 populate_metadata read hostname 'smithi125' 2023-10-17T06:07:17.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2ed53c740 1 --2- 172.21.15.125:0/1703796693 >> [v2:172.21.15.125:6836/3617198893,v1:172.21.15.125:6837/3617198893] conn(0x1ac1ac0 0x1ac1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2ed53c740 4 client.4446 mds_command: new command op to 4290 tid=0[{"prefix": "status"}] 2023-10-17T06:07:17.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2ed53c740 1 -- 172.21.15.125:0/1703796693 --> [v2:172.21.15.125:6836/3617198893,v1:172.21.15.125:6837/3617198893] -- command(tid 0: {"prefix": "status"}) v1 -- 0x184c4e0 con 0x1ac1ac0 2023-10-17T06:07:17.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2db7fe700 1 --2- 172.21.15.125:0/1703796693 >> [v2:172.21.15.125:6836/3617198893,v1:172.21.15.125:6837/3617198893] conn(0x1ac1ac0 0x1ac1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2db7fe700 1 --2- 172.21.15.125:0/1703796693 >> [v2:172.21.15.125:6836/3617198893,v1:172.21.15.125:6837/3617198893] conn(0x1ac1ac0 0x1ac1ea0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bd5c2a52e65b504 server_cookie=40d64e0967e272b4 in_seq=0 out_seq=0 2023-10-17T06:07:17.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2c2ffd700 10 client.4446 ms_handle_connect on v2:172.21.15.125:6836/3617198893 2023-10-17T06:07:17.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2c2ffd700 1 -- 172.21.15.125:0/1703796693 <== mds.0 v2:172.21.15.125:6836/3617198893 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x184c4e0 con 0x1ac1ac0 2023-10-17T06:07:17.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2c2ffd700 10 client.4446 handle_command_reply: tid=0 2023-10-17T06:07:17.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2ed53c740 1 client.4446 shutdown 2023-10-17T06:07:17.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2ed53c740 1 -- 172.21.15.125:0/1703796693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 msgr2=0x1ac4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:17.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2ed53c740 1 --2- 172.21.15.125:0/1703796693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1ac4030 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4050a40 tx=0x7ff2d4004770 comp rx=0 tx=0).stop 2023-10-17T06:07:17.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2ed53c740 1 -- 172.21.15.125:0/1703796693 shutdown_connections 2023-10-17T06:07:17.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2ed53c740 1 --2- 172.21.15.125:0/1703796693 >> [v2:172.21.15.125:6836/3617198893,v1:172.21.15.125:6837/3617198893] conn(0x1ac1ac0 0x1ac1ea0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2ed53c740 1 --2- 172.21.15.125:0/1703796693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x1aa9bf0 0x1ac5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2c2ffd700 0 client.4446 ms_handle_reset on v2:172.21.15.125:6836/3617198893 2023-10-17T06:07:17.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2ed53c740 1 --2- 172.21.15.125:0/1703796693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x1a8d220 0x1ac4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2ed53c740 1 --2- 172.21.15.125:0/1703796693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x1a8ce40 0x1ac4030 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2ed53c740 1 -- 172.21.15.125:0/1703796693 >> 172.21.15.125:0/1703796693 conn(0x17f5550 msgr2=0x1a8f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:17.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2ed53c740 1 -- 172.21.15.125:0/1703796693 shutdown_connections 2023-10-17T06:07:17.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2ed53c740 1 -- 172.21.15.125:0/1703796693 wait complete. 2023-10-17T06:07:17.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.644+0000 7ff2ed53c740 20 client.4446 trim_cache size 0 max 16384 2023-10-17T06:07:17.658 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-17T06:07:17.658 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_fsid": "c779df02-0ec4-47de-a0f3-2371e60a2dde", 2023-10-17T06:07:17.658 INFO:teuthology.orchestra.run.smithi125.stdout: "whoami": 0, 2023-10-17T06:07:17.659 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 4290, 2023-10-17T06:07:17.659 INFO:teuthology.orchestra.run.smithi125.stdout: "want_state": "up:active", 2023-10-17T06:07:17.659 INFO:teuthology.orchestra.run.smithi125.stdout: "state": "up:active", 2023-10-17T06:07:17.659 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs", 2023-10-17T06:07:17.659 INFO:teuthology.orchestra.run.smithi125.stdout: "rank_uptime": 7.8581448380000003, 2023-10-17T06:07:17.660 INFO:teuthology.orchestra.run.smithi125.stdout: "mdsmap_epoch": 7, 2023-10-17T06:07:17.660 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch": 28, 2023-10-17T06:07:17.660 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch_barrier": 28, 2023-10-17T06:07:17.660 INFO:teuthology.orchestra.run.smithi125.stdout: "uptime": 14.751265668 2023-10-17T06:07:17.660 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-17T06:07:17.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.648+0000 7ff2e9040700 1 -- 172.21.15.125:0/2533918053 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2c40656f0 msgr2=0x7ff2c4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:17.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.648+0000 7ff2e9040700 1 --2- 172.21.15.125:0/2533918053 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2c40656f0 0x7ff2c4067bb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc014040 tx=0x7ff2cc008030 comp rx=0 tx=0).stop 2023-10-17T06:07:17.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.648+0000 7ff2e9040700 1 -- 172.21.15.125:0/2533918053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e40cbde0 msgr2=0x7ff2e41f61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:17.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.648+0000 7ff2e9040700 1 --2- 172.21.15.125:0/2533918053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e40cbde0 0x7ff2e41f61c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400e840 tx=0x7ff2d400ec00 comp rx=0 tx=0).stop 2023-10-17T06:07:17.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.648+0000 7ff2e9040700 1 -- 172.21.15.125:0/2533918053 shutdown_connections 2023-10-17T06:07:17.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.648+0000 7ff2e9040700 1 --2- 172.21.15.125:0/2533918053 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2c40656f0 0x7ff2c4067bb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.648+0000 7ff2e9040700 1 --2- 172.21.15.125:0/2533918053 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2e4144150 0x7ff2e41f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.648+0000 7ff2e9040700 1 --2- 172.21.15.125:0/2533918053 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2e40ce1a0 0x7ff2e40af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.648+0000 7ff2e9040700 1 --2- 172.21.15.125:0/2533918053 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2e40cbde0 0x7ff2e41f61c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.648+0000 7ff2e9040700 1 -- 172.21.15.125:0/2533918053 >> 172.21.15.125:0/2533918053 conn(0x7ff2e40b0bf0 msgr2=0x7ff2e40ae8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:17.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.648+0000 7ff2e9040700 1 -- 172.21.15.125:0/2533918053 shutdown_connections 2023-10-17T06:07:17.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.648+0000 7ff2e9040700 1 -- 172.21.15.125:0/2533918053 wait complete. 2023-10-17T06:07:17.671 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-17T06:07:17.672 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-17T06:07:17.672 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-17T06:07:17.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.844+0000 7f4556da1700 1 Processor -- start 2023-10-17T06:07:17.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.844+0000 7f4556da1700 1 -- start start 2023-10-17T06:07:17.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.844+0000 7f4556da1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45500d2e00 0x7f45500b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.844+0000 7f4556da1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f455015d0d0 con 0x7f4550160710 2023-10-17T06:07:17.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.844+0000 7f4556da1700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f455006f0f0 con 0x7f45500b5ae0 2023-10-17T06:07:17.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.844+0000 7f4556da1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f455015df90 con 0x7f45500d2e00 2023-10-17T06:07:17.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.848+0000 7f455559e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4550160710 0x7f45500d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45486/0 (socket says 172.21.15.125:45486) 2023-10-17T06:07:17.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.848+0000 7f455559e700 1 -- 172.21.15.125:0/559722097 learned_addr learned my addr 172.21.15.125:0/559722097 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:17.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.848+0000 7f4555d9f700 1 --2- 172.21.15.125:0/559722097 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45500d2e00 0x7f45500b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.848+0000 7f4555d9f700 1 -- 172.21.15.125:0/559722097 >> v1:172.21.15.184:6789/0 conn(0x7f45500b5ae0 legacy=0x7f455006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:17.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.848+0000 7f4555d9f700 1 -- 172.21.15.125:0/559722097 >> v1:172.21.15.125:6789/0 conn(0x7f4550160710 legacy=0x7f45500d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:17.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.848+0000 7f4555d9f700 1 -- 172.21.15.125:0/559722097 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455015d310 con 0x7f45500d2e00 2023-10-17T06:07:17.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.848+0000 7f4554d9d700 1 -- 172.21.15.125:0/559722097 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285488061 0 0) 0x7f4540001110 con 0x7f4550160710 2023-10-17T06:07:17.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.848+0000 7f4555d9f700 1 --2- 172.21.15.125:0/559722097 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45500d2e00 0x7f45500b6e00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f454c0098b0 tx=0x7f454c009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7189e44861e9ce5 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:17.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.848+0000 7f4554d9d700 1 -- 172.21.15.125:0/559722097 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c011830 con 0x7f45500d2e00 2023-10-17T06:07:17.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.848+0000 7f4554d9d700 1 -- 172.21.15.125:0/559722097 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454c011990 con 0x7f45500d2e00 2023-10-17T06:07:17.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.848+0000 7f4554d9d700 1 -- 172.21.15.125:0/559722097 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c011d20 con 0x7f45500d2e00 2023-10-17T06:07:17.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.848+0000 7f4556da1700 1 -- 172.21.15.125:0/559722097 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45500d2e00 msgr2=0x7f45500b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:17.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.848+0000 7f4556da1700 1 --2- 172.21.15.125:0/559722097 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45500d2e00 0x7f45500b6e00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f454c0098b0 tx=0x7f454c009bc0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.848+0000 7f4556da1700 1 -- 172.21.15.125:0/559722097 shutdown_connections 2023-10-17T06:07:17.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.848+0000 7f4556da1700 1 --2- 172.21.15.125:0/559722097 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45500d2e00 0x7f45500b6e00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.848+0000 7f4556da1700 1 -- 172.21.15.125:0/559722097 >> 172.21.15.125:0/559722097 conn(0x7f4550069f20 msgr2=0x7f455006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:17.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.848+0000 7f4556da1700 1 -- 172.21.15.125:0/559722097 shutdown_connections 2023-10-17T06:07:17.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.848+0000 7f4556da1700 1 -- 172.21.15.125:0/559722097 wait complete. 2023-10-17T06:07:17.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.852+0000 7f4556da1700 1 Processor -- start 2023-10-17T06:07:17.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.852+0000 7f4556da1700 1 -- start start 2023-10-17T06:07:17.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.852+0000 7f4556da1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45500b5ae0 0x7f45501584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.852+0000 7f4556da1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45500d2e00 0x7f45500b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.852+0000 7f4556da1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4550160710 0x7f45500b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.852+0000 7f4556da1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45501f67e0 con 0x7f45500d2e00 2023-10-17T06:07:17.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.852+0000 7f4556da1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45501f6c00 con 0x7f4550160710 2023-10-17T06:07:17.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.852+0000 7f4556da1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45501f5e40 con 0x7f45500b5ae0 2023-10-17T06:07:17.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.852+0000 7f455559e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45500d2e00 0x7f45500b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.856+0000 7f455559e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45500d2e00 0x7f45500b27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49570/0 (socket says 172.21.15.125:49570) 2023-10-17T06:07:17.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.856+0000 7f455559e700 1 -- 172.21.15.125:0/4149269127 learned_addr learned my addr 172.21.15.125:0/4149269127 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:17.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.856+0000 7f45565a0700 1 --2- 172.21.15.125:0/4149269127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4550160710 0x7f45500b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.856+0000 7f4555d9f700 1 --2- 172.21.15.125:0/4149269127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45500b5ae0 0x7f45501584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.856+0000 7f455559e700 1 -- 172.21.15.125:0/4149269127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45500b5ae0 msgr2=0x7f45501584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:17.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.856+0000 7f455559e700 1 --2- 172.21.15.125:0/4149269127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45500b5ae0 0x7f45501584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.856+0000 7f455559e700 1 -- 172.21.15.125:0/4149269127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4550160710 msgr2=0x7f45500b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:17.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.856+0000 7f455559e700 1 --2- 172.21.15.125:0/4149269127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4550160710 0x7f45500b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:17.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.856+0000 7f455559e700 1 -- 172.21.15.125:0/4149269127 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c0094b0 con 0x7f45500d2e00 2023-10-17T06:07:17.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.856+0000 7f455559e700 1 --2- 172.21.15.125:0/4149269127 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45500d2e00 0x7f45500b27f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f454000c550 tx=0x7f454000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:17.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.856+0000 7f45467fc700 1 -- 172.21.15.125:0/4149269127 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4540004ca0 con 0x7f45500d2e00 2023-10-17T06:07:17.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.856+0000 7f45467fc700 1 -- 172.21.15.125:0/4149269127 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4540004e00 con 0x7f45500d2e00 2023-10-17T06:07:17.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.856+0000 7f45467fc700 1 -- 172.21.15.125:0/4149269127 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4540007310 con 0x7f45500d2e00 2023-10-17T06:07:17.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.856+0000 7f4556da1700 1 -- 172.21.15.125:0/4149269127 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45501f6120 con 0x7f45500d2e00 2023-10-17T06:07:17.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.856+0000 7f4556da1700 1 -- 172.21.15.125:0/4149269127 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4550158a00 con 0x7f45500d2e00 2023-10-17T06:07:17.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.856+0000 7f4556da1700 1 -- 172.21.15.125:0/4149269127 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4550072e60 con 0x7f45500d2e00 2023-10-17T06:07:17.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.860+0000 7f45467fc700 1 -- 172.21.15.125:0/4149269127 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4540007470 con 0x7f45500d2e00 2023-10-17T06:07:17.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.860+0000 7f45467fc700 1 --2- 172.21.15.125:0/4149269127 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4534065720 0x7f4534067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:17.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.860+0000 7f45467fc700 1 -- 172.21.15.125:0/4149269127 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4540082ad0 con 0x7f45500d2e00 2023-10-17T06:07:17.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.860+0000 7f4555d9f700 1 --2- 172.21.15.125:0/4149269127 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4534065720 0x7f4534067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:17.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.864+0000 7f4555d9f700 1 --2- 172.21.15.125:0/4149269127 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4534065720 0x7f4534067be0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f454c009880 tx=0x7f454c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:17.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:17.868+0000 7f45467fc700 1 -- 172.21.15.125:0/4149269127 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f45400502a0 con 0x7f45500d2e00 2023-10-17T06:07:18.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:18.172+0000 7f4556da1700 1 -- 172.21.15.125:0/4149269127 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f455015d0d0 con 0x7f45500d2e00 2023-10-17T06:07:18.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:18.172+0000 7f45467fc700 1 -- 172.21.15.125:0/4149269127 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f455015d0d0 con 0x7f45500d2e00 2023-10-17T06:07:18.175 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-17T06:07:18.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:18.176+0000 7f4556da1700 1 -- 172.21.15.125:0/4149269127 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4534065720 msgr2=0x7f4534067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:18.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:18.176+0000 7f4556da1700 1 --2- 172.21.15.125:0/4149269127 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4534065720 0x7f4534067be0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f454c009880 tx=0x7f454c01c040 comp rx=0 tx=0).stop 2023-10-17T06:07:18.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:18.176+0000 7f4556da1700 1 -- 172.21.15.125:0/4149269127 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45500d2e00 msgr2=0x7f45500b27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:18.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:18.176+0000 7f4556da1700 1 --2- 172.21.15.125:0/4149269127 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45500d2e00 0x7f45500b27f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f454000c550 tx=0x7f454000c860 comp rx=0 tx=0).stop 2023-10-17T06:07:18.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:18.176+0000 7f4556da1700 1 -- 172.21.15.125:0/4149269127 shutdown_connections 2023-10-17T06:07:18.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:18.176+0000 7f4556da1700 1 --2- 172.21.15.125:0/4149269127 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4534065720 0x7f4534067be0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:18.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:18.176+0000 7f4556da1700 1 --2- 172.21.15.125:0/4149269127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4550160710 0x7f45500b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:18.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:18.176+0000 7f4556da1700 1 --2- 172.21.15.125:0/4149269127 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45500d2e00 0x7f45500b27f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:18.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:18.176+0000 7f4556da1700 1 --2- 172.21.15.125:0/4149269127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45500b5ae0 0x7f45501584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:18.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:18.176+0000 7f4556da1700 1 -- 172.21.15.125:0/4149269127 >> 172.21.15.125:0/4149269127 conn(0x7f4550069f20 msgr2=0x7f45500b68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:18.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:18.176+0000 7f4556da1700 1 -- 172.21.15.125:0/4149269127 shutdown_connections 2023-10-17T06:07:18.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:18.176+0000 7f4556da1700 1 -- 172.21.15.125:0/4149269127 wait complete. 2023-10-17T06:07:18.199 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-17T06:07:18.200 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-17T06:07:18.200 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-10-17T06:07:18.200 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-17T06:07:18.201 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-17T06:07:18.201 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-17T06:07:18.201 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-17T06:07:18.201 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-17T06:07:18.202 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-17T06:07:18.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:18.203 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-10-17T06:07:18.218 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-17T06:07:18.218 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-17T06:07:18.219 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-10-17T06:07:18.219 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:18.219 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-10-17T06:07:18.219 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:18.219 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:07:18.220 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:18.220 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f0 2023-10-17T06:07:18.220 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:07:18.220 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:18.220 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f1 2023-10-17T06:07:18.220 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:07:18.221 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:18.221 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-17T06:07:18.221 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:18.221 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-17T06:07:18.221 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42410sec preferred_lft 42410sec 2023-10-17T06:07:18.222 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::ec4:7aff:fe8f:d739/64 scope link 2023-10-17T06:07:18.222 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:18.222 INFO:teuthology.orchestra.run.smithi125.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-17T06:07:18.222 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 02:42:72:b2:4f:6c brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:18.223 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-17T06:07:18.223 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:18.224 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-17T06:07:18.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:18.225 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-17T06:07:18.225 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-17T06:07:18.226 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link add name ceph-brx type bridge 2023-10-17T06:07:18.226 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip addr flush dev ceph-brx 2023-10-17T06:07:18.226 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set ceph-brx up 2023-10-17T06:07:18.227 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-17T06:07:18.227 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-17T06:07:18.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:18.381 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-17T06:07:18.414 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-10-17T06:07:18.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:18.418 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-10-17T06:07:18.496 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-10-17T06:07:18.496 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-17T06:07:18.497 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-17T06:07:18.497 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-17T06:07:18.497 INFO:teuthology.orchestra.run.smithi125.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-17T06:07:18.497 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-17T06:07:18.497 INFO:teuthology.orchestra.run.smithi125.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-17T06:07:18.498 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-17T06:07:18.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:18.499 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-17T06:07:18.499 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-17T06:07:18.499 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-17T06:07:18.500 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-17T06:07:18.500 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-17T06:07:18.500 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-17T06:07:18.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:18.642 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-10-17T06:07:18.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:18.660 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list-id 2023-10-17T06:07:18.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:18.719 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-17T06:07:18.720 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-17T06:07:18.720 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-17T06:07:18.720 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-17T06:07:18.721 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-17T06:07:18.840 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-17T06:07:18.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:18.841 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-17T06:07:18.841 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-17T06:07:18.842 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-17T06:07:18.842 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-17T06:07:18.842 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-17T06:07:18.843 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-17T06:07:18.843 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-17T06:07:18.843 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-17T06:07:19.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:19.026 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-17T06:07:19.026 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-17T06:07:19.027 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2023-10-17T06:07:19.027 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set dev brx.0 master ceph-brx 2023-10-17T06:07:19.027 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-17T06:07:19.101 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-17T06:07:19.101 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-17T06:07:19.102 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-17T06:07:19.119 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-17T06:07:19.120 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-17T06:07:19.121 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-17T06:07:19.181 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-10-17T06:07:19.265 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-17T06:07:19.266 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-17T06:07:19.343 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-17T06:07:19.346 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-17T06:07:19.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:19.348 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-10-17T06:07:19.405 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-17T06:07:19.406 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-17T06:07:19.455 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-10-17T06:07:19.488 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-17T06:07:19.489 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-17T06:07:19.560 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-17T06:07:19.562 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-17T06:07:19.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:19.563 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-10-17T06:07:19.606 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi125.stderr:2023-10-17T06:07:19.604+0000 7f93652a3640 -1 init, newargv = 0x55c35df91b20 newargc=15 2023-10-17T06:07:19.606 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi125.stderr:ceph-fuse[40856]: starting ceph client 2023-10-17T06:07:19.621 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi125.stderr:ceph-fuse[40856]: starting fuse 2023-10-17T06:07:19.623 INFO:teuthology.orchestra.run.smithi125.stdout:49 2023-10-17T06:07:19.623 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-10-17T06:07:19.624 DEBUG:teuthology.orchestra.run.smithi125:> sudo stdin-killer -- python3 -c ' 2023-10-17T06:07:19.624 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2023-10-17T06:07:19.624 DEBUG:teuthology.orchestra.run.smithi125:> import re 2023-10-17T06:07:19.625 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-10-17T06:07:19.625 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2023-10-17T06:07:19.625 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-17T06:07:19.626 DEBUG:teuthology.orchestra.run.smithi125:> def _find_admin_socket(client_name): 2023-10-17T06:07:19.626 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-17T06:07:19.627 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2023-10-17T06:07:19.627 DEBUG:teuthology.orchestra.run.smithi125:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-17T06:07:19.628 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-17T06:07:19.628 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2023-10-17T06:07:19.628 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2023-10-17T06:07:19.629 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2023-10-17T06:07:19.629 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2023-10-17T06:07:19.629 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-17T06:07:19.630 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2023-10-17T06:07:19.630 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-17T06:07:19.631 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-17T06:07:19.631 DEBUG:teuthology.orchestra.run.smithi125:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-17T06:07:19.632 DEBUG:teuthology.orchestra.run.smithi125:> contents = proc_f.read() 2023-10-17T06:07:19.633 DEBUG:teuthology.orchestra.run.smithi125:> if mountpoint in contents: 2023-10-17T06:07:19.633 DEBUG:teuthology.orchestra.run.smithi125:> return f 2023-10-17T06:07:19.634 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-17T06:07:19.635 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-17T06:07:19.635 DEBUG:teuthology.orchestra.run.smithi125:> print(_find_admin_socket("client.admin")) 2023-10-17T06:07:19.636 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-10-17T06:07:19.797 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.admin.40856.asok 2023-10-17T06:07:19.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-17T06:07:19.818 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.40856.asok 2023-10-17T06:07:19.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:19.819 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.40856.asok status 2023-10-17T06:07:20.028 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-17T06:07:20.029 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2023-10-17T06:07:20.029 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "6f3e6b48891b9b50415c0822b6b870797fcda16d", 2023-10-17T06:07:20.029 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 18.0.0-5610-g6f3e6b48 (6f3e6b48891b9b50415c0822b6b870797fcda16d) reef (dev)", 2023-10-17T06:07:20.029 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "admin", 2023-10-17T06:07:20.030 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2023-10-17T06:07:20.030 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-17T06:07:20.030 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "40856", 2023-10-17T06:07:20.030 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2023-10-17T06:07:20.030 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:07:20.031 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2023-10-17T06:07:20.031 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2023-10-17T06:07:20.031 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 4376, 2023-10-17T06:07:20.031 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2023-10-17T06:07:20.031 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2023-10-17T06:07:20.032 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2023-10-17T06:07:20.032 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 4376 2023-10-17T06:07:20.032 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:07:20.032 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-10-17T06:07:20.032 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-17T06:07:20.032 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2023-10-17T06:07:20.033 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 1204780085 2023-10-17T06:07:20.033 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:07:20.033 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:07:20.033 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-10-17T06:07:20.033 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-17T06:07:20.034 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "172.21.15.125:0", 2023-10-17T06:07:20.034 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 1204780085 2023-10-17T06:07:20.034 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:07:20.034 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.4376 172.21.15.125:0/1204780085", 2023-10-17T06:07:20.034 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "172.21.15.125:0/1204780085", 2023-10-17T06:07:20.035 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2023-10-17T06:07:20.035 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 7, 2023-10-17T06:07:20.035 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 28, 2023-10-17T06:07:20.035 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2023-10-17T06:07:20.035 INFO:teuthology.orchestra.run.smithi125.stdout: "blocklisted": false, 2023-10-17T06:07:20.036 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2023-10-17T06:07:20.036 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-17T06:07:20.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:20.044 DEBUG:teuthology.orchestra.run.smithi125:> stat --file-system '--printf=%T 2023-10-17T06:07:20.044 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-17T06:07:20.065 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2023-10-17T06:07:20.065 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-17T06:07:20.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:20.066 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-17T06:07:20.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:20.151 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-17T06:07:20.262 INFO:teuthology.orchestra.run.smithi125.stdout:# file: . 2023-10-17T06:07:20.263 INFO:teuthology.orchestra.run.smithi125.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-17T06:07:20.263 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:20.264 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:07:20.264 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:07:20.280 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:07:20.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.496+0000 7f0952c5e700 1 Processor -- start 2023-10-17T06:07:20.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.496+0000 7f0952c5e700 1 -- start start 2023-10-17T06:07:20.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f0952c5e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f094c0b1e60 0x7f094c070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:20.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f0952c5e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f094c0d2f20 0x7f094c0d3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:20.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f0952c5e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094c0d0460 con 0x7f094c15cc10 2023-10-17T06:07:20.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f0952c5e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094c06eef0 con 0x7f094c0d2f20 2023-10-17T06:07:20.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f0952c5e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0d38d0 con 0x7f094c0b1e60 2023-10-17T06:07:20.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f09509fa700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f094c15cc10 0x7f094c0cfd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45492/0 (socket says 172.21.15.125:45492) 2023-10-17T06:07:20.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f09509fa700 1 -- 172.21.15.125:0/2258635589 learned_addr learned my addr 172.21.15.125:0/2258635589 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:20.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f09511fb700 1 --2- 172.21.15.125:0/2258635589 >> v2:172.21.15.125:3300/0 conn(0x7f094c0d2f20 0x7f094c0d3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:20.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f094bfff700 1 --2- 172.21.15.125:0/2258635589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f094c0b1e60 0x7f094c070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:20.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f094b7fe700 1 -- 172.21.15.125:0/2258635589 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537058449 0 0) 0x7f094c0d0460 con 0x7f094c15cc10 2023-10-17T06:07:20.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f094b7fe700 1 -- 172.21.15.125:0/2258635589 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f093c0035d0 con 0x7f094c15cc10 2023-10-17T06:07:20.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f094b7fe700 1 -- 172.21.15.125:0/2258635589 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1436656734 0 0) 0x7f093c0035d0 con 0x7f094c15cc10 2023-10-17T06:07:20.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f094b7fe700 1 -- 172.21.15.125:0/2258635589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f094c0b1e60 msgr2=0x7f094c070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:20.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f094b7fe700 1 --2- 172.21.15.125:0/2258635589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f094c0b1e60 0x7f094c070a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:20.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f094b7fe700 1 -- 172.21.15.125:0/2258635589 >> v2:172.21.15.125:3300/0 conn(0x7f094c0d2f20 msgr2=0x7f094c0d3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:20.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f094b7fe700 1 --2- 172.21.15.125:0/2258635589 >> v2:172.21.15.125:3300/0 conn(0x7f094c0d2f20 0x7f094c0d3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:20.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f094b7fe700 1 -- 172.21.15.125:0/2258635589 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c06d220 con 0x7f094c15cc10 2023-10-17T06:07:20.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f094b7fe700 1 -- 172.21.15.125:0/2258635589 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7f0940001670 con 0x7f094c15cc10 2023-10-17T06:07:20.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f094b7fe700 1 -- 172.21.15.125:0/2258635589 >> v1:172.21.15.125:6789/0 conn(0x7f094c15cc10 legacy=0x7f094c0cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:20.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f094b7fe700 1 --2- 172.21.15.125:0/2258635589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f093c003a20 0x7f093c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:20.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f094b7fe700 1 --2- 172.21.15.125:0/2258635589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f094c0b1e60 0x7f093c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:20.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f094b7fe700 1 --2- 172.21.15.125:0/2258635589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f093c004db0 0x7f093c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:20.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f094b7fe700 1 -- 172.21.15.125:0/2258635589 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c06eef0 con 0x7f093c003a20 2023-10-17T06:07:20.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f094b7fe700 1 -- 172.21.15.125:0/2258635589 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0d38d0 con 0x7f093c004db0 2023-10-17T06:07:20.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f094b7fe700 1 -- 172.21.15.125:0/2258635589 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093c00ba30 con 0x7f094c0b1e60 2023-10-17T06:07:20.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f09511fb700 1 --2- 172.21.15.125:0/2258635589 >> v2:172.21.15.125:3300/0 conn(0x7f094c0d2f20 0x7f094c0d3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:07:20.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f09509fa700 1 --2- 172.21.15.125:0/2258635589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f093c003a20 0x7f093c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:20.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f094bfff700 1 --2- 172.21.15.125:0/2258635589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f094c0b1e60 0x7f093c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:20.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f09509fa700 1 -- 172.21.15.125:0/2258635589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f094c0b1e60 msgr2=0x7f093c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:20.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f09509fa700 1 --2- 172.21.15.125:0/2258635589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f094c0b1e60 0x7f093c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:20.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f09509fa700 1 -- 172.21.15.125:0/2258635589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f093c004db0 msgr2=0x7f093c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:20.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f09511fb700 1 --2- 172.21.15.125:0/2258635589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f093c004db0 0x7f093c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:20.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f09509fa700 1 --2- 172.21.15.125:0/2258635589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f093c004db0 0x7f093c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:20.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f09509fa700 1 -- 172.21.15.125:0/2258635589 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c0035d0 con 0x7f093c003a20 2023-10-17T06:07:20.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.500+0000 7f09511fb700 1 --2- 172.21.15.125:0/2258635589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f093c004db0 0x7f093c005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:20.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.504+0000 7f09509fa700 1 --2- 172.21.15.125:0/2258635589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f093c003a20 0x7f093c003e40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f094000c2f0 tx=0x7f093c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e37a15a53d0317 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:20.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.504+0000 7f094b7fe700 1 -- 172.21.15.125:0/2258635589 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0940007b90 con 0x7f093c003a20 2023-10-17T06:07:20.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.504+0000 7f094b7fe700 1 -- 172.21.15.125:0/2258635589 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094000ce30 con 0x7f093c003a20 2023-10-17T06:07:20.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.504+0000 7f094b7fe700 1 -- 172.21.15.125:0/2258635589 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0940005bc0 con 0x7f093c003a20 2023-10-17T06:07:20.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.504+0000 7f0952c5e700 1 -- 172.21.15.125:0/2258635589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f093c003a20 msgr2=0x7f093c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:20.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.504+0000 7f0952c5e700 1 --2- 172.21.15.125:0/2258635589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f093c003a20 0x7f093c003e40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f094000c2f0 tx=0x7f093c0058a0 comp rx=0 tx=0).stop 2023-10-17T06:07:20.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.504+0000 7f09511fb700 1 -- 172.21.15.125:0/2258635589 reap_dead start 2023-10-17T06:07:20.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.504+0000 7f0952c5e700 1 -- 172.21.15.125:0/2258635589 shutdown_connections 2023-10-17T06:07:20.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.504+0000 7f0952c5e700 1 -- 172.21.15.125:0/2258635589 >> 172.21.15.125:0/2258635589 conn(0x7f094c069ef0 msgr2=0x7f094c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:20.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.504+0000 7f0952c5e700 1 -- 172.21.15.125:0/2258635589 shutdown_connections 2023-10-17T06:07:20.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.504+0000 7f0952c5e700 1 -- 172.21.15.125:0/2258635589 wait complete. 2023-10-17T06:07:20.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.508+0000 7f0952c5e700 1 Processor -- start 2023-10-17T06:07:20.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.508+0000 7f0952c5e700 1 -- start start 2023-10-17T06:07:20.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.508+0000 7f0952c5e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f093c003a20 0x7f094c155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:20.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.508+0000 7f0952c5e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f094c15bd70 0x7f094c0ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:20.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.508+0000 7f0952c5e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f094c15c1d0 0x7f094c0ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:20.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.508+0000 7f0952c5e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c1f4fe0 con 0x7f094c15bd70 2023-10-17T06:07:20.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.508+0000 7f0952c5e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c155d40 con 0x7f093c003a20 2023-10-17T06:07:20.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.508+0000 7f0952c5e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0abcc0 con 0x7f094c15c1d0 2023-10-17T06:07:20.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.512+0000 7f094bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f094c15bd70 0x7f094c0ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.512+0000 7f094bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f094c15bd70 0x7f094c0ad550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49586/0 (socket says 172.21.15.125:49586) 2023-10-17T06:07:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.512+0000 7f094bfff700 1 -- 172.21.15.125:0/1413637798 learned_addr learned my addr 172.21.15.125:0/1413637798 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.512+0000 7f09509fa700 1 --2- 172.21.15.125:0/1413637798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f093c003a20 0x7f094c155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.512+0000 7f09511fb700 1 --2- 172.21.15.125:0/1413637798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f094c15c1d0 0x7f094c0ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:20.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.512+0000 7f094bfff700 1 -- 172.21.15.125:0/1413637798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f094c15c1d0 msgr2=0x7f094c0ada90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:20.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.512+0000 7f094bfff700 1 --2- 172.21.15.125:0/1413637798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f094c15c1d0 0x7f094c0ada90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:20.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.512+0000 7f094bfff700 1 -- 172.21.15.125:0/1413637798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f093c003a20 msgr2=0x7f094c155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:20.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.512+0000 7f094bfff700 1 --2- 172.21.15.125:0/1413637798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f093c003a20 0x7f094c155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:20.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.512+0000 7f094bfff700 1 -- 172.21.15.125:0/1413637798 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c1f4990 con 0x7f094c15bd70 2023-10-17T06:07:20.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.512+0000 7f09511fb700 1 --2- 172.21.15.125:0/1413637798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f094c15c1d0 0x7f094c0ada90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:20.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.512+0000 7f094bfff700 1 --2- 172.21.15.125:0/1413637798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f094c15bd70 0x7f094c0ad550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f09380108f0 tx=0x7f0938010c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:20.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.512+0000 7f09497fa700 1 -- 172.21.15.125:0/1413637798 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938016730 con 0x7f094c15bd70 2023-10-17T06:07:20.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.512+0000 7f09497fa700 1 -- 172.21.15.125:0/1413637798 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0938016890 con 0x7f094c15bd70 2023-10-17T06:07:20.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.512+0000 7f0952c5e700 1 -- 172.21.15.125:0/1413637798 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094c1f4c70 con 0x7f094c15bd70 2023-10-17T06:07:20.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.512+0000 7f09497fa700 1 -- 172.21.15.125:0/1413637798 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938016c00 con 0x7f094c15bd70 2023-10-17T06:07:20.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.512+0000 7f0952c5e700 1 -- 172.21.15.125:0/1413637798 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094c0abfa0 con 0x7f094c15bd70 2023-10-17T06:07:20.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.516+0000 7f0952c5e700 1 -- 172.21.15.125:0/1413637798 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094c1f5650 con 0x7f094c15bd70 2023-10-17T06:07:20.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.516+0000 7f09497fa700 1 -- 172.21.15.125:0/1413637798 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f093801f450 con 0x7f094c15bd70 2023-10-17T06:07:20.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.520+0000 7f09497fa700 1 --2- 172.21.15.125:0/1413637798 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f09300656f0 0x7f0930067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:20.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.520+0000 7f09497fa700 1 -- 172.21.15.125:0/1413637798 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0938083840 con 0x7f094c15bd70 2023-10-17T06:07:20.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.520+0000 7f09509fa700 1 --2- 172.21.15.125:0/1413637798 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f09300656f0 0x7f0930067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:20.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.520+0000 7f09509fa700 1 --2- 172.21.15.125:0/1413637798 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f09300656f0 0x7f0930067bb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f094000c2f0 tx=0x7f094000a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:20.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.524+0000 7f09497fa700 1 -- 172.21.15.125:0/1413637798 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0938050ee0 con 0x7f094c15bd70 2023-10-17T06:07:20.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.700+0000 7f0952c5e700 1 -- 172.21.15.125:0/1413637798 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f094c072e60 con 0x7f094c15bd70 2023-10-17T06:07:20.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.700+0000 7f09497fa700 1 -- 172.21.15.125:0/1413637798 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f0938054500 con 0x7f094c15bd70 2023-10-17T06:07:20.704 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:20.704 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":28,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:14.576796+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:07:20.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.704+0000 7f0952c5e700 1 -- 172.21.15.125:0/1413637798 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f09300656f0 msgr2=0x7f0930067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:20.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.704+0000 7f0952c5e700 1 --2- 172.21.15.125:0/1413637798 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f09300656f0 0x7f0930067bb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f094000c2f0 tx=0x7f094000a000 comp rx=0 tx=0).stop 2023-10-17T06:07:20.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.704+0000 7f0952c5e700 1 -- 172.21.15.125:0/1413637798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f094c15bd70 msgr2=0x7f094c0ad550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:20.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.704+0000 7f0952c5e700 1 --2- 172.21.15.125:0/1413637798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f094c15bd70 0x7f094c0ad550 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f09380108f0 tx=0x7f0938010c00 comp rx=0 tx=0).stop 2023-10-17T06:07:20.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.704+0000 7f0952c5e700 1 -- 172.21.15.125:0/1413637798 shutdown_connections 2023-10-17T06:07:20.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.704+0000 7f0952c5e700 1 --2- 172.21.15.125:0/1413637798 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f09300656f0 0x7f0930067bb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:20.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.704+0000 7f0952c5e700 1 --2- 172.21.15.125:0/1413637798 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f094c15c1d0 0x7f094c0ada90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:20.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.704+0000 7f0952c5e700 1 --2- 172.21.15.125:0/1413637798 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f094c15bd70 0x7f094c0ad550 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:20.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.704+0000 7f0952c5e700 1 --2- 172.21.15.125:0/1413637798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f093c003a20 0x7f094c155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:20.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.704+0000 7f0952c5e700 1 -- 172.21.15.125:0/1413637798 >> 172.21.15.125:0/1413637798 conn(0x7f094c069ef0 msgr2=0x7f094c0b6290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:20.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.708+0000 7f0952c5e700 1 -- 172.21.15.125:0/1413637798 shutdown_connections 2023-10-17T06:07:20.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.708+0000 7f0952c5e700 1 -- 172.21.15.125:0/1413637798 wait complete. 2023-10-17T06:07:20.729 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-17T06:07:06.629169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-17T06:07:08.148117+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-17T06:07:11.895112+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-17T06:07:20.730 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:07:20.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.904+0000 7febf74fa700 1 Processor -- start 2023-10-17T06:07:20.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.904+0000 7febf74fa700 1 -- start start 2023-10-17T06:07:20.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febf74fa700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7febf01467c0 0x7febf00b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:20.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febf74fa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febf006f9a0 0x7febf006fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:20.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febf74fa700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf0146ba0 con 0x7febf01612e0 2023-10-17T06:07:20.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febf74fa700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf00d0920 con 0x7febf01467c0 2023-10-17T06:07:20.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febf74fa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf0070320 con 0x7febf006f9a0 2023-10-17T06:07:20.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febf4a95700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7febf01612e0 0x7febf015d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45508/0 (socket says 172.21.15.125:45508) 2023-10-17T06:07:20.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febf4a95700 1 -- 172.21.15.125:0/2790210454 learned_addr learned my addr 172.21.15.125:0/2790210454 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:20.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febf5296700 1 --2- 172.21.15.125:0/2790210454 >> v2:172.21.15.184:3300/0 conn(0x7febf01467c0 0x7febf00b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:20.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febf5a97700 1 --2- 172.21.15.125:0/2790210454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febf006f9a0 0x7febf006fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:20.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febe7fff700 1 -- 172.21.15.125:0/2790210454 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342732737 0 0) 0x7febf0146ba0 con 0x7febf01612e0 2023-10-17T06:07:20.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febe7fff700 1 -- 172.21.15.125:0/2790210454 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febdc0035d0 con 0x7febf01612e0 2023-10-17T06:07:20.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febe7fff700 1 -- 172.21.15.125:0/2790210454 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1125339123 0 0) 0x7febdc0035d0 con 0x7febf01612e0 2023-10-17T06:07:20.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febe7fff700 1 -- 172.21.15.125:0/2790210454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febf006f9a0 msgr2=0x7febf006fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:20.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febe7fff700 1 --2- 172.21.15.125:0/2790210454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febf006f9a0 0x7febf006fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:20.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febe7fff700 1 -- 172.21.15.125:0/2790210454 >> v2:172.21.15.184:3300/0 conn(0x7febf01467c0 msgr2=0x7febf00b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:20.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febe7fff700 1 --2- 172.21.15.125:0/2790210454 >> v2:172.21.15.184:3300/0 conn(0x7febf01467c0 0x7febf00b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:20.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febe7fff700 1 -- 172.21.15.125:0/2790210454 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf00b6160 con 0x7febf01612e0 2023-10-17T06:07:20.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febe7fff700 1 -- 172.21.15.125:0/2790210454 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7febe0001670 con 0x7febf01612e0 2023-10-17T06:07:20.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febe7fff700 1 -- 172.21.15.125:0/2790210454 >> v1:172.21.15.125:6789/0 conn(0x7febf01612e0 legacy=0x7febf015d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:20.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febe7fff700 1 --2- 172.21.15.125:0/2790210454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febdc003a90 0x7febdc003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:20.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febe7fff700 1 --2- 172.21.15.125:0/2790210454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febf006f9a0 0x7febdc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:20.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febe7fff700 1 --2- 172.21.15.125:0/2790210454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febdc004db0 0x7febdc005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:20.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febe7fff700 1 -- 172.21.15.125:0/2790210454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf00d0920 con 0x7febdc004db0 2023-10-17T06:07:20.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febe7fff700 1 -- 172.21.15.125:0/2790210454 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf0070320 con 0x7febdc003a90 2023-10-17T06:07:20.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febe7fff700 1 -- 172.21.15.125:0/2790210454 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febdc00ba30 con 0x7febf006f9a0 2023-10-17T06:07:20.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.908+0000 7febf5296700 1 --2- 172.21.15.125:0/2790210454 >> v2:172.21.15.184:3300/0 conn(0x7febf01467c0 0x7febf00b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:07:20.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.912+0000 7febf5a97700 1 --2- 172.21.15.125:0/2790210454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febdc004db0 0x7febdc005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:20.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.912+0000 7febf4a95700 1 --2- 172.21.15.125:0/2790210454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febf006f9a0 0x7febdc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:20.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.912+0000 7febf5296700 1 --2- 172.21.15.125:0/2790210454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febdc003a90 0x7febdc003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:20.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.912+0000 7febf5a97700 1 -- 172.21.15.125:0/2790210454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febf006f9a0 msgr2=0x7febdc004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:20.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.912+0000 7febf5a97700 1 --2- 172.21.15.125:0/2790210454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febf006f9a0 0x7febdc004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:20.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.912+0000 7febf5a97700 1 -- 172.21.15.125:0/2790210454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febdc003a90 msgr2=0x7febdc003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:20.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.912+0000 7febf5a97700 1 --2- 172.21.15.125:0/2790210454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febdc003a90 0x7febdc003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:20.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.912+0000 7febf5a97700 1 -- 172.21.15.125:0/2790210454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc0035d0 con 0x7febdc004db0 2023-10-17T06:07:20.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.912+0000 7febf5a97700 1 --2- 172.21.15.125:0/2790210454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febdc004db0 0x7febdc005230 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7febe8009fc0 tx=0x7febdc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f10c4ab8f7e45d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:20.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.912+0000 7febe7fff700 1 -- 172.21.15.125:0/2790210454 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe800ec30 con 0x7febdc004db0 2023-10-17T06:07:20.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.912+0000 7febe7fff700 1 -- 172.21.15.125:0/2790210454 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe800f040 con 0x7febdc004db0 2023-10-17T06:07:20.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.912+0000 7febe7fff700 1 -- 172.21.15.125:0/2790210454 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe8014480 con 0x7febdc004db0 2023-10-17T06:07:20.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.912+0000 7febf74fa700 1 -- 172.21.15.125:0/2790210454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febdc004db0 msgr2=0x7febdc005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:20.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.912+0000 7febf74fa700 1 --2- 172.21.15.125:0/2790210454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febdc004db0 0x7febdc005230 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7febe8009fc0 tx=0x7febdc0058a0 comp rx=0 tx=0).stop 2023-10-17T06:07:20.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.912+0000 7febf5a97700 1 -- 172.21.15.125:0/2790210454 reap_dead start 2023-10-17T06:07:20.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.912+0000 7febf74fa700 1 -- 172.21.15.125:0/2790210454 shutdown_connections 2023-10-17T06:07:20.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.912+0000 7febf74fa700 1 -- 172.21.15.125:0/2790210454 >> 172.21.15.125:0/2790210454 conn(0x7febf006a130 msgr2=0x7febf006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:20.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.912+0000 7febf74fa700 1 -- 172.21.15.125:0/2790210454 shutdown_connections 2023-10-17T06:07:20.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.912+0000 7febf74fa700 1 -- 172.21.15.125:0/2790210454 wait complete. 2023-10-17T06:07:20.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.916+0000 7febf74fa700 1 Processor -- start 2023-10-17T06:07:20.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.916+0000 7febf74fa700 1 -- start start 2023-10-17T06:07:20.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febf74fa700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febdc004db0 0x7febf00cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:20.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febf74fa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febf015c820 0x7febf00cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:20.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febf74fa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febf006d850 0x7febf006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:20.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febf74fa700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf00ce4c0 con 0x7febf015c820 2023-10-17T06:07:20.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febf74fa700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf00c8ad0 con 0x7febdc004db0 2023-10-17T06:07:20.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febf74fa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf006e210 con 0x7febf006d850 2023-10-17T06:07:20.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febf4a95700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febf015c820 0x7febf00cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:20.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febf4a95700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febf015c820 0x7febf00cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49602/0 (socket says 172.21.15.125:49602) 2023-10-17T06:07:20.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febf4a95700 1 -- 172.21.15.125:0/3286867003 learned_addr learned my addr 172.21.15.125:0/3286867003 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:20.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febf5296700 1 --2- 172.21.15.125:0/3286867003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febdc004db0 0x7febf00cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:20.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febf5a97700 1 --2- 172.21.15.125:0/3286867003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febf006d850 0x7febf006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:20.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febf5a97700 1 -- 172.21.15.125:0/3286867003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febdc004db0 msgr2=0x7febf00cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:20.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febf5a97700 1 --2- 172.21.15.125:0/3286867003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febdc004db0 0x7febf00cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:20.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febf5a97700 1 -- 172.21.15.125:0/3286867003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febf015c820 msgr2=0x7febf00cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:20.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febf5a97700 1 --2- 172.21.15.125:0/3286867003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febf015c820 0x7febf00cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:20.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febf5a97700 1 -- 172.21.15.125:0/3286867003 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf00cc050 con 0x7febf006d850 2023-10-17T06:07:20.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febf4a95700 1 --2- 172.21.15.125:0/3286867003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febf015c820 0x7febf00cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:07:20.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febf5a97700 1 --2- 172.21.15.125:0/3286867003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febf006d850 0x7febf006dcd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7febe8009f90 tx=0x7febe8009750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:20.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febe5ffb700 1 -- 172.21.15.125:0/3286867003 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe8007000 con 0x7febf006d850 2023-10-17T06:07:20.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febe5ffb700 1 -- 172.21.15.125:0/3286867003 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe8003e70 con 0x7febf006d850 2023-10-17T06:07:20.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febf74fa700 1 -- 172.21.15.125:0/3286867003 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf015cca0 con 0x7febf006d850 2023-10-17T06:07:20.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febe5ffb700 1 -- 172.21.15.125:0/3286867003 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe8014c50 con 0x7febf006d850 2023-10-17T06:07:20.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.920+0000 7febf74fa700 1 -- 172.21.15.125:0/3286867003 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf00ce990 con 0x7febf006d850 2023-10-17T06:07:20.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.924+0000 7febf74fa700 1 -- 172.21.15.125:0/3286867003 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf0072e60 con 0x7febf006d850 2023-10-17T06:07:20.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.924+0000 7febe5ffb700 1 -- 172.21.15.125:0/3286867003 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7febe8024020 con 0x7febf006d850 2023-10-17T06:07:20.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.924+0000 7febe5ffb700 1 --2- 172.21.15.125:0/3286867003 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7febd40656f0 0x7febd4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:20.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.928+0000 7febe5ffb700 1 -- 172.21.15.125:0/3286867003 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7febe8084690 con 0x7febf006d850 2023-10-17T06:07:20.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.928+0000 7febf5296700 1 --2- 172.21.15.125:0/3286867003 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7febd40656f0 0x7febd4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:20.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.928+0000 7febf5296700 1 --2- 172.21.15.125:0/3286867003 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7febd40656f0 0x7febd4067bb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7febec009d90 tx=0x7febec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:20.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:20.936+0000 7febe5ffb700 1 -- 172.21.15.125:0/3286867003 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7febe8051ef0 con 0x7febf006d850 2023-10-17T06:07:21.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.132+0000 7febf74fa700 1 -- 172.21.15.125:0/3286867003 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7febf00cc050 con 0x7febf006d850 2023-10-17T06:07:21.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.132+0000 7febe5ffb700 1 -- 172.21.15.125:0/3286867003 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7febf00cc050 con 0x7febf006d850 2023-10-17T06:07:21.134 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:07:21.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.136+0000 7febf74fa700 1 -- 172.21.15.125:0/3286867003 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7febd40656f0 msgr2=0x7febd4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:21.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.136+0000 7febf74fa700 1 --2- 172.21.15.125:0/3286867003 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7febd40656f0 0x7febd4067bb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7febec009d90 tx=0x7febec008040 comp rx=0 tx=0).stop 2023-10-17T06:07:21.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.136+0000 7febf74fa700 1 -- 172.21.15.125:0/3286867003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febf006d850 msgr2=0x7febf006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:21.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.136+0000 7febf74fa700 1 --2- 172.21.15.125:0/3286867003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febf006d850 0x7febf006dcd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7febe8009f90 tx=0x7febe8009750 comp rx=0 tx=0).stop 2023-10-17T06:07:21.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.136+0000 7febf74fa700 1 -- 172.21.15.125:0/3286867003 shutdown_connections 2023-10-17T06:07:21.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.136+0000 7febf74fa700 1 --2- 172.21.15.125:0/3286867003 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7febd40656f0 0x7febd4067bb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:21.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.136+0000 7febf74fa700 1 --2- 172.21.15.125:0/3286867003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febf006d850 0x7febf006dcd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:21.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.136+0000 7febf74fa700 1 --2- 172.21.15.125:0/3286867003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febf015c820 0x7febf00cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:21.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.136+0000 7febf74fa700 1 --2- 172.21.15.125:0/3286867003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febdc004db0 0x7febf00cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:21.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.136+0000 7febf74fa700 1 -- 172.21.15.125:0/3286867003 >> 172.21.15.125:0/3286867003 conn(0x7febf006a130 msgr2=0x7febf006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:21.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.136+0000 7febf74fa700 1 -- 172.21.15.125:0/3286867003 shutdown_connections 2023-10-17T06:07:21.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.136+0000 7febf74fa700 1 -- 172.21.15.125:0/3286867003 wait complete. 2023-10-17T06:07:21.160 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:07:21.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.344+0000 7ff19d58d700 1 Processor -- start 2023-10-17T06:07:21.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.344+0000 7ff19d58d700 1 -- start start 2023-10-17T06:07:21.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.348+0000 7ff19d58d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff198160710 0x7ff1980b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:21.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.348+0000 7ff19d58d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19815d0d0 con 0x7ff1980b5ae0 2023-10-17T06:07:21.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.348+0000 7ff19d58d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19806f0f0 con 0x7ff1980d2e00 2023-10-17T06:07:21.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.348+0000 7ff19d58d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19815df90 con 0x7ff198160710 2023-10-17T06:07:21.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.348+0000 7ff1977fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff1980b5ae0 0x7ff19806db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45510/0 (socket says 172.21.15.125:45510) 2023-10-17T06:07:21.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.348+0000 7ff1977fe700 1 -- 172.21.15.125:0/4123891950 learned_addr learned my addr 172.21.15.125:0/4123891950 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:21.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.348+0000 7ff1967fc700 1 --2- 172.21.15.125:0/4123891950 >> v2:172.21.15.184:3300/0 conn(0x7ff198160710 0x7ff1980b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:21.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.348+0000 7ff195ffb700 1 -- 172.21.15.125:0/4123891950 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484503928 0 0) 0x7ff1900014e0 con 0x7ff1980b5ae0 2023-10-17T06:07:21.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.348+0000 7ff195ffb700 1 -- 172.21.15.125:0/4123891950 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1800035d0 con 0x7ff1980b5ae0 2023-10-17T06:07:21.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.348+0000 7ff195ffb700 1 -- 172.21.15.125:0/4123891950 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3118306188 0 0) 0x7ff19806f0f0 con 0x7ff1980d2e00 2023-10-17T06:07:21.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.348+0000 7ff195ffb700 1 -- 172.21.15.125:0/4123891950 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1900014e0 con 0x7ff1980d2e00 2023-10-17T06:07:21.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.352+0000 7ff1967fc700 1 -- 172.21.15.125:0/4123891950 >> v1:172.21.15.184:6789/0 conn(0x7ff1980d2e00 legacy=0x7ff1980d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:21.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.352+0000 7ff1967fc700 1 -- 172.21.15.125:0/4123891950 >> v1:172.21.15.125:6789/0 conn(0x7ff1980b5ae0 legacy=0x7ff19806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:21.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.352+0000 7ff1967fc700 1 -- 172.21.15.125:0/4123891950 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19815d310 con 0x7ff198160710 2023-10-17T06:07:21.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.352+0000 7ff1967fc700 1 --2- 172.21.15.125:0/4123891950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff198160710 0x7ff1980b6e00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009850 tx=0x7ff18c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ebc85943adbb6bc server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:21.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.352+0000 7ff195ffb700 1 -- 172.21.15.125:0/4123891950 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c011830 con 0x7ff198160710 2023-10-17T06:07:21.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.352+0000 7ff195ffb700 1 -- 172.21.15.125:0/4123891950 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18c011990 con 0x7ff198160710 2023-10-17T06:07:21.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.352+0000 7ff195ffb700 1 -- 172.21.15.125:0/4123891950 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c011d40 con 0x7ff198160710 2023-10-17T06:07:21.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.352+0000 7ff19d58d700 1 -- 172.21.15.125:0/4123891950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff198160710 msgr2=0x7ff1980b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:21.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.352+0000 7ff19d58d700 1 --2- 172.21.15.125:0/4123891950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff198160710 0x7ff1980b6e00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009850 tx=0x7ff18c009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:21.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.352+0000 7ff19d58d700 1 -- 172.21.15.125:0/4123891950 shutdown_connections 2023-10-17T06:07:21.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.352+0000 7ff19d58d700 1 --2- 172.21.15.125:0/4123891950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff198160710 0x7ff1980b6e00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:21.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.352+0000 7ff19d58d700 1 -- 172.21.15.125:0/4123891950 >> 172.21.15.125:0/4123891950 conn(0x7ff198069f20 msgr2=0x7ff19806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:21.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.352+0000 7ff19d58d700 1 -- 172.21.15.125:0/4123891950 shutdown_connections 2023-10-17T06:07:21.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.352+0000 7ff19d58d700 1 -- 172.21.15.125:0/4123891950 wait complete. 2023-10-17T06:07:21.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.356+0000 7ff19d58d700 1 Processor -- start 2023-10-17T06:07:21.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.356+0000 7ff19d58d700 1 -- start start 2023-10-17T06:07:21.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.356+0000 7ff19d58d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1980b5ae0 0x7ff1981f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:21.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.356+0000 7ff19d58d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1980d2e00 0x7ff198144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:21.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.356+0000 7ff19d58d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff198160710 0x7ff198143510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:21.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.356+0000 7ff19d58d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1980d0e70 con 0x7ff1980b5ae0 2023-10-17T06:07:21.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.356+0000 7ff19d58d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff198144f40 con 0x7ff198160710 2023-10-17T06:07:21.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.356+0000 7ff19d58d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff198142470 con 0x7ff1980d2e00 2023-10-17T06:07:21.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.356+0000 7ff1977fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff198160710 0x7ff198143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:21.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.356+0000 7ff1977fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff198160710 0x7ff198143510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:59024/0 (socket says 172.21.15.125:59024) 2023-10-17T06:07:21.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.356+0000 7ff196ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1980b5ae0 0x7ff1981f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:21.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.356+0000 7ff1977fe700 1 -- 172.21.15.125:0/4272379576 learned_addr learned my addr 172.21.15.125:0/4272379576 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:21.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.356+0000 7ff1967fc700 1 --2- 172.21.15.125:0/4272379576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1980d2e00 0x7ff198144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:21.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.356+0000 7ff196ffd700 1 -- 172.21.15.125:0/4272379576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1980d2e00 msgr2=0x7ff198144a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:21.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.356+0000 7ff196ffd700 1 --2- 172.21.15.125:0/4272379576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1980d2e00 0x7ff198144a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:21.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.356+0000 7ff196ffd700 1 -- 172.21.15.125:0/4272379576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff198160710 msgr2=0x7ff198143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:21.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.356+0000 7ff196ffd700 1 --2- 172.21.15.125:0/4272379576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff198160710 0x7ff198143510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:21.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.356+0000 7ff196ffd700 1 -- 172.21.15.125:0/4272379576 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c0094b0 con 0x7ff1980b5ae0 2023-10-17T06:07:21.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.360+0000 7ff196ffd700 1 --2- 172.21.15.125:0/4272379576 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1980b5ae0 0x7ff1981f2010 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff18800c430 tx=0x7ff18800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:21.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.360+0000 7ff17f7fe700 1 -- 172.21.15.125:0/4272379576 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1880052d0 con 0x7ff1980b5ae0 2023-10-17T06:07:21.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.360+0000 7ff17f7fe700 1 -- 172.21.15.125:0/4272379576 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff188005450 con 0x7ff1980b5ae0 2023-10-17T06:07:21.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.360+0000 7ff19d58d700 1 -- 172.21.15.125:0/4272379576 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff198142750 con 0x7ff1980b5ae0 2023-10-17T06:07:21.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.360+0000 7ff17f7fe700 1 -- 172.21.15.125:0/4272379576 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1880038e0 con 0x7ff1980b5ae0 2023-10-17T06:07:21.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.360+0000 7ff19d58d700 1 -- 172.21.15.125:0/4272379576 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff198142d10 con 0x7ff1980b5ae0 2023-10-17T06:07:21.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.360+0000 7ff19d58d700 1 -- 172.21.15.125:0/4272379576 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19804e910 con 0x7ff1980b5ae0 2023-10-17T06:07:21.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.364+0000 7ff17f7fe700 1 -- 172.21.15.125:0/4272379576 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff188003c50 con 0x7ff1980b5ae0 2023-10-17T06:07:21.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.364+0000 7ff17f7fe700 1 --2- 172.21.15.125:0/4272379576 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff1840656f0 0x7ff184067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:21.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.364+0000 7ff17f7fe700 1 -- 172.21.15.125:0/4272379576 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff188082670 con 0x7ff1980b5ae0 2023-10-17T06:07:21.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.364+0000 7ff1967fc700 1 --2- 172.21.15.125:0/4272379576 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff1840656f0 0x7ff184067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:21.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.364+0000 7ff1967fc700 1 --2- 172.21.15.125:0/4272379576 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff1840656f0 0x7ff184067bb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009850 tx=0x7ff18c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:21.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.368+0000 7ff17f7fe700 1 -- 172.21.15.125:0/4272379576 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff18804fda0 con 0x7ff1980b5ae0 2023-10-17T06:07:21.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.548+0000 7ff19d58d700 1 -- 172.21.15.125:0/4272379576 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff1980b7120 con 0x7ff1980b5ae0 2023-10-17T06:07:21.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.548+0000 7ff17f7fe700 1 -- 172.21.15.125:0/4272379576 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff1880533c0 con 0x7ff1980b5ae0 2023-10-17T06:07:21.551 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:07:21.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.552+0000 7ff19d58d700 1 -- 172.21.15.125:0/4272379576 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff1840656f0 msgr2=0x7ff184067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:21.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.552+0000 7ff19d58d700 1 --2- 172.21.15.125:0/4272379576 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff1840656f0 0x7ff184067bb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009850 tx=0x7ff18c008030 comp rx=0 tx=0).stop 2023-10-17T06:07:21.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.552+0000 7ff19d58d700 1 -- 172.21.15.125:0/4272379576 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1980b5ae0 msgr2=0x7ff1981f2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:21.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.552+0000 7ff19d58d700 1 --2- 172.21.15.125:0/4272379576 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1980b5ae0 0x7ff1981f2010 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff18800c430 tx=0x7ff18800c740 comp rx=0 tx=0).stop 2023-10-17T06:07:21.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.552+0000 7ff19d58d700 1 -- 172.21.15.125:0/4272379576 shutdown_connections 2023-10-17T06:07:21.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.552+0000 7ff19d58d700 1 --2- 172.21.15.125:0/4272379576 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff1840656f0 0x7ff184067bb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:21.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.552+0000 7ff19d58d700 1 --2- 172.21.15.125:0/4272379576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff198160710 0x7ff198143510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:21.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.552+0000 7ff19d58d700 1 --2- 172.21.15.125:0/4272379576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1980d2e00 0x7ff198144a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:21.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.552+0000 7ff19d58d700 1 --2- 172.21.15.125:0/4272379576 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1980b5ae0 0x7ff1981f2010 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:21.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.552+0000 7ff19d58d700 1 -- 172.21.15.125:0/4272379576 >> 172.21.15.125:0/4272379576 conn(0x7ff198069f20 msgr2=0x7ff1980b2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:21.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.552+0000 7ff19d58d700 1 -- 172.21.15.125:0/4272379576 shutdown_connections 2023-10-17T06:07:21.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.552+0000 7ff19d58d700 1 -- 172.21.15.125:0/4272379576 wait complete. 2023-10-17T06:07:21.579 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-17T06:07:21.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.760+0000 7f1a991dc700 1 Processor -- start 2023-10-17T06:07:21.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.760+0000 7f1a991dc700 1 -- start start 2023-10-17T06:07:21.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.760+0000 7f1a991dc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a9415e740 0x7f1a940c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:21.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a991dc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1a9406af00 0x7f1a94070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:21.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a991dc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a9406b390 con 0x7f1a9415eb20 2023-10-17T06:07:21.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a991dc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a9406aa00 con 0x7f1a9406af00 2023-10-17T06:07:21.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a991dc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a940ca4e0 con 0x7f1a9415e740 2023-10-17T06:07:21.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a8b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1a9415eb20 0x7f1a940ce6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45518/0 (socket says 172.21.15.125:45518) 2023-10-17T06:07:21.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a8b7fe700 1 -- 172.21.15.125:0/3845411930 learned_addr learned my addr 172.21.15.125:0/3845411930 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:21.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a989db700 1 --2- 172.21.15.125:0/3845411930 >> v2:172.21.15.125:3300/0 conn(0x7f1a9406af00 0x7f1a94070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:21.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a93fff700 1 --2- 172.21.15.125:0/3845411930 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a9415e740 0x7f1a940c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:21.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a937fe700 1 -- 172.21.15.125:0/3845411930 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291623016 0 0) 0x7f1a9406b390 con 0x7f1a9415eb20 2023-10-17T06:07:21.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a937fe700 1 -- 172.21.15.125:0/3845411930 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a800035d0 con 0x7f1a9415eb20 2023-10-17T06:07:21.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a989db700 1 -- 172.21.15.125:0/3845411930 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a9415e740 msgr2=0x7f1a940c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:21.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a989db700 1 --2- 172.21.15.125:0/3845411930 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a9415e740 0x7f1a940c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:21.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a989db700 1 -- 172.21.15.125:0/3845411930 >> v1:172.21.15.125:6789/0 conn(0x7f1a9415eb20 legacy=0x7f1a940ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:21.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a989db700 1 -- 172.21.15.125:0/3845411930 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a940c9590 con 0x7f1a9406af00 2023-10-17T06:07:21.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a989db700 1 --2- 172.21.15.125:0/3845411930 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a9406af00 0x7f1a94070460 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009850 tx=0x7f1a8c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1864ea27b0fe823d server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:21.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a937fe700 1 -- 172.21.15.125:0/3845411930 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c011830 con 0x7f1a9406af00 2023-10-17T06:07:21.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a937fe700 1 -- 172.21.15.125:0/3845411930 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c011990 con 0x7f1a9406af00 2023-10-17T06:07:21.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a937fe700 1 -- 172.21.15.125:0/3845411930 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c011d40 con 0x7f1a9406af00 2023-10-17T06:07:21.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a991dc700 1 -- 172.21.15.125:0/3845411930 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a9406af00 msgr2=0x7f1a94070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:21.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a991dc700 1 --2- 172.21.15.125:0/3845411930 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a9406af00 0x7f1a94070460 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009850 tx=0x7f1a8c009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:21.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a991dc700 1 -- 172.21.15.125:0/3845411930 shutdown_connections 2023-10-17T06:07:21.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a991dc700 1 --2- 172.21.15.125:0/3845411930 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a9406af00 0x7f1a94070460 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:21.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.764+0000 7f1a991dc700 1 --2- 172.21.15.125:0/3845411930 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a9415e740 0x7f1a940c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:21.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.768+0000 7f1a991dc700 1 -- 172.21.15.125:0/3845411930 >> 172.21.15.125:0/3845411930 conn(0x7f1a940cb920 msgr2=0x7f1a940cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:21.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.768+0000 7f1a991dc700 1 -- 172.21.15.125:0/3845411930 shutdown_connections 2023-10-17T06:07:21.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.768+0000 7f1a991dc700 1 -- 172.21.15.125:0/3845411930 wait complete. 2023-10-17T06:07:21.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.768+0000 7f1a991dc700 1 Processor -- start 2023-10-17T06:07:21.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.768+0000 7f1a991dc700 1 -- start start 2023-10-17T06:07:21.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.768+0000 7f1a991dc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a9406af00 0x7f1a94148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:21.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.768+0000 7f1a991dc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a9415e740 0x7f1a940b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:21.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.768+0000 7f1a991dc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a9415eb20 0x7f1a940b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:21.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.768+0000 7f1a991dc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a940b4c20 con 0x7f1a9415eb20 2023-10-17T06:07:21.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.768+0000 7f1a991dc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a940c49a0 con 0x7f1a9406af00 2023-10-17T06:07:21.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.768+0000 7f1a991dc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a940c4c80 con 0x7f1a9415e740 2023-10-17T06:07:21.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.768+0000 7f1a989db700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a9415eb20 0x7f1a940b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:21.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.772+0000 7f1a989db700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a9415eb20 0x7f1a940b2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49620/0 (socket says 172.21.15.125:49620) 2023-10-17T06:07:21.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.772+0000 7f1a989db700 1 -- 172.21.15.125:0/1967021174 learned_addr learned my addr 172.21.15.125:0/1967021174 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:21.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.772+0000 7f1a8b7fe700 1 --2- 172.21.15.125:0/1967021174 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a9415e740 0x7f1a940b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:21.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.772+0000 7f1a93fff700 1 --2- 172.21.15.125:0/1967021174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a9406af00 0x7f1a94148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:21.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.772+0000 7f1a989db700 1 -- 172.21.15.125:0/1967021174 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a9415e740 msgr2=0x7f1a940b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:21.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.772+0000 7f1a989db700 1 --2- 172.21.15.125:0/1967021174 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a9415e740 0x7f1a940b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:21.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.772+0000 7f1a989db700 1 -- 172.21.15.125:0/1967021174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a9406af00 msgr2=0x7f1a94148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:21.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.772+0000 7f1a989db700 1 --2- 172.21.15.125:0/1967021174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a9406af00 0x7f1a94148070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:21.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.772+0000 7f1a989db700 1 -- 172.21.15.125:0/1967021174 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8c0094b0 con 0x7f1a9415eb20 2023-10-17T06:07:21.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.772+0000 7f1a989db700 1 --2- 172.21.15.125:0/1967021174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a9415eb20 0x7f1a940b2a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1a9406eaf0 tx=0x7f1a8c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:21.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.772+0000 7f1a917fa700 1 -- 172.21.15.125:0/1967021174 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c004300 con 0x7f1a9415eb20 2023-10-17T06:07:21.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.772+0000 7f1a917fa700 1 -- 172.21.15.125:0/1967021174 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c01f070 con 0x7f1a9415eb20 2023-10-17T06:07:21.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.772+0000 7f1a991dc700 1 -- 172.21.15.125:0/1967021174 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a940c4f60 con 0x7f1a9415eb20 2023-10-17T06:07:21.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.772+0000 7f1a917fa700 1 -- 172.21.15.125:0/1967021174 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0036c0 con 0x7f1a9415eb20 2023-10-17T06:07:21.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.772+0000 7f1a991dc700 1 -- 172.21.15.125:0/1967021174 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a940c5520 con 0x7f1a9415eb20 2023-10-17T06:07:21.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.772+0000 7f1a991dc700 1 -- 172.21.15.125:0/1967021174 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a940c5740 con 0x7f1a9415eb20 2023-10-17T06:07:21.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.776+0000 7f1a917fa700 1 -- 172.21.15.125:0/1967021174 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1a8c021030 con 0x7f1a9415eb20 2023-10-17T06:07:21.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.776+0000 7f1a917fa700 1 --2- 172.21.15.125:0/1967021174 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1a740656f0 0x7f1a74067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:21.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.776+0000 7f1a917fa700 1 -- 172.21.15.125:0/1967021174 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1a8c084390 con 0x7f1a9415eb20 2023-10-17T06:07:21.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.776+0000 7f1a93fff700 1 --2- 172.21.15.125:0/1967021174 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1a740656f0 0x7f1a74067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:21.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.776+0000 7f1a93fff700 1 --2- 172.21.15.125:0/1967021174 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1a740656f0 0x7f1a74067bb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1a84009bf0 tx=0x7f1a84009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:21.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:21.780+0000 7f1a917fa700 1 -- 172.21.15.125:0/1967021174 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f1a8c051ca0 con 0x7f1a9415eb20 2023-10-17T06:07:22.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.028+0000 7f1a991dc700 1 -- 172.21.15.125:0/1967021174 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1a9404e910 con 0x7f1a9415eb20 2023-10-17T06:07:22.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.032+0000 7f1a917fa700 1 -- 172.21.15.125:0/1967021174 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1a8c0552c0 con 0x7f1a9415eb20 2023-10-17T06:07:22.033 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:07:22.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.036+0000 7f1a991dc700 1 -- 172.21.15.125:0/1967021174 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1a740656f0 msgr2=0x7f1a74067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:22.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.036+0000 7f1a991dc700 1 --2- 172.21.15.125:0/1967021174 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1a740656f0 0x7f1a74067bb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1a84009bf0 tx=0x7f1a84009240 comp rx=0 tx=0).stop 2023-10-17T06:07:22.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.036+0000 7f1a991dc700 1 -- 172.21.15.125:0/1967021174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a9415eb20 msgr2=0x7f1a940b2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:22.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.036+0000 7f1a991dc700 1 --2- 172.21.15.125:0/1967021174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a9415eb20 0x7f1a940b2a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1a9406eaf0 tx=0x7f1a8c004770 comp rx=0 tx=0).stop 2023-10-17T06:07:22.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.036+0000 7f1a991dc700 1 -- 172.21.15.125:0/1967021174 shutdown_connections 2023-10-17T06:07:22.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.036+0000 7f1a991dc700 1 --2- 172.21.15.125:0/1967021174 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1a740656f0 0x7f1a74067bb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.036+0000 7f1a991dc700 1 --2- 172.21.15.125:0/1967021174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a9415eb20 0x7f1a940b2a10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.036+0000 7f1a991dc700 1 --2- 172.21.15.125:0/1967021174 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a9415e740 0x7f1a940b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.036+0000 7f1a991dc700 1 --2- 172.21.15.125:0/1967021174 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a9406af00 0x7f1a94148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.036+0000 7f1a991dc700 1 -- 172.21.15.125:0/1967021174 >> 172.21.15.125:0/1967021174 conn(0x7f1a940cb920 msgr2=0x7f1a940cd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:22.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.036+0000 7f1a991dc700 1 -- 172.21.15.125:0/1967021174 shutdown_connections 2023-10-17T06:07:22.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.036+0000 7f1a991dc700 1 -- 172.21.15.125:0/1967021174 wait complete. 2023-10-17T06:07:22.060 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-17T06:07:22.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.228+0000 7f37c8e47700 1 Processor -- start 2023-10-17T06:07:22.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.228+0000 7f37c8e47700 1 -- start start 2023-10-17T06:07:22.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c8e47700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37c40d2e00 0x7f37c40b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:22.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c8e47700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f37c40b5ae0 0x7f37c406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:22.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c8e47700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c415d0d0 con 0x7f37c4160710 2023-10-17T06:07:22.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c8e47700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c415df90 con 0x7f37c40b5ae0 2023-10-17T06:07:22.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c8e47700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c406f0f0 con 0x7f37c40d2e00 2023-10-17T06:07:22.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37baffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f37c4160710 0x7f37c40d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45524/0 (socket says 172.21.15.125:45524) 2023-10-17T06:07:22.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37baffd700 1 -- 172.21.15.125:0/2804446113 learned_addr learned my addr 172.21.15.125:0/2804446113 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:22.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c3fff700 1 --2- 172.21.15.125:0/2804446113 >> v2:172.21.15.125:3300/0 conn(0x7f37c40b5ae0 0x7f37c406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:22.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c37fe700 1 --2- 172.21.15.125:0/2804446113 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37c40d2e00 0x7f37c40b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:22.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c2ffd700 1 -- 172.21.15.125:0/2804446113 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870793456 0 0) 0x7f37ac001110 con 0x7f37c4160710 2023-10-17T06:07:22.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c2ffd700 1 -- 172.21.15.125:0/2804446113 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37b00035d0 con 0x7f37c4160710 2023-10-17T06:07:22.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c2ffd700 1 -- 172.21.15.125:0/2804446113 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1566069170 0 0) 0x7f37b00035d0 con 0x7f37c4160710 2023-10-17T06:07:22.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c2ffd700 1 -- 172.21.15.125:0/2804446113 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37c40d2e00 msgr2=0x7f37c40b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:22.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c2ffd700 1 --2- 172.21.15.125:0/2804446113 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37c40d2e00 0x7f37c40b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c2ffd700 1 -- 172.21.15.125:0/2804446113 >> v2:172.21.15.125:3300/0 conn(0x7f37c40b5ae0 msgr2=0x7f37c406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:22.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c2ffd700 1 --2- 172.21.15.125:0/2804446113 >> v2:172.21.15.125:3300/0 conn(0x7f37c40b5ae0 0x7f37c406db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c2ffd700 1 -- 172.21.15.125:0/2804446113 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c415d310 con 0x7f37c4160710 2023-10-17T06:07:22.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c2ffd700 1 -- 172.21.15.125:0/2804446113 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7f37ac001800 con 0x7f37c4160710 2023-10-17T06:07:22.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c3fff700 1 --2- 172.21.15.125:0/2804446113 >> v2:172.21.15.125:3300/0 conn(0x7f37c40b5ae0 0x7f37c406db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:07:22.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c2ffd700 1 -- 172.21.15.125:0/2804446113 >> v1:172.21.15.125:6789/0 conn(0x7f37c4160710 legacy=0x7f37c40d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:22.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c2ffd700 1 --2- 172.21.15.125:0/2804446113 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37c40d2e00 0x7f37b0003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:22.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c2ffd700 1 --2- 172.21.15.125:0/2804446113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37b0004060 0x7f37b0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:22.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c2ffd700 1 --2- 172.21.15.125:0/2804446113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37b0004db0 0x7f37b0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:22.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c2ffd700 1 -- 172.21.15.125:0/2804446113 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c415df90 con 0x7f37b0004060 2023-10-17T06:07:22.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c2ffd700 1 -- 172.21.15.125:0/2804446113 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c406f0f0 con 0x7f37b0004db0 2023-10-17T06:07:22.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c2ffd700 1 -- 172.21.15.125:0/2804446113 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b000bab0 con 0x7f37c40d2e00 2023-10-17T06:07:22.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37baffd700 1 --2- 172.21.15.125:0/2804446113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37b0004060 0x7f37b0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:22.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37c37fe700 1 --2- 172.21.15.125:0/2804446113 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37c40d2e00 0x7f37b0003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:22.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37baffd700 1 -- 172.21.15.125:0/2804446113 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37c40d2e00 msgr2=0x7f37b0003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:22.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37baffd700 1 --2- 172.21.15.125:0/2804446113 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37c40d2e00 0x7f37b0003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37baffd700 1 -- 172.21.15.125:0/2804446113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37b0004db0 msgr2=0x7f37b0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:22.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37baffd700 1 --2- 172.21.15.125:0/2804446113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37b0004db0 0x7f37b0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37baffd700 1 -- 172.21.15.125:0/2804446113 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b00035d0 con 0x7f37b0004060 2023-10-17T06:07:22.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.232+0000 7f37baffd700 1 --2- 172.21.15.125:0/2804446113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37b0004060 0x7f37b0004870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00c160 tx=0x7f37b00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6ec6995ba85284 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:22.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.236+0000 7f37c2ffd700 1 -- 172.21.15.125:0/2804446113 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac00cd00 con 0x7f37b0004060 2023-10-17T06:07:22.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.236+0000 7f37c2ffd700 1 -- 172.21.15.125:0/2804446113 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac00ce80 con 0x7f37b0004060 2023-10-17T06:07:22.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.236+0000 7f37c2ffd700 1 -- 172.21.15.125:0/2804446113 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac005bc0 con 0x7f37b0004060 2023-10-17T06:07:22.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.236+0000 7f37c8e47700 1 -- 172.21.15.125:0/2804446113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37b0004060 msgr2=0x7f37b0004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:22.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.236+0000 7f37c8e47700 1 --2- 172.21.15.125:0/2804446113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37b0004060 0x7f37b0004870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00c160 tx=0x7f37b00058a0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.236+0000 7f37c3fff700 1 -- 172.21.15.125:0/2804446113 reap_dead start 2023-10-17T06:07:22.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.236+0000 7f37c8e47700 1 -- 172.21.15.125:0/2804446113 shutdown_connections 2023-10-17T06:07:22.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.236+0000 7f37c8e47700 1 -- 172.21.15.125:0/2804446113 >> 172.21.15.125:0/2804446113 conn(0x7f37c4069f20 msgr2=0x7f37c406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:22.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.236+0000 7f37c8e47700 1 -- 172.21.15.125:0/2804446113 shutdown_connections 2023-10-17T06:07:22.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.236+0000 7f37c8e47700 1 -- 172.21.15.125:0/2804446113 wait complete. 2023-10-17T06:07:22.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.240+0000 7f37c8e47700 1 Processor -- start 2023-10-17T06:07:22.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.240+0000 7f37c8e47700 1 -- start start 2023-10-17T06:07:22.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.240+0000 7f37c8e47700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37b0004060 0x7f37c414b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:22.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.240+0000 7f37c8e47700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37c40b14a0 0x7f37c414f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:22.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.240+0000 7f37c8e47700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37c4149d40 0x7f37c415f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:22.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.240+0000 7f37c8e47700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c414bb50 con 0x7f37b0004060 2023-10-17T06:07:22.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.240+0000 7f37c8e47700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c414fba0 con 0x7f37c40b14a0 2023-10-17T06:07:22.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.240+0000 7f37c8e47700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c414a570 con 0x7f37c4149d40 2023-10-17T06:07:22.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.240+0000 7f37c37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37b0004060 0x7f37c414b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:22.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.240+0000 7f37c37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37b0004060 0x7f37c414b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49668/0 (socket says 172.21.15.125:49668) 2023-10-17T06:07:22.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.240+0000 7f37c37fe700 1 -- 172.21.15.125:0/1031468656 learned_addr learned my addr 172.21.15.125:0/1031468656 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:22.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.240+0000 7f37c3fff700 1 --2- 172.21.15.125:0/1031468656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37c4149d40 0x7f37c415f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:22.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.240+0000 7f37baffd700 1 --2- 172.21.15.125:0/1031468656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37c40b14a0 0x7f37c414f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:22.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.240+0000 7f37c37fe700 1 -- 172.21.15.125:0/1031468656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37c4149d40 msgr2=0x7f37c415f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:22.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.240+0000 7f37c37fe700 1 --2- 172.21.15.125:0/1031468656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37c4149d40 0x7f37c415f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.244+0000 7f37c37fe700 1 -- 172.21.15.125:0/1031468656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37c40b14a0 msgr2=0x7f37c414f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:22.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.244+0000 7f37c37fe700 1 --2- 172.21.15.125:0/1031468656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37c40b14a0 0x7f37c414f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.244+0000 7f37c37fe700 1 -- 172.21.15.125:0/1031468656 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c414a850 con 0x7f37b0004060 2023-10-17T06:07:22.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.244+0000 7f37baffd700 1 --2- 172.21.15.125:0/1031468656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37c40b14a0 0x7f37c414f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:22.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.244+0000 7f37c37fe700 1 --2- 172.21.15.125:0/1031468656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37b0004060 0x7f37c414b610 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f37b40108f0 tx=0x7f37b4010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:22.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.244+0000 7f37c0ff9700 1 -- 172.21.15.125:0/1031468656 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4010e90 con 0x7f37b0004060 2023-10-17T06:07:22.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.244+0000 7f37c0ff9700 1 -- 172.21.15.125:0/1031468656 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b400e8d0 con 0x7f37b0004060 2023-10-17T06:07:22.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.244+0000 7f37c0ff9700 1 -- 172.21.15.125:0/1031468656 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b400ec40 con 0x7f37b0004060 2023-10-17T06:07:22.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.244+0000 7f37c8e47700 1 -- 172.21.15.125:0/1031468656 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c414ab30 con 0x7f37b0004060 2023-10-17T06:07:22.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.244+0000 7f37c8e47700 1 -- 172.21.15.125:0/1031468656 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c414b0f0 con 0x7f37b0004060 2023-10-17T06:07:22.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.244+0000 7f37c8e47700 1 -- 172.21.15.125:0/1031468656 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c414b2b0 con 0x7f37b0004060 2023-10-17T06:07:22.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.248+0000 7f37c0ff9700 1 -- 172.21.15.125:0/1031468656 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f37b4016460 con 0x7f37b0004060 2023-10-17T06:07:22.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.248+0000 7f37c0ff9700 1 --2- 172.21.15.125:0/1031468656 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f37a4065720 0x7f37a4067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:22.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.248+0000 7f37c0ff9700 1 -- 172.21.15.125:0/1031468656 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f37b40832d0 con 0x7f37b0004060 2023-10-17T06:07:22.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.248+0000 7f37baffd700 1 --2- 172.21.15.125:0/1031468656 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f37a4065720 0x7f37a4067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:22.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.248+0000 7f37baffd700 1 --2- 172.21.15.125:0/1031468656 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f37a4065720 0x7f37a4067be0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f37c40d0d60 tx=0x7f37ac007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:22.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.256+0000 7f37c0ff9700 1 -- 172.21.15.125:0/1031468656 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f37b4050b30 con 0x7f37b0004060 2023-10-17T06:07:22.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.428+0000 7f37c8e47700 1 -- 172.21.15.125:0/1031468656 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f37c404e910 con 0x7f37b0004060 2023-10-17T06:07:22.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.432+0000 7f37c0ff9700 1 -- 172.21.15.125:0/1031468656 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f37b4054150 con 0x7f37b0004060 2023-10-17T06:07:22.434 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-17T06:07:22.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.432+0000 7f37c8e47700 1 -- 172.21.15.125:0/1031468656 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f37a4065720 msgr2=0x7f37a4067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:22.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.432+0000 7f37c8e47700 1 --2- 172.21.15.125:0/1031468656 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f37a4065720 0x7f37a4067be0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f37c40d0d60 tx=0x7f37ac007000 comp rx=0 tx=0).stop 2023-10-17T06:07:22.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.432+0000 7f37c8e47700 1 -- 172.21.15.125:0/1031468656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37b0004060 msgr2=0x7f37c414b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:22.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.432+0000 7f37c8e47700 1 --2- 172.21.15.125:0/1031468656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37b0004060 0x7f37c414b610 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f37b40108f0 tx=0x7f37b4010cb0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.432+0000 7f37c8e47700 1 -- 172.21.15.125:0/1031468656 shutdown_connections 2023-10-17T06:07:22.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.432+0000 7f37c8e47700 1 --2- 172.21.15.125:0/1031468656 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f37a4065720 0x7f37a4067be0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.432+0000 7f37c8e47700 1 --2- 172.21.15.125:0/1031468656 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f37c4149d40 0x7f37c415f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.432+0000 7f37c8e47700 1 --2- 172.21.15.125:0/1031468656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f37c40b14a0 0x7f37c414f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.432+0000 7f37c8e47700 1 --2- 172.21.15.125:0/1031468656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f37b0004060 0x7f37c414b610 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.432+0000 7f37c8e47700 1 -- 172.21.15.125:0/1031468656 >> 172.21.15.125:0/1031468656 conn(0x7f37c4069f20 msgr2=0x7f37c415c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:22.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.436+0000 7f37c8e47700 1 -- 172.21.15.125:0/1031468656 shutdown_connections 2023-10-17T06:07:22.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.436+0000 7f37c8e47700 1 -- 172.21.15.125:0/1031468656 wait complete. 2023-10-17T06:07:22.462 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-17T06:07:22.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.636+0000 7fe335a00700 1 Processor -- start 2023-10-17T06:07:22.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.640+0000 7fe335a00700 1 -- start start 2023-10-17T06:07:22.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.640+0000 7fe335a00700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3300d3530 0x7fe33006fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:22.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.640+0000 7fe335a00700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3300b6e40 con 0x7fe33015dcf0 2023-10-17T06:07:22.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.640+0000 7fe335a00700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3300b7120 con 0x7fe3300d23e0 2023-10-17T06:07:22.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.640+0000 7fe335a00700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33015e160 con 0x7fe3300d3530 2023-10-17T06:07:22.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.640+0000 7fe32effd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fe3300d23e0 0x7fe3300b65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:34018/0 (socket says 172.21.15.125:34018) 2023-10-17T06:07:22.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.640+0000 7fe32effd700 1 -- 172.21.15.125:0/3794771422 learned_addr learned my addr 172.21.15.125:0/3794771422 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:22.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32f7fe700 1 --2- 172.21.15.125:0/3794771422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3300d3530 0x7fe33006fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:22.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32dffb700 1 -- 172.21.15.125:0/3794771422 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270195037 0 0) 0x7fe3300b7120 con 0x7fe3300d23e0 2023-10-17T06:07:22.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32dffb700 1 -- 172.21.15.125:0/3794771422 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3180035d0 con 0x7fe3300d23e0 2023-10-17T06:07:22.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32dffb700 1 -- 172.21.15.125:0/3794771422 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897869201 0 0) 0x7fe3300b6e40 con 0x7fe33015dcf0 2023-10-17T06:07:22.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32dffb700 1 -- 172.21.15.125:0/3794771422 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3300b7120 con 0x7fe33015dcf0 2023-10-17T06:07:22.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32dffb700 1 -- 172.21.15.125:0/3794771422 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1037151525 0 0) 0x7fe3180035d0 con 0x7fe3300d23e0 2023-10-17T06:07:22.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32dffb700 1 -- 172.21.15.125:0/3794771422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3300d3530 msgr2=0x7fe33006fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:22.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32dffb700 1 --2- 172.21.15.125:0/3794771422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe3300d3530 0x7fe33006fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32dffb700 1 -- 172.21.15.125:0/3794771422 >> v1:172.21.15.125:6789/0 conn(0x7fe33015dcf0 legacy=0x7fe3300d2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:22.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32dffb700 1 -- 172.21.15.125:0/3794771422 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33015d4f0 con 0x7fe3300d23e0 2023-10-17T06:07:22.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32dffb700 1 -- 172.21.15.125:0/3794771422 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7fe320001670 con 0x7fe3300d23e0 2023-10-17T06:07:22.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32dffb700 1 -- 172.21.15.125:0/3794771422 >> v1:172.21.15.184:6789/0 conn(0x7fe3300d23e0 legacy=0x7fe3300b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:22.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32dffb700 1 --2- 172.21.15.125:0/3794771422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe318003c20 0x7fe318004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:22.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32dffb700 1 --2- 172.21.15.125:0/3794771422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe318004870 0x7fe318004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:22.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32dffb700 1 --2- 172.21.15.125:0/3794771422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe318005230 0x7fe31800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:22.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32dffb700 1 -- 172.21.15.125:0/3794771422 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33015e160 con 0x7fe318004870 2023-10-17T06:07:22.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32dffb700 1 -- 172.21.15.125:0/3794771422 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31800c0a0 con 0x7fe318005230 2023-10-17T06:07:22.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32dffb700 1 -- 172.21.15.125:0/3794771422 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31800c260 con 0x7fe318003c20 2023-10-17T06:07:22.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32e7fc700 1 --2- 172.21.15.125:0/3794771422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe318004870 0x7fe318004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:22.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32effd700 1 --2- 172.21.15.125:0/3794771422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe318003c20 0x7fe318004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:22.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32f7fe700 1 --2- 172.21.15.125:0/3794771422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe318005230 0x7fe31800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:22.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32e7fc700 1 -- 172.21.15.125:0/3794771422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe318003c20 msgr2=0x7fe318004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:22.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32e7fc700 1 --2- 172.21.15.125:0/3794771422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe318003c20 0x7fe318004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32e7fc700 1 -- 172.21.15.125:0/3794771422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe318005230 msgr2=0x7fe31800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:22.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32e7fc700 1 --2- 172.21.15.125:0/3794771422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe318005230 0x7fe31800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32e7fc700 1 -- 172.21.15.125:0/3794771422 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3180035d0 con 0x7fe318004870 2023-10-17T06:07:22.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32effd700 1 --2- 172.21.15.125:0/3794771422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe318003c20 0x7fe318004020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:22.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32e7fc700 1 --2- 172.21.15.125:0/3794771422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe318004870 0x7fe318004cf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe324001960 tx=0x7fe3180058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6a7df4293d9b90 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:22.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32dffb700 1 -- 172.21.15.125:0/3794771422 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe324001450 con 0x7fe318004870 2023-10-17T06:07:22.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32dffb700 1 -- 172.21.15.125:0/3794771422 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3240052f0 con 0x7fe318004870 2023-10-17T06:07:22.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32dffb700 1 -- 172.21.15.125:0/3794771422 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3240036a0 con 0x7fe318004870 2023-10-17T06:07:22.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe335a00700 1 -- 172.21.15.125:0/3794771422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe318004870 msgr2=0x7fe318004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:22.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe335a00700 1 --2- 172.21.15.125:0/3794771422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe318004870 0x7fe318004cf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe324001960 tx=0x7fe3180058a0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.644+0000 7fe32f7fe700 1 -- 172.21.15.125:0/3794771422 reap_dead start 2023-10-17T06:07:22.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.648+0000 7fe335a00700 1 -- 172.21.15.125:0/3794771422 shutdown_connections 2023-10-17T06:07:22.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.648+0000 7fe335a00700 1 -- 172.21.15.125:0/3794771422 >> 172.21.15.125:0/3794771422 conn(0x7fe330069f20 msgr2=0x7fe33006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:22.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.648+0000 7fe335a00700 1 -- 172.21.15.125:0/3794771422 shutdown_connections 2023-10-17T06:07:22.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.648+0000 7fe335a00700 1 -- 172.21.15.125:0/3794771422 wait complete. 2023-10-17T06:07:22.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.648+0000 7fe335a00700 1 Processor -- start 2023-10-17T06:07:22.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.648+0000 7fe335a00700 1 -- start start 2023-10-17T06:07:22.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe335a00700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe318004870 0x7fe3300b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:22.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe335a00700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3300ab8e0 0x7fe3300b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:22.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe335a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe330157570 0x7fe3301579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:22.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe335a00700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe330157f30 con 0x7fe3300ab8e0 2023-10-17T06:07:22.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe335a00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3300b2570 con 0x7fe330157570 2023-10-17T06:07:22.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe335a00700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3300abe50 con 0x7fe318004870 2023-10-17T06:07:22.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe32e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3300ab8e0 0x7fe3300b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:22.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe32e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3300ab8e0 0x7fe3300b4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49682/0 (socket says 172.21.15.125:49682) 2023-10-17T06:07:22.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe32e7fc700 1 -- 172.21.15.125:0/816512655 learned_addr learned my addr 172.21.15.125:0/816512655 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:22.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe32effd700 1 --2- 172.21.15.125:0/816512655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe318004870 0x7fe3300b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:22.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe32f7fe700 1 --2- 172.21.15.125:0/816512655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe330157570 0x7fe3301579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:22.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe32e7fc700 1 -- 172.21.15.125:0/816512655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe318004870 msgr2=0x7fe3300b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:22.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe32e7fc700 1 --2- 172.21.15.125:0/816512655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe318004870 0x7fe3300b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe32e7fc700 1 -- 172.21.15.125:0/816512655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe330157570 msgr2=0x7fe3301579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:22.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe32e7fc700 1 --2- 172.21.15.125:0/816512655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe330157570 0x7fe3301579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe32e7fc700 1 -- 172.21.15.125:0/816512655 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3300ac130 con 0x7fe3300ab8e0 2023-10-17T06:07:22.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe32e7fc700 1 --2- 172.21.15.125:0/816512655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3300ab8e0 0x7fe3300b4f40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe324004000 tx=0x7fe3240012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:22.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe317fff700 1 -- 172.21.15.125:0/816512655 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe324006c90 con 0x7fe3300ab8e0 2023-10-17T06:07:22.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe317fff700 1 -- 172.21.15.125:0/816512655 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe324006e10 con 0x7fe3300ab8e0 2023-10-17T06:07:22.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe335a00700 1 -- 172.21.15.125:0/816512655 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3300ac410 con 0x7fe3300ab8e0 2023-10-17T06:07:22.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe317fff700 1 -- 172.21.15.125:0/816512655 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe324007280 con 0x7fe3300ab8e0 2023-10-17T06:07:22.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.652+0000 7fe335a00700 1 -- 172.21.15.125:0/816512655 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3300ac9d0 con 0x7fe3300ab8e0 2023-10-17T06:07:22.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.656+0000 7fe335a00700 1 -- 172.21.15.125:0/816512655 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3300af670 con 0x7fe3300ab8e0 2023-10-17T06:07:22.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.656+0000 7fe317fff700 1 -- 172.21.15.125:0/816512655 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe3240073e0 con 0x7fe3300ab8e0 2023-10-17T06:07:22.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.660+0000 7fe317fff700 1 --2- 172.21.15.125:0/816512655 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe31c0656f0 0x7fe31c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:22.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.660+0000 7fe317fff700 1 -- 172.21.15.125:0/816512655 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe324084070 con 0x7fe3300ab8e0 2023-10-17T06:07:22.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.660+0000 7fe32effd700 1 --2- 172.21.15.125:0/816512655 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe31c0656f0 0x7fe31c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:22.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.660+0000 7fe32effd700 1 --2- 172.21.15.125:0/816512655 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe31c0656f0 0x7fe31c067bb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe320000c00 tx=0x7fe320007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:22.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.664+0000 7fe317fff700 1 -- 172.21.15.125:0/816512655 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe3240b4d40 con 0x7fe3300ab8e0 2023-10-17T06:07:22.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.844+0000 7fe335a00700 1 -- 172.21.15.125:0/816512655 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe33004e910 con 0x7fe3300ab8e0 2023-10-17T06:07:22.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.844+0000 7fe317fff700 1 -- 172.21.15.125:0/816512655 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe3240518e0 con 0x7fe3300ab8e0 2023-10-17T06:07:22.847 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:07:22.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.848+0000 7fe335a00700 1 -- 172.21.15.125:0/816512655 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe31c0656f0 msgr2=0x7fe31c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:22.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.848+0000 7fe335a00700 1 --2- 172.21.15.125:0/816512655 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe31c0656f0 0x7fe31c067bb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe320000c00 tx=0x7fe320007040 comp rx=0 tx=0).stop 2023-10-17T06:07:22.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.848+0000 7fe335a00700 1 -- 172.21.15.125:0/816512655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3300ab8e0 msgr2=0x7fe3300b4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:22.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.848+0000 7fe335a00700 1 --2- 172.21.15.125:0/816512655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3300ab8e0 0x7fe3300b4f40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe324004000 tx=0x7fe3240012d0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.848+0000 7fe335a00700 1 -- 172.21.15.125:0/816512655 shutdown_connections 2023-10-17T06:07:22.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.848+0000 7fe335a00700 1 --2- 172.21.15.125:0/816512655 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe31c0656f0 0x7fe31c067bb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.848+0000 7fe335a00700 1 --2- 172.21.15.125:0/816512655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe330157570 0x7fe3301579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.848+0000 7fe335a00700 1 --2- 172.21.15.125:0/816512655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3300ab8e0 0x7fe3300b4f40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.848+0000 7fe335a00700 1 --2- 172.21.15.125:0/816512655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe318004870 0x7fe3300b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:22.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.848+0000 7fe335a00700 1 -- 172.21.15.125:0/816512655 >> 172.21.15.125:0/816512655 conn(0x7fe330069f20 msgr2=0x7fe33006f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:22.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.848+0000 7fe335a00700 1 -- 172.21.15.125:0/816512655 shutdown_connections 2023-10-17T06:07:22.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:22.848+0000 7fe335a00700 1 -- 172.21.15.125:0/816512655 wait complete. 2023-10-17T06:07:22.874 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-17T06:07:23.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.056+0000 7fc540889700 1 Processor -- start 2023-10-17T06:07:23.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.056+0000 7fc540889700 1 -- start start 2023-10-17T06:07:23.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc540889700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc53c146650 0x7fc53c0b76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:23.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc540889700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc53c0b7c00 0x7fc53c06f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:23.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc540889700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc53c06fef0 0x7fc53c1609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:23.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc540889700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53c0b8060 con 0x7fc53c0b7c00 2023-10-17T06:07:23.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc540889700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53c0b6930 con 0x7fc53c146650 2023-10-17T06:07:23.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc540889700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c070380 con 0x7fc53c06fef0 2023-10-17T06:07:23.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc539d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc53c0b7c00 0x7fc53c06f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:23.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc539d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc53c0b7c00 0x7fc53c06f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49688/0 (socket says 172.21.15.125:49688) 2023-10-17T06:07:23.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc539d9b700 1 -- 172.21.15.125:0/1343368254 learned_addr learned my addr 172.21.15.125:0/1343368254 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:23.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc53ad9d700 1 --2- 172.21.15.125:0/1343368254 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc53c06fef0 0x7fc53c1609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:23.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc53a59c700 1 --2- 172.21.15.125:0/1343368254 >> v2:172.21.15.184:3300/0 conn(0x7fc53c146650 0x7fc53c0b76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:23.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc539d9b700 1 -- 172.21.15.125:0/1343368254 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc53c06fef0 msgr2=0x7fc53c1609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:23.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc539d9b700 1 --2- 172.21.15.125:0/1343368254 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc53c06fef0 0x7fc53c1609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc539d9b700 1 -- 172.21.15.125:0/1343368254 >> v2:172.21.15.184:3300/0 conn(0x7fc53c146650 msgr2=0x7fc53c0b76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:23.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc539d9b700 1 --2- 172.21.15.125:0/1343368254 >> v2:172.21.15.184:3300/0 conn(0x7fc53c146650 0x7fc53c0b76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc539d9b700 1 -- 172.21.15.125:0/1343368254 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c0b5d20 con 0x7fc53c0b7c00 2023-10-17T06:07:23.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc539d9b700 1 --2- 172.21.15.125:0/1343368254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc53c0b7c00 0x7fc53c06f9b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc53c070ec0 tx=0x7fc530009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7e732b9d7e949d server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:23.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc53959a700 1 -- 172.21.15.125:0/1343368254 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc530011830 con 0x7fc53c0b7c00 2023-10-17T06:07:23.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc53959a700 1 -- 172.21.15.125:0/1343368254 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc530011990 con 0x7fc53c0b7c00 2023-10-17T06:07:23.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc53959a700 1 -- 172.21.15.125:0/1343368254 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc530011d20 con 0x7fc53c0b7c00 2023-10-17T06:07:23.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc540889700 1 -- 172.21.15.125:0/1343368254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc53c0b7c00 msgr2=0x7fc53c06f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:23.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.060+0000 7fc540889700 1 --2- 172.21.15.125:0/1343368254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc53c0b7c00 0x7fc53c06f9b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc53c070ec0 tx=0x7fc530009bf0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.064+0000 7fc540889700 1 -- 172.21.15.125:0/1343368254 shutdown_connections 2023-10-17T06:07:23.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.064+0000 7fc540889700 1 --2- 172.21.15.125:0/1343368254 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc53c06fef0 0x7fc53c1609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.064+0000 7fc540889700 1 --2- 172.21.15.125:0/1343368254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc53c0b7c00 0x7fc53c06f9b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.064+0000 7fc540889700 1 --2- 172.21.15.125:0/1343368254 >> v2:172.21.15.184:3300/0 conn(0x7fc53c146650 0x7fc53c0b76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.064+0000 7fc540889700 1 -- 172.21.15.125:0/1343368254 >> 172.21.15.125:0/1343368254 conn(0x7fc53c06a130 msgr2=0x7fc53c06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:23.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.064+0000 7fc540889700 1 -- 172.21.15.125:0/1343368254 shutdown_connections 2023-10-17T06:07:23.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.064+0000 7fc540889700 1 -- 172.21.15.125:0/1343368254 wait complete. 2023-10-17T06:07:23.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.068+0000 7fc540889700 1 Processor -- start 2023-10-17T06:07:23.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.068+0000 7fc540889700 1 -- start start 2023-10-17T06:07:23.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.068+0000 7fc540889700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc53c06fef0 0x7fc53c146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:23.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.068+0000 7fc540889700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc53c0b7c00 0x7fc53c15a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:23.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.068+0000 7fc540889700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc53c146650 0x7fc53c15a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:23.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.068+0000 7fc540889700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c15d7d0 con 0x7fc53c0b7c00 2023-10-17T06:07:23.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.068+0000 7fc540889700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c146f70 con 0x7fc53c146650 2023-10-17T06:07:23.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.068+0000 7fc540889700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c15d440 con 0x7fc53c06fef0 2023-10-17T06:07:23.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.068+0000 7fc539d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc53c0b7c00 0x7fc53c15a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:23.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.068+0000 7fc539d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc53c0b7c00 0x7fc53c15a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49694/0 (socket says 172.21.15.125:49694) 2023-10-17T06:07:23.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.068+0000 7fc539d9b700 1 -- 172.21.15.125:0/1887720998 learned_addr learned my addr 172.21.15.125:0/1887720998 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:23.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.068+0000 7fc53a59c700 1 --2- 172.21.15.125:0/1887720998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc53c06fef0 0x7fc53c146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:23.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.068+0000 7fc539d9b700 1 -- 172.21.15.125:0/1887720998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc53c06fef0 msgr2=0x7fc53c146a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:23.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.068+0000 7fc539d9b700 1 --2- 172.21.15.125:0/1887720998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc53c06fef0 0x7fc53c146a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.068+0000 7fc539d9b700 1 -- 172.21.15.125:0/1887720998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc53c146650 msgr2=0x7fc53c15a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:23.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.068+0000 7fc539d9b700 1 --2- 172.21.15.125:0/1887720998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc53c146650 0x7fc53c15a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.068+0000 7fc539d9b700 1 -- 172.21.15.125:0/1887720998 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc530009570 con 0x7fc53c0b7c00 2023-10-17T06:07:23.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.068+0000 7fc53a59c700 1 --2- 172.21.15.125:0/1887720998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc53c06fef0 0x7fc53c146a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:23.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.068+0000 7fc539d9b700 1 --2- 172.21.15.125:0/1887720998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc53c0b7c00 0x7fc53c15a250 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc530000c00 tx=0x7fc530004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:23.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.068+0000 7fc52affd700 1 -- 172.21.15.125:0/1887720998 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc530004590 con 0x7fc53c0b7c00 2023-10-17T06:07:23.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.072+0000 7fc52affd700 1 -- 172.21.15.125:0/1887720998 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53001e070 con 0x7fc53c0b7c00 2023-10-17T06:07:23.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.072+0000 7fc52affd700 1 -- 172.21.15.125:0/1887720998 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5300038c0 con 0x7fc53c0b7c00 2023-10-17T06:07:23.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.072+0000 7fc540889700 1 -- 172.21.15.125:0/1887720998 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53c15da20 con 0x7fc53c0b7c00 2023-10-17T06:07:23.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.072+0000 7fc540889700 1 -- 172.21.15.125:0/1887720998 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53c15dfe0 con 0x7fc53c0b7c00 2023-10-17T06:07:23.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.072+0000 7fc540889700 1 -- 172.21.15.125:0/1887720998 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc53c15e170 con 0x7fc53c0b7c00 2023-10-17T06:07:23.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.072+0000 7fc52affd700 1 -- 172.21.15.125:0/1887720998 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc530003a20 con 0x7fc53c0b7c00 2023-10-17T06:07:23.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.076+0000 7fc52affd700 1 --2- 172.21.15.125:0/1887720998 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc51c0656f0 0x7fc51c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:23.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.076+0000 7fc52affd700 1 -- 172.21.15.125:0/1887720998 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc530020070 con 0x7fc53c0b7c00 2023-10-17T06:07:23.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.076+0000 7fc53a59c700 1 --2- 172.21.15.125:0/1887720998 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc51c0656f0 0x7fc51c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:23.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.076+0000 7fc53a59c700 1 --2- 172.21.15.125:0/1887720998 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc51c0656f0 0x7fc51c067bb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc52c009a50 tx=0x7fc52c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:23.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.080+0000 7fc52affd700 1 -- 172.21.15.125:0/1887720998 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc530051c50 con 0x7fc53c0b7c00 2023-10-17T06:07:23.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.284+0000 7fc540889700 1 -- 172.21.15.125:0/1887720998 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc53c072e60 con 0x7fc53c0b7c00 2023-10-17T06:07:23.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.284+0000 7fc52affd700 1 -- 172.21.15.125:0/1887720998 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc530055270 con 0x7fc53c0b7c00 2023-10-17T06:07:23.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.292+0000 7fc540889700 1 -- 172.21.15.125:0/1887720998 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc51c0656f0 msgr2=0x7fc51c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:23.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.292+0000 7fc540889700 1 --2- 172.21.15.125:0/1887720998 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc51c0656f0 0x7fc51c067bb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc52c009a50 tx=0x7fc52c008040 comp rx=0 tx=0).stop 2023-10-17T06:07:23.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.292+0000 7fc540889700 1 -- 172.21.15.125:0/1887720998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc53c0b7c00 msgr2=0x7fc53c15a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:23.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.292+0000 7fc540889700 1 --2- 172.21.15.125:0/1887720998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc53c0b7c00 0x7fc53c15a250 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc530000c00 tx=0x7fc530004770 comp rx=0 tx=0).stop 2023-10-17T06:07:23.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.292+0000 7fc540889700 1 -- 172.21.15.125:0/1887720998 shutdown_connections 2023-10-17T06:07:23.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.292+0000 7fc540889700 1 --2- 172.21.15.125:0/1887720998 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc51c0656f0 0x7fc51c067bb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.292+0000 7fc540889700 1 --2- 172.21.15.125:0/1887720998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc53c146650 0x7fc53c15a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.292+0000 7fc540889700 1 --2- 172.21.15.125:0/1887720998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc53c0b7c00 0x7fc53c15a250 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.292+0000 7fc540889700 1 --2- 172.21.15.125:0/1887720998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc53c06fef0 0x7fc53c146a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.292+0000 7fc540889700 1 -- 172.21.15.125:0/1887720998 >> 172.21.15.125:0/1887720998 conn(0x7fc53c06a130 msgr2=0x7fc53c143330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:23.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.292+0000 7fc540889700 1 -- 172.21.15.125:0/1887720998 shutdown_connections 2023-10-17T06:07:23.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.292+0000 7fc540889700 1 -- 172.21.15.125:0/1887720998 wait complete. 2023-10-17T06:07:23.296 INFO:teuthology.orchestra.run.smithi125.stderr:listed 0 entries 2023-10-17T06:07:23.314 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:07:23.315 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:07:23.334 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:07:23.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.552+0000 7fed614fc700 1 Processor -- start 2023-10-17T06:07:23.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.552+0000 7fed614fc700 1 -- start start 2023-10-17T06:07:23.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.552+0000 7fed614fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fed5c0cb910 0x7fed5c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:23.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.552+0000 7fed614fc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5c06fcc0 con 0x7fed5c0cc900 2023-10-17T06:07:23.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.552+0000 7fed614fc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5c06ff00 con 0x7fed5c1610a0 2023-10-17T06:07:23.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.552+0000 7fed614fc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5c0c3210 con 0x7fed5c0cb910 2023-10-17T06:07:23.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.556+0000 7fed5bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fed5c0cb910 0x7fed5c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:23.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.556+0000 7fed5bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fed5c0cb910 0x7fed5c0ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60664/0 (socket says 172.21.15.125:60664) 2023-10-17T06:07:23.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.556+0000 7fed5affd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fed5c0cc900 0x7fed5c0ccce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52810/0 (socket says 172.21.15.125:52810) 2023-10-17T06:07:23.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.556+0000 7fed5bfff700 1 -- 172.21.15.125:0/1907193439 learned_addr learned my addr 172.21.15.125:0/1907193439 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:23.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.556+0000 7fed5bfff700 1 -- 172.21.15.125:0/1907193439 >> v1:172.21.15.184:6789/0 conn(0x7fed5c1610a0 legacy=0x7fed5c0cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:23.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.556+0000 7fed5bfff700 1 -- 172.21.15.125:0/1907193439 >> v1:172.21.15.125:6789/0 conn(0x7fed5c0cc900 legacy=0x7fed5c0ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:23.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.556+0000 7fed5bfff700 1 -- 172.21.15.125:0/1907193439 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c070a10 con 0x7fed5c0cb910 2023-10-17T06:07:23.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.556+0000 7fed5bfff700 1 --2- 172.21.15.125:0/1907193439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed5c0cb910 0x7fed5c0ce220 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fed54009e50 tx=0x7fed5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852c3bb7215a3c0b server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:23.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.556+0000 7fed5a7fc700 1 -- 172.21.15.125:0/1907193439 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5400e070 con 0x7fed5c0cb910 2023-10-17T06:07:23.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.556+0000 7fed5a7fc700 1 -- 172.21.15.125:0/1907193439 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5400b9c0 con 0x7fed5c0cb910 2023-10-17T06:07:23.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.556+0000 7fed5a7fc700 1 -- 172.21.15.125:0/1907193439 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5400bd70 con 0x7fed5c0cb910 2023-10-17T06:07:23.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.556+0000 7fed614fc700 1 -- 172.21.15.125:0/1907193439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed5c0cb910 msgr2=0x7fed5c0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:23.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.556+0000 7fed614fc700 1 --2- 172.21.15.125:0/1907193439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed5c0cb910 0x7fed5c0ce220 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fed54009e50 tx=0x7fed5400b330 comp rx=0 tx=0).stop 2023-10-17T06:07:23.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.556+0000 7fed614fc700 1 -- 172.21.15.125:0/1907193439 shutdown_connections 2023-10-17T06:07:23.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.556+0000 7fed614fc700 1 --2- 172.21.15.125:0/1907193439 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed5c0cb910 0x7fed5c0ce220 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.556+0000 7fed614fc700 1 -- 172.21.15.125:0/1907193439 >> 172.21.15.125:0/1907193439 conn(0x7fed5c0b1a50 msgr2=0x7fed5c0b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:23.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.556+0000 7fed614fc700 1 -- 172.21.15.125:0/1907193439 shutdown_connections 2023-10-17T06:07:23.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.556+0000 7fed614fc700 1 -- 172.21.15.125:0/1907193439 wait complete. 2023-10-17T06:07:23.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.560+0000 7fed614fc700 1 Processor -- start 2023-10-17T06:07:23.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.560+0000 7fed614fc700 1 -- start start 2023-10-17T06:07:23.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.560+0000 7fed614fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed5c0cb910 0x7fed5c0b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:23.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.560+0000 7fed614fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed5c0cc900 0x7fed5c15bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:23.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.560+0000 7fed614fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed5c0c2000 0x7fed5c0c24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:23.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.560+0000 7fed614fc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0c29f0 con 0x7fed5c0c2000 2023-10-17T06:07:23.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.560+0000 7fed614fc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0c71d0 con 0x7fed5c0cc900 2023-10-17T06:07:23.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.560+0000 7fed614fc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0c3e50 con 0x7fed5c0cb910 2023-10-17T06:07:23.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.560+0000 7fed5bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed5c0c2000 0x7fed5c0c24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:23.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.560+0000 7fed5bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed5c0c2000 0x7fed5c0c24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60674/0 (socket says 172.21.15.125:60674) 2023-10-17T06:07:23.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.560+0000 7fed5bfff700 1 -- 172.21.15.125:0/1400567170 learned_addr learned my addr 172.21.15.125:0/1400567170 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:23.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.560+0000 7fed5affd700 1 --2- 172.21.15.125:0/1400567170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed5c0cb910 0x7fed5c0b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:23.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.560+0000 7fed53fff700 1 --2- 172.21.15.125:0/1400567170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed5c0cc900 0x7fed5c15bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:23.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.560+0000 7fed5bfff700 1 -- 172.21.15.125:0/1400567170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed5c0cb910 msgr2=0x7fed5c0b4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:23.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.560+0000 7fed5bfff700 1 --2- 172.21.15.125:0/1400567170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed5c0cb910 0x7fed5c0b4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.564+0000 7fed5bfff700 1 -- 172.21.15.125:0/1400567170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed5c0cc900 msgr2=0x7fed5c15bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.564+0000 7fed5bfff700 1 --2- 172.21.15.125:0/1400567170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed5c0cc900 0x7fed5c15bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.564+0000 7fed5bfff700 1 -- 172.21.15.125:0/1400567170 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed54009b30 con 0x7fed5c0c2000 2023-10-17T06:07:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.564+0000 7fed5affd700 1 --2- 172.21.15.125:0/1400567170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed5c0cb910 0x7fed5c0b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:23.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.564+0000 7fed53fff700 1 --2- 172.21.15.125:0/1400567170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed5c0cc900 0x7fed5c15bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:23.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.564+0000 7fed5bfff700 1 --2- 172.21.15.125:0/1400567170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed5c0c2000 0x7fed5c0c24b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0671a0 tx=0x7fed54004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:23.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.564+0000 7fed537fe700 1 -- 172.21.15.125:0/1400567170 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54004960 con 0x7fed5c0c2000 2023-10-17T06:07:23.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.564+0000 7fed537fe700 1 -- 172.21.15.125:0/1400567170 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed540092e0 con 0x7fed5c0c2000 2023-10-17T06:07:23.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.564+0000 7fed614fc700 1 -- 172.21.15.125:0/1400567170 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed5c0c4130 con 0x7fed5c0c2000 2023-10-17T06:07:23.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.564+0000 7fed537fe700 1 -- 172.21.15.125:0/1400567170 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5401c660 con 0x7fed5c0c2000 2023-10-17T06:07:23.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.564+0000 7fed614fc700 1 -- 172.21.15.125:0/1400567170 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5c15c2d0 con 0x7fed5c0c2000 2023-10-17T06:07:23.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.564+0000 7fed614fc700 1 -- 172.21.15.125:0/1400567170 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed5c0c7360 con 0x7fed5c0c2000 2023-10-17T06:07:23.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.568+0000 7fed537fe700 1 -- 172.21.15.125:0/1400567170 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fed5401c7c0 con 0x7fed5c0c2000 2023-10-17T06:07:23.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.568+0000 7fed537fe700 1 --2- 172.21.15.125:0/1400567170 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fed3c0656f0 0x7fed3c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:23.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.568+0000 7fed537fe700 1 -- 172.21.15.125:0/1400567170 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fed54084e70 con 0x7fed5c0c2000 2023-10-17T06:07:23.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.568+0000 7fed5affd700 1 --2- 172.21.15.125:0/1400567170 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fed3c0656f0 0x7fed3c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:23.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.568+0000 7fed5affd700 1 --2- 172.21.15.125:0/1400567170 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fed3c0656f0 0x7fed3c067bb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fed4c000f60 tx=0x7fed4c007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:23.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.576+0000 7fed537fe700 1 -- 172.21.15.125:0/1400567170 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fed54052630 con 0x7fed5c0c2000 2023-10-17T06:07:23.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.756+0000 7fed614fc700 1 -- 172.21.15.125:0/1400567170 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed5c070700 con 0x7fed5c0c2000 2023-10-17T06:07:23.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.756+0000 7fed537fe700 1 -- 172.21.15.125:0/1400567170 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7fed54055c50 con 0x7fed5c0c2000 2023-10-17T06:07:23.760 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:23.760 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":28,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:14.576796+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:07:23.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.760+0000 7fed614fc700 1 -- 172.21.15.125:0/1400567170 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fed3c0656f0 msgr2=0x7fed3c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:23.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.760+0000 7fed614fc700 1 --2- 172.21.15.125:0/1400567170 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fed3c0656f0 0x7fed3c067bb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fed4c000f60 tx=0x7fed4c007df0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.760+0000 7fed614fc700 1 -- 172.21.15.125:0/1400567170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed5c0c2000 msgr2=0x7fed5c0c24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:23.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.760+0000 7fed614fc700 1 --2- 172.21.15.125:0/1400567170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed5c0c2000 0x7fed5c0c24b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0671a0 tx=0x7fed54004af0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.760+0000 7fed614fc700 1 -- 172.21.15.125:0/1400567170 shutdown_connections 2023-10-17T06:07:23.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.760+0000 7fed614fc700 1 --2- 172.21.15.125:0/1400567170 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fed3c0656f0 0x7fed3c067bb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.760+0000 7fed614fc700 1 --2- 172.21.15.125:0/1400567170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed5c0c2000 0x7fed5c0c24b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.760+0000 7fed614fc700 1 --2- 172.21.15.125:0/1400567170 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed5c0cc900 0x7fed5c15bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.760+0000 7fed614fc700 1 --2- 172.21.15.125:0/1400567170 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed5c0cb910 0x7fed5c0b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.760+0000 7fed614fc700 1 -- 172.21.15.125:0/1400567170 >> 172.21.15.125:0/1400567170 conn(0x7fed5c0b1a50 msgr2=0x7fed5c0d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:23.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.760+0000 7fed614fc700 1 -- 172.21.15.125:0/1400567170 shutdown_connections 2023-10-17T06:07:23.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.760+0000 7fed614fc700 1 -- 172.21.15.125:0/1400567170 wait complete. 2023-10-17T06:07:23.785 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-17T06:07:06.629169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-17T06:07:08.148117+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-17T06:07:11.895112+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-17T06:07:23.786 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:07:23.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.972+0000 7f3ba53bb700 1 Processor -- start 2023-10-17T06:07:23.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.972+0000 7f3ba53bb700 1 -- start start 2023-10-17T06:07:23.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3ba53bb700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3ba015dcf0 0x7f3ba006fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:23.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3ba53bb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba00b6e40 con 0x7f3ba00d2e20 2023-10-17T06:07:23.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3ba53bb700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba00b7120 con 0x7f3ba00d23e0 2023-10-17T06:07:23.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3ba53bb700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba015e160 con 0x7f3ba015dcf0 2023-10-17T06:07:23.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3ba4bba700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3ba00d2e20 0x7f3ba01607d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52816/0 (socket says 172.21.15.125:52816) 2023-10-17T06:07:23.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3ba4bba700 1 -- 172.21.15.125:0/2080955209 learned_addr learned my addr 172.21.15.125:0/2080955209 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:23.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3b9f7fe700 1 --2- 172.21.15.125:0/2080955209 >> v2:172.21.15.184:3300/0 conn(0x7f3ba015dcf0 0x7f3ba006fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:23.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3b9effd700 1 -- 172.21.15.125:0/2080955209 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475009941 0 0) 0x7f3ba00b6e40 con 0x7f3ba00d2e20 2023-10-17T06:07:23.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3b9effd700 1 -- 172.21.15.125:0/2080955209 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b880035d0 con 0x7f3ba00d2e20 2023-10-17T06:07:23.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3b9effd700 1 -- 172.21.15.125:0/2080955209 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 320673843 0 0) 0x7f3ba00b7120 con 0x7f3ba00d23e0 2023-10-17T06:07:23.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3b9effd700 1 -- 172.21.15.125:0/2080955209 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ba00b6e40 con 0x7f3ba00d23e0 2023-10-17T06:07:23.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3b9effd700 1 -- 172.21.15.125:0/2080955209 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3427527541 0 0) 0x7f3b880035d0 con 0x7f3ba00d2e20 2023-10-17T06:07:23.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3b9effd700 1 -- 172.21.15.125:0/2080955209 >> v2:172.21.15.184:3300/0 conn(0x7f3ba015dcf0 msgr2=0x7f3ba006fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:23.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3b9effd700 1 --2- 172.21.15.125:0/2080955209 >> v2:172.21.15.184:3300/0 conn(0x7f3ba015dcf0 0x7f3ba006fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3b9effd700 1 -- 172.21.15.125:0/2080955209 >> v1:172.21.15.184:6789/0 conn(0x7f3ba00d23e0 legacy=0x7f3ba00b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:23.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3b9effd700 1 -- 172.21.15.125:0/2080955209 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba015d4f0 con 0x7f3ba00d2e20 2023-10-17T06:07:23.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3b9effd700 1 -- 172.21.15.125:0/2080955209 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7f3b98001a40 con 0x7f3ba00d2e20 2023-10-17T06:07:23.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3b9effd700 1 -- 172.21.15.125:0/2080955209 >> v1:172.21.15.125:6789/0 conn(0x7f3ba00d2e20 legacy=0x7f3ba01607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:23.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3b9effd700 1 --2- 172.21.15.125:0/2080955209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b88003c70 0x7f3b88004070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:23.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3b9effd700 1 --2- 172.21.15.125:0/2080955209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b88004870 0x7f3b88004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:23.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3b9effd700 1 --2- 172.21.15.125:0/2080955209 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3b88005230 0x7f3b8800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:23.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3b9effd700 1 -- 172.21.15.125:0/2080955209 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba015e160 con 0x7f3b88004870 2023-10-17T06:07:23.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3b9effd700 1 -- 172.21.15.125:0/2080955209 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8800c1d0 con 0x7f3b88003c70 2023-10-17T06:07:23.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3b9effd700 1 -- 172.21.15.125:0/2080955209 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8800c390 con 0x7f3b88005230 2023-10-17T06:07:23.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3b9f7fe700 1 --2- 172.21.15.125:0/2080955209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b88004870 0x7f3b88004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:23.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.976+0000 7f3b9ffff700 1 --2- 172.21.15.125:0/2080955209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b88003c70 0x7f3b88004070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:23.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.980+0000 7f3ba4bba700 1 --2- 172.21.15.125:0/2080955209 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3b88005230 0x7f3b8800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:23.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.980+0000 7f3b9ffff700 1 -- 172.21.15.125:0/2080955209 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3b88005230 msgr2=0x7f3b8800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:23.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.980+0000 7f3b9ffff700 1 --2- 172.21.15.125:0/2080955209 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3b88005230 0x7f3b8800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.980+0000 7f3b9ffff700 1 -- 172.21.15.125:0/2080955209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b88004870 msgr2=0x7f3b88004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:23.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.980+0000 7f3b9ffff700 1 --2- 172.21.15.125:0/2080955209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b88004870 0x7f3b88004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.980+0000 7f3b9ffff700 1 -- 172.21.15.125:0/2080955209 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b880035d0 con 0x7f3b88003c70 2023-10-17T06:07:23.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.980+0000 7f3b9f7fe700 1 --2- 172.21.15.125:0/2080955209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b88004870 0x7f3b88004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:07:23.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.980+0000 7f3ba4bba700 1 -- 172.21.15.125:0/2080955209 reap_dead start 2023-10-17T06:07:23.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.980+0000 7f3b9ffff700 1 --2- 172.21.15.125:0/2080955209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b88003c70 0x7f3b88004070 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3b90001960 tx=0x7f3b880058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e1988fdc47e0123 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:23.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.980+0000 7f3b9effd700 1 -- 172.21.15.125:0/2080955209 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90001450 con 0x7f3b88003c70 2023-10-17T06:07:23.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.980+0000 7f3b9effd700 1 -- 172.21.15.125:0/2080955209 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b90006aa0 con 0x7f3b88003c70 2023-10-17T06:07:23.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.980+0000 7f3b9effd700 1 -- 172.21.15.125:0/2080955209 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90006e50 con 0x7f3b88003c70 2023-10-17T06:07:23.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.980+0000 7f3ba53bb700 1 -- 172.21.15.125:0/2080955209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b88003c70 msgr2=0x7f3b88004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:23.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.980+0000 7f3ba53bb700 1 --2- 172.21.15.125:0/2080955209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b88003c70 0x7f3b88004070 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3b90001960 tx=0x7f3b880058a0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.980+0000 7f3ba53bb700 1 -- 172.21.15.125:0/2080955209 shutdown_connections 2023-10-17T06:07:23.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.980+0000 7f3ba53bb700 1 --2- 172.21.15.125:0/2080955209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b88003c70 0x7f3b88004070 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.980+0000 7f3ba53bb700 1 -- 172.21.15.125:0/2080955209 >> 172.21.15.125:0/2080955209 conn(0x7f3ba0069f20 msgr2=0x7f3ba006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:23.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.980+0000 7f3ba53bb700 1 -- 172.21.15.125:0/2080955209 shutdown_connections 2023-10-17T06:07:23.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.980+0000 7f3ba53bb700 1 -- 172.21.15.125:0/2080955209 wait complete. 2023-10-17T06:07:23.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.984+0000 7f3ba53bb700 1 Processor -- start 2023-10-17T06:07:23.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.984+0000 7f3ba53bb700 1 -- start start 2023-10-17T06:07:23.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.984+0000 7f3ba53bb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b88003c70 0x7f3ba0160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:23.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.984+0000 7f3ba53bb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ba015e2a0 0x7f3ba00d1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:23.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.984+0000 7f3ba53bb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ba0151870 0x7f3ba0151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:23.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.984+0000 7f3ba53bb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba0152210 con 0x7f3b88003c70 2023-10-17T06:07:23.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.984+0000 7f3ba53bb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba015f2b0 con 0x7f3ba015e2a0 2023-10-17T06:07:23.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.984+0000 7f3ba53bb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba015ea10 con 0x7f3ba0151870 2023-10-17T06:07:23.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.984+0000 7f3b9ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b88003c70 0x7f3ba0160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:23.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.984+0000 7f3b9ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b88003c70 0x7f3ba0160490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60690/0 (socket says 172.21.15.125:60690) 2023-10-17T06:07:23.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.984+0000 7f3b9ffff700 1 -- 172.21.15.125:0/4086793972 learned_addr learned my addr 172.21.15.125:0/4086793972 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:23.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.984+0000 7f3ba4bba700 1 --2- 172.21.15.125:0/4086793972 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ba0151870 0x7f3ba0151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:23.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.988+0000 7f3b9f7fe700 1 --2- 172.21.15.125:0/4086793972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ba015e2a0 0x7f3ba00d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:23.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.988+0000 7f3b9ffff700 1 -- 172.21.15.125:0/4086793972 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ba0151870 msgr2=0x7f3ba0151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:23.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.988+0000 7f3b9ffff700 1 --2- 172.21.15.125:0/4086793972 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ba0151870 0x7f3ba0151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.988+0000 7f3b9ffff700 1 -- 172.21.15.125:0/4086793972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ba015e2a0 msgr2=0x7f3ba00d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:23.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.988+0000 7f3b9ffff700 1 --2- 172.21.15.125:0/4086793972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ba015e2a0 0x7f3ba00d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:23.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.988+0000 7f3b9ffff700 1 -- 172.21.15.125:0/4086793972 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba015ecf0 con 0x7f3b88003c70 2023-10-17T06:07:23.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.988+0000 7f3ba4bba700 1 --2- 172.21.15.125:0/4086793972 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ba0151870 0x7f3ba0151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:23.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.988+0000 7f3b9ffff700 1 --2- 172.21.15.125:0/4086793972 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b88003c70 0x7f3ba0160490 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800c360 tx=0x7f3b900012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:23.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.988+0000 7f3b9cff9700 1 -- 172.21.15.125:0/4086793972 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90001450 con 0x7f3b88003c70 2023-10-17T06:07:23.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.988+0000 7f3b9cff9700 1 -- 172.21.15.125:0/4086793972 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b900054d0 con 0x7f3b88003c70 2023-10-17T06:07:23.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.988+0000 7f3ba53bb700 1 -- 172.21.15.125:0/4086793972 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba0152210 con 0x7f3b88003c70 2023-10-17T06:07:23.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.988+0000 7f3b9cff9700 1 -- 172.21.15.125:0/4086793972 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90007250 con 0x7f3b88003c70 2023-10-17T06:07:23.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.988+0000 7f3ba53bb700 1 -- 172.21.15.125:0/4086793972 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba008a0a0 con 0x7f3b88003c70 2023-10-17T06:07:23.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.988+0000 7f3ba53bb700 1 -- 172.21.15.125:0/4086793972 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba008a230 con 0x7f3b88003c70 2023-10-17T06:07:23.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.992+0000 7f3b9cff9700 1 -- 172.21.15.125:0/4086793972 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f3b900073b0 con 0x7f3b88003c70 2023-10-17T06:07:23.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.992+0000 7f3b9cff9700 1 --2- 172.21.15.125:0/4086793972 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3b8c0656f0 0x7f3b8c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:23.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.992+0000 7f3b9cff9700 1 -- 172.21.15.125:0/4086793972 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3b90083ee0 con 0x7f3b88003c70 2023-10-17T06:07:23.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.992+0000 7f3b9f7fe700 1 --2- 172.21.15.125:0/4086793972 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3b8c0656f0 0x7f3b8c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:23.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:23.992+0000 7f3b9f7fe700 1 --2- 172.21.15.125:0/4086793972 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3b8c0656f0 0x7f3b8c067bb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3ba008e3e0 tx=0x7f3b94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:24.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.000+0000 7f3b9cff9700 1 -- 172.21.15.125:0/4086793972 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f3b900516c0 con 0x7f3b88003c70 2023-10-17T06:07:24.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.180+0000 7f3ba53bb700 1 -- 172.21.15.125:0/4086793972 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3ba004e910 con 0x7f3b88003c70 2023-10-17T06:07:24.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.180+0000 7f3b9cff9700 1 -- 172.21.15.125:0/4086793972 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b900170a0 con 0x7f3b88003c70 2023-10-17T06:07:24.184 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:07:24.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.184+0000 7f3ba53bb700 1 -- 172.21.15.125:0/4086793972 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3b8c0656f0 msgr2=0x7f3b8c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:24.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.184+0000 7f3ba53bb700 1 --2- 172.21.15.125:0/4086793972 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3b8c0656f0 0x7f3b8c067bb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3ba008e3e0 tx=0x7f3b94008040 comp rx=0 tx=0).stop 2023-10-17T06:07:24.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.184+0000 7f3ba53bb700 1 -- 172.21.15.125:0/4086793972 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b88003c70 msgr2=0x7f3ba0160490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:24.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.184+0000 7f3ba53bb700 1 --2- 172.21.15.125:0/4086793972 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b88003c70 0x7f3ba0160490 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800c360 tx=0x7f3b900012d0 comp rx=0 tx=0).stop 2023-10-17T06:07:24.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.184+0000 7f3ba53bb700 1 -- 172.21.15.125:0/4086793972 shutdown_connections 2023-10-17T06:07:24.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.184+0000 7f3ba53bb700 1 --2- 172.21.15.125:0/4086793972 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3b8c0656f0 0x7f3b8c067bb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:24.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.184+0000 7f3ba53bb700 1 --2- 172.21.15.125:0/4086793972 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3ba0151870 0x7f3ba0151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:24.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.184+0000 7f3ba53bb700 1 --2- 172.21.15.125:0/4086793972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ba015e2a0 0x7f3ba00d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:24.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.184+0000 7f3ba53bb700 1 --2- 172.21.15.125:0/4086793972 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b88003c70 0x7f3ba0160490 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:24.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.184+0000 7f3ba53bb700 1 -- 172.21.15.125:0/4086793972 >> 172.21.15.125:0/4086793972 conn(0x7f3ba0069f20 msgr2=0x7f3ba015c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:24.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.188+0000 7f3ba53bb700 1 -- 172.21.15.125:0/4086793972 shutdown_connections 2023-10-17T06:07:24.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.188+0000 7f3ba53bb700 1 -- 172.21.15.125:0/4086793972 wait complete. 2023-10-17T06:07:24.208 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:07:24.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.388+0000 7f36ee647700 1 Processor -- start 2023-10-17T06:07:24.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.388+0000 7f36ee647700 1 -- start start 2023-10-17T06:07:24.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ee647700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f36e80b3d40 0x7f36e80cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:24.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ee647700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f36e806ce20 0x7f36e806d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:24.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ee647700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e806d7b0 con 0x7f36e8164a20 2023-10-17T06:07:24.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ee647700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e806e2d0 con 0x7f36e806ce20 2023-10-17T06:07:24.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ee647700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e80ca4c0 con 0x7f36e80b3d40 2023-10-17T06:07:24.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ede46700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f36e806ce20 0x7f36e806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:24.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ede46700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f36e806ce20 0x7f36e806d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60694/0 (socket says 172.21.15.125:60694) 2023-10-17T06:07:24.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ede46700 1 -- 172.21.15.125:0/20207750 learned_addr learned my addr 172.21.15.125:0/20207750 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:24.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ed645700 1 --2- 172.21.15.125:0/20207750 >> v2:172.21.15.184:3300/0 conn(0x7f36e80b3d40 0x7f36e80cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:24.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ede46700 1 -- 172.21.15.125:0/20207750 >> v2:172.21.15.184:3300/0 conn(0x7f36e80b3d40 msgr2=0x7f36e80cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:24.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ede46700 1 --2- 172.21.15.125:0/20207750 >> v2:172.21.15.184:3300/0 conn(0x7f36e80b3d40 0x7f36e80cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:24.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ede46700 1 -- 172.21.15.125:0/20207750 >> v1:172.21.15.184:6789/0 conn(0x7f36e8164a20 legacy=0x7f36e80c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:24.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ede46700 1 -- 172.21.15.125:0/20207750 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e80ca7a0 con 0x7f36e806ce20 2023-10-17T06:07:24.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ed645700 1 --2- 172.21.15.125:0/20207750 >> v2:172.21.15.184:3300/0 conn(0x7f36e80b3d40 0x7f36e80cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:24.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ede46700 1 --2- 172.21.15.125:0/20207750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36e806ce20 0x7f36e806d270 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f36e806e760 tx=0x7f36e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2397f1570e47be server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:24.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36dffff700 1 -- 172.21.15.125:0/20207750 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e000e070 con 0x7f36e806ce20 2023-10-17T06:07:24.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36dffff700 1 -- 172.21.15.125:0/20207750 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e0003a40 con 0x7f36e806ce20 2023-10-17T06:07:24.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36dffff700 1 -- 172.21.15.125:0/20207750 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e0003df0 con 0x7f36e806ce20 2023-10-17T06:07:24.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ee647700 1 -- 172.21.15.125:0/20207750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36e806ce20 msgr2=0x7f36e806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:24.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ee647700 1 --2- 172.21.15.125:0/20207750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36e806ce20 0x7f36e806d270 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f36e806e760 tx=0x7f36e000b330 comp rx=0 tx=0).stop 2023-10-17T06:07:24.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ee647700 1 -- 172.21.15.125:0/20207750 shutdown_connections 2023-10-17T06:07:24.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ee647700 1 --2- 172.21.15.125:0/20207750 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36e806ce20 0x7f36e806d270 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:24.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ee647700 1 --2- 172.21.15.125:0/20207750 >> v2:172.21.15.184:3300/0 conn(0x7f36e80b3d40 0x7f36e80cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:24.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.392+0000 7f36ee647700 1 -- 172.21.15.125:0/20207750 >> 172.21.15.125:0/20207750 conn(0x7f36e80ce5c0 msgr2=0x7f36e80ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:24.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.396+0000 7f36ee647700 1 -- 172.21.15.125:0/20207750 shutdown_connections 2023-10-17T06:07:24.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.396+0000 7f36ee647700 1 -- 172.21.15.125:0/20207750 wait complete. 2023-10-17T06:07:24.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.396+0000 7f36ee647700 1 Processor -- start 2023-10-17T06:07:24.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.396+0000 7f36ee647700 1 -- start start 2023-10-17T06:07:24.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ee647700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36e806ce20 0x7f36e80b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:24.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ee647700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36e80b3d40 0x7f36e80c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:24.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ee647700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36e8164a20 0x7f36e8155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:24.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ee647700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e80b2c90 con 0x7f36e8164a20 2023-10-17T06:07:24.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ee647700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e80c84b0 con 0x7f36e80b3d40 2023-10-17T06:07:24.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ee647700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e80b23f0 con 0x7f36e806ce20 2023-10-17T06:07:24.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ede46700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36e8164a20 0x7f36e8155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:24.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ed645700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36e806ce20 0x7f36e80b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:24.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ede46700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36e8164a20 0x7f36e8155470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60704/0 (socket says 172.21.15.125:60704) 2023-10-17T06:07:24.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ede46700 1 -- 172.21.15.125:0/2892468557 learned_addr learned my addr 172.21.15.125:0/2892468557 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:24.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ece44700 1 --2- 172.21.15.125:0/2892468557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36e80b3d40 0x7f36e80c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:24.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ede46700 1 -- 172.21.15.125:0/2892468557 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36e806ce20 msgr2=0x7f36e80b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:24.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ede46700 1 --2- 172.21.15.125:0/2892468557 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36e806ce20 0x7f36e80b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:24.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ede46700 1 -- 172.21.15.125:0/2892468557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36e80b3d40 msgr2=0x7f36e80c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:24.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ede46700 1 --2- 172.21.15.125:0/2892468557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36e80b3d40 0x7f36e80c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:24.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ede46700 1 -- 172.21.15.125:0/2892468557 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e0009b30 con 0x7f36e8164a20 2023-10-17T06:07:24.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ede46700 1 --2- 172.21.15.125:0/2892468557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36e8164a20 0x7f36e8155470 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f36e0015040 tx=0x7f36e0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:24.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ddffb700 1 -- 172.21.15.125:0/2892468557 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e0004440 con 0x7f36e8164a20 2023-10-17T06:07:24.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ddffb700 1 -- 172.21.15.125:0/2892468557 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e00045c0 con 0x7f36e8164a20 2023-10-17T06:07:24.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ee647700 1 -- 172.21.15.125:0/2892468557 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e80b26d0 con 0x7f36e8164a20 2023-10-17T06:07:24.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.400+0000 7f36ddffb700 1 -- 172.21.15.125:0/2892468557 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e0004970 con 0x7f36e8164a20 2023-10-17T06:07:24.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.404+0000 7f36ee647700 1 -- 172.21.15.125:0/2892468557 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e815d260 con 0x7f36e8164a20 2023-10-17T06:07:24.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.404+0000 7f36ee647700 1 -- 172.21.15.125:0/2892468557 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e815d0c0 con 0x7f36e8164a20 2023-10-17T06:07:24.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.404+0000 7f36ddffb700 1 -- 172.21.15.125:0/2892468557 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f36e0025450 con 0x7f36e8164a20 2023-10-17T06:07:24.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.408+0000 7f36ddffb700 1 --2- 172.21.15.125:0/2892468557 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36cc0656f0 0x7f36cc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:24.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.408+0000 7f36ddffb700 1 -- 172.21.15.125:0/2892468557 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f36e0084630 con 0x7f36e8164a20 2023-10-17T06:07:24.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.408+0000 7f36ed645700 1 --2- 172.21.15.125:0/2892468557 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36cc0656f0 0x7f36cc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:24.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.408+0000 7f36ed645700 1 --2- 172.21.15.125:0/2892468557 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36cc0656f0 0x7f36cc067bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f36e4006fd0 tx=0x7f36e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:24.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.416+0000 7f36ddffb700 1 -- 172.21.15.125:0/2892468557 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f36e815d0c0 con 0x7f36e8164a20 2023-10-17T06:07:24.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.600+0000 7f36ee647700 1 -- 172.21.15.125:0/2892468557 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f36e806d7b0 con 0x7f36e8164a20 2023-10-17T06:07:24.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.600+0000 7f36ddffb700 1 -- 172.21.15.125:0/2892468557 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f36e806d7b0 con 0x7f36e8164a20 2023-10-17T06:07:24.603 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:07:24.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.604+0000 7f36ee647700 1 -- 172.21.15.125:0/2892468557 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36cc0656f0 msgr2=0x7f36cc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:24.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.604+0000 7f36ee647700 1 --2- 172.21.15.125:0/2892468557 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36cc0656f0 0x7f36cc067bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f36e4006fd0 tx=0x7f36e4008040 comp rx=0 tx=0).stop 2023-10-17T06:07:24.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.604+0000 7f36ee647700 1 -- 172.21.15.125:0/2892468557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36e8164a20 msgr2=0x7f36e8155470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:24.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.604+0000 7f36ee647700 1 --2- 172.21.15.125:0/2892468557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36e8164a20 0x7f36e8155470 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f36e0015040 tx=0x7f36e0004af0 comp rx=0 tx=0).stop 2023-10-17T06:07:24.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.604+0000 7f36ee647700 1 -- 172.21.15.125:0/2892468557 shutdown_connections 2023-10-17T06:07:24.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.604+0000 7f36ee647700 1 --2- 172.21.15.125:0/2892468557 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36cc0656f0 0x7f36cc067bb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:24.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.604+0000 7f36ee647700 1 --2- 172.21.15.125:0/2892468557 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36e8164a20 0x7f36e8155470 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:24.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.604+0000 7f36ee647700 1 --2- 172.21.15.125:0/2892468557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36e80b3d40 0x7f36e80c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:24.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.604+0000 7f36ee647700 1 --2- 172.21.15.125:0/2892468557 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36e806ce20 0x7f36e80b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:24.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.604+0000 7f36ee647700 1 -- 172.21.15.125:0/2892468557 >> 172.21.15.125:0/2892468557 conn(0x7f36e80ce5c0 msgr2=0x7f36e81608f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:24.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.604+0000 7f36ee647700 1 -- 172.21.15.125:0/2892468557 shutdown_connections 2023-10-17T06:07:24.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.604+0000 7f36ee647700 1 -- 172.21.15.125:0/2892468557 wait complete. 2023-10-17T06:07:24.624 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-17T06:07:24.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.800+0000 7fc5708a8700 1 Processor -- start 2023-10-17T06:07:24.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.804+0000 7fc5708a8700 1 -- start start 2023-10-17T06:07:24.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.804+0000 7fc5708a8700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc56c160710 0x7fc56c0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:24.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.804+0000 7fc5708a8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc56c0b5ae0 0x7fc56c06db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:24.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.804+0000 7fc5708a8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56c15d0d0 con 0x7fc56c0d2e00 2023-10-17T06:07:24.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.804+0000 7fc5708a8700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56c15df90 con 0x7fc56c160710 2023-10-17T06:07:24.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.804+0000 7fc5708a8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c06f0f0 con 0x7fc56c0b5ae0 2023-10-17T06:07:24.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc56ad9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc56c0d2e00 0x7fc56c0d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52824/0 (socket says 172.21.15.125:52824) 2023-10-17T06:07:24.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc56ad9d700 1 -- 172.21.15.125:0/348436080 learned_addr learned my addr 172.21.15.125:0/348436080 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:24.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc56a59c700 1 --2- 172.21.15.125:0/348436080 >> v2:172.21.15.184:3300/0 conn(0x7fc56c160710 0x7fc56c0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:24.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc56b59e700 1 --2- 172.21.15.125:0/348436080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc56c0b5ae0 0x7fc56c06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:24.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc569d9b700 1 -- 172.21.15.125:0/348436080 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673344296 0 0) 0x7fc55c001110 con 0x7fc56c0d2e00 2023-10-17T06:07:24.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc569d9b700 1 -- 172.21.15.125:0/348436080 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5540035d0 con 0x7fc56c0d2e00 2023-10-17T06:07:24.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc56a59c700 1 -- 172.21.15.125:0/348436080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc56c0b5ae0 msgr2=0x7fc56c06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:24.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc56a59c700 1 --2- 172.21.15.125:0/348436080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc56c0b5ae0 0x7fc56c06db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:24.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc56a59c700 1 -- 172.21.15.125:0/348436080 >> v1:172.21.15.125:6789/0 conn(0x7fc56c0d2e00 legacy=0x7fc56c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:24.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc569d9b700 1 -- 172.21.15.125:0/348436080 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3215911777 0 0) 0x7fc5540035d0 con 0x7fc56c0d2e00 2023-10-17T06:07:24.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc56a59c700 1 -- 172.21.15.125:0/348436080 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c15d310 con 0x7fc56c160710 2023-10-17T06:07:24.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc56a59c700 1 --2- 172.21.15.125:0/348436080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc56c160710 0x7fc56c0b6e00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc560009850 tx=0x7fc560009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8930e343ac7017a server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:24.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc569d9b700 1 -- 172.21.15.125:0/348436080 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c001800 con 0x7fc56c160710 2023-10-17T06:07:24.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc569d9b700 1 -- 172.21.15.125:0/348436080 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc560004030 con 0x7fc56c160710 2023-10-17T06:07:24.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc569d9b700 1 -- 172.21.15.125:0/348436080 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5600043e0 con 0x7fc56c160710 2023-10-17T06:07:24.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc5708a8700 1 -- 172.21.15.125:0/348436080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc56c160710 msgr2=0x7fc56c0b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:24.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc5708a8700 1 --2- 172.21.15.125:0/348436080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc56c160710 0x7fc56c0b6e00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc560009850 tx=0x7fc560009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:24.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc5708a8700 1 -- 172.21.15.125:0/348436080 shutdown_connections 2023-10-17T06:07:24.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc5708a8700 1 --2- 172.21.15.125:0/348436080 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc56c0b5ae0 0x7fc56c06db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:24.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc5708a8700 1 --2- 172.21.15.125:0/348436080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc56c160710 0x7fc56c0b6e00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:24.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc5708a8700 1 -- 172.21.15.125:0/348436080 >> 172.21.15.125:0/348436080 conn(0x7fc56c069f20 msgr2=0x7fc56c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:24.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc5708a8700 1 -- 172.21.15.125:0/348436080 shutdown_connections 2023-10-17T06:07:24.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.808+0000 7fc5708a8700 1 -- 172.21.15.125:0/348436080 wait complete. 2023-10-17T06:07:24.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.812+0000 7fc5708a8700 1 Processor -- start 2023-10-17T06:07:24.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.812+0000 7fc5708a8700 1 -- start start 2023-10-17T06:07:24.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.812+0000 7fc5708a8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc56c0b5ae0 0x7fc56c0ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:24.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.812+0000 7fc5708a8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc56c0d2e00 0x7fc56c08b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:24.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.812+0000 7fc5708a8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc56c160710 0x7fc56c0acf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:24.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.812+0000 7fc5708a8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c0abec0 con 0x7fc56c160710 2023-10-17T06:07:24.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.812+0000 7fc5708a8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c0ac1a0 con 0x7fc56c0b5ae0 2023-10-17T06:07:24.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.812+0000 7fc5708a8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56c0ac480 con 0x7fc56c0d2e00 2023-10-17T06:07:24.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.812+0000 7fc56b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc56c160710 0x7fc56c0acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:24.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.812+0000 7fc56b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc56c160710 0x7fc56c0acf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60718/0 (socket says 172.21.15.125:60718) 2023-10-17T06:07:24.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.812+0000 7fc56b59e700 1 -- 172.21.15.125:0/2786541003 learned_addr learned my addr 172.21.15.125:0/2786541003 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:24.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.812+0000 7fc56ad9d700 1 --2- 172.21.15.125:0/2786541003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc56c0b5ae0 0x7fc56c0ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:24.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.812+0000 7fc56a59c700 1 --2- 172.21.15.125:0/2786541003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc56c0d2e00 0x7fc56c08b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:24.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.816+0000 7fc56b59e700 1 -- 172.21.15.125:0/2786541003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc56c0d2e00 msgr2=0x7fc56c08b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:24.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.816+0000 7fc56b59e700 1 --2- 172.21.15.125:0/2786541003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc56c0d2e00 0x7fc56c08b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:24.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.816+0000 7fc56b59e700 1 -- 172.21.15.125:0/2786541003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc56c0b5ae0 msgr2=0x7fc56c0ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:24.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.816+0000 7fc56b59e700 1 --2- 172.21.15.125:0/2786541003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc56c0b5ae0 0x7fc56c0ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:24.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.816+0000 7fc56b59e700 1 -- 172.21.15.125:0/2786541003 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5600094b0 con 0x7fc56c160710 2023-10-17T06:07:24.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.816+0000 7fc56b59e700 1 --2- 172.21.15.125:0/2786541003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc56c160710 0x7fc56c0acf60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc56400efc0 tx=0x7fc56400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:24.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.816+0000 7fc5537fe700 1 -- 172.21.15.125:0/2786541003 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56400cad0 con 0x7fc56c160710 2023-10-17T06:07:24.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.816+0000 7fc5537fe700 1 -- 172.21.15.125:0/2786541003 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56400f040 con 0x7fc56c160710 2023-10-17T06:07:24.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.816+0000 7fc5708a8700 1 -- 172.21.15.125:0/2786541003 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56c0ac760 con 0x7fc56c160710 2023-10-17T06:07:24.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.816+0000 7fc5537fe700 1 -- 172.21.15.125:0/2786541003 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56400ce70 con 0x7fc56c160710 2023-10-17T06:07:24.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.816+0000 7fc5708a8700 1 -- 172.21.15.125:0/2786541003 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc56c15b610 con 0x7fc56c160710 2023-10-17T06:07:24.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.816+0000 7fc5708a8700 1 -- 172.21.15.125:0/2786541003 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56c0acc80 con 0x7fc56c160710 2023-10-17T06:07:24.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.820+0000 7fc5537fe700 1 -- 172.21.15.125:0/2786541003 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc564014480 con 0x7fc56c160710 2023-10-17T06:07:24.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.820+0000 7fc5537fe700 1 --2- 172.21.15.125:0/2786541003 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc558065720 0x7fc558067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:24.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.820+0000 7fc5537fe700 1 -- 172.21.15.125:0/2786541003 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc564006e40 con 0x7fc56c160710 2023-10-17T06:07:24.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.820+0000 7fc56ad9d700 1 --2- 172.21.15.125:0/2786541003 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc558065720 0x7fc558067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:24.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.820+0000 7fc56ad9d700 1 --2- 172.21.15.125:0/2786541003 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc558065720 0x7fc558067be0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc55c000f60 tx=0x7fc55c001df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:24.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:24.828+0000 7fc5537fe700 1 -- 172.21.15.125:0/2786541003 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc56c0acc80 con 0x7fc56c160710 2023-10-17T06:07:25.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.068+0000 7fc5708a8700 1 -- 172.21.15.125:0/2786541003 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc56c0acc80 con 0x7fc56c160710 2023-10-17T06:07:25.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.068+0000 7fc5537fe700 1 -- 172.21.15.125:0/2786541003 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc56c0acc80 con 0x7fc56c160710 2023-10-17T06:07:25.071 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:07:25.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.072+0000 7fc5708a8700 1 -- 172.21.15.125:0/2786541003 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc558065720 msgr2=0x7fc558067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:25.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.072+0000 7fc5708a8700 1 --2- 172.21.15.125:0/2786541003 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc558065720 0x7fc558067be0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc55c000f60 tx=0x7fc55c001df0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.072+0000 7fc5708a8700 1 -- 172.21.15.125:0/2786541003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc56c160710 msgr2=0x7fc56c0acf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:25.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.072+0000 7fc5708a8700 1 --2- 172.21.15.125:0/2786541003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc56c160710 0x7fc56c0acf60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc56400efc0 tx=0x7fc56400c0c0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.072+0000 7fc5708a8700 1 -- 172.21.15.125:0/2786541003 shutdown_connections 2023-10-17T06:07:25.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.072+0000 7fc5708a8700 1 --2- 172.21.15.125:0/2786541003 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc558065720 0x7fc558067be0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.072+0000 7fc5708a8700 1 --2- 172.21.15.125:0/2786541003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc56c160710 0x7fc56c0acf60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.072+0000 7fc5708a8700 1 --2- 172.21.15.125:0/2786541003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc56c0d2e00 0x7fc56c08b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.072+0000 7fc5708a8700 1 --2- 172.21.15.125:0/2786541003 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc56c0b5ae0 0x7fc56c0ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.072+0000 7fc5708a8700 1 -- 172.21.15.125:0/2786541003 >> 172.21.15.125:0/2786541003 conn(0x7fc56c069f20 msgr2=0x7fc56c0d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:25.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.072+0000 7fc5708a8700 1 -- 172.21.15.125:0/2786541003 shutdown_connections 2023-10-17T06:07:25.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.072+0000 7fc5708a8700 1 -- 172.21.15.125:0/2786541003 wait complete. 2023-10-17T06:07:25.094 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-17T06:07:25.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.268+0000 7ff392fd5700 1 Processor -- start 2023-10-17T06:07:25.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.268+0000 7ff392fd5700 1 -- start start 2023-10-17T06:07:25.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.272+0000 7ff392fd5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff38c0d2e00 0x7ff38c0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:25.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.272+0000 7ff392fd5700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff38c160710 0x7ff38c0d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:25.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.272+0000 7ff392fd5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38c15d0d0 con 0x7ff38c0b5ae0 2023-10-17T06:07:25.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.272+0000 7ff392fd5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38c15df90 con 0x7ff38c0d2e00 2023-10-17T06:07:25.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.272+0000 7ff392fd5700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38c06f0f0 con 0x7ff38c160710 2023-10-17T06:07:25.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.272+0000 7ff3927d4700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff38c0b5ae0 0x7ff38c06db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52830/0 (socket says 172.21.15.125:52830) 2023-10-17T06:07:25.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.272+0000 7ff3927d4700 1 -- 172.21.15.125:0/2349399990 learned_addr learned my addr 172.21.15.125:0/2349399990 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:25.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.272+0000 7ff391fd3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff38c0d2e00 0x7ff38c0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:25.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.272+0000 7ff3917d2700 1 --2- 172.21.15.125:0/2349399990 >> v2:172.21.15.184:3300/0 conn(0x7ff38c160710 0x7ff38c0d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:25.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.272+0000 7ff390fd1700 1 -- 172.21.15.125:0/2349399990 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880782270 0 0) 0x7ff3840014e0 con 0x7ff38c0b5ae0 2023-10-17T06:07:25.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.272+0000 7ff391fd3700 1 -- 172.21.15.125:0/2349399990 >> v2:172.21.15.184:3300/0 conn(0x7ff38c160710 msgr2=0x7ff38c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:25.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.272+0000 7ff391fd3700 1 --2- 172.21.15.125:0/2349399990 >> v2:172.21.15.184:3300/0 conn(0x7ff38c160710 0x7ff38c0d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.272+0000 7ff391fd3700 1 -- 172.21.15.125:0/2349399990 >> v1:172.21.15.125:6789/0 conn(0x7ff38c0b5ae0 legacy=0x7ff38c06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:25.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.272+0000 7ff391fd3700 1 -- 172.21.15.125:0/2349399990 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c0d3720 con 0x7ff38c0d2e00 2023-10-17T06:07:25.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.272+0000 7ff391fd3700 1 --2- 172.21.15.125:0/2349399990 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff38c0d2e00 0x7ff38c0b6e00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0d2420 tx=0x7ff388009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c634fecc69d2958 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:25.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.272+0000 7ff390fd1700 1 -- 172.21.15.125:0/2349399990 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff388011830 con 0x7ff38c0d2e00 2023-10-17T06:07:25.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.272+0000 7ff390fd1700 1 -- 172.21.15.125:0/2349399990 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff388011990 con 0x7ff38c0d2e00 2023-10-17T06:07:25.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.272+0000 7ff390fd1700 1 -- 172.21.15.125:0/2349399990 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff388011d20 con 0x7ff38c0d2e00 2023-10-17T06:07:25.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.276+0000 7ff392fd5700 1 -- 172.21.15.125:0/2349399990 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff38c0d2e00 msgr2=0x7ff38c0b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:25.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.276+0000 7ff392fd5700 1 --2- 172.21.15.125:0/2349399990 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff38c0d2e00 0x7ff38c0b6e00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0d2420 tx=0x7ff388009b30 comp rx=0 tx=0).stop 2023-10-17T06:07:25.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.276+0000 7ff392fd5700 1 -- 172.21.15.125:0/2349399990 shutdown_connections 2023-10-17T06:07:25.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.276+0000 7ff392fd5700 1 --2- 172.21.15.125:0/2349399990 >> v2:172.21.15.184:3300/0 conn(0x7ff38c160710 0x7ff38c0d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.276+0000 7ff392fd5700 1 --2- 172.21.15.125:0/2349399990 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff38c0d2e00 0x7ff38c0b6e00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.276+0000 7ff392fd5700 1 -- 172.21.15.125:0/2349399990 >> 172.21.15.125:0/2349399990 conn(0x7ff38c069f20 msgr2=0x7ff38c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:25.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.276+0000 7ff392fd5700 1 -- 172.21.15.125:0/2349399990 shutdown_connections 2023-10-17T06:07:25.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.276+0000 7ff392fd5700 1 -- 172.21.15.125:0/2349399990 wait complete. 2023-10-17T06:07:25.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.276+0000 7ff392fd5700 1 Processor -- start 2023-10-17T06:07:25.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.276+0000 7ff392fd5700 1 -- start start 2023-10-17T06:07:25.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff392fd5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff38c0b5ae0 0x7ff38c0ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:25.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff392fd5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff38c0d2e00 0x7ff38c0b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:25.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff392fd5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff38c160710 0x7ff38c0ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:25.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff392fd5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c0abe20 con 0x7ff38c160710 2023-10-17T06:07:25.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff392fd5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c0b70b0 con 0x7ff38c0b5ae0 2023-10-17T06:07:25.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff392fd5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c0adac0 con 0x7ff38c0d2e00 2023-10-17T06:07:25.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff3927d4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff38c160710 0x7ff38c0ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:25.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff3927d4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff38c160710 0x7ff38c0ac7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60738/0 (socket says 172.21.15.125:60738) 2023-10-17T06:07:25.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff3927d4700 1 -- 172.21.15.125:0/4075381088 learned_addr learned my addr 172.21.15.125:0/4075381088 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:25.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff391fd3700 1 --2- 172.21.15.125:0/4075381088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff38c0b5ae0 0x7ff38c0ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:25.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff3917d2700 1 --2- 172.21.15.125:0/4075381088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff38c0d2e00 0x7ff38c0b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:25.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff3927d4700 1 -- 172.21.15.125:0/4075381088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff38c0d2e00 msgr2=0x7ff38c0b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:25.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff3927d4700 1 --2- 172.21.15.125:0/4075381088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff38c0d2e00 0x7ff38c0b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff3927d4700 1 -- 172.21.15.125:0/4075381088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff38c0b5ae0 msgr2=0x7ff38c0ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:25.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff3927d4700 1 --2- 172.21.15.125:0/4075381088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff38c0b5ae0 0x7ff38c0ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff3927d4700 1 -- 172.21.15.125:0/4075381088 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3880094b0 con 0x7ff38c160710 2023-10-17T06:07:25.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff3927d4700 1 --2- 172.21.15.125:0/4075381088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff38c160710 0x7ff38c0ac7a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff38400cb40 tx=0x7ff38400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:25.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff3827fc700 1 -- 172.21.15.125:0/4075381088 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38400a9e0 con 0x7ff38c160710 2023-10-17T06:07:25.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff3827fc700 1 -- 172.21.15.125:0/4075381088 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38400ab40 con 0x7ff38c160710 2023-10-17T06:07:25.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff392fd5700 1 -- 172.21.15.125:0/4075381088 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38c0adda0 con 0x7ff38c160710 2023-10-17T06:07:25.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff3827fc700 1 -- 172.21.15.125:0/4075381088 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3840070d0 con 0x7ff38c160710 2023-10-17T06:07:25.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.280+0000 7ff392fd5700 1 -- 172.21.15.125:0/4075381088 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38c0afa60 con 0x7ff38c160710 2023-10-17T06:07:25.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.284+0000 7ff392fd5700 1 -- 172.21.15.125:0/4075381088 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38c0af5e0 con 0x7ff38c160710 2023-10-17T06:07:25.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.284+0000 7ff3827fc700 1 -- 172.21.15.125:0/4075381088 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff384007230 con 0x7ff38c160710 2023-10-17T06:07:25.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.284+0000 7ff3827fc700 1 --2- 172.21.15.125:0/4075381088 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff370065720 0x7ff370067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:25.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.284+0000 7ff3827fc700 1 -- 172.21.15.125:0/4075381088 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff384082770 con 0x7ff38c160710 2023-10-17T06:07:25.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.284+0000 7ff391fd3700 1 --2- 172.21.15.125:0/4075381088 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff370065720 0x7ff370067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:25.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.288+0000 7ff391fd3700 1 --2- 172.21.15.125:0/4075381088 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff370065720 0x7ff370067be0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff3880090b0 tx=0x7ff388008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:25.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.292+0000 7ff3827fc700 1 -- 172.21.15.125:0/4075381088 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff38c0af5e0 con 0x7ff38c160710 2023-10-17T06:07:25.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.464+0000 7ff392fd5700 1 -- 172.21.15.125:0/4075381088 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff38c15d0d0 con 0x7ff38c160710 2023-10-17T06:07:25.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.468+0000 7ff3827fc700 1 -- 172.21.15.125:0/4075381088 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff38c15d0d0 con 0x7ff38c160710 2023-10-17T06:07:25.469 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-17T06:07:25.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.472+0000 7ff392fd5700 1 -- 172.21.15.125:0/4075381088 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff370065720 msgr2=0x7ff370067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:25.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.472+0000 7ff392fd5700 1 --2- 172.21.15.125:0/4075381088 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff370065720 0x7ff370067be0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff3880090b0 tx=0x7ff388008030 comp rx=0 tx=0).stop 2023-10-17T06:07:25.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.472+0000 7ff392fd5700 1 -- 172.21.15.125:0/4075381088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff38c160710 msgr2=0x7ff38c0ac7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:25.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.472+0000 7ff392fd5700 1 --2- 172.21.15.125:0/4075381088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff38c160710 0x7ff38c0ac7a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff38400cb40 tx=0x7ff38400ce50 comp rx=0 tx=0).stop 2023-10-17T06:07:25.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.472+0000 7ff392fd5700 1 -- 172.21.15.125:0/4075381088 shutdown_connections 2023-10-17T06:07:25.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.472+0000 7ff392fd5700 1 --2- 172.21.15.125:0/4075381088 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff370065720 0x7ff370067be0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.472+0000 7ff392fd5700 1 --2- 172.21.15.125:0/4075381088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff38c160710 0x7ff38c0ac7a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.472+0000 7ff392fd5700 1 --2- 172.21.15.125:0/4075381088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff38c0d2e00 0x7ff38c0b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.472+0000 7ff392fd5700 1 --2- 172.21.15.125:0/4075381088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff38c0b5ae0 0x7ff38c0ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.472+0000 7ff392fd5700 1 -- 172.21.15.125:0/4075381088 >> 172.21.15.125:0/4075381088 conn(0x7ff38c069f20 msgr2=0x7ff38c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:25.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.472+0000 7ff392fd5700 1 -- 172.21.15.125:0/4075381088 shutdown_connections 2023-10-17T06:07:25.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.472+0000 7ff392fd5700 1 -- 172.21.15.125:0/4075381088 wait complete. 2023-10-17T06:07:25.493 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-17T06:07:25.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.684+0000 7f2f66ef0700 1 Processor -- start 2023-10-17T06:07:25.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.684+0000 7f2f66ef0700 1 -- start start 2023-10-17T06:07:25.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.688+0000 7f2f66ef0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2f6015ccd0 0x7f2f600cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:25.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.688+0000 7f2f66ef0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6006b4a0 0x7f2f6006b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:25.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.688+0000 7f2f66ef0700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6006a400 con 0x7f2f60160910 2023-10-17T06:07:25.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.688+0000 7f2f66ef0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6006a6e0 con 0x7f2f6015ccd0 2023-10-17T06:07:25.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.688+0000 7f2f66ef0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6006a9c0 con 0x7f2f6006b4a0 2023-10-17T06:07:25.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.688+0000 7f2f64c8c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2f6015ccd0 0x7f2f600cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:25.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.688+0000 7f2f6548d700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2f60160910 0x7f2f600cb240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:47846/0 (socket says 172.21.15.125:47846) 2023-10-17T06:07:25.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.688+0000 7f2f6548d700 1 -- 172.21.15.125:0/3517944239 learned_addr learned my addr 172.21.15.125:0/3517944239 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:25.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.688+0000 7f2f5ffff700 1 --2- 172.21.15.125:0/3517944239 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6006b4a0 0x7f2f6006b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:25.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.688+0000 7f2f5f7fe700 1 -- 172.21.15.125:0/3517944239 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951316950 0 0) 0x7f2f6006a400 con 0x7f2f60160910 2023-10-17T06:07:25.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.688+0000 7f2f5f7fe700 1 -- 172.21.15.125:0/3517944239 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f480035d0 con 0x7f2f60160910 2023-10-17T06:07:25.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.688+0000 7f2f64c8c700 1 -- 172.21.15.125:0/3517944239 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6006b4a0 msgr2=0x7f2f6006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:25.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.688+0000 7f2f64c8c700 1 --2- 172.21.15.125:0/3517944239 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6006b4a0 0x7f2f6006b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.688+0000 7f2f64c8c700 1 -- 172.21.15.125:0/3517944239 >> v1:172.21.15.184:6789/0 conn(0x7f2f60160910 legacy=0x7f2f600cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:25.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.688+0000 7f2f64c8c700 1 -- 172.21.15.125:0/3517944239 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6006aca0 con 0x7f2f6015ccd0 2023-10-17T06:07:25.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.688+0000 7f2f64c8c700 1 --2- 172.21.15.125:0/3517944239 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f6015ccd0 0x7f2f600cef60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009850 tx=0x7f2f54009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7c87e061878537 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:25.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.692+0000 7f2f5f7fe700 1 -- 172.21.15.125:0/3517944239 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54011830 con 0x7f2f6015ccd0 2023-10-17T06:07:25.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.692+0000 7f2f5f7fe700 1 -- 172.21.15.125:0/3517944239 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f54011990 con 0x7f2f6015ccd0 2023-10-17T06:07:25.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.692+0000 7f2f5f7fe700 1 -- 172.21.15.125:0/3517944239 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54011d40 con 0x7f2f6015ccd0 2023-10-17T06:07:25.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.692+0000 7f2f66ef0700 1 -- 172.21.15.125:0/3517944239 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f6015ccd0 msgr2=0x7f2f600cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:25.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.692+0000 7f2f66ef0700 1 --2- 172.21.15.125:0/3517944239 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f6015ccd0 0x7f2f600cef60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009850 tx=0x7f2f54009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:25.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.692+0000 7f2f66ef0700 1 -- 172.21.15.125:0/3517944239 shutdown_connections 2023-10-17T06:07:25.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.692+0000 7f2f66ef0700 1 --2- 172.21.15.125:0/3517944239 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6006b4a0 0x7f2f6006b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.692+0000 7f2f66ef0700 1 --2- 172.21.15.125:0/3517944239 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f6015ccd0 0x7f2f600cef60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.692+0000 7f2f66ef0700 1 -- 172.21.15.125:0/3517944239 >> 172.21.15.125:0/3517944239 conn(0x7f2f600d0a10 msgr2=0x7f2f600d0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:25.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.692+0000 7f2f66ef0700 1 -- 172.21.15.125:0/3517944239 shutdown_connections 2023-10-17T06:07:25.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.692+0000 7f2f66ef0700 1 -- 172.21.15.125:0/3517944239 wait complete. 2023-10-17T06:07:25.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.692+0000 7f2f66ef0700 1 Processor -- start 2023-10-17T06:07:25.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.692+0000 7f2f66ef0700 1 -- start start 2023-10-17T06:07:25.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f66ef0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f6006b4a0 0x7f2f600c4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:25.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f66ef0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6015ccd0 0x7f2f600c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:25.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f66ef0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f60160910 0x7f2f600c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:25.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f66ef0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f600c5830 con 0x7f2f60160910 2023-10-17T06:07:25.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f66ef0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6015d1e0 con 0x7f2f6006b4a0 2023-10-17T06:07:25.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f66ef0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6015d4c0 con 0x7f2f6015ccd0 2023-10-17T06:07:25.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f6548d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f60160910 0x7f2f600c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:25.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f6548d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f60160910 0x7f2f600c6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60758/0 (socket says 172.21.15.125:60758) 2023-10-17T06:07:25.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f6548d700 1 -- 172.21.15.125:0/1268255360 learned_addr learned my addr 172.21.15.125:0/1268255360 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:25.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f5ffff700 1 --2- 172.21.15.125:0/1268255360 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6015ccd0 0x7f2f600c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:25.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f64c8c700 1 --2- 172.21.15.125:0/1268255360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f6006b4a0 0x7f2f600c4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:25.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f6548d700 1 -- 172.21.15.125:0/1268255360 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6015ccd0 msgr2=0x7f2f600c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:25.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f6548d700 1 --2- 172.21.15.125:0/1268255360 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6015ccd0 0x7f2f600c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f6548d700 1 -- 172.21.15.125:0/1268255360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f6006b4a0 msgr2=0x7f2f600c4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:25.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f6548d700 1 --2- 172.21.15.125:0/1268255360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f6006b4a0 0x7f2f600c4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f6548d700 1 -- 172.21.15.125:0/1268255360 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f540094b0 con 0x7f2f60160910 2023-10-17T06:07:25.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f6548d700 1 --2- 172.21.15.125:0/1268255360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f60160910 0x7f2f600c6240 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800caa0 tx=0x7f2f5800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:25.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f5d7fa700 1 -- 172.21.15.125:0/1268255360 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f58007480 con 0x7f2f60160910 2023-10-17T06:07:25.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f5d7fa700 1 -- 172.21.15.125:0/1268255360 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f580075e0 con 0x7f2f60160910 2023-10-17T06:07:25.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f66ef0700 1 -- 172.21.15.125:0/1268255360 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6015d7a0 con 0x7f2f60160910 2023-10-17T06:07:25.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f5d7fa700 1 -- 172.21.15.125:0/1268255360 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f58007970 con 0x7f2f60160910 2023-10-17T06:07:25.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.696+0000 7f2f66ef0700 1 -- 172.21.15.125:0/1268255360 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f600c5470 con 0x7f2f60160910 2023-10-17T06:07:25.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.700+0000 7f2f66ef0700 1 -- 172.21.15.125:0/1268255360 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6015dcc0 con 0x7f2f60160910 2023-10-17T06:07:25.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.700+0000 7f2f5d7fa700 1 -- 172.21.15.125:0/1268255360 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2f5801b3b0 con 0x7f2f60160910 2023-10-17T06:07:25.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.700+0000 7f2f5d7fa700 1 --2- 172.21.15.125:0/1268255360 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2f4c0656f0 0x7f2f4c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:25.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.704+0000 7f2f5d7fa700 1 -- 172.21.15.125:0/1268255360 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2f58082a70 con 0x7f2f60160910 2023-10-17T06:07:25.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.704+0000 7f2f64c8c700 1 --2- 172.21.15.125:0/1268255360 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2f4c0656f0 0x7f2f4c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:25.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.704+0000 7f2f64c8c700 1 --2- 172.21.15.125:0/1268255360 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2f4c0656f0 0x7f2f4c067bb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f540090b0 tx=0x7f2f54008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:25.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.708+0000 7f2f5d7fa700 1 -- 172.21.15.125:0/1268255360 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2f6015dcc0 con 0x7f2f60160910 2023-10-17T06:07:25.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.892+0000 7f2f66ef0700 1 -- 172.21.15.125:0/1268255360 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2f6015dcc0 con 0x7f2f60160910 2023-10-17T06:07:25.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.896+0000 7f2f5d7fa700 1 -- 172.21.15.125:0/1268255360 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2f6015dcc0 con 0x7f2f60160910 2023-10-17T06:07:25.897 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:07:25.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.896+0000 7f2f66ef0700 1 -- 172.21.15.125:0/1268255360 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2f4c0656f0 msgr2=0x7f2f4c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:25.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.896+0000 7f2f66ef0700 1 --2- 172.21.15.125:0/1268255360 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2f4c0656f0 0x7f2f4c067bb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f540090b0 tx=0x7f2f54008030 comp rx=0 tx=0).stop 2023-10-17T06:07:25.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.896+0000 7f2f66ef0700 1 -- 172.21.15.125:0/1268255360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f60160910 msgr2=0x7f2f600c6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:25.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.896+0000 7f2f66ef0700 1 --2- 172.21.15.125:0/1268255360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f60160910 0x7f2f600c6240 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2f5800caa0 tx=0x7f2f5800cad0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.896+0000 7f2f66ef0700 1 -- 172.21.15.125:0/1268255360 shutdown_connections 2023-10-17T06:07:25.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.896+0000 7f2f66ef0700 1 --2- 172.21.15.125:0/1268255360 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2f4c0656f0 0x7f2f4c067bb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.896+0000 7f2f66ef0700 1 --2- 172.21.15.125:0/1268255360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f60160910 0x7f2f600c6240 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.896+0000 7f2f66ef0700 1 --2- 172.21.15.125:0/1268255360 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f6015ccd0 0x7f2f600c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.896+0000 7f2f66ef0700 1 --2- 172.21.15.125:0/1268255360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f6006b4a0 0x7f2f600c4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:25.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.896+0000 7f2f66ef0700 1 -- 172.21.15.125:0/1268255360 >> 172.21.15.125:0/1268255360 conn(0x7f2f600d0a10 msgr2=0x7f2f600aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:25.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.900+0000 7f2f66ef0700 1 -- 172.21.15.125:0/1268255360 shutdown_connections 2023-10-17T06:07:25.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:25.900+0000 7f2f66ef0700 1 -- 172.21.15.125:0/1268255360 wait complete. 2023-10-17T06:07:25.921 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-17T06:07:26.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.092+0000 7ff258f9e700 1 Processor -- start 2023-10-17T06:07:26.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.092+0000 7ff258f9e700 1 -- start start 2023-10-17T06:07:26.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff258f9e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff254160e50 0x7ff25406e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:26.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff258f9e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff2540b28f0 0x7ff25406fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:26.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff258f9e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2540b16d0 con 0x7ff2540cb500 2023-10-17T06:07:26.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff258f9e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2540b1ee0 con 0x7ff254160e50 2023-10-17T06:07:26.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff258f9e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2540ae0f0 con 0x7ff2540b28f0 2023-10-17T06:07:26.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff2537fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff254160e50 0x7ff25406e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:26.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff2537fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff254160e50 0x7ff25406e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60766/0 (socket says 172.21.15.125:60766) 2023-10-17T06:07:26.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff2537fe700 1 -- 172.21.15.125:0/1774394345 learned_addr learned my addr 172.21.15.125:0/1774394345 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:26.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff253fff700 1 --2- 172.21.15.125:0/1774394345 >> v2:172.21.15.184:3300/0 conn(0x7ff2540b28f0 0x7ff25406fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:26.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff2537fe700 1 -- 172.21.15.125:0/1774394345 >> v2:172.21.15.184:3300/0 conn(0x7ff2540b28f0 msgr2=0x7ff25406fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:26.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff2537fe700 1 --2- 172.21.15.125:0/1774394345 >> v2:172.21.15.184:3300/0 conn(0x7ff2540b28f0 0x7ff25406fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:26.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff2537fe700 1 -- 172.21.15.125:0/1774394345 >> v1:172.21.15.125:6789/0 conn(0x7ff2540cb500 legacy=0x7ff2540b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:26.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff2537fe700 1 -- 172.21.15.125:0/1774394345 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2540b1920 con 0x7ff254160e50 2023-10-17T06:07:26.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff2537fe700 1 --2- 172.21.15.125:0/1774394345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff254160e50 0x7ff25406e3e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff244009910 tx=0x7ff244009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1140db44acf3c2a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:26.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff2527fc700 1 -- 172.21.15.125:0/1774394345 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24400ba20 con 0x7ff254160e50 2023-10-17T06:07:26.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff2527fc700 1 -- 172.21.15.125:0/1774394345 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24400bb80 con 0x7ff254160e50 2023-10-17T06:07:26.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff2527fc700 1 -- 172.21.15.125:0/1774394345 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff244009e60 con 0x7ff254160e50 2023-10-17T06:07:26.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff258f9e700 1 -- 172.21.15.125:0/1774394345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff254160e50 msgr2=0x7ff25406e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:26.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff258f9e700 1 --2- 172.21.15.125:0/1774394345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff254160e50 0x7ff25406e3e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff244009910 tx=0x7ff244009c20 comp rx=0 tx=0).stop 2023-10-17T06:07:26.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff258f9e700 1 -- 172.21.15.125:0/1774394345 shutdown_connections 2023-10-17T06:07:26.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff258f9e700 1 --2- 172.21.15.125:0/1774394345 >> v2:172.21.15.184:3300/0 conn(0x7ff2540b28f0 0x7ff25406fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:26.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff258f9e700 1 --2- 172.21.15.125:0/1774394345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff254160e50 0x7ff25406e3e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:26.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff258f9e700 1 -- 172.21.15.125:0/1774394345 >> 172.21.15.125:0/1774394345 conn(0x7ff2540b0bf0 msgr2=0x7ff2540ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:26.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff258f9e700 1 -- 172.21.15.125:0/1774394345 shutdown_connections 2023-10-17T06:07:26.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.096+0000 7ff258f9e700 1 -- 172.21.15.125:0/1774394345 wait complete. 2023-10-17T06:07:26.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.100+0000 7ff258f9e700 1 Processor -- start 2023-10-17T06:07:26.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.100+0000 7ff258f9e700 1 -- start start 2023-10-17T06:07:26.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.100+0000 7ff258f9e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2540b28f0 0x7ff25414c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:26.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff258f9e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2540cb500 0x7ff254162280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:26.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff258f9e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff254160e50 0x7ff2541627c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:26.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff258f9e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25414a5f0 con 0x7ff2540b28f0 2023-10-17T06:07:26.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff258f9e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25414d0a0 con 0x7ff2540cb500 2023-10-17T06:07:26.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff258f9e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25414cae0 con 0x7ff254160e50 2023-10-17T06:07:26.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff2537fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2540b28f0 0x7ff25414c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:26.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff2537fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2540b28f0 0x7ff25414c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60774/0 (socket says 172.21.15.125:60774) 2023-10-17T06:07:26.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff2537fe700 1 -- 172.21.15.125:0/523039618 learned_addr learned my addr 172.21.15.125:0/523039618 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:26.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff252ffd700 1 --2- 172.21.15.125:0/523039618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2540cb500 0x7ff254162280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:26.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff253fff700 1 --2- 172.21.15.125:0/523039618 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff254160e50 0x7ff2541627c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:26.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff2537fe700 1 -- 172.21.15.125:0/523039618 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff254160e50 msgr2=0x7ff2541627c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:26.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff2537fe700 1 --2- 172.21.15.125:0/523039618 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff254160e50 0x7ff2541627c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:26.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff2537fe700 1 -- 172.21.15.125:0/523039618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2540cb500 msgr2=0x7ff254162280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:26.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff2537fe700 1 --2- 172.21.15.125:0/523039618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2540cb500 0x7ff254162280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:26.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff2537fe700 1 -- 172.21.15.125:0/523039618 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff244009570 con 0x7ff2540b28f0 2023-10-17T06:07:26.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff252ffd700 1 --2- 172.21.15.125:0/523039618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2540cb500 0x7ff254162280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:26.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff2537fe700 1 --2- 172.21.15.125:0/523039618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2540b28f0 0x7ff25414c110 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff244000c00 tx=0x7ff244004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:26.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff23bfff700 1 -- 172.21.15.125:0/523039618 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff244004520 con 0x7ff2540b28f0 2023-10-17T06:07:26.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff23bfff700 1 -- 172.21.15.125:0/523039618 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24401e070 con 0x7ff2540b28f0 2023-10-17T06:07:26.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff23bfff700 1 -- 172.21.15.125:0/523039618 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff244003900 con 0x7ff2540b28f0 2023-10-17T06:07:26.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff258f9e700 1 -- 172.21.15.125:0/523039618 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25414cdc0 con 0x7ff2540b28f0 2023-10-17T06:07:26.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff258f9e700 1 -- 172.21.15.125:0/523039618 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff25414c650 con 0x7ff2540b28f0 2023-10-17T06:07:26.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.104+0000 7ff258f9e700 1 -- 172.21.15.125:0/523039618 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff25414c830 con 0x7ff2540b28f0 2023-10-17T06:07:26.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.108+0000 7ff23bfff700 1 -- 172.21.15.125:0/523039618 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff244003a60 con 0x7ff2540b28f0 2023-10-17T06:07:26.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.108+0000 7ff23bfff700 1 --2- 172.21.15.125:0/523039618 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2400656f0 0x7ff240067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:26.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.108+0000 7ff23bfff700 1 -- 172.21.15.125:0/523039618 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff244020070 con 0x7ff2540b28f0 2023-10-17T06:07:26.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.108+0000 7ff252ffd700 1 --2- 172.21.15.125:0/523039618 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2400656f0 0x7ff240067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:26.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.108+0000 7ff252ffd700 1 --2- 172.21.15.125:0/523039618 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2400656f0 0x7ff240067bb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff2541630b0 tx=0x7ff248009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:26.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.112+0000 7ff23bfff700 1 -- 172.21.15.125:0/523039618 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff244051e20 con 0x7ff2540b28f0 2023-10-17T06:07:26.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.320+0000 7ff258f9e700 1 -- 172.21.15.125:0/523039618 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff254072e60 con 0x7ff2540b28f0 2023-10-17T06:07:26.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.320+0000 7ff23bfff700 1 -- 172.21.15.125:0/523039618 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff244055440 con 0x7ff2540b28f0 2023-10-17T06:07:26.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.324+0000 7ff258f9e700 1 -- 172.21.15.125:0/523039618 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2400656f0 msgr2=0x7ff240067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:26.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.324+0000 7ff258f9e700 1 --2- 172.21.15.125:0/523039618 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2400656f0 0x7ff240067bb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff2541630b0 tx=0x7ff248009040 comp rx=0 tx=0).stop 2023-10-17T06:07:26.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.324+0000 7ff258f9e700 1 -- 172.21.15.125:0/523039618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2540b28f0 msgr2=0x7ff25414c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:26.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.324+0000 7ff258f9e700 1 --2- 172.21.15.125:0/523039618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2540b28f0 0x7ff25414c110 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff244000c00 tx=0x7ff244004770 comp rx=0 tx=0).stop 2023-10-17T06:07:26.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.324+0000 7ff258f9e700 1 -- 172.21.15.125:0/523039618 shutdown_connections 2023-10-17T06:07:26.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.324+0000 7ff258f9e700 1 --2- 172.21.15.125:0/523039618 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2400656f0 0x7ff240067bb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:26.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.324+0000 7ff258f9e700 1 --2- 172.21.15.125:0/523039618 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff254160e50 0x7ff2541627c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:26.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.324+0000 7ff258f9e700 1 --2- 172.21.15.125:0/523039618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2540cb500 0x7ff254162280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:26.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.324+0000 7ff258f9e700 1 --2- 172.21.15.125:0/523039618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2540b28f0 0x7ff25414c110 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:26.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.324+0000 7ff258f9e700 1 -- 172.21.15.125:0/523039618 >> 172.21.15.125:0/523039618 conn(0x7ff2540b0bf0 msgr2=0x7ff25406dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:26.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.324+0000 7ff258f9e700 1 -- 172.21.15.125:0/523039618 shutdown_connections 2023-10-17T06:07:26.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:26.324+0000 7ff258f9e700 1 -- 172.21.15.125:0/523039618 wait complete. 2023-10-17T06:07:26.329 INFO:teuthology.orchestra.run.smithi125.stderr:listed 0 entries 2023-10-17T06:07:26.346 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2023-10-17T06:07:26.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:26.347 DEBUG:teuthology.orchestra.run.smithi125:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-17T06:07:26.384 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi125.stderr:ceph-fuse[40856]: fuse finished with error 0 and tester_r 0 2023-10-17T06:07:26.389 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:07:31.369 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:07:31.377 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:07:32.490 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-10-17T06:07:32.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:32.491 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-17T06:07:32.526 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:07:32.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.747+0000 7fdbdd8b5700 1 Processor -- start 2023-10-17T06:07:32.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.747+0000 7fdbdd8b5700 1 -- start start 2023-10-17T06:07:32.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbdd8b5700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdbd8146800 0x7fdbd80b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:32.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbdd8b5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdbd80700b0 0x7fdbd815eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:32.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbdd8b5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd815e680 con 0x7fdbd815dd30 2023-10-17T06:07:32.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbdd8b5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd80b6180 con 0x7fdbd80700b0 2023-10-17T06:07:32.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbdd8b5700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd80b6460 con 0x7fdbd8146800 2023-10-17T06:07:32.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbd77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdbd80700b0 0x7fdbd815eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:32.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbd67fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdbd815dd30 0x7fdbd806f9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52858/0 (socket says 172.21.15.125:52858) 2023-10-17T06:07:32.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbd67fc700 1 -- 172.21.15.125:0/1721679484 learned_addr learned my addr 172.21.15.125:0/1721679484 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:32.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbd6ffd700 1 --2- 172.21.15.125:0/1721679484 >> v2:172.21.15.184:3300/0 conn(0x7fdbd8146800 0x7fdbd80b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:32.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbd77fe700 1 -- 172.21.15.125:0/1721679484 >> v2:172.21.15.184:3300/0 conn(0x7fdbd8146800 msgr2=0x7fdbd80b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:32.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbd77fe700 1 --2- 172.21.15.125:0/1721679484 >> v2:172.21.15.184:3300/0 conn(0x7fdbd8146800 0x7fdbd80b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:32.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbd77fe700 1 -- 172.21.15.125:0/1721679484 >> v1:172.21.15.125:6789/0 conn(0x7fdbd815dd30 legacy=0x7fdbd806f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:32.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbd77fe700 1 -- 172.21.15.125:0/1721679484 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd80b6740 con 0x7fdbd80700b0 2023-10-17T06:07:32.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbd5ffb700 1 -- 172.21.15.125:0/1721679484 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863345856 0 0) 0x7fdbd815e680 con 0x7fdbd815dd30 2023-10-17T06:07:32.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbd77fe700 1 --2- 172.21.15.125:0/1721679484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbd80700b0 0x7fdbd815eb10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80706b0 tx=0x7fdbd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e29783fd08af3b server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:32.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbd5ffb700 1 -- 172.21.15.125:0/1721679484 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd000e070 con 0x7fdbd80700b0 2023-10-17T06:07:32.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbd5ffb700 1 -- 172.21.15.125:0/1721679484 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd000bb20 con 0x7fdbd80700b0 2023-10-17T06:07:32.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbd5ffb700 1 -- 172.21.15.125:0/1721679484 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0012430 con 0x7fdbd80700b0 2023-10-17T06:07:32.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbdd8b5700 1 -- 172.21.15.125:0/1721679484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbd80700b0 msgr2=0x7fdbd815eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:32.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbdd8b5700 1 --2- 172.21.15.125:0/1721679484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbd80700b0 0x7fdbd815eb10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80706b0 tx=0x7fdbd000b330 comp rx=0 tx=0).stop 2023-10-17T06:07:32.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbdd8b5700 1 -- 172.21.15.125:0/1721679484 shutdown_connections 2023-10-17T06:07:32.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbdd8b5700 1 --2- 172.21.15.125:0/1721679484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbd80700b0 0x7fdbd815eb10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:32.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbdd8b5700 1 --2- 172.21.15.125:0/1721679484 >> v2:172.21.15.184:3300/0 conn(0x7fdbd8146800 0x7fdbd80b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:32.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbdd8b5700 1 -- 172.21.15.125:0/1721679484 >> 172.21.15.125:0/1721679484 conn(0x7fdbd806a130 msgr2=0x7fdbd806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:32.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbdd8b5700 1 -- 172.21.15.125:0/1721679484 shutdown_connections 2023-10-17T06:07:32.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.751+0000 7fdbdd8b5700 1 -- 172.21.15.125:0/1721679484 wait complete. 2023-10-17T06:07:32.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.755+0000 7fdbdd8b5700 1 Processor -- start 2023-10-17T06:07:32.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.755+0000 7fdbdd8b5700 1 -- start start 2023-10-17T06:07:32.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbdd8b5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbd80700b0 0x7fdbd806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:32.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbdd8b5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbd8146800 0x7fdbd81f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:32.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbdd8b5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbd815dd30 0x7fdbd815c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:32.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbdd8b5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd813c0b0 con 0x7fdbd80700b0 2023-10-17T06:07:32.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbdd8b5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd813c390 con 0x7fdbd8146800 2023-10-17T06:07:32.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbdd8b5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd813c670 con 0x7fdbd815dd30 2023-10-17T06:07:32.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbd6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbd80700b0 0x7fdbd806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:32.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbd6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbd80700b0 0x7fdbd806d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60794/0 (socket says 172.21.15.125:60794) 2023-10-17T06:07:32.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbd6ffd700 1 -- 172.21.15.125:0/3582744333 learned_addr learned my addr 172.21.15.125:0/3582744333 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:32.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbd77fe700 1 --2- 172.21.15.125:0/3582744333 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbd815dd30 0x7fdbd815c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:32.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbd67fc700 1 --2- 172.21.15.125:0/3582744333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbd8146800 0x7fdbd81f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:32.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbd6ffd700 1 -- 172.21.15.125:0/3582744333 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbd815dd30 msgr2=0x7fdbd815c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:32.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbd6ffd700 1 --2- 172.21.15.125:0/3582744333 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbd815dd30 0x7fdbd815c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:32.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbd6ffd700 1 -- 172.21.15.125:0/3582744333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbd8146800 msgr2=0x7fdbd81f3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:32.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbd6ffd700 1 --2- 172.21.15.125:0/3582744333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbd8146800 0x7fdbd81f3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:32.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbd6ffd700 1 -- 172.21.15.125:0/3582744333 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd0009a70 con 0x7fdbd80700b0 2023-10-17T06:07:32.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbd77fe700 1 --2- 172.21.15.125:0/3582744333 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbd815dd30 0x7fdbd815c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:32.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbd67fc700 1 --2- 172.21.15.125:0/3582744333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbd8146800 0x7fdbd81f3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:32.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbd6ffd700 1 --2- 172.21.15.125:0/3582744333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbd80700b0 0x7fdbd806d220 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800e9d0 tx=0x7fdbc800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:32.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbbffff700 1 -- 172.21.15.125:0/3582744333 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8009720 con 0x7fdbd80700b0 2023-10-17T06:07:32.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbbffff700 1 -- 172.21.15.125:0/3582744333 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc800c850 con 0x7fdbd80700b0 2023-10-17T06:07:32.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbbffff700 1 -- 172.21.15.125:0/3582744333 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc800cbc0 con 0x7fdbd80700b0 2023-10-17T06:07:32.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbdd8b5700 1 -- 172.21.15.125:0/3582744333 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd813c950 con 0x7fdbd80700b0 2023-10-17T06:07:32.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.759+0000 7fdbdd8b5700 1 -- 172.21.15.125:0/3582744333 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd806d760 con 0x7fdbd80700b0 2023-10-17T06:07:32.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.763+0000 7fdbdd8b5700 1 -- 172.21.15.125:0/3582744333 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd8072e60 con 0x7fdbd80700b0 2023-10-17T06:07:32.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.763+0000 7fdbbffff700 1 -- 172.21.15.125:0/3582744333 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fdbc800cd20 con 0x7fdbd80700b0 2023-10-17T06:07:32.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.763+0000 7fdbbffff700 1 --2- 172.21.15.125:0/3582744333 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdbc40656f0 0x7fdbc4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:32.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.763+0000 7fdbbffff700 1 -- 172.21.15.125:0/3582744333 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdbc8083220 con 0x7fdbd80700b0 2023-10-17T06:07:32.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.763+0000 7fdbd67fc700 1 --2- 172.21.15.125:0/3582744333 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdbc40656f0 0x7fdbc4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:32.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.763+0000 7fdbd67fc700 1 --2- 172.21.15.125:0/3582744333 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdbc40656f0 0x7fdbc4067bb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdbd813df10 tx=0x7fdbcc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:32.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.771+0000 7fdbbffff700 1 -- 172.21.15.125:0/3582744333 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fdbc8054470 con 0x7fdbd80700b0 2023-10-17T06:07:32.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.959+0000 7fdbdd8b5700 1 -- 172.21.15.125:0/3582744333 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbd80b71e0 con 0x7fdbd80700b0 2023-10-17T06:07:32.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.959+0000 7fdbbffff700 1 -- 172.21.15.125:0/3582744333 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7fdbc8054000 con 0x7fdbd80700b0 2023-10-17T06:07:32.965 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:32.965 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":28,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:14.576796+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:07:32.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.963+0000 7fdbdd8b5700 1 -- 172.21.15.125:0/3582744333 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdbc40656f0 msgr2=0x7fdbc4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:32.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.963+0000 7fdbdd8b5700 1 --2- 172.21.15.125:0/3582744333 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdbc40656f0 0x7fdbc4067bb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdbd813df10 tx=0x7fdbcc009040 comp rx=0 tx=0).stop 2023-10-17T06:07:32.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.963+0000 7fdbdd8b5700 1 -- 172.21.15.125:0/3582744333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbd80700b0 msgr2=0x7fdbd806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:32.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.963+0000 7fdbdd8b5700 1 --2- 172.21.15.125:0/3582744333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbd80700b0 0x7fdbd806d220 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800e9d0 tx=0x7fdbc800ed90 comp rx=0 tx=0).stop 2023-10-17T06:07:32.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.963+0000 7fdbdd8b5700 1 -- 172.21.15.125:0/3582744333 shutdown_connections 2023-10-17T06:07:32.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.963+0000 7fdbdd8b5700 1 --2- 172.21.15.125:0/3582744333 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdbc40656f0 0x7fdbc4067bb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:32.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.963+0000 7fdbdd8b5700 1 --2- 172.21.15.125:0/3582744333 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbd815dd30 0x7fdbd815c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:32.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.963+0000 7fdbdd8b5700 1 --2- 172.21.15.125:0/3582744333 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbd8146800 0x7fdbd81f3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:32.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.963+0000 7fdbdd8b5700 1 --2- 172.21.15.125:0/3582744333 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbd80700b0 0x7fdbd806d220 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:32.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.963+0000 7fdbdd8b5700 1 -- 172.21.15.125:0/3582744333 >> 172.21.15.125:0/3582744333 conn(0x7fdbd806a130 msgr2=0x7fdbd815d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:32.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.963+0000 7fdbdd8b5700 1 -- 172.21.15.125:0/3582744333 shutdown_connections 2023-10-17T06:07:32.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:32.963+0000 7fdbdd8b5700 1 -- 172.21.15.125:0/3582744333 wait complete. 2023-10-17T06:07:32.988 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:07:33.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.159+0000 7ff2e40a9700 1 Processor -- start 2023-10-17T06:07:33.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.163+0000 7ff2e40a9700 1 -- start start 2023-10-17T06:07:33.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.163+0000 7ff2e40a9700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff2dc1593c0 0x7ff2dc15da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:33.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.163+0000 7ff2e40a9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2dc1597a0 con 0x7ff2dc0cb8a0 2023-10-17T06:07:33.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.163+0000 7ff2e40a9700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2dc06d920 con 0x7ff2dc06ced0 2023-10-17T06:07:33.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.163+0000 7ff2e40a9700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2dc15d610 con 0x7ff2dc1593c0 2023-10-17T06:07:33.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.163+0000 7ff2e2646700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff2dc0cb8a0 0x7ff2dc0b1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52866/0 (socket says 172.21.15.125:52866) 2023-10-17T06:07:33.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.163+0000 7ff2e2646700 1 -- 172.21.15.125:0/2367426370 learned_addr learned my addr 172.21.15.125:0/2367426370 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:33.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.167+0000 7ff2e1e45700 1 --2- 172.21.15.125:0/2367426370 >> v2:172.21.15.184:3300/0 conn(0x7ff2dc1593c0 0x7ff2dc15da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:33.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.167+0000 7ff2e0e43700 1 -- 172.21.15.125:0/2367426370 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222091316 0 0) 0x7ff2dc1597a0 con 0x7ff2dc0cb8a0 2023-10-17T06:07:33.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.167+0000 7ff2e0e43700 1 -- 172.21.15.125:0/2367426370 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2c80034f0 con 0x7ff2dc0cb8a0 2023-10-17T06:07:33.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.167+0000 7ff2e0e43700 1 -- 172.21.15.125:0/2367426370 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730073848 0 0) 0x7ff2dc06d920 con 0x7ff2dc06ced0 2023-10-17T06:07:33.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.167+0000 7ff2e0e43700 1 -- 172.21.15.125:0/2367426370 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2dc1597a0 con 0x7ff2dc06ced0 2023-10-17T06:07:33.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.167+0000 7ff2e1e45700 1 -- 172.21.15.125:0/2367426370 >> v1:172.21.15.184:6789/0 conn(0x7ff2dc06ced0 legacy=0x7ff2dc0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:33.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.167+0000 7ff2e1e45700 1 -- 172.21.15.125:0/2367426370 >> v1:172.21.15.125:6789/0 conn(0x7ff2dc0cb8a0 legacy=0x7ff2dc0b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:33.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.167+0000 7ff2e1e45700 1 -- 172.21.15.125:0/2367426370 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc15cf50 con 0x7ff2dc1593c0 2023-10-17T06:07:33.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.167+0000 7ff2e1e45700 1 --2- 172.21.15.125:0/2367426370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2dc1593c0 0x7ff2dc15da30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009850 tx=0x7ff2d8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d47cd2b74bec39fe server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:33.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.167+0000 7ff2e0e43700 1 -- 172.21.15.125:0/2367426370 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8011830 con 0x7ff2dc1593c0 2023-10-17T06:07:33.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.167+0000 7ff2e0e43700 1 -- 172.21.15.125:0/2367426370 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d8011990 con 0x7ff2dc1593c0 2023-10-17T06:07:33.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.167+0000 7ff2e0e43700 1 -- 172.21.15.125:0/2367426370 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8011d40 con 0x7ff2dc1593c0 2023-10-17T06:07:33.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.167+0000 7ff2e40a9700 1 -- 172.21.15.125:0/2367426370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2dc1593c0 msgr2=0x7ff2dc15da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:33.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.167+0000 7ff2e40a9700 1 --2- 172.21.15.125:0/2367426370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2dc1593c0 0x7ff2dc15da30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009850 tx=0x7ff2d8009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:33.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.167+0000 7ff2e40a9700 1 -- 172.21.15.125:0/2367426370 shutdown_connections 2023-10-17T06:07:33.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.167+0000 7ff2e40a9700 1 --2- 172.21.15.125:0/2367426370 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2dc1593c0 0x7ff2dc15da30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:33.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.167+0000 7ff2e40a9700 1 -- 172.21.15.125:0/2367426370 >> 172.21.15.125:0/2367426370 conn(0x7ff2dc06a340 msgr2=0x7ff2dc0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:33.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.167+0000 7ff2e40a9700 1 -- 172.21.15.125:0/2367426370 shutdown_connections 2023-10-17T06:07:33.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.167+0000 7ff2e40a9700 1 -- 172.21.15.125:0/2367426370 wait complete. 2023-10-17T06:07:33.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.171+0000 7ff2e40a9700 1 Processor -- start 2023-10-17T06:07:33.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.171+0000 7ff2e40a9700 1 -- start start 2023-10-17T06:07:33.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e40a9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2dc06ced0 0x7ff2dc1505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:33.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e40a9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2dc0cb8a0 0x7ff2dc06f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:33.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e40a9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2dc1593c0 0x7ff2dc06f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:33.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e40a9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc1f3100 con 0x7ff2dc06ced0 2023-10-17T06:07:33.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e40a9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc141a00 con 0x7ff2dc0cb8a0 2023-10-17T06:07:33.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e40a9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc141ce0 con 0x7ff2dc1593c0 2023-10-17T06:07:33.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e1e45700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2dc06ced0 0x7ff2dc1505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:33.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e1e45700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2dc06ced0 0x7ff2dc1505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60796/0 (socket says 172.21.15.125:60796) 2023-10-17T06:07:33.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e1e45700 1 -- 172.21.15.125:0/3362223465 learned_addr learned my addr 172.21.15.125:0/3362223465 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:33.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e1644700 1 --2- 172.21.15.125:0/3362223465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2dc0cb8a0 0x7ff2dc06f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:33.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e2646700 1 --2- 172.21.15.125:0/3362223465 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2dc1593c0 0x7ff2dc06f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:33.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e1e45700 1 -- 172.21.15.125:0/3362223465 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2dc1593c0 msgr2=0x7ff2dc06f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:33.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e1e45700 1 --2- 172.21.15.125:0/3362223465 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2dc1593c0 0x7ff2dc06f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:33.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e1e45700 1 -- 172.21.15.125:0/3362223465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2dc0cb8a0 msgr2=0x7ff2dc06f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:33.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e1e45700 1 --2- 172.21.15.125:0/3362223465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2dc0cb8a0 0x7ff2dc06f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:33.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e1e45700 1 -- 172.21.15.125:0/3362223465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d80094b0 con 0x7ff2dc06ced0 2023-10-17T06:07:33.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e1644700 1 --2- 172.21.15.125:0/3362223465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2dc0cb8a0 0x7ff2dc06f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:33.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e2646700 1 --2- 172.21.15.125:0/3362223465 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2dc1593c0 0x7ff2dc06f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:33.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e1e45700 1 --2- 172.21.15.125:0/3362223465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2dc06ced0 0x7ff2dc1505f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80090b0 tx=0x7ff2d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:33.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2d27fc700 1 -- 172.21.15.125:0/3362223465 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8019ab0 con 0x7ff2dc06ced0 2023-10-17T06:07:33.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2d27fc700 1 -- 172.21.15.125:0/3362223465 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d801e070 con 0x7ff2dc06ced0 2023-10-17T06:07:33.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2d27fc700 1 -- 172.21.15.125:0/3362223465 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8019e70 con 0x7ff2dc06ced0 2023-10-17T06:07:33.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e40a9700 1 -- 172.21.15.125:0/3362223465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2dc141fc0 con 0x7ff2dc06ced0 2023-10-17T06:07:33.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.175+0000 7ff2e40a9700 1 -- 172.21.15.125:0/3362223465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2dc1427c0 con 0x7ff2dc06ced0 2023-10-17T06:07:33.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.179+0000 7ff2e40a9700 1 -- 172.21.15.125:0/3362223465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2dc072e60 con 0x7ff2dc06ced0 2023-10-17T06:07:33.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.179+0000 7ff2d27fc700 1 -- 172.21.15.125:0/3362223465 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff2d802d450 con 0x7ff2dc06ced0 2023-10-17T06:07:33.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.179+0000 7ff2d27fc700 1 --2- 172.21.15.125:0/3362223465 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2c00656f0 0x7ff2c0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:33.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.183+0000 7ff2d27fc700 1 -- 172.21.15.125:0/3362223465 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff2d8084130 con 0x7ff2dc06ced0 2023-10-17T06:07:33.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.183+0000 7ff2e1644700 1 --2- 172.21.15.125:0/3362223465 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2c00656f0 0x7ff2c0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:33.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.183+0000 7ff2e1644700 1 --2- 172.21.15.125:0/3362223465 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2c00656f0 0x7ff2c0067bb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0cb800 tx=0x7ff2cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:33.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.187+0000 7ff2d27fc700 1 -- 172.21.15.125:0/3362223465 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff2d8051960 con 0x7ff2dc06ced0 2023-10-17T06:07:33.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.371+0000 7ff2e40a9700 1 -- 172.21.15.125:0/3362223465 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2dc070940 con 0x7ff2dc06ced0 2023-10-17T06:07:33.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.375+0000 7ff2d27fc700 1 -- 172.21.15.125:0/3362223465 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7ff2d8054f80 con 0x7ff2dc06ced0 2023-10-17T06:07:33.377 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:33.377 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":28,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:14.576796+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:07:33.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.375+0000 7ff2e40a9700 1 -- 172.21.15.125:0/3362223465 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2c00656f0 msgr2=0x7ff2c0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:33.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.375+0000 7ff2e40a9700 1 --2- 172.21.15.125:0/3362223465 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2c00656f0 0x7ff2c0067bb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0cb800 tx=0x7ff2cc009040 comp rx=0 tx=0).stop 2023-10-17T06:07:33.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.375+0000 7ff2e40a9700 1 -- 172.21.15.125:0/3362223465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2dc06ced0 msgr2=0x7ff2dc1505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:33.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.375+0000 7ff2e40a9700 1 --2- 172.21.15.125:0/3362223465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2dc06ced0 0x7ff2dc1505f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80090b0 tx=0x7ff2d8004770 comp rx=0 tx=0).stop 2023-10-17T06:07:33.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.375+0000 7ff2e40a9700 1 -- 172.21.15.125:0/3362223465 shutdown_connections 2023-10-17T06:07:33.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.375+0000 7ff2e40a9700 1 --2- 172.21.15.125:0/3362223465 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2c00656f0 0x7ff2c0067bb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:33.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.375+0000 7ff2e40a9700 1 --2- 172.21.15.125:0/3362223465 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2dc1593c0 0x7ff2dc06f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:33.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.375+0000 7ff2e40a9700 1 --2- 172.21.15.125:0/3362223465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2dc0cb8a0 0x7ff2dc06f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:33.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.375+0000 7ff2e40a9700 1 --2- 172.21.15.125:0/3362223465 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2dc06ced0 0x7ff2dc1505f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:33.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.375+0000 7ff2e40a9700 1 -- 172.21.15.125:0/3362223465 >> 172.21.15.125:0/3362223465 conn(0x7ff2dc06a340 msgr2=0x7ff2dc15a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:33.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.375+0000 7ff2e40a9700 1 -- 172.21.15.125:0/3362223465 shutdown_connections 2023-10-17T06:07:33.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.375+0000 7ff2e40a9700 1 -- 172.21.15.125:0/3362223465 wait complete. 2023-10-17T06:07:33.401 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-17T06:07:33.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.571+0000 7f21513ed700 1 Processor -- start 2023-10-17T06:07:33.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.571+0000 7f21513ed700 1 -- start start 2023-10-17T06:07:33.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.571+0000 7f21513ed700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f214c0b5ae0 0x7f214c0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:33.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.571+0000 7f21513ed700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c15d0d0 con 0x7f214c0d2e00 2023-10-17T06:07:33.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.571+0000 7f21513ed700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c06f0f0 con 0x7f214c160710 2023-10-17T06:07:33.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.571+0000 7f21513ed700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214c15df90 con 0x7f214c0b5ae0 2023-10-17T06:07:33.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.575+0000 7f214b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f214c0b5ae0 0x7f214c0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:33.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.575+0000 7f214affd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f214c0d2e00 0x7f214c0d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53898/0 (socket says 172.21.15.125:53898) 2023-10-17T06:07:33.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.575+0000 7f214affd700 1 -- 172.21.15.125:0/1931261004 learned_addr learned my addr 172.21.15.125:0/1931261004 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:33.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.575+0000 7f214b7fe700 1 -- 172.21.15.125:0/1931261004 >> v1:172.21.15.184:6789/0 conn(0x7f214c160710 legacy=0x7f214c06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:33.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.575+0000 7f214b7fe700 1 -- 172.21.15.125:0/1931261004 >> v1:172.21.15.125:6789/0 conn(0x7f214c0d2e00 legacy=0x7f214c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:33.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.575+0000 7f214b7fe700 1 -- 172.21.15.125:0/1931261004 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c15d310 con 0x7f214c0b5ae0 2023-10-17T06:07:33.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.575+0000 7f214b7fe700 1 --2- 172.21.15.125:0/1931261004 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f214c0b5ae0 0x7f214c0b6e00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2144009d90 tx=0x7f214400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9871357fff1c5ee9 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:33.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.575+0000 7f2149ffb700 1 -- 172.21.15.125:0/1931261004 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214400e070 con 0x7f214c0b5ae0 2023-10-17T06:07:33.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.575+0000 7f2149ffb700 1 -- 172.21.15.125:0/1931261004 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214400bbd0 con 0x7f214c0b5ae0 2023-10-17T06:07:33.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.575+0000 7f2149ffb700 1 -- 172.21.15.125:0/1931261004 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144012430 con 0x7f214c0b5ae0 2023-10-17T06:07:33.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.575+0000 7f21513ed700 1 -- 172.21.15.125:0/1931261004 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f214c0b5ae0 msgr2=0x7f214c0b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:33.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.575+0000 7f21513ed700 1 --2- 172.21.15.125:0/1931261004 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f214c0b5ae0 0x7f214c0b6e00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2144009d90 tx=0x7f214400b330 comp rx=0 tx=0).stop 2023-10-17T06:07:33.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.575+0000 7f21513ed700 1 -- 172.21.15.125:0/1931261004 shutdown_connections 2023-10-17T06:07:33.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.575+0000 7f21513ed700 1 --2- 172.21.15.125:0/1931261004 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f214c0b5ae0 0x7f214c0b6e00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:33.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.575+0000 7f21513ed700 1 -- 172.21.15.125:0/1931261004 >> 172.21.15.125:0/1931261004 conn(0x7f214c069f20 msgr2=0x7f214c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:33.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.575+0000 7f21513ed700 1 -- 172.21.15.125:0/1931261004 shutdown_connections 2023-10-17T06:07:33.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.575+0000 7f21513ed700 1 -- 172.21.15.125:0/1931261004 wait complete. 2023-10-17T06:07:33.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.579+0000 7f21513ed700 1 Processor -- start 2023-10-17T06:07:33.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.579+0000 7f21513ed700 1 -- start start 2023-10-17T06:07:33.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.579+0000 7f21513ed700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f214c0b5ae0 0x7f214c151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:33.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.579+0000 7f21513ed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f214c0d2e00 0x7f214c1541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:33.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.579+0000 7f21513ed700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f214c160710 0x7f214c0b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:33.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.579+0000 7f21513ed700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c153d10 con 0x7f214c0d2e00 2023-10-17T06:07:33.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.579+0000 7f21513ed700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c1546e0 con 0x7f214c160710 2023-10-17T06:07:33.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.579+0000 7f21513ed700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214c153100 con 0x7f214c0b5ae0 2023-10-17T06:07:33.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.579+0000 7f214a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f214c0d2e00 0x7f214c1541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:33.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.579+0000 7f214a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f214c0d2e00 0x7f214c1541a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48446/0 (socket says 172.21.15.125:48446) 2023-10-17T06:07:33.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.579+0000 7f214a7fc700 1 -- 172.21.15.125:0/1366854924 learned_addr learned my addr 172.21.15.125:0/1366854924 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:33.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.579+0000 7f214affd700 1 --2- 172.21.15.125:0/1366854924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f214c0b5ae0 0x7f214c151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:33.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.583+0000 7f214b7fe700 1 --2- 172.21.15.125:0/1366854924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f214c160710 0x7f214c0b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:33.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.583+0000 7f214a7fc700 1 -- 172.21.15.125:0/1366854924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f214c0b5ae0 msgr2=0x7f214c151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:33.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.583+0000 7f214a7fc700 1 --2- 172.21.15.125:0/1366854924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f214c0b5ae0 0x7f214c151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:33.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.583+0000 7f214a7fc700 1 -- 172.21.15.125:0/1366854924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f214c160710 msgr2=0x7f214c0b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:33.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.583+0000 7f214a7fc700 1 --2- 172.21.15.125:0/1366854924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f214c160710 0x7f214c0b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:33.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.583+0000 7f214a7fc700 1 -- 172.21.15.125:0/1366854924 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2144009a70 con 0x7f214c0d2e00 2023-10-17T06:07:33.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.583+0000 7f214a7fc700 1 --2- 172.21.15.125:0/1366854924 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f214c0d2e00 0x7f214c1541a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f214000c500 tx=0x7f214000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:33.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.583+0000 7f21337fe700 1 -- 172.21.15.125:0/1366854924 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21400052d0 con 0x7f214c0d2e00 2023-10-17T06:07:33.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.583+0000 7f21337fe700 1 -- 172.21.15.125:0/1366854924 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2140005430 con 0x7f214c0d2e00 2023-10-17T06:07:33.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.583+0000 7f21513ed700 1 -- 172.21.15.125:0/1366854924 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214c1533e0 con 0x7f214c0d2e00 2023-10-17T06:07:33.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.583+0000 7f21337fe700 1 -- 172.21.15.125:0/1366854924 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21400055a0 con 0x7f214c0d2e00 2023-10-17T06:07:33.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.583+0000 7f21513ed700 1 -- 172.21.15.125:0/1366854924 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c1539a0 con 0x7f214c0d2e00 2023-10-17T06:07:33.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.583+0000 7f21513ed700 1 -- 172.21.15.125:0/1366854924 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214c153ec0 con 0x7f214c0d2e00 2023-10-17T06:07:33.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.587+0000 7f21337fe700 1 -- 172.21.15.125:0/1366854924 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f21400038e0 con 0x7f214c0d2e00 2023-10-17T06:07:33.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.587+0000 7f21337fe700 1 --2- 172.21.15.125:0/1366854924 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f21380656f0 0x7f2138067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:33.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.587+0000 7f21337fe700 1 -- 172.21.15.125:0/1366854924 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2140082590 con 0x7f214c0d2e00 2023-10-17T06:07:33.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.587+0000 7f214affd700 1 --2- 172.21.15.125:0/1366854924 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f21380656f0 0x7f2138067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:33.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.587+0000 7f214affd700 1 --2- 172.21.15.125:0/1366854924 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f21380656f0 0x7f2138067bb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f213c005930 tx=0x7f213c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:33.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.595+0000 7f21337fe700 1 -- 172.21.15.125:0/1366854924 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f214004fcc0 con 0x7f214c0d2e00 2023-10-17T06:07:33.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:33.879+0000 7f21513ed700 1 -- 172.21.15.125:0/1366854924 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f214c04e910 con 0x7f214c0d2e00 2023-10-17T06:07:34.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.579+0000 7f21337fe700 1 -- 172.21.15.125:0/1366854924 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f21400532e0 con 0x7f214c0d2e00 2023-10-17T06:07:34.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.583+0000 7f21513ed700 1 -- 172.21.15.125:0/1366854924 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f21380656f0 msgr2=0x7f2138067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:34.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.583+0000 7f21513ed700 1 --2- 172.21.15.125:0/1366854924 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f21380656f0 0x7f2138067bb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f213c005930 tx=0x7f213c009040 comp rx=0 tx=0).stop 2023-10-17T06:07:34.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.583+0000 7f21513ed700 1 -- 172.21.15.125:0/1366854924 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f214c0d2e00 msgr2=0x7f214c1541a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:34.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.583+0000 7f21513ed700 1 --2- 172.21.15.125:0/1366854924 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f214c0d2e00 0x7f214c1541a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f214000c500 tx=0x7f214000c810 comp rx=0 tx=0).stop 2023-10-17T06:07:34.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.583+0000 7f21513ed700 1 -- 172.21.15.125:0/1366854924 shutdown_connections 2023-10-17T06:07:34.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.583+0000 7f21513ed700 1 --2- 172.21.15.125:0/1366854924 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f21380656f0 0x7f2138067bb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:34.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.583+0000 7f21513ed700 1 --2- 172.21.15.125:0/1366854924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f214c160710 0x7f214c0b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:34.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.583+0000 7f21513ed700 1 --2- 172.21.15.125:0/1366854924 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f214c0d2e00 0x7f214c1541a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:34.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.583+0000 7f21513ed700 1 --2- 172.21.15.125:0/1366854924 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f214c0b5ae0 0x7f214c151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:34.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.583+0000 7f21513ed700 1 -- 172.21.15.125:0/1366854924 >> 172.21.15.125:0/1366854924 conn(0x7f214c069f20 msgr2=0x7f214c0b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:34.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.583+0000 7f21513ed700 1 -- 172.21.15.125:0/1366854924 shutdown_connections 2023-10-17T06:07:34.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.583+0000 7f21513ed700 1 -- 172.21.15.125:0/1366854924 wait complete. 2023-10-17T06:07:34.607 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-10-17T06:07:34.607 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-17T06:07:34.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.787+0000 7fe66c0df700 1 Processor -- start 2023-10-17T06:07:34.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.787+0000 7fe66c0df700 1 -- start start 2023-10-17T06:07:34.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.791+0000 7fe66c0df700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe6641467c0 0x7fe6640b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:34.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.791+0000 7fe66c0df700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe66406f9a0 0x7fe66406fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:34.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.791+0000 7fe66c0df700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe664146ba0 con 0x7fe6641612e0 2023-10-17T06:07:34.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.791+0000 7fe66c0df700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6640d0920 con 0x7fe6641467c0 2023-10-17T06:07:34.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.791+0000 7fe66c0df700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe664070320 con 0x7fe66406f9a0 2023-10-17T06:07:34.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.791+0000 7fe669e7b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe6641467c0 0x7fe6640b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:34.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.791+0000 7fe66967a700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe6641612e0 0x7fe66415d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53908/0 (socket says 172.21.15.125:53908) 2023-10-17T06:07:34.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.791+0000 7fe66967a700 1 -- 172.21.15.125:0/3645314222 learned_addr learned my addr 172.21.15.125:0/3645314222 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:34.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.791+0000 7fe66a67c700 1 --2- 172.21.15.125:0/3645314222 >> v2:172.21.15.184:3300/0 conn(0x7fe66406f9a0 0x7fe66406fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:34.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.791+0000 7fe669e7b700 1 -- 172.21.15.125:0/3645314222 >> v2:172.21.15.184:3300/0 conn(0x7fe66406f9a0 msgr2=0x7fe66406fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:34.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.791+0000 7fe669e7b700 1 --2- 172.21.15.125:0/3645314222 >> v2:172.21.15.184:3300/0 conn(0x7fe66406f9a0 0x7fe66406fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:34.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.791+0000 7fe669e7b700 1 -- 172.21.15.125:0/3645314222 >> v1:172.21.15.125:6789/0 conn(0x7fe6641612e0 legacy=0x7fe66415d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:34.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.791+0000 7fe669e7b700 1 -- 172.21.15.125:0/3645314222 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6640b6160 con 0x7fe6641467c0 2023-10-17T06:07:34.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.791+0000 7fe669e7b700 1 --2- 172.21.15.125:0/3645314222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6641467c0 0x7fe6640b5b80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe6640b81f0 tx=0x7fe660009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4576fbb6f734b5c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:34.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.791+0000 7fe668e79700 1 -- 172.21.15.125:0/3645314222 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660011830 con 0x7fe6641467c0 2023-10-17T06:07:34.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.791+0000 7fe668e79700 1 -- 172.21.15.125:0/3645314222 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe660011990 con 0x7fe6641467c0 2023-10-17T06:07:34.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.791+0000 7fe668e79700 1 -- 172.21.15.125:0/3645314222 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660011d20 con 0x7fe6641467c0 2023-10-17T06:07:34.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.795+0000 7fe66c0df700 1 -- 172.21.15.125:0/3645314222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6641467c0 msgr2=0x7fe6640b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:34.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.795+0000 7fe66c0df700 1 --2- 172.21.15.125:0/3645314222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6641467c0 0x7fe6640b5b80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe6640b81f0 tx=0x7fe660009b30 comp rx=0 tx=0).stop 2023-10-17T06:07:34.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.795+0000 7fe66c0df700 1 -- 172.21.15.125:0/3645314222 shutdown_connections 2023-10-17T06:07:34.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.795+0000 7fe66c0df700 1 --2- 172.21.15.125:0/3645314222 >> v2:172.21.15.184:3300/0 conn(0x7fe66406f9a0 0x7fe66406fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:34.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.795+0000 7fe66c0df700 1 --2- 172.21.15.125:0/3645314222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe6641467c0 0x7fe6640b5b80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:34.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.795+0000 7fe66c0df700 1 -- 172.21.15.125:0/3645314222 >> 172.21.15.125:0/3645314222 conn(0x7fe66406a130 msgr2=0x7fe66406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:34.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.795+0000 7fe66c0df700 1 -- 172.21.15.125:0/3645314222 shutdown_connections 2023-10-17T06:07:34.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.795+0000 7fe66c0df700 1 -- 172.21.15.125:0/3645314222 wait complete. 2023-10-17T06:07:34.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.799+0000 7fe66c0df700 1 Processor -- start 2023-10-17T06:07:34.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.799+0000 7fe66c0df700 1 -- start start 2023-10-17T06:07:34.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.799+0000 7fe66c0df700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe66406f9a0 0x7fe664134350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:34.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.799+0000 7fe66c0df700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6641467c0 0x7fe6640d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:34.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.799+0000 7fe66c0df700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6641612e0 0x7fe6640d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:34.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.799+0000 7fe66c0df700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6641f9870 con 0x7fe66406f9a0 2023-10-17T06:07:34.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.799+0000 7fe66c0df700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66415c480 con 0x7fe6641612e0 2023-10-17T06:07:34.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.799+0000 7fe66c0df700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe664134890 con 0x7fe6641467c0 2023-10-17T06:07:34.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.799+0000 7fe669e7b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe66406f9a0 0x7fe664134350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:34.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.799+0000 7fe669e7b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe66406f9a0 0x7fe664134350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48466/0 (socket says 172.21.15.125:48466) 2023-10-17T06:07:34.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.799+0000 7fe669e7b700 1 -- 172.21.15.125:0/2052842378 learned_addr learned my addr 172.21.15.125:0/2052842378 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:34.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.799+0000 7fe66a67c700 1 --2- 172.21.15.125:0/2052842378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6641612e0 0x7fe6640d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:34.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.799+0000 7fe66967a700 1 --2- 172.21.15.125:0/2052842378 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6641467c0 0x7fe6640d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:34.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.799+0000 7fe669e7b700 1 -- 172.21.15.125:0/2052842378 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6641467c0 msgr2=0x7fe6640d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:34.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.799+0000 7fe669e7b700 1 --2- 172.21.15.125:0/2052842378 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6641467c0 0x7fe6640d0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:34.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.799+0000 7fe669e7b700 1 -- 172.21.15.125:0/2052842378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6641612e0 msgr2=0x7fe6640d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:34.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.799+0000 7fe669e7b700 1 --2- 172.21.15.125:0/2052842378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6641612e0 0x7fe6640d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:34.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.799+0000 7fe669e7b700 1 -- 172.21.15.125:0/2052842378 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6600094b0 con 0x7fe66406f9a0 2023-10-17T06:07:34.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.799+0000 7fe66967a700 1 --2- 172.21.15.125:0/2052842378 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6641467c0 0x7fe6640d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:34.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.803+0000 7fe669e7b700 1 --2- 172.21.15.125:0/2052842378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe66406f9a0 0x7fe664134350 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe660009b70 tx=0x7fe660004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:34.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.803+0000 7fe65a7fc700 1 -- 172.21.15.125:0/2052842378 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660004480 con 0x7fe66406f9a0 2023-10-17T06:07:34.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.803+0000 7fe65a7fc700 1 -- 172.21.15.125:0/2052842378 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66001f070 con 0x7fe66406f9a0 2023-10-17T06:07:34.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.803+0000 7fe66c0df700 1 -- 172.21.15.125:0/2052842378 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6641f8c60 con 0x7fe66406f9a0 2023-10-17T06:07:34.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.803+0000 7fe65a7fc700 1 -- 172.21.15.125:0/2052842378 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6600038e0 con 0x7fe66406f9a0 2023-10-17T06:07:34.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.803+0000 7fe66c0df700 1 -- 172.21.15.125:0/2052842378 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6641f9220 con 0x7fe66406f9a0 2023-10-17T06:07:34.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.803+0000 7fe66c0df700 1 -- 172.21.15.125:0/2052842378 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6640b4800 con 0x7fe66406f9a0 2023-10-17T06:07:34.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.803+0000 7fe65a7fc700 1 -- 172.21.15.125:0/2052842378 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe660021030 con 0x7fe66406f9a0 2023-10-17T06:07:34.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.807+0000 7fe65a7fc700 1 --2- 172.21.15.125:0/2052842378 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe6480656f0 0x7fe648067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:34.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.807+0000 7fe65a7fc700 1 -- 172.21.15.125:0/2052842378 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe660084430 con 0x7fe66406f9a0 2023-10-17T06:07:34.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.807+0000 7fe66967a700 1 --2- 172.21.15.125:0/2052842378 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe6480656f0 0x7fe648067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:34.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.807+0000 7fe66967a700 1 --2- 172.21.15.125:0/2052842378 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe6480656f0 0x7fe648067bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe654007fd0 tx=0x7fe654009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:34.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:34.811+0000 7fe65a7fc700 1 -- 172.21.15.125:0/2052842378 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe660051d10 con 0x7fe66406f9a0 2023-10-17T06:07:35.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.043+0000 7fe66c0df700 1 -- 172.21.15.125:0/2052842378 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe664161770 con 0x7fe66406f9a0 2023-10-17T06:07:35.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.583+0000 7fe65a7fc700 1 -- 172.21.15.125:0/2052842378 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe660055330 con 0x7fe66406f9a0 2023-10-17T06:07:35.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.591+0000 7fe66c0df700 1 -- 172.21.15.125:0/2052842378 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe6480656f0 msgr2=0x7fe648067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:35.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.591+0000 7fe66c0df700 1 --2- 172.21.15.125:0/2052842378 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe6480656f0 0x7fe648067bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe654007fd0 tx=0x7fe654009040 comp rx=0 tx=0).stop 2023-10-17T06:07:35.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.591+0000 7fe66c0df700 1 -- 172.21.15.125:0/2052842378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe66406f9a0 msgr2=0x7fe664134350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:35.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.591+0000 7fe66c0df700 1 --2- 172.21.15.125:0/2052842378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe66406f9a0 0x7fe664134350 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe660009b70 tx=0x7fe660004770 comp rx=0 tx=0).stop 2023-10-17T06:07:35.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.591+0000 7fe66c0df700 1 -- 172.21.15.125:0/2052842378 shutdown_connections 2023-10-17T06:07:35.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.591+0000 7fe66c0df700 1 --2- 172.21.15.125:0/2052842378 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe6480656f0 0x7fe648067bb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:35.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.591+0000 7fe66c0df700 1 --2- 172.21.15.125:0/2052842378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6641612e0 0x7fe6640d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:35.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.591+0000 7fe66c0df700 1 --2- 172.21.15.125:0/2052842378 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6641467c0 0x7fe6640d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:35.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.591+0000 7fe66c0df700 1 --2- 172.21.15.125:0/2052842378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe66406f9a0 0x7fe664134350 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:35.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.591+0000 7fe66c0df700 1 -- 172.21.15.125:0/2052842378 >> 172.21.15.125:0/2052842378 conn(0x7fe66406a130 msgr2=0x7fe6640b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:35.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.591+0000 7fe66c0df700 1 -- 172.21.15.125:0/2052842378 shutdown_connections 2023-10-17T06:07:35.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.591+0000 7fe66c0df700 1 -- 172.21.15.125:0/2052842378 wait complete. 2023-10-17T06:07:35.617 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-17T06:07:35.618 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:07:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.799+0000 7f42b0370700 1 Processor -- start 2023-10-17T06:07:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.799+0000 7f42b0370700 1 -- start start 2023-10-17T06:07:35.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42b0370700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42a8155420 0x7f42a80cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:35.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42b0370700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f42a815bf00 0x7f42a80cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:35.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42b0370700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42a80b0f90 0x7f42a80ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:35.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42b0370700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a8155800 con 0x7f42a8155420 2023-10-17T06:07:35.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42b0370700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a80cbc80 con 0x7f42a815bf00 2023-10-17T06:07:35.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42b0370700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a80cb9a0 con 0x7f42a80b0f90 2023-10-17T06:07:35.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42ae10c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42a8155420 0x7f42a80cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:35.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42ae10c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42a8155420 0x7f42a80cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48478/0 (socket says 172.21.15.125:48478) 2023-10-17T06:07:35.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42ae10c700 1 -- 172.21.15.125:0/1136819969 learned_addr learned my addr 172.21.15.125:0/1136819969 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:35.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42ad90b700 1 --2- 172.21.15.125:0/1136819969 >> v2:172.21.15.184:3300/0 conn(0x7f42a815bf00 0x7f42a80cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:35.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42ae10c700 1 -- 172.21.15.125:0/1136819969 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42a80b0f90 msgr2=0x7f42a80ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:35.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42ae10c700 1 --2- 172.21.15.125:0/1136819969 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42a80b0f90 0x7f42a80ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:35.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42ae10c700 1 -- 172.21.15.125:0/1136819969 >> v2:172.21.15.184:3300/0 conn(0x7f42a815bf00 msgr2=0x7f42a80cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:35.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42ae10c700 1 --2- 172.21.15.125:0/1136819969 >> v2:172.21.15.184:3300/0 conn(0x7f42a815bf00 0x7f42a80cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42ae10c700 1 -- 172.21.15.125:0/1136819969 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a815b420 con 0x7f42a8155420 2023-10-17T06:07:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42ae10c700 1 --2- 172.21.15.125:0/1136819969 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42a8155420 0x7f42a80cb150 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f42a80b3b50 tx=0x7f42a4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10204a7f2f74d7e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42ad10a700 1 -- 172.21.15.125:0/1136819969 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a400b8a0 con 0x7f42a8155420 2023-10-17T06:07:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42ad10a700 1 -- 172.21.15.125:0/1136819969 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a400ba00 con 0x7f42a8155420 2023-10-17T06:07:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42ad10a700 1 -- 172.21.15.125:0/1136819969 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a400bd90 con 0x7f42a8155420 2023-10-17T06:07:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42b0370700 1 -- 172.21.15.125:0/1136819969 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42a8155420 msgr2=0x7f42a80cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.803+0000 7f42b0370700 1 --2- 172.21.15.125:0/1136819969 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42a8155420 0x7f42a80cb150 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f42a80b3b50 tx=0x7f42a4009bf0 comp rx=0 tx=0).stop 2023-10-17T06:07:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.807+0000 7f42b0370700 1 -- 172.21.15.125:0/1136819969 shutdown_connections 2023-10-17T06:07:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.807+0000 7f42b0370700 1 --2- 172.21.15.125:0/1136819969 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42a80b0f90 0x7f42a80ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.807+0000 7f42b0370700 1 --2- 172.21.15.125:0/1136819969 >> v2:172.21.15.184:3300/0 conn(0x7f42a815bf00 0x7f42a80cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:35.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.807+0000 7f42b0370700 1 --2- 172.21.15.125:0/1136819969 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42a8155420 0x7f42a80cb150 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:35.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.807+0000 7f42b0370700 1 -- 172.21.15.125:0/1136819969 >> 172.21.15.125:0/1136819969 conn(0x7f42a806a340 msgr2=0x7f42a80b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:35.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.807+0000 7f42b0370700 1 -- 172.21.15.125:0/1136819969 shutdown_connections 2023-10-17T06:07:35.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.807+0000 7f42b0370700 1 -- 172.21.15.125:0/1136819969 wait complete. 2023-10-17T06:07:35.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.807+0000 7f42b0370700 1 Processor -- start 2023-10-17T06:07:35.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.807+0000 7f42b0370700 1 -- start start 2023-10-17T06:07:35.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42b0370700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42a80b0f90 0x7f42a80a8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:35.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42b0370700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42a8155420 0x7f42a815d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:35.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42b0370700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42a815bf00 0x7f42a80cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:35.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42b0370700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a80a9220 con 0x7f42a8155420 2023-10-17T06:07:35.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42b0370700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a80a9500 con 0x7f42a80b0f90 2023-10-17T06:07:35.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42b0370700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a80a97e0 con 0x7f42a815bf00 2023-10-17T06:07:35.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42ad90b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42a8155420 0x7f42a815d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:35.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42ad90b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42a8155420 0x7f42a815d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48480/0 (socket says 172.21.15.125:48480) 2023-10-17T06:07:35.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42ad90b700 1 -- 172.21.15.125:0/950867206 learned_addr learned my addr 172.21.15.125:0/950867206 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:35.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42ae90d700 1 --2- 172.21.15.125:0/950867206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42a815bf00 0x7f42a80cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:35.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42ae10c700 1 --2- 172.21.15.125:0/950867206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42a80b0f90 0x7f42a80a8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:35.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42ad90b700 1 -- 172.21.15.125:0/950867206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42a815bf00 msgr2=0x7f42a80cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:35.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42ad90b700 1 --2- 172.21.15.125:0/950867206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42a815bf00 0x7f42a80cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:35.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42ad90b700 1 -- 172.21.15.125:0/950867206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42a80b0f90 msgr2=0x7f42a80a8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:35.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42ad90b700 1 --2- 172.21.15.125:0/950867206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42a80b0f90 0x7f42a80a8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:35.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42ad90b700 1 -- 172.21.15.125:0/950867206 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a4009570 con 0x7f42a8155420 2023-10-17T06:07:35.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42ae90d700 1 --2- 172.21.15.125:0/950867206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42a815bf00 0x7f42a80cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:35.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42ae10c700 1 --2- 172.21.15.125:0/950867206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42a80b0f90 0x7f42a80a8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:35.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42ad90b700 1 --2- 172.21.15.125:0/950867206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42a8155420 0x7f42a815d260 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f429800e760 tx=0x7f429800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:35.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f429effd700 1 -- 172.21.15.125:0/950867206 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298013610 con 0x7f42a8155420 2023-10-17T06:07:35.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f429effd700 1 -- 172.21.15.125:0/950867206 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4298013770 con 0x7f42a8155420 2023-10-17T06:07:35.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42b0370700 1 -- 172.21.15.125:0/950867206 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a80a9ac0 con 0x7f42a8155420 2023-10-17T06:07:35.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f429effd700 1 -- 172.21.15.125:0/950867206 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298013ae0 con 0x7f42a8155420 2023-10-17T06:07:35.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.811+0000 7f42b0370700 1 -- 172.21.15.125:0/950867206 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a8142e10 con 0x7f42a8155420 2023-10-17T06:07:35.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.815+0000 7f42b0370700 1 -- 172.21.15.125:0/950867206 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a8072e60 con 0x7f42a8155420 2023-10-17T06:07:35.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.815+0000 7f429effd700 1 -- 172.21.15.125:0/950867206 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4298013c40 con 0x7f42a8155420 2023-10-17T06:07:35.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.815+0000 7f429effd700 1 --2- 172.21.15.125:0/950867206 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f428c065720 0x7f428c067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:35.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.815+0000 7f429effd700 1 -- 172.21.15.125:0/950867206 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4298082d00 con 0x7f42a8155420 2023-10-17T06:07:35.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.815+0000 7f42ae10c700 1 --2- 172.21.15.125:0/950867206 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f428c065720 0x7f428c067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:35.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.815+0000 7f42ae10c700 1 --2- 172.21.15.125:0/950867206 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f428c065720 0x7f428c067be0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42a4000c00 tx=0x7f42a4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:35.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:35.823+0000 7f429effd700 1 -- 172.21.15.125:0/950867206 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f4298053f60 con 0x7f42a8155420 2023-10-17T06:07:36.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.059+0000 7f42b0370700 1 -- 172.21.15.125:0/950867206 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42a81436f0 con 0x7f42a8155420 2023-10-17T06:07:36.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.063+0000 7f429effd700 1 -- 172.21.15.125:0/950867206 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f4298021090 con 0x7f42a8155420 2023-10-17T06:07:36.065 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:36.065 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/3744648044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3744648044},{"type":"v1","addr":"172.21.15.184:6833","nonce":3744648044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/181458401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181458401},{"type":"v1","addr":"172.21.15.184:6835","nonce":181458401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/908363262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":908363262},{"type":"v1","addr":"172.21.15.125:6835","nonce":908363262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:07:09.036610+0000","modified":"2023-10-17T06:07:35.578225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/3617198893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":3617198893},{"type":"v1","addr":"172.21.15.125:6837","nonce":3617198893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-17T06:07:36.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.063+0000 7f42b0370700 1 -- 172.21.15.125:0/950867206 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f428c065720 msgr2=0x7f428c067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:36.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.063+0000 7f42b0370700 1 --2- 172.21.15.125:0/950867206 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f428c065720 0x7f428c067be0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42a4000c00 tx=0x7f42a4008030 comp rx=0 tx=0).stop 2023-10-17T06:07:36.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.063+0000 7f42b0370700 1 -- 172.21.15.125:0/950867206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42a8155420 msgr2=0x7f42a815d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:36.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.063+0000 7f42b0370700 1 --2- 172.21.15.125:0/950867206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42a8155420 0x7f42a815d260 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f429800e760 tx=0x7f429800eb20 comp rx=0 tx=0).stop 2023-10-17T06:07:36.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.063+0000 7f42b0370700 1 -- 172.21.15.125:0/950867206 shutdown_connections 2023-10-17T06:07:36.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.063+0000 7f42b0370700 1 --2- 172.21.15.125:0/950867206 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f428c065720 0x7f428c067be0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.063+0000 7f42b0370700 1 --2- 172.21.15.125:0/950867206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42a815bf00 0x7f42a80cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.063+0000 7f42b0370700 1 --2- 172.21.15.125:0/950867206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42a8155420 0x7f42a815d260 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.063+0000 7f42b0370700 1 --2- 172.21.15.125:0/950867206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42a80b0f90 0x7f42a80a8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.063+0000 7f42b0370700 1 -- 172.21.15.125:0/950867206 >> 172.21.15.125:0/950867206 conn(0x7f42a806a340 msgr2=0x7f42a81442b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:36.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.067+0000 7f42b0370700 1 -- 172.21.15.125:0/950867206 shutdown_connections 2023-10-17T06:07:36.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.067+0000 7f42b0370700 1 -- 172.21.15.125:0/950867206 wait complete. 2023-10-17T06:07:36.071 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 9 2023-10-17T06:07:36.090 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:07:36.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.255+0000 7f0c84912700 1 Processor -- start 2023-10-17T06:07:36.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.255+0000 7f0c84912700 1 -- start start 2023-10-17T06:07:36.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.259+0000 7f0c84912700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0c8006d530 0x7f0c800cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:36.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.259+0000 7f0c84912700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c800ca4c0 con 0x7f0c80164a20 2023-10-17T06:07:36.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.259+0000 7f0c84912700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c800ca7a0 con 0x7f0c800b3d40 2023-10-17T06:07:36.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.259+0000 7f0c84912700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8006e2d0 con 0x7f0c8006d530 2023-10-17T06:07:36.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.259+0000 7f0c7f59e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0c8006d530 0x7f0c800cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:36.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.259+0000 7f0c7f59e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0c8006d530 0x7f0c800cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48494/0 (socket says 172.21.15.125:48494) 2023-10-17T06:07:36.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.259+0000 7f0c7f59e700 1 -- 172.21.15.125:0/2655736077 learned_addr learned my addr 172.21.15.125:0/2655736077 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:36.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.259+0000 7f0c7ed9d700 1 --1- 172.21.15.125:0/2655736077 >> v1:172.21.15.184:6789/0 conn(0x7f0c800b3d40 0x7f0c800c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:36072/0 (socket says 172.21.15.125:36072) 2023-10-17T06:07:36.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.259+0000 7f0c7f59e700 1 -- 172.21.15.125:0/2655736077 >> v1:172.21.15.184:6789/0 conn(0x7f0c800b3d40 legacy=0x7f0c800c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:36.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.259+0000 7f0c7f59e700 1 -- 172.21.15.125:0/2655736077 >> v1:172.21.15.125:6789/0 conn(0x7f0c80164a20 legacy=0x7f0c8006ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:36.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.259+0000 7f0c7f59e700 1 -- 172.21.15.125:0/2655736077 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c800caa80 con 0x7f0c8006d530 2023-10-17T06:07:36.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.259+0000 7f0c7f59e700 1 --2- 172.21.15.125:0/2655736077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c8006d530 0x7f0c800cc190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0c78009e50 tx=0x7f0c7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea72a5b670285d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:36.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.259+0000 7f0c7e59c700 1 -- 172.21.15.125:0/2655736077 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7800e070 con 0x7f0c8006d530 2023-10-17T06:07:36.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.259+0000 7f0c7e59c700 1 -- 172.21.15.125:0/2655736077 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7800b9c0 con 0x7f0c8006d530 2023-10-17T06:07:36.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.259+0000 7f0c7e59c700 1 -- 172.21.15.125:0/2655736077 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7800bd70 con 0x7f0c8006d530 2023-10-17T06:07:36.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.263+0000 7f0c84912700 1 -- 172.21.15.125:0/2655736077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c8006d530 msgr2=0x7f0c800cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:36.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.263+0000 7f0c84912700 1 --2- 172.21.15.125:0/2655736077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c8006d530 0x7f0c800cc190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0c78009e50 tx=0x7f0c7800b330 comp rx=0 tx=0).stop 2023-10-17T06:07:36.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.263+0000 7f0c84912700 1 -- 172.21.15.125:0/2655736077 shutdown_connections 2023-10-17T06:07:36.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.263+0000 7f0c84912700 1 --2- 172.21.15.125:0/2655736077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c8006d530 0x7f0c800cc190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.263+0000 7f0c84912700 1 -- 172.21.15.125:0/2655736077 >> 172.21.15.125:0/2655736077 conn(0x7f0c800ce5c0 msgr2=0x7f0c800ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:36.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.263+0000 7f0c84912700 1 -- 172.21.15.125:0/2655736077 shutdown_connections 2023-10-17T06:07:36.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.263+0000 7f0c84912700 1 -- 172.21.15.125:0/2655736077 wait complete. 2023-10-17T06:07:36.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.267+0000 7f0c84912700 1 Processor -- start 2023-10-17T06:07:36.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.267+0000 7f0c84912700 1 -- start start 2023-10-17T06:07:36.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.267+0000 7f0c84912700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c8006d530 0x7f0c8014b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:36.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.267+0000 7f0c84912700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c800b3d40 0x7f0c800cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:36.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.267+0000 7f0c84912700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c80164a20 0x7f0c800cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:36.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.267+0000 7f0c84912700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8014be10 con 0x7f0c80164a20 2023-10-17T06:07:36.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.267+0000 7f0c84912700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8015f000 con 0x7f0c8006d530 2023-10-17T06:07:36.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.267+0000 7f0c84912700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8015e3f0 con 0x7f0c800b3d40 2023-10-17T06:07:36.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.267+0000 7f0c7f59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c80164a20 0x7f0c800cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:36.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.267+0000 7f0c7f59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c80164a20 0x7f0c800cd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48508/0 (socket says 172.21.15.125:48508) 2023-10-17T06:07:36.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.267+0000 7f0c7f59e700 1 -- 172.21.15.125:0/1846283199 learned_addr learned my addr 172.21.15.125:0/1846283199 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:36.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.267+0000 7f0c7659c700 1 --2- 172.21.15.125:0/1846283199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c800b3d40 0x7f0c800cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:36.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.267+0000 7f0c7ed9d700 1 --2- 172.21.15.125:0/1846283199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c8006d530 0x7f0c8014b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:36.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.271+0000 7f0c7f59e700 1 -- 172.21.15.125:0/1846283199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c800b3d40 msgr2=0x7f0c800cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:36.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.271+0000 7f0c7f59e700 1 --2- 172.21.15.125:0/1846283199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c800b3d40 0x7f0c800cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.271+0000 7f0c7f59e700 1 -- 172.21.15.125:0/1846283199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c8006d530 msgr2=0x7f0c8014b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:36.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.271+0000 7f0c7f59e700 1 --2- 172.21.15.125:0/1846283199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c8006d530 0x7f0c8014b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.271+0000 7f0c7f59e700 1 -- 172.21.15.125:0/1846283199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c78009b30 con 0x7f0c80164a20 2023-10-17T06:07:36.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.271+0000 7f0c7f59e700 1 --2- 172.21.15.125:0/1846283199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c80164a20 0x7f0c800cd5b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0c78012000 tx=0x7f0c78004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:36.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.271+0000 7f0c77fff700 1 -- 172.21.15.125:0/1846283199 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c78004800 con 0x7f0c80164a20 2023-10-17T06:07:36.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.271+0000 7f0c84912700 1 -- 172.21.15.125:0/1846283199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c8015e6d0 con 0x7f0c80164a20 2023-10-17T06:07:36.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.271+0000 7f0c77fff700 1 -- 172.21.15.125:0/1846283199 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c780099b0 con 0x7f0c80164a20 2023-10-17T06:07:36.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.271+0000 7f0c77fff700 1 -- 172.21.15.125:0/1846283199 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7801c680 con 0x7f0c80164a20 2023-10-17T06:07:36.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.271+0000 7f0c84912700 1 -- 172.21.15.125:0/1846283199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8015ec90 con 0x7f0c80164a20 2023-10-17T06:07:36.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.271+0000 7f0c84912700 1 -- 172.21.15.125:0/1846283199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c801598a0 con 0x7f0c80164a20 2023-10-17T06:07:36.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.275+0000 7f0c77fff700 1 -- 172.21.15.125:0/1846283199 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0c7801c7e0 con 0x7f0c80164a20 2023-10-17T06:07:36.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.275+0000 7f0c77fff700 1 --2- 172.21.15.125:0/1846283199 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0c600656f0 0x7f0c60067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:36.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.275+0000 7f0c77fff700 1 -- 172.21.15.125:0/1846283199 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0c78084ba0 con 0x7f0c80164a20 2023-10-17T06:07:36.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.275+0000 7f0c7ed9d700 1 --2- 172.21.15.125:0/1846283199 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0c600656f0 0x7f0c60067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:36.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.275+0000 7f0c7ed9d700 1 --2- 172.21.15.125:0/1846283199 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0c600656f0 0x7f0c60067bb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0c70000f60 tx=0x7f0c70007ef0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:36.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.279+0000 7f0c77fff700 1 -- 172.21.15.125:0/1846283199 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0c801598a0 con 0x7f0c80164a20 2023-10-17T06:07:36.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.459+0000 7f0c84912700 1 -- 172.21.15.125:0/1846283199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c801598a0 con 0x7f0c80164a20 2023-10-17T06:07:36.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.463+0000 7f0c77fff700 1 -- 172.21.15.125:0/1846283199 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f0c801598a0 con 0x7f0c80164a20 2023-10-17T06:07:36.465 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:36.465 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":28,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:14.576796+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:07:36.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.463+0000 7f0c84912700 1 -- 172.21.15.125:0/1846283199 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0c600656f0 msgr2=0x7f0c60067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:36.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.463+0000 7f0c84912700 1 --2- 172.21.15.125:0/1846283199 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0c600656f0 0x7f0c60067bb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0c70000f60 tx=0x7f0c70007ef0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.463+0000 7f0c84912700 1 -- 172.21.15.125:0/1846283199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c80164a20 msgr2=0x7f0c800cd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:36.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.463+0000 7f0c84912700 1 --2- 172.21.15.125:0/1846283199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c80164a20 0x7f0c800cd5b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0c78012000 tx=0x7f0c78004af0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.463+0000 7f0c84912700 1 -- 172.21.15.125:0/1846283199 shutdown_connections 2023-10-17T06:07:36.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.463+0000 7f0c84912700 1 --2- 172.21.15.125:0/1846283199 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0c600656f0 0x7f0c60067bb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.463+0000 7f0c84912700 1 --2- 172.21.15.125:0/1846283199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c80164a20 0x7f0c800cd5b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.463+0000 7f0c84912700 1 --2- 172.21.15.125:0/1846283199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c800b3d40 0x7f0c800cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.463+0000 7f0c84912700 1 --2- 172.21.15.125:0/1846283199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c8006d530 0x7f0c8014b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.463+0000 7f0c84912700 1 -- 172.21.15.125:0/1846283199 >> 172.21.15.125:0/1846283199 conn(0x7f0c800ce5c0 msgr2=0x7f0c80161cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:36.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.463+0000 7f0c84912700 1 -- 172.21.15.125:0/1846283199 shutdown_connections 2023-10-17T06:07:36.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.463+0000 7f0c84912700 1 -- 172.21.15.125:0/1846283199 wait complete. 2023-10-17T06:07:36.492 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-17T06:07:36.493 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-17T06:07:36.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.659+0000 7f2a31a00700 1 Processor -- start 2023-10-17T06:07:36.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.659+0000 7f2a31a00700 1 -- start start 2023-10-17T06:07:36.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.663+0000 7f2a31a00700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a2c15aa20 0x7f2a2c15b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:36.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.663+0000 7f2a31a00700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2a2c15e500 0x7f2a2c0ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:36.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.663+0000 7f2a31a00700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2a2c15e980 0x7f2a2c0caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:36.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.663+0000 7f2a31a00700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2c15f430 con 0x7f2a2c15e500 2023-10-17T06:07:36.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.663+0000 7f2a31a00700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2c15ae00 con 0x7f2a2c15e980 2023-10-17T06:07:36.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.663+0000 7f2a31a00700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c15ee70 con 0x7f2a2c15aa20 2023-10-17T06:07:36.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.663+0000 7f2a2a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2a2c15e500 0x7f2a2c0ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:36.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.663+0000 7f2a2affd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a2c15aa20 0x7f2a2c15b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:36.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.663+0000 7f2a2a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2a2c15e500 0x7f2a2c0ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48514/0 (socket says 172.21.15.125:48514) 2023-10-17T06:07:36.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.663+0000 7f2a2a7fc700 1 -- 172.21.15.125:0/4262262784 learned_addr learned my addr 172.21.15.125:0/4262262784 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:36.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.663+0000 7f2a2bfff700 1 --2- 172.21.15.125:0/4262262784 >> v2:172.21.15.184:3300/0 conn(0x7f2a2c15e980 0x7f2a2c0caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:36.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.663+0000 7f2a2a7fc700 1 -- 172.21.15.125:0/4262262784 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a2c15aa20 msgr2=0x7f2a2c15b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:36.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.663+0000 7f2a2a7fc700 1 --2- 172.21.15.125:0/4262262784 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a2c15aa20 0x7f2a2c15b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.663+0000 7f2a2a7fc700 1 -- 172.21.15.125:0/4262262784 >> v2:172.21.15.184:3300/0 conn(0x7f2a2c15e980 msgr2=0x7f2a2c0caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:36.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.663+0000 7f2a2a7fc700 1 --2- 172.21.15.125:0/4262262784 >> v2:172.21.15.184:3300/0 conn(0x7f2a2c15e980 0x7f2a2c0caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.663+0000 7f2a2a7fc700 1 -- 172.21.15.125:0/4262262784 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c15f150 con 0x7f2a2c15e500 2023-10-17T06:07:36.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.667+0000 7f2a2a7fc700 1 --2- 172.21.15.125:0/4262262784 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a2c15e500 0x7f2a2c0ca590 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0aeca0 tx=0x7f2a20009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f97183a9316351 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:36.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.667+0000 7f2a29ffb700 1 -- 172.21.15.125:0/4262262784 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20011830 con 0x7f2a2c15e500 2023-10-17T06:07:36.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.667+0000 7f2a29ffb700 1 -- 172.21.15.125:0/4262262784 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a20011990 con 0x7f2a2c15e500 2023-10-17T06:07:36.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.667+0000 7f2a29ffb700 1 -- 172.21.15.125:0/4262262784 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20011d20 con 0x7f2a2c15e500 2023-10-17T06:07:36.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.667+0000 7f2a31a00700 1 -- 172.21.15.125:0/4262262784 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a2c15e500 msgr2=0x7f2a2c0ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:36.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.667+0000 7f2a31a00700 1 --2- 172.21.15.125:0/4262262784 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a2c15e500 0x7f2a2c0ca590 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0aeca0 tx=0x7f2a20009bf0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.667+0000 7f2a31a00700 1 -- 172.21.15.125:0/4262262784 shutdown_connections 2023-10-17T06:07:36.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.667+0000 7f2a31a00700 1 --2- 172.21.15.125:0/4262262784 >> v2:172.21.15.184:3300/0 conn(0x7f2a2c15e980 0x7f2a2c0caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.667+0000 7f2a31a00700 1 --2- 172.21.15.125:0/4262262784 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a2c15e500 0x7f2a2c0ca590 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.667+0000 7f2a31a00700 1 --2- 172.21.15.125:0/4262262784 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a2c15aa20 0x7f2a2c15b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.667+0000 7f2a31a00700 1 -- 172.21.15.125:0/4262262784 >> 172.21.15.125:0/4262262784 conn(0x7f2a2c0b1a50 msgr2=0x7f2a2c0b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:36.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.667+0000 7f2a31a00700 1 -- 172.21.15.125:0/4262262784 shutdown_connections 2023-10-17T06:07:36.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.667+0000 7f2a31a00700 1 -- 172.21.15.125:0/4262262784 wait complete. 2023-10-17T06:07:36.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a31a00700 1 Processor -- start 2023-10-17T06:07:36.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a31a00700 1 -- start start 2023-10-17T06:07:36.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a31a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a2c15aa20 0x7f2a2c159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:36.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a31a00700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a2c15e500 0x7f2a2c1fa240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:36.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a31a00700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a2c15e980 0x7f2a2c0b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:36.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a31a00700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c0b5810 con 0x7f2a2c15e500 2023-10-17T06:07:36.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a31a00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c0b3ec0 con 0x7f2a2c15aa20 2023-10-17T06:07:36.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a31a00700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c0b40d0 con 0x7f2a2c15e980 2023-10-17T06:07:36.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a2a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a2c15e500 0x7f2a2c1fa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:36.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a2a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a2c15e500 0x7f2a2c1fa240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48526/0 (socket says 172.21.15.125:48526) 2023-10-17T06:07:36.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a2a7fc700 1 -- 172.21.15.125:0/1921959345 learned_addr learned my addr 172.21.15.125:0/1921959345 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:36.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a2bfff700 1 --2- 172.21.15.125:0/1921959345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a2c15e980 0x7f2a2c0b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:36.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a2affd700 1 --2- 172.21.15.125:0/1921959345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a2c15aa20 0x7f2a2c159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:36.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a2a7fc700 1 -- 172.21.15.125:0/1921959345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a2c15e980 msgr2=0x7f2a2c0b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:36.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a2a7fc700 1 --2- 172.21.15.125:0/1921959345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a2c15e980 0x7f2a2c0b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a2a7fc700 1 -- 172.21.15.125:0/1921959345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a2c15aa20 msgr2=0x7f2a2c159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:36.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a2a7fc700 1 --2- 172.21.15.125:0/1921959345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a2c15aa20 0x7f2a2c159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a2a7fc700 1 -- 172.21.15.125:0/1921959345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a20009570 con 0x7f2a2c15e500 2023-10-17T06:07:36.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a2a7fc700 1 --2- 172.21.15.125:0/1921959345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a2c15e500 0x7f2a2c1fa240 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2a20000c00 tx=0x7f2a20004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:36.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a13fff700 1 -- 172.21.15.125:0/1921959345 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20004590 con 0x7f2a2c15e500 2023-10-17T06:07:36.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a13fff700 1 -- 172.21.15.125:0/1921959345 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2001e070 con 0x7f2a2c15e500 2023-10-17T06:07:36.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a31a00700 1 -- 172.21.15.125:0/1921959345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2c0b43b0 con 0x7f2a2c15e500 2023-10-17T06:07:36.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a13fff700 1 -- 172.21.15.125:0/1921959345 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20003900 con 0x7f2a2c15e500 2023-10-17T06:07:36.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.671+0000 7f2a31a00700 1 -- 172.21.15.125:0/1921959345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2c0b4970 con 0x7f2a2c15e500 2023-10-17T06:07:36.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.675+0000 7f2a31a00700 1 -- 172.21.15.125:0/1921959345 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2c072e60 con 0x7f2a2c15e500 2023-10-17T06:07:36.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.675+0000 7f2a13fff700 1 -- 172.21.15.125:0/1921959345 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2a20003a60 con 0x7f2a2c15e500 2023-10-17T06:07:36.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.679+0000 7f2a13fff700 1 --2- 172.21.15.125:0/1921959345 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2a180656f0 0x7f2a18067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:36.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.679+0000 7f2a13fff700 1 -- 172.21.15.125:0/1921959345 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2a20083b20 con 0x7f2a2c15e500 2023-10-17T06:07:36.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.679+0000 7f2a2affd700 1 --2- 172.21.15.125:0/1921959345 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2a180656f0 0x7f2a18067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:36.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.679+0000 7f2a2affd700 1 --2- 172.21.15.125:0/1921959345 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2a180656f0 0x7f2a18067bb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c1540e0 tx=0x7f2a1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:36.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.683+0000 7f2a13fff700 1 -- 172.21.15.125:0/1921959345 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2a20051400 con 0x7f2a2c15e500 2023-10-17T06:07:36.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.855+0000 7f2a31a00700 1 -- 172.21.15.125:0/1921959345 --> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a2c15b390 con 0x7f2a180656f0 2023-10-17T06:07:36.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.879+0000 7f2a13fff700 1 -- 172.21.15.125:0/1921959345 <== mgr.4107 v2:172.21.15.125:6832/2516570548 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367197 (secure 0 0 0) 0x7f2a1c0096d0 con 0x7f2a180656f0 2023-10-17T06:07:36.886 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:36.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.887+0000 7f2a31a00700 1 -- 172.21.15.125:0/1921959345 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2a180656f0 msgr2=0x7f2a18067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:36.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.887+0000 7f2a31a00700 1 --2- 172.21.15.125:0/1921959345 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2a180656f0 0x7f2a18067bb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c1540e0 tx=0x7f2a1c008040 comp rx=0 tx=0).stop 2023-10-17T06:07:36.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.887+0000 7f2a31a00700 1 -- 172.21.15.125:0/1921959345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a2c15e500 msgr2=0x7f2a2c1fa240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:36.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.887+0000 7f2a31a00700 1 --2- 172.21.15.125:0/1921959345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a2c15e500 0x7f2a2c1fa240 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2a20000c00 tx=0x7f2a20004770 comp rx=0 tx=0).stop 2023-10-17T06:07:36.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.887+0000 7f2a31a00700 1 -- 172.21.15.125:0/1921959345 shutdown_connections 2023-10-17T06:07:36.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.887+0000 7f2a31a00700 1 --2- 172.21.15.125:0/1921959345 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2a180656f0 0x7f2a18067bb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.887+0000 7f2a31a00700 1 --2- 172.21.15.125:0/1921959345 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2a2c15e980 0x7f2a2c0b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.887+0000 7f2a31a00700 1 --2- 172.21.15.125:0/1921959345 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2a2c15e500 0x7f2a2c1fa240 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.887+0000 7f2a31a00700 1 --2- 172.21.15.125:0/1921959345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2a2c15aa20 0x7f2a2c159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:36.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.887+0000 7f2a31a00700 1 -- 172.21.15.125:0/1921959345 >> 172.21.15.125:0/1921959345 conn(0x7f2a2c0b1a50 msgr2=0x7f2a2c15c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:36.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.887+0000 7f2a31a00700 1 -- 172.21.15.125:0/1921959345 shutdown_connections 2023-10-17T06:07:36.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:36.887+0000 7f2a31a00700 1 -- 172.21.15.125:0/1921959345 wait complete. 2023-10-17T06:07:36.892 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-17T06:07:36.911 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-10-17T06:07:35.952630+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219680,"kb_used_data":3524,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755040,"statfs":{"total":773094113280,"available":772869160960,"internally_reserved":0,"allocated":3608576,"data_stored":2164503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005101"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290252+0000","last_change":"2023-10-17T06:07:13.901434+0000","last_active":"2023-10-17T06:07:15.290252+0000","last_peered":"2023-10-17T06:07:15.290252+0000","last_clean":"2023-10-17T06:07:15.290252+0000","last_became_active":"2023-10-17T06:07:13.901040+0000","last_became_peered":"2023-10-17T06:07:13.901040+0000","last_unstale":"2023-10-17T06:07:15.290252+0000","last_undegraded":"2023-10-17T06:07:15.290252+0000","last_fullsized":"2023-10-17T06:07:15.290252+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:36:26.363513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292800+0000","last_change":"2023-10-17T06:07:08.591346+0000","last_active":"2023-10-17T06:07:15.292800+0000","last_peered":"2023-10-17T06:07:15.292800+0000","last_clean":"2023-10-17T06:07:15.292800+0000","last_became_active":"2023-10-17T06:07:08.591043+0000","last_became_peered":"2023-10-17T06:07:08.591043+0000","last_unstale":"2023-10-17T06:07:15.292800+0000","last_undegraded":"2023-10-17T06:07:15.292800+0000","last_fullsized":"2023-10-17T06:07:15.292800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:20.494951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879068+0000","last_change":"2023-10-17T06:07:09.836025+0000","last_active":"2023-10-17T06:07:14.879068+0000","last_peered":"2023-10-17T06:07:14.879068+0000","last_clean":"2023-10-17T06:07:14.879068+0000","last_became_active":"2023-10-17T06:07:09.835767+0000","last_became_peered":"2023-10-17T06:07:09.835767+0000","last_unstale":"2023-10-17T06:07:14.879068+0000","last_undegraded":"2023-10-17T06:07:14.879068+0000","last_fullsized":"2023-10-17T06:07:14.879068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:42:27.021964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878105+0000","last_change":"2023-10-17T06:07:13.895224+0000","last_active":"2023-10-17T06:07:14.878105+0000","last_peered":"2023-10-17T06:07:14.878105+0000","last_clean":"2023-10-17T06:07:14.878105+0000","last_became_active":"2023-10-17T06:07:13.894817+0000","last_became_peered":"2023-10-17T06:07:13.894817+0000","last_unstale":"2023-10-17T06:07:14.878105+0000","last_undegraded":"2023-10-17T06:07:14.878105+0000","last_fullsized":"2023-10-17T06:07:14.878105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:48:43.184952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290660+0000","last_change":"2023-10-17T06:07:08.593335+0000","last_active":"2023-10-17T06:07:15.290660+0000","last_peered":"2023-10-17T06:07:15.290660+0000","last_clean":"2023-10-17T06:07:15.290660+0000","last_became_active":"2023-10-17T06:07:08.592714+0000","last_became_peered":"2023-10-17T06:07:08.592714+0000","last_unstale":"2023-10-17T06:07:15.290660+0000","last_undegraded":"2023-10-17T06:07:15.290660+0000","last_fullsized":"2023-10-17T06:07:15.290660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:19:27.180864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289199+0000","last_change":"2023-10-17T06:07:09.826416+0000","last_active":"2023-10-17T06:07:15.289199+0000","last_peered":"2023-10-17T06:07:15.289199+0000","last_clean":"2023-10-17T06:07:15.289199+0000","last_became_active":"2023-10-17T06:07:09.826166+0000","last_became_peered":"2023-10-17T06:07:09.826166+0000","last_unstale":"2023-10-17T06:07:15.289199+0000","last_undegraded":"2023-10-17T06:07:15.289199+0000","last_fullsized":"2023-10-17T06:07:15.289199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:40:00.062457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883131+0000","last_change":"2023-10-17T06:07:13.882442+0000","last_active":"2023-10-17T06:07:14.883131+0000","last_peered":"2023-10-17T06:07:14.883131+0000","last_clean":"2023-10-17T06:07:14.883131+0000","last_became_active":"2023-10-17T06:07:13.882071+0000","last_became_peered":"2023-10-17T06:07:13.882071+0000","last_unstale":"2023-10-17T06:07:14.883131+0000","last_undegraded":"2023-10-17T06:07:14.883131+0000","last_fullsized":"2023-10-17T06:07:14.883131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:17:23.703090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883798+0000","last_change":"2023-10-17T06:07:08.596020+0000","last_active":"2023-10-17T06:07:14.883798+0000","last_peered":"2023-10-17T06:07:14.883798+0000","last_clean":"2023-10-17T06:07:14.883798+0000","last_became_active":"2023-10-17T06:07:08.595675+0000","last_became_peered":"2023-10-17T06:07:08.595675+0000","last_unstale":"2023-10-17T06:07:14.883798+0000","last_undegraded":"2023-10-17T06:07:14.883798+0000","last_fullsized":"2023-10-17T06:07:14.883798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:49:51.752101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878221+0000","last_change":"2023-10-17T06:07:09.810995+0000","last_active":"2023-10-17T06:07:14.878221+0000","last_peered":"2023-10-17T06:07:14.878221+0000","last_clean":"2023-10-17T06:07:14.878221+0000","last_became_active":"2023-10-17T06:07:09.810703+0000","last_became_peered":"2023-10-17T06:07:09.810703+0000","last_unstale":"2023-10-17T06:07:14.878221+0000","last_undegraded":"2023-10-17T06:07:14.878221+0000","last_fullsized":"2023-10-17T06:07:14.878221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:47:31.281761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876631+0000","last_change":"2023-10-17T06:07:13.895957+0000","last_active":"2023-10-17T06:07:14.876631+0000","last_peered":"2023-10-17T06:07:14.876631+0000","last_clean":"2023-10-17T06:07:14.876631+0000","last_became_active":"2023-10-17T06:07:13.895553+0000","last_became_peered":"2023-10-17T06:07:13.895553+0000","last_unstale":"2023-10-17T06:07:14.876631+0000","last_undegraded":"2023-10-17T06:07:14.876631+0000","last_fullsized":"2023-10-17T06:07:14.876631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:26.493795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883297+0000","last_change":"2023-10-17T06:07:08.596194+0000","last_active":"2023-10-17T06:07:14.883297+0000","last_peered":"2023-10-17T06:07:14.883297+0000","last_clean":"2023-10-17T06:07:14.883297+0000","last_became_active":"2023-10-17T06:07:08.595660+0000","last_became_peered":"2023-10-17T06:07:08.595660+0000","last_unstale":"2023-10-17T06:07:14.883297+0000","last_undegraded":"2023-10-17T06:07:14.883297+0000","last_fullsized":"2023-10-17T06:07:14.883297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:39:59.057172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880325+0000","last_change":"2023-10-17T06:07:09.807993+0000","last_active":"2023-10-17T06:07:14.880325+0000","last_peered":"2023-10-17T06:07:14.880325+0000","last_clean":"2023-10-17T06:07:14.880325+0000","last_became_active":"2023-10-17T06:07:09.807693+0000","last_became_peered":"2023-10-17T06:07:09.807693+0000","last_unstale":"2023-10-17T06:07:14.880325+0000","last_undegraded":"2023-10-17T06:07:14.880325+0000","last_fullsized":"2023-10-17T06:07:14.880325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:35:18.327855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292566+0000","last_change":"2023-10-17T06:07:13.889302+0000","last_active":"2023-10-17T06:07:15.292566+0000","last_peered":"2023-10-17T06:07:15.292566+0000","last_clean":"2023-10-17T06:07:15.292566+0000","last_became_active":"2023-10-17T06:07:13.888782+0000","last_became_peered":"2023-10-17T06:07:13.888782+0000","last_unstale":"2023-10-17T06:07:15.292566+0000","last_undegraded":"2023-10-17T06:07:15.292566+0000","last_fullsized":"2023-10-17T06:07:15.292566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:00:23.332863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292161+0000","last_change":"2023-10-17T06:07:08.594447+0000","last_active":"2023-10-17T06:07:15.292161+0000","last_peered":"2023-10-17T06:07:15.292161+0000","last_clean":"2023-10-17T06:07:15.292161+0000","last_became_active":"2023-10-17T06:07:08.594176+0000","last_became_peered":"2023-10-17T06:07:08.594176+0000","last_unstale":"2023-10-17T06:07:15.292161+0000","last_undegraded":"2023-10-17T06:07:15.292161+0000","last_fullsized":"2023-10-17T06:07:15.292161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:15:03.640415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877356+0000","last_change":"2023-10-17T06:07:09.819893+0000","last_active":"2023-10-17T06:07:14.877356+0000","last_peered":"2023-10-17T06:07:14.877356+0000","last_clean":"2023-10-17T06:07:14.877356+0000","last_became_active":"2023-10-17T06:07:09.819607+0000","last_became_peered":"2023-10-17T06:07:09.819607+0000","last_unstale":"2023-10-17T06:07:14.877356+0000","last_undegraded":"2023-10-17T06:07:14.877356+0000","last_fullsized":"2023-10-17T06:07:14.877356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:21:39.864171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878555+0000","last_change":"2023-10-17T06:07:13.880508+0000","last_active":"2023-10-17T06:07:14.878555+0000","last_peered":"2023-10-17T06:07:14.878555+0000","last_clean":"2023-10-17T06:07:14.878555+0000","last_became_active":"2023-10-17T06:07:13.879917+0000","last_became_peered":"2023-10-17T06:07:13.879917+0000","last_unstale":"2023-10-17T06:07:14.878555+0000","last_undegraded":"2023-10-17T06:07:14.878555+0000","last_fullsized":"2023-10-17T06:07:14.878555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:40:59.144753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878410+0000","last_change":"2023-10-17T06:07:08.588962+0000","last_active":"2023-10-17T06:07:14.878410+0000","last_peered":"2023-10-17T06:07:14.878410+0000","last_clean":"2023-10-17T06:07:14.878410+0000","last_became_active":"2023-10-17T06:07:08.588620+0000","last_became_peered":"2023-10-17T06:07:08.588620+0000","last_unstale":"2023-10-17T06:07:14.878410+0000","last_undegraded":"2023-10-17T06:07:14.878410+0000","last_fullsized":"2023-10-17T06:07:14.878410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:54:25.029489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291108+0000","last_change":"2023-10-17T06:07:09.828789+0000","last_active":"2023-10-17T06:07:15.291108+0000","last_peered":"2023-10-17T06:07:15.291108+0000","last_clean":"2023-10-17T06:07:15.291108+0000","last_became_active":"2023-10-17T06:07:09.828222+0000","last_became_peered":"2023-10-17T06:07:09.828222+0000","last_unstale":"2023-10-17T06:07:15.291108+0000","last_undegraded":"2023-10-17T06:07:15.291108+0000","last_fullsized":"2023-10-17T06:07:15.291108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:40:29.612977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290241+0000","last_change":"2023-10-17T06:07:13.884632+0000","last_active":"2023-10-17T06:07:15.290241+0000","last_peered":"2023-10-17T06:07:15.290241+0000","last_clean":"2023-10-17T06:07:15.290241+0000","last_became_active":"2023-10-17T06:07:13.883506+0000","last_became_peered":"2023-10-17T06:07:13.883506+0000","last_unstale":"2023-10-17T06:07:15.290241+0000","last_undegraded":"2023-10-17T06:07:15.290241+0000","last_fullsized":"2023-10-17T06:07:15.290241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:58:02.371449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291061+0000","last_change":"2023-10-17T06:07:08.596112+0000","last_active":"2023-10-17T06:07:15.291061+0000","last_peered":"2023-10-17T06:07:15.291061+0000","last_clean":"2023-10-17T06:07:15.291061+0000","last_became_active":"2023-10-17T06:07:08.595385+0000","last_became_peered":"2023-10-17T06:07:08.595385+0000","last_unstale":"2023-10-17T06:07:15.291061+0000","last_undegraded":"2023-10-17T06:07:15.291061+0000","last_fullsized":"2023-10-17T06:07:15.291061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:25:55.002475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292431+0000","last_change":"2023-10-17T06:07:09.839412+0000","last_active":"2023-10-17T06:07:15.292431+0000","last_peered":"2023-10-17T06:07:15.292431+0000","last_clean":"2023-10-17T06:07:15.292431+0000","last_became_active":"2023-10-17T06:07:09.838904+0000","last_became_peered":"2023-10-17T06:07:09.838904+0000","last_unstale":"2023-10-17T06:07:15.292431+0000","last_undegraded":"2023-10-17T06:07:15.292431+0000","last_fullsized":"2023-10-17T06:07:15.292431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:19:22.830429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292307+0000","last_change":"2023-10-17T06:07:13.888543+0000","last_active":"2023-10-17T06:07:15.292307+0000","last_peered":"2023-10-17T06:07:15.292307+0000","last_clean":"2023-10-17T06:07:15.292307+0000","last_became_active":"2023-10-17T06:07:13.888176+0000","last_became_peered":"2023-10-17T06:07:13.888176+0000","last_unstale":"2023-10-17T06:07:15.292307+0000","last_undegraded":"2023-10-17T06:07:15.292307+0000","last_fullsized":"2023-10-17T06:07:15.292307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:26.493795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289600+0000","last_change":"2023-10-17T06:07:08.589779+0000","last_active":"2023-10-17T06:07:15.289600+0000","last_peered":"2023-10-17T06:07:15.289600+0000","last_clean":"2023-10-17T06:07:15.289600+0000","last_became_active":"2023-10-17T06:07:08.587389+0000","last_became_peered":"2023-10-17T06:07:08.587389+0000","last_unstale":"2023-10-17T06:07:15.289600+0000","last_undegraded":"2023-10-17T06:07:15.289600+0000","last_fullsized":"2023-10-17T06:07:15.289600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:45:38.247338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290377+0000","last_change":"2023-10-17T06:07:09.824706+0000","last_active":"2023-10-17T06:07:15.290377+0000","last_peered":"2023-10-17T06:07:15.290377+0000","last_clean":"2023-10-17T06:07:15.290377+0000","last_became_active":"2023-10-17T06:07:09.824384+0000","last_became_peered":"2023-10-17T06:07:09.824384+0000","last_unstale":"2023-10-17T06:07:15.290377+0000","last_undegraded":"2023-10-17T06:07:15.290377+0000","last_fullsized":"2023-10-17T06:07:15.290377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:33:14.304674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291416+0000","last_change":"2023-10-17T06:07:09.814976+0000","last_active":"2023-10-17T06:07:15.291416+0000","last_peered":"2023-10-17T06:07:15.291416+0000","last_clean":"2023-10-17T06:07:15.291416+0000","last_became_active":"2023-10-17T06:07:09.814529+0000","last_became_peered":"2023-10-17T06:07:09.814529+0000","last_unstale":"2023-10-17T06:07:15.291416+0000","last_undegraded":"2023-10-17T06:07:15.291416+0000","last_fullsized":"2023-10-17T06:07:15.291416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:48:38.906119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292919+0000","last_change":"2023-10-17T06:07:08.596874+0000","last_active":"2023-10-17T06:07:15.292919+0000","last_peered":"2023-10-17T06:07:15.292919+0000","last_clean":"2023-10-17T06:07:15.292919+0000","last_became_active":"2023-10-17T06:07:08.596349+0000","last_became_peered":"2023-10-17T06:07:08.596349+0000","last_unstale":"2023-10-17T06:07:15.292919+0000","last_undegraded":"2023-10-17T06:07:15.292919+0000","last_fullsized":"2023-10-17T06:07:15.292919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:37:33.810500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289117+0000","last_change":"2023-10-17T06:07:13.888460+0000","last_active":"2023-10-17T06:07:15.289117+0000","last_peered":"2023-10-17T06:07:15.289117+0000","last_clean":"2023-10-17T06:07:15.289117+0000","last_became_active":"2023-10-17T06:07:13.887943+0000","last_became_peered":"2023-10-17T06:07:13.887943+0000","last_unstale":"2023-10-17T06:07:15.289117+0000","last_undegraded":"2023-10-17T06:07:15.289117+0000","last_fullsized":"2023-10-17T06:07:15.289117+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:33:38.048460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.288908+0000","last_change":"2023-10-17T06:07:09.823031+0000","last_active":"2023-10-17T06:07:15.288908+0000","last_peered":"2023-10-17T06:07:15.288908+0000","last_clean":"2023-10-17T06:07:15.288908+0000","last_became_active":"2023-10-17T06:07:09.821733+0000","last_became_peered":"2023-10-17T06:07:09.821733+0000","last_unstale":"2023-10-17T06:07:15.288908+0000","last_undegraded":"2023-10-17T06:07:15.288908+0000","last_fullsized":"2023-10-17T06:07:15.288908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:38.659545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883705+0000","last_change":"2023-10-17T06:07:08.588590+0000","last_active":"2023-10-17T06:07:14.883705+0000","last_peered":"2023-10-17T06:07:14.883705+0000","last_clean":"2023-10-17T06:07:14.883705+0000","last_became_active":"2023-10-17T06:07:08.587376+0000","last_became_peered":"2023-10-17T06:07:08.587376+0000","last_unstale":"2023-10-17T06:07:14.883705+0000","last_undegraded":"2023-10-17T06:07:14.883705+0000","last_fullsized":"2023-10-17T06:07:14.883705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:19:27.180864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876041+0000","last_change":"2023-10-17T06:07:13.890283+0000","last_active":"2023-10-17T06:07:14.876041+0000","last_peered":"2023-10-17T06:07:14.876041+0000","last_clean":"2023-10-17T06:07:14.876041+0000","last_became_active":"2023-10-17T06:07:13.889919+0000","last_became_peered":"2023-10-17T06:07:13.889919+0000","last_unstale":"2023-10-17T06:07:14.876041+0000","last_undegraded":"2023-10-17T06:07:14.876041+0000","last_fullsized":"2023-10-17T06:07:14.876041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:37:49.339156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877482+0000","last_change":"2023-10-17T06:07:08.600096+0000","last_active":"2023-10-17T06:07:14.877482+0000","last_peered":"2023-10-17T06:07:14.877482+0000","last_clean":"2023-10-17T06:07:14.877482+0000","last_became_active":"2023-10-17T06:07:08.599786+0000","last_became_peered":"2023-10-17T06:07:08.599786+0000","last_unstale":"2023-10-17T06:07:14.877482+0000","last_undegraded":"2023-10-17T06:07:14.877482+0000","last_fullsized":"2023-10-17T06:07:14.877482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:37:33.810500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290765+0000","last_change":"2023-10-17T06:07:09.827852+0000","last_active":"2023-10-17T06:07:15.290765+0000","last_peered":"2023-10-17T06:07:15.290765+0000","last_clean":"2023-10-17T06:07:15.290765+0000","last_became_active":"2023-10-17T06:07:09.827571+0000","last_became_peered":"2023-10-17T06:07:09.827571+0000","last_unstale":"2023-10-17T06:07:15.290765+0000","last_undegraded":"2023-10-17T06:07:15.290765+0000","last_fullsized":"2023-10-17T06:07:15.290765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:53:34.063175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289369+0000","last_change":"2023-10-17T06:07:13.888236+0000","last_active":"2023-10-17T06:07:15.289369+0000","last_peered":"2023-10-17T06:07:15.289369+0000","last_clean":"2023-10-17T06:07:15.289369+0000","last_became_active":"2023-10-17T06:07:13.887862+0000","last_became_peered":"2023-10-17T06:07:13.887862+0000","last_unstale":"2023-10-17T06:07:15.289369+0000","last_undegraded":"2023-10-17T06:07:15.289369+0000","last_fullsized":"2023-10-17T06:07:15.289369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:39:43.311635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:26.389600+0000","last_change":"2023-10-17T06:07:08.585396+0000","last_active":"2023-10-17T06:07:26.389600+0000","last_peered":"2023-10-17T06:07:26.389600+0000","last_clean":"2023-10-17T06:07:26.389600+0000","last_became_active":"2023-10-17T06:07:08.585072+0000","last_became_peered":"2023-10-17T06:07:08.585072+0000","last_unstale":"2023-10-17T06:07:26.389600+0000","last_undegraded":"2023-10-17T06:07:26.389600+0000","last_fullsized":"2023-10-17T06:07:26.389600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:45:24.700330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880432+0000","last_change":"2023-10-17T06:07:09.821236+0000","last_active":"2023-10-17T06:07:14.880432+0000","last_peered":"2023-10-17T06:07:14.880432+0000","last_clean":"2023-10-17T06:07:14.880432+0000","last_became_active":"2023-10-17T06:07:09.820316+0000","last_became_peered":"2023-10-17T06:07:09.820316+0000","last_unstale":"2023-10-17T06:07:14.880432+0000","last_undegraded":"2023-10-17T06:07:14.880432+0000","last_fullsized":"2023-10-17T06:07:14.880432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:57:46.498866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290002+0000","last_change":"2023-10-17T06:07:13.889504+0000","last_active":"2023-10-17T06:07:15.290002+0000","last_peered":"2023-10-17T06:07:15.290002+0000","last_clean":"2023-10-17T06:07:15.290002+0000","last_became_active":"2023-10-17T06:07:13.889086+0000","last_became_peered":"2023-10-17T06:07:13.889086+0000","last_unstale":"2023-10-17T06:07:15.290002+0000","last_undegraded":"2023-10-17T06:07:15.290002+0000","last_fullsized":"2023-10-17T06:07:15.290002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:11:54.644012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880973+0000","last_change":"2023-10-17T06:07:09.808679+0000","last_active":"2023-10-17T06:07:14.880973+0000","last_peered":"2023-10-17T06:07:14.880973+0000","last_clean":"2023-10-17T06:07:14.880973+0000","last_became_active":"2023-10-17T06:07:09.808378+0000","last_became_peered":"2023-10-17T06:07:09.808378+0000","last_unstale":"2023-10-17T06:07:14.880973+0000","last_undegraded":"2023-10-17T06:07:14.880973+0000","last_fullsized":"2023-10-17T06:07:14.880973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:25:25.772710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290420+0000","last_change":"2023-10-17T06:07:02.749481+0000","last_active":"2023-10-17T06:07:15.290420+0000","last_peered":"2023-10-17T06:07:15.290420+0000","last_clean":"2023-10-17T06:07:15.290420+0000","last_became_active":"2023-10-17T06:07:02.748983+0000","last_became_peered":"2023-10-17T06:07:02.748983+0000","last_unstale":"2023-10-17T06:07:15.290420+0000","last_undegraded":"2023-10-17T06:07:15.290420+0000","last_fullsized":"2023-10-17T06:07:15.290420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:52.302673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292851+0000","last_change":"2023-10-17T06:07:08.590018+0000","last_active":"2023-10-17T06:07:15.292851+0000","last_peered":"2023-10-17T06:07:15.292851+0000","last_clean":"2023-10-17T06:07:15.292851+0000","last_became_active":"2023-10-17T06:07:08.589795+0000","last_became_peered":"2023-10-17T06:07:08.589795+0000","last_unstale":"2023-10-17T06:07:15.292851+0000","last_undegraded":"2023-10-17T06:07:15.292851+0000","last_fullsized":"2023-10-17T06:07:15.292851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:36:10.482323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.288777+0000","last_change":"2023-10-17T06:07:13.896667+0000","last_active":"2023-10-17T06:07:15.288777+0000","last_peered":"2023-10-17T06:07:15.288777+0000","last_clean":"2023-10-17T06:07:15.288777+0000","last_became_active":"2023-10-17T06:07:13.896149+0000","last_became_peered":"2023-10-17T06:07:13.896149+0000","last_unstale":"2023-10-17T06:07:15.288777+0000","last_undegraded":"2023-10-17T06:07:15.288777+0000","last_fullsized":"2023-10-17T06:07:15.288777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:11:10.074323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289308+0000","last_change":"2023-10-17T06:07:09.822567+0000","last_active":"2023-10-17T06:07:15.289308+0000","last_peered":"2023-10-17T06:07:15.289308+0000","last_clean":"2023-10-17T06:07:15.289308+0000","last_became_active":"2023-10-17T06:07:09.822127+0000","last_became_peered":"2023-10-17T06:07:09.822127+0000","last_unstale":"2023-10-17T06:07:15.289308+0000","last_undegraded":"2023-10-17T06:07:15.289308+0000","last_fullsized":"2023-10-17T06:07:15.289308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:34:10.878608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292896+0000","last_change":"2023-10-17T06:07:02.746809+0000","last_active":"2023-10-17T06:07:15.292896+0000","last_peered":"2023-10-17T06:07:15.292896+0000","last_clean":"2023-10-17T06:07:15.292896+0000","last_became_active":"2023-10-17T06:07:02.746404+0000","last_became_peered":"2023-10-17T06:07:02.746404+0000","last_unstale":"2023-10-17T06:07:15.292896+0000","last_undegraded":"2023-10-17T06:07:15.292896+0000","last_fullsized":"2023-10-17T06:07:15.292896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:31.812798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291815+0000","last_change":"2023-10-17T06:07:08.592911+0000","last_active":"2023-10-17T06:07:15.291815+0000","last_peered":"2023-10-17T06:07:15.291815+0000","last_clean":"2023-10-17T06:07:15.291815+0000","last_became_active":"2023-10-17T06:07:08.592015+0000","last_became_peered":"2023-10-17T06:07:08.592015+0000","last_unstale":"2023-10-17T06:07:15.291815+0000","last_undegraded":"2023-10-17T06:07:15.291815+0000","last_fullsized":"2023-10-17T06:07:15.291815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:47:30.276476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880688+0000","last_change":"2023-10-17T06:07:13.886563+0000","last_active":"2023-10-17T06:07:14.880688+0000","last_peered":"2023-10-17T06:07:14.880688+0000","last_clean":"2023-10-17T06:07:14.880688+0000","last_became_active":"2023-10-17T06:07:13.885937+0000","last_became_peered":"2023-10-17T06:07:13.885937+0000","last_unstale":"2023-10-17T06:07:14.880688+0000","last_undegraded":"2023-10-17T06:07:14.880688+0000","last_fullsized":"2023-10-17T06:07:14.880688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:16:52.713610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292036+0000","last_change":"2023-10-17T06:07:09.828851+0000","last_active":"2023-10-17T06:07:15.292036+0000","last_peered":"2023-10-17T06:07:15.292036+0000","last_clean":"2023-10-17T06:07:15.292036+0000","last_became_active":"2023-10-17T06:07:09.828580+0000","last_became_peered":"2023-10-17T06:07:09.828580+0000","last_unstale":"2023-10-17T06:07:15.292036+0000","last_undegraded":"2023-10-17T06:07:15.292036+0000","last_fullsized":"2023-10-17T06:07:15.292036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:37:45.060322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878005+0000","last_change":"2023-10-17T06:07:02.943274+0000","last_active":"2023-10-17T06:07:14.878005+0000","last_peered":"2023-10-17T06:07:14.878005+0000","last_clean":"2023-10-17T06:07:14.878005+0000","last_became_active":"2023-10-17T06:07:02.942674+0000","last_became_peered":"2023-10-17T06:07:02.942674+0000","last_unstale":"2023-10-17T06:07:14.878005+0000","last_undegraded":"2023-10-17T06:07:14.878005+0000","last_fullsized":"2023-10-17T06:07:14.878005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:15:10.401039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291849+0000","last_change":"2023-10-17T06:07:08.589251+0000","last_active":"2023-10-17T06:07:15.291849+0000","last_peered":"2023-10-17T06:07:15.291849+0000","last_clean":"2023-10-17T06:07:15.291849+0000","last_became_active":"2023-10-17T06:07:08.588935+0000","last_became_peered":"2023-10-17T06:07:08.588935+0000","last_unstale":"2023-10-17T06:07:15.291849+0000","last_undegraded":"2023-10-17T06:07:15.291849+0000","last_fullsized":"2023-10-17T06:07:15.291849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:12:42.498064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289409+0000","last_change":"2023-10-17T06:07:13.878939+0000","last_active":"2023-10-17T06:07:15.289409+0000","last_peered":"2023-10-17T06:07:15.289409+0000","last_clean":"2023-10-17T06:07:15.289409+0000","last_became_active":"2023-10-17T06:07:13.878486+0000","last_became_peered":"2023-10-17T06:07:13.878486+0000","last_unstale":"2023-10-17T06:07:15.289409+0000","last_undegraded":"2023-10-17T06:07:15.289409+0000","last_fullsized":"2023-10-17T06:07:15.289409+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:56.529454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291030+0000","last_change":"2023-10-17T06:07:09.811823+0000","last_active":"2023-10-17T06:07:15.291030+0000","last_peered":"2023-10-17T06:07:15.291030+0000","last_clean":"2023-10-17T06:07:15.291030+0000","last_became_active":"2023-10-17T06:07:09.811377+0000","last_became_peered":"2023-10-17T06:07:09.811377+0000","last_unstale":"2023-10-17T06:07:15.291030+0000","last_undegraded":"2023-10-17T06:07:15.291030+0000","last_fullsized":"2023-10-17T06:07:15.291030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:40:59.235159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292614+0000","last_change":"2023-10-17T06:07:02.943009+0000","last_active":"2023-10-17T06:07:15.292614+0000","last_peered":"2023-10-17T06:07:15.292614+0000","last_clean":"2023-10-17T06:07:15.292614+0000","last_became_active":"2023-10-17T06:07:02.942298+0000","last_became_peered":"2023-10-17T06:07:02.942298+0000","last_unstale":"2023-10-17T06:07:15.292614+0000","last_undegraded":"2023-10-17T06:07:15.292614+0000","last_fullsized":"2023-10-17T06:07:15.292614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:50:16.016660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883796+0000","last_change":"2023-10-17T06:07:08.593524+0000","last_active":"2023-10-17T06:07:14.883796+0000","last_peered":"2023-10-17T06:07:14.883796+0000","last_clean":"2023-10-17T06:07:14.883796+0000","last_became_active":"2023-10-17T06:07:08.593028+0000","last_became_peered":"2023-10-17T06:07:08.593028+0000","last_unstale":"2023-10-17T06:07:14.883796+0000","last_undegraded":"2023-10-17T06:07:14.883796+0000","last_fullsized":"2023-10-17T06:07:14.883796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:40:28.607693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291886+0000","last_change":"2023-10-17T06:07:13.894885+0000","last_active":"2023-10-17T06:07:15.291886+0000","last_peered":"2023-10-17T06:07:15.291886+0000","last_clean":"2023-10-17T06:07:15.291886+0000","last_became_active":"2023-10-17T06:07:13.894293+0000","last_became_peered":"2023-10-17T06:07:13.894293+0000","last_unstale":"2023-10-17T06:07:15.291886+0000","last_undegraded":"2023-10-17T06:07:15.291886+0000","last_fullsized":"2023-10-17T06:07:15.291886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:35.048426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291587+0000","last_change":"2023-10-17T06:07:09.821864+0000","last_active":"2023-10-17T06:07:15.291587+0000","last_peered":"2023-10-17T06:07:15.291587+0000","last_clean":"2023-10-17T06:07:15.291587+0000","last_became_active":"2023-10-17T06:07:09.821343+0000","last_became_peered":"2023-10-17T06:07:09.821343+0000","last_unstale":"2023-10-17T06:07:15.291587+0000","last_undegraded":"2023-10-17T06:07:15.291587+0000","last_fullsized":"2023-10-17T06:07:15.291587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:34:13.301999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880514+0000","last_change":"2023-10-17T06:07:08.599322+0000","last_active":"2023-10-17T06:07:14.880514+0000","last_peered":"2023-10-17T06:07:14.880514+0000","last_clean":"2023-10-17T06:07:14.880514+0000","last_became_active":"2023-10-17T06:07:08.598993+0000","last_became_peered":"2023-10-17T06:07:08.598993+0000","last_unstale":"2023-10-17T06:07:14.880514+0000","last_undegraded":"2023-10-17T06:07:14.880514+0000","last_fullsized":"2023-10-17T06:07:14.880514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:58:22.441442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883204+0000","last_change":"2023-10-17T06:07:02.747287+0000","last_active":"2023-10-17T06:07:14.883204+0000","last_peered":"2023-10-17T06:07:14.883204+0000","last_clean":"2023-10-17T06:07:14.883204+0000","last_became_active":"2023-10-17T06:07:02.746659+0000","last_became_peered":"2023-10-17T06:07:02.746659+0000","last_unstale":"2023-10-17T06:07:14.883204+0000","last_undegraded":"2023-10-17T06:07:14.883204+0000","last_fullsized":"2023-10-17T06:07:14.883204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:10:58.948743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292088+0000","last_change":"2023-10-17T06:07:13.889327+0000","last_active":"2023-10-17T06:07:15.292088+0000","last_peered":"2023-10-17T06:07:15.292088+0000","last_clean":"2023-10-17T06:07:15.292088+0000","last_became_active":"2023-10-17T06:07:13.888985+0000","last_became_peered":"2023-10-17T06:07:13.888985+0000","last_unstale":"2023-10-17T06:07:15.292088+0000","last_undegraded":"2023-10-17T06:07:15.292088+0000","last_fullsized":"2023-10-17T06:07:15.292088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:37.345075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292956+0000","last_change":"2023-10-17T06:07:09.831976+0000","last_active":"2023-10-17T06:07:15.292956+0000","last_peered":"2023-10-17T06:07:15.292956+0000","last_clean":"2023-10-17T06:07:15.292956+0000","last_became_active":"2023-10-17T06:07:09.831699+0000","last_became_peered":"2023-10-17T06:07:09.831699+0000","last_unstale":"2023-10-17T06:07:15.292956+0000","last_undegraded":"2023-10-17T06:07:15.292956+0000","last_fullsized":"2023-10-17T06:07:15.292956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:34:10.878608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290153+0000","last_change":"2023-10-17T06:07:08.590078+0000","last_active":"2023-10-17T06:07:15.290153+0000","last_peered":"2023-10-17T06:07:15.290153+0000","last_clean":"2023-10-17T06:07:15.290153+0000","last_became_active":"2023-10-17T06:07:08.589804+0000","last_became_peered":"2023-10-17T06:07:08.589804+0000","last_unstale":"2023-10-17T06:07:15.290153+0000","last_undegraded":"2023-10-17T06:07:15.290153+0000","last_fullsized":"2023-10-17T06:07:15.290153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:31:11.288698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876702+0000","last_change":"2023-10-17T06:07:02.746785+0000","last_active":"2023-10-17T06:07:14.876702+0000","last_peered":"2023-10-17T06:07:14.876702+0000","last_clean":"2023-10-17T06:07:14.876702+0000","last_became_active":"2023-10-17T06:07:02.746431+0000","last_became_peered":"2023-10-17T06:07:02.746431+0000","last_unstale":"2023-10-17T06:07:14.876702+0000","last_undegraded":"2023-10-17T06:07:14.876702+0000","last_fullsized":"2023-10-17T06:07:14.876702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:47:53.439829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877694+0000","last_change":"2023-10-17T06:07:13.894877+0000","last_active":"2023-10-17T06:07:14.877694+0000","last_peered":"2023-10-17T06:07:14.877694+0000","last_clean":"2023-10-17T06:07:14.877694+0000","last_became_active":"2023-10-17T06:07:13.894391+0000","last_became_peered":"2023-10-17T06:07:13.894391+0000","last_unstale":"2023-10-17T06:07:14.877694+0000","last_undegraded":"2023-10-17T06:07:14.877694+0000","last_fullsized":"2023-10-17T06:07:14.877694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:38:55.951805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292434+0000","last_change":"2023-10-17T06:07:09.833782+0000","last_active":"2023-10-17T06:07:15.292434+0000","last_peered":"2023-10-17T06:07:15.292434+0000","last_clean":"2023-10-17T06:07:15.292434+0000","last_became_active":"2023-10-17T06:07:09.833566+0000","last_became_peered":"2023-10-17T06:07:09.833566+0000","last_unstale":"2023-10-17T06:07:15.292434+0000","last_undegraded":"2023-10-17T06:07:15.292434+0000","last_fullsized":"2023-10-17T06:07:15.292434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:16:06.764453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290341+0000","last_change":"2023-10-17T06:07:08.594763+0000","last_active":"2023-10-17T06:07:15.290341+0000","last_peered":"2023-10-17T06:07:15.290341+0000","last_clean":"2023-10-17T06:07:15.290341+0000","last_became_active":"2023-10-17T06:07:08.594251+0000","last_became_peered":"2023-10-17T06:07:08.594251+0000","last_unstale":"2023-10-17T06:07:15.290341+0000","last_undegraded":"2023-10-17T06:07:15.290341+0000","last_fullsized":"2023-10-17T06:07:15.290341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:27:17.766731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876827+0000","last_change":"2023-10-17T06:07:02.746953+0000","last_active":"2023-10-17T06:07:14.876827+0000","last_peered":"2023-10-17T06:07:14.876827+0000","last_clean":"2023-10-17T06:07:14.876827+0000","last_became_active":"2023-10-17T06:07:02.746344+0000","last_became_peered":"2023-10-17T06:07:02.746344+0000","last_unstale":"2023-10-17T06:07:14.876827+0000","last_undegraded":"2023-10-17T06:07:14.876827+0000","last_fullsized":"2023-10-17T06:07:14.876827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:30:18.210606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883947+0000","last_change":"2023-10-17T06:07:13.893870+0000","last_active":"2023-10-17T06:07:14.883947+0000","last_peered":"2023-10-17T06:07:14.883947+0000","last_clean":"2023-10-17T06:07:14.883947+0000","last_became_active":"2023-10-17T06:07:13.893268+0000","last_became_peered":"2023-10-17T06:07:13.893268+0000","last_unstale":"2023-10-17T06:07:14.883947+0000","last_undegraded":"2023-10-17T06:07:14.883947+0000","last_fullsized":"2023-10-17T06:07:14.883947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:48:43.184952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289977+0000","last_change":"2023-10-17T06:07:09.822737+0000","last_active":"2023-10-17T06:07:15.289977+0000","last_peered":"2023-10-17T06:07:15.289977+0000","last_clean":"2023-10-17T06:07:15.289977+0000","last_became_active":"2023-10-17T06:07:09.822425+0000","last_became_peered":"2023-10-17T06:07:09.822425+0000","last_unstale":"2023-10-17T06:07:15.289977+0000","last_undegraded":"2023-10-17T06:07:15.289977+0000","last_fullsized":"2023-10-17T06:07:15.289977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:56:42.475703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291869+0000","last_change":"2023-10-17T06:07:08.593933+0000","last_active":"2023-10-17T06:07:15.291869+0000","last_peered":"2023-10-17T06:07:15.291869+0000","last_clean":"2023-10-17T06:07:15.291869+0000","last_became_active":"2023-10-17T06:07:08.593639+0000","last_became_peered":"2023-10-17T06:07:08.593639+0000","last_unstale":"2023-10-17T06:07:15.291869+0000","last_undegraded":"2023-10-17T06:07:15.291869+0000","last_fullsized":"2023-10-17T06:07:15.291869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:54:25.029489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883311+0000","last_change":"2023-10-17T06:07:02.747957+0000","last_active":"2023-10-17T06:07:14.883311+0000","last_peered":"2023-10-17T06:07:14.883311+0000","last_clean":"2023-10-17T06:07:14.883311+0000","last_became_active":"2023-10-17T06:07:02.747569+0000","last_became_peered":"2023-10-17T06:07:02.747569+0000","last_unstale":"2023-10-17T06:07:14.883311+0000","last_undegraded":"2023-10-17T06:07:14.883311+0000","last_fullsized":"2023-10-17T06:07:14.883311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:34:04.031861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876594+0000","last_change":"2023-10-17T06:06:55.916050+0000","last_active":"2023-10-17T06:07:14.876594+0000","last_peered":"2023-10-17T06:07:14.876594+0000","last_clean":"2023-10-17T06:07:14.876594+0000","last_became_active":"2023-10-17T06:06:55.914009+0000","last_became_peered":"2023-10-17T06:06:55.914009+0000","last_unstale":"2023-10-17T06:07:14.876594+0000","last_undegraded":"2023-10-17T06:07:14.876594+0000","last_fullsized":"2023-10-17T06:07:14.876594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:06:54.658926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:06:54.658926+0000","last_clean_scrub_stamp":"2023-10-17T06:06:54.658926+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:14:50.752002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877158+0000","last_change":"2023-10-17T06:07:13.894679+0000","last_active":"2023-10-17T06:07:14.877158+0000","last_peered":"2023-10-17T06:07:14.877158+0000","last_clean":"2023-10-17T06:07:14.877158+0000","last_became_active":"2023-10-17T06:07:13.894264+0000","last_became_peered":"2023-10-17T06:07:13.894264+0000","last_unstale":"2023-10-17T06:07:14.877158+0000","last_undegraded":"2023-10-17T06:07:14.877158+0000","last_fullsized":"2023-10-17T06:07:14.877158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:59:46.899748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292942+0000","last_change":"2023-10-17T06:07:09.820803+0000","last_active":"2023-10-17T06:07:15.292942+0000","last_peered":"2023-10-17T06:07:15.292942+0000","last_clean":"2023-10-17T06:07:15.292942+0000","last_became_active":"2023-10-17T06:07:09.820566+0000","last_became_peered":"2023-10-17T06:07:09.820566+0000","last_unstale":"2023-10-17T06:07:15.292942+0000","last_undegraded":"2023-10-17T06:07:15.292942+0000","last_fullsized":"2023-10-17T06:07:15.292942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:40:00.062457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289860+0000","last_change":"2023-10-17T06:07:08.589080+0000","last_active":"2023-10-17T06:07:15.289860+0000","last_peered":"2023-10-17T06:07:15.289860+0000","last_clean":"2023-10-17T06:07:15.289860+0000","last_became_active":"2023-10-17T06:07:08.588709+0000","last_became_peered":"2023-10-17T06:07:08.588709+0000","last_unstale":"2023-10-17T06:07:15.289860+0000","last_undegraded":"2023-10-17T06:07:15.289860+0000","last_fullsized":"2023-10-17T06:07:15.289860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:53:36.421259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879485+0000","last_change":"2023-10-17T06:07:13.886705+0000","last_active":"2023-10-17T06:07:14.879485+0000","last_peered":"2023-10-17T06:07:14.879485+0000","last_clean":"2023-10-17T06:07:14.879485+0000","last_became_active":"2023-10-17T06:07:13.883384+0000","last_became_peered":"2023-10-17T06:07:13.883384+0000","last_unstale":"2023-10-17T06:07:14.879485+0000","last_undegraded":"2023-10-17T06:07:14.879485+0000","last_fullsized":"2023-10-17T06:07:14.879485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:52:08.295905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879605+0000","last_change":"2023-10-17T06:07:09.829835+0000","last_active":"2023-10-17T06:07:14.879605+0000","last_peered":"2023-10-17T06:07:14.879605+0000","last_clean":"2023-10-17T06:07:14.879605+0000","last_became_active":"2023-10-17T06:07:09.829477+0000","last_became_peered":"2023-10-17T06:07:09.829477+0000","last_unstale":"2023-10-17T06:07:14.879605+0000","last_undegraded":"2023-10-17T06:07:14.879605+0000","last_fullsized":"2023-10-17T06:07:14.879605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:54:26.203860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880973+0000","last_change":"2023-10-17T06:07:08.598286+0000","last_active":"2023-10-17T06:07:14.880973+0000","last_peered":"2023-10-17T06:07:14.880973+0000","last_clean":"2023-10-17T06:07:14.880973+0000","last_became_active":"2023-10-17T06:07:08.596247+0000","last_became_peered":"2023-10-17T06:07:08.596247+0000","last_unstale":"2023-10-17T06:07:14.880973+0000","last_undegraded":"2023-10-17T06:07:14.880973+0000","last_fullsized":"2023-10-17T06:07:14.880973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:17.909670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883786+0000","last_change":"2023-10-17T06:07:13.881124+0000","last_active":"2023-10-17T06:07:14.883786+0000","last_peered":"2023-10-17T06:07:14.883786+0000","last_clean":"2023-10-17T06:07:14.883786+0000","last_became_active":"2023-10-17T06:07:13.880566+0000","last_became_peered":"2023-10-17T06:07:13.880566+0000","last_unstale":"2023-10-17T06:07:14.883786+0000","last_undegraded":"2023-10-17T06:07:14.883786+0000","last_fullsized":"2023-10-17T06:07:14.883786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:40:21.126507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879496+0000","last_change":"2023-10-17T06:07:09.813992+0000","last_active":"2023-10-17T06:07:14.879496+0000","last_peered":"2023-10-17T06:07:14.879496+0000","last_clean":"2023-10-17T06:07:14.879496+0000","last_became_active":"2023-10-17T06:07:09.813694+0000","last_became_peered":"2023-10-17T06:07:09.813694+0000","last_unstale":"2023-10-17T06:07:14.879496+0000","last_undegraded":"2023-10-17T06:07:14.879496+0000","last_fullsized":"2023-10-17T06:07:14.879496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:47:35.627253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290037+0000","last_change":"2023-10-17T06:07:08.596976+0000","last_active":"2023-10-17T06:07:15.290037+0000","last_peered":"2023-10-17T06:07:15.290037+0000","last_clean":"2023-10-17T06:07:15.290037+0000","last_became_active":"2023-10-17T06:07:08.596039+0000","last_became_peered":"2023-10-17T06:07:08.596039+0000","last_unstale":"2023-10-17T06:07:15.290037+0000","last_undegraded":"2023-10-17T06:07:15.290037+0000","last_fullsized":"2023-10-17T06:07:15.290037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:38:51.815549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292604+0000","last_change":"2023-10-17T06:07:13.903277+0000","last_active":"2023-10-17T06:07:15.292604+0000","last_peered":"2023-10-17T06:07:15.292604+0000","last_clean":"2023-10-17T06:07:15.292604+0000","last_became_active":"2023-10-17T06:07:13.902862+0000","last_became_peered":"2023-10-17T06:07:13.902862+0000","last_unstale":"2023-10-17T06:07:15.292604+0000","last_undegraded":"2023-10-17T06:07:15.292604+0000","last_fullsized":"2023-10-17T06:07:15.292604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:10:38.378978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878801+0000","last_change":"2023-10-17T06:07:09.810979+0000","last_active":"2023-10-17T06:07:14.878801+0000","last_peered":"2023-10-17T06:07:14.878801+0000","last_clean":"2023-10-17T06:07:14.878801+0000","last_became_active":"2023-10-17T06:07:09.810707+0000","last_became_peered":"2023-10-17T06:07:09.810707+0000","last_unstale":"2023-10-17T06:07:14.878801+0000","last_undegraded":"2023-10-17T06:07:14.878801+0000","last_fullsized":"2023-10-17T06:07:14.878801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:27:20.376471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290069+0000","last_change":"2023-10-17T06:07:08.597403+0000","last_active":"2023-10-17T06:07:15.290069+0000","last_peered":"2023-10-17T06:07:15.290069+0000","last_clean":"2023-10-17T06:07:15.290069+0000","last_became_active":"2023-10-17T06:07:08.597116+0000","last_became_peered":"2023-10-17T06:07:08.597116+0000","last_unstale":"2023-10-17T06:07:15.290069+0000","last_undegraded":"2023-10-17T06:07:15.290069+0000","last_fullsized":"2023-10-17T06:07:15.290069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:47:26.508182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877174+0000","last_change":"2023-10-17T06:07:13.886903+0000","last_active":"2023-10-17T06:07:14.877174+0000","last_peered":"2023-10-17T06:07:14.877174+0000","last_clean":"2023-10-17T06:07:14.877174+0000","last_became_active":"2023-10-17T06:07:13.886501+0000","last_became_peered":"2023-10-17T06:07:13.886501+0000","last_unstale":"2023-10-17T06:07:14.877174+0000","last_undegraded":"2023-10-17T06:07:14.877174+0000","last_fullsized":"2023-10-17T06:07:14.877174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:31:21.259203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291890+0000","last_change":"2023-10-17T06:07:09.832883+0000","last_active":"2023-10-17T06:07:15.291890+0000","last_peered":"2023-10-17T06:07:15.291890+0000","last_clean":"2023-10-17T06:07:15.291890+0000","last_became_active":"2023-10-17T06:07:09.832553+0000","last_became_peered":"2023-10-17T06:07:09.832553+0000","last_unstale":"2023-10-17T06:07:15.291890+0000","last_undegraded":"2023-10-17T06:07:15.291890+0000","last_fullsized":"2023-10-17T06:07:15.291890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:55:00.304360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883483+0000","last_change":"2023-10-17T06:07:08.593403+0000","last_active":"2023-10-17T06:07:14.883483+0000","last_peered":"2023-10-17T06:07:14.883483+0000","last_clean":"2023-10-17T06:07:14.883483+0000","last_became_active":"2023-10-17T06:07:08.593066+0000","last_became_peered":"2023-10-17T06:07:08.593066+0000","last_unstale":"2023-10-17T06:07:14.883483+0000","last_undegraded":"2023-10-17T06:07:14.883483+0000","last_fullsized":"2023-10-17T06:07:14.883483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:30.456365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877086+0000","last_change":"2023-10-17T06:07:13.884346+0000","last_active":"2023-10-17T06:07:14.877086+0000","last_peered":"2023-10-17T06:07:14.877086+0000","last_clean":"2023-10-17T06:07:14.877086+0000","last_became_active":"2023-10-17T06:07:13.883456+0000","last_became_peered":"2023-10-17T06:07:13.883456+0000","last_unstale":"2023-10-17T06:07:14.877086+0000","last_undegraded":"2023-10-17T06:07:14.877086+0000","last_fullsized":"2023-10-17T06:07:14.877086+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:21:45.506386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289623+0000","last_change":"2023-10-17T06:07:09.830493+0000","last_active":"2023-10-17T06:07:15.289623+0000","last_peered":"2023-10-17T06:07:15.289623+0000","last_clean":"2023-10-17T06:07:15.289623+0000","last_became_active":"2023-10-17T06:07:09.830215+0000","last_became_peered":"2023-10-17T06:07:09.830215+0000","last_unstale":"2023-10-17T06:07:15.289623+0000","last_undegraded":"2023-10-17T06:07:15.289623+0000","last_fullsized":"2023-10-17T06:07:15.289623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:16:55.493821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877695+0000","last_change":"2023-10-17T06:07:08.591482+0000","last_active":"2023-10-17T06:07:14.877695+0000","last_peered":"2023-10-17T06:07:14.877695+0000","last_clean":"2023-10-17T06:07:14.877695+0000","last_became_active":"2023-10-17T06:07:08.591091+0000","last_became_peered":"2023-10-17T06:07:08.591091+0000","last_unstale":"2023-10-17T06:07:14.877695+0000","last_undegraded":"2023-10-17T06:07:14.877695+0000","last_fullsized":"2023-10-17T06:07:14.877695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:37:06.939408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876853+0000","last_change":"2023-10-17T06:07:13.888286+0000","last_active":"2023-10-17T06:07:14.876853+0000","last_peered":"2023-10-17T06:07:14.876853+0000","last_clean":"2023-10-17T06:07:14.876853+0000","last_became_active":"2023-10-17T06:07:13.887859+0000","last_became_peered":"2023-10-17T06:07:13.887859+0000","last_unstale":"2023-10-17T06:07:14.876853+0000","last_undegraded":"2023-10-17T06:07:14.876853+0000","last_fullsized":"2023-10-17T06:07:14.876853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:16:48.285650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880831+0000","last_change":"2023-10-17T06:07:09.817272+0000","last_active":"2023-10-17T06:07:14.880831+0000","last_peered":"2023-10-17T06:07:14.880831+0000","last_clean":"2023-10-17T06:07:14.880831+0000","last_became_active":"2023-10-17T06:07:09.817017+0000","last_became_peered":"2023-10-17T06:07:09.817017+0000","last_unstale":"2023-10-17T06:07:14.880831+0000","last_undegraded":"2023-10-17T06:07:14.880831+0000","last_fullsized":"2023-10-17T06:07:14.880831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:30:38.008679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877583+0000","last_change":"2023-10-17T06:07:08.595069+0000","last_active":"2023-10-17T06:07:14.877583+0000","last_peered":"2023-10-17T06:07:14.877583+0000","last_clean":"2023-10-17T06:07:14.877583+0000","last_became_active":"2023-10-17T06:07:08.594724+0000","last_became_peered":"2023-10-17T06:07:08.594724+0000","last_unstale":"2023-10-17T06:07:14.877583+0000","last_undegraded":"2023-10-17T06:07:14.877583+0000","last_fullsized":"2023-10-17T06:07:14.877583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:30:12.591601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876486+0000","last_change":"2023-10-17T06:07:13.900939+0000","last_active":"2023-10-17T06:07:14.876486+0000","last_peered":"2023-10-17T06:07:14.876486+0000","last_clean":"2023-10-17T06:07:14.876486+0000","last_became_active":"2023-10-17T06:07:13.900504+0000","last_became_peered":"2023-10-17T06:07:13.900504+0000","last_unstale":"2023-10-17T06:07:14.876486+0000","last_undegraded":"2023-10-17T06:07:14.876486+0000","last_fullsized":"2023-10-17T06:07:14.876486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:57:24.016963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.882704+0000","last_change":"2023-10-17T06:07:09.811667+0000","last_active":"2023-10-17T06:07:14.882704+0000","last_peered":"2023-10-17T06:07:14.882704+0000","last_clean":"2023-10-17T06:07:14.882704+0000","last_became_active":"2023-10-17T06:07:09.811321+0000","last_became_peered":"2023-10-17T06:07:09.811321+0000","last_unstale":"2023-10-17T06:07:14.882704+0000","last_undegraded":"2023-10-17T06:07:14.882704+0000","last_fullsized":"2023-10-17T06:07:14.882704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:10:34.100144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877826+0000","last_change":"2023-10-17T06:07:08.591244+0000","last_active":"2023-10-17T06:07:14.877826+0000","last_peered":"2023-10-17T06:07:14.877826+0000","last_clean":"2023-10-17T06:07:14.877826+0000","last_became_active":"2023-10-17T06:07:08.591000+0000","last_became_peered":"2023-10-17T06:07:08.591000+0000","last_unstale":"2023-10-17T06:07:14.877826+0000","last_undegraded":"2023-10-17T06:07:14.877826+0000","last_fullsized":"2023-10-17T06:07:14.877826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:35:22.580242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876460+0000","last_change":"2023-10-17T06:07:13.885860+0000","last_active":"2023-10-17T06:07:14.876460+0000","last_peered":"2023-10-17T06:07:14.876460+0000","last_clean":"2023-10-17T06:07:14.876460+0000","last_became_active":"2023-10-17T06:07:13.885432+0000","last_became_peered":"2023-10-17T06:07:13.885432+0000","last_unstale":"2023-10-17T06:07:14.876460+0000","last_undegraded":"2023-10-17T06:07:14.876460+0000","last_fullsized":"2023-10-17T06:07:14.876460+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:37.345075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883253+0000","last_change":"2023-10-17T06:07:13.890018+0000","last_active":"2023-10-17T06:07:14.883253+0000","last_peered":"2023-10-17T06:07:14.883253+0000","last_clean":"2023-10-17T06:07:14.883253+0000","last_became_active":"2023-10-17T06:07:13.889612+0000","last_became_peered":"2023-10-17T06:07:13.889612+0000","last_unstale":"2023-10-17T06:07:14.883253+0000","last_undegraded":"2023-10-17T06:07:14.883253+0000","last_fullsized":"2023-10-17T06:07:14.883253+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:42.938379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289398+0000","last_change":"2023-10-17T06:07:08.591493+0000","last_active":"2023-10-17T06:07:15.289398+0000","last_peered":"2023-10-17T06:07:15.289398+0000","last_clean":"2023-10-17T06:07:15.289398+0000","last_became_active":"2023-10-17T06:07:08.591098+0000","last_became_peered":"2023-10-17T06:07:08.591098+0000","last_unstale":"2023-10-17T06:07:15.289398+0000","last_undegraded":"2023-10-17T06:07:15.289398+0000","last_fullsized":"2023-10-17T06:07:15.289398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:30:33.950741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291656+0000","last_change":"2023-10-17T06:07:09.822777+0000","last_active":"2023-10-17T06:07:15.291656+0000","last_peered":"2023-10-17T06:07:15.291656+0000","last_clean":"2023-10-17T06:07:15.291656+0000","last_became_active":"2023-10-17T06:07:09.822160+0000","last_became_peered":"2023-10-17T06:07:09.822160+0000","last_unstale":"2023-10-17T06:07:15.291656+0000","last_undegraded":"2023-10-17T06:07:15.291656+0000","last_fullsized":"2023-10-17T06:07:15.291656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:36:13.053365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291408+0000","last_change":"2023-10-17T06:07:13.895666+0000","last_active":"2023-10-17T06:07:15.291408+0000","last_peered":"2023-10-17T06:07:15.291408+0000","last_clean":"2023-10-17T06:07:15.291408+0000","last_became_active":"2023-10-17T06:07:13.895322+0000","last_became_peered":"2023-10-17T06:07:13.895322+0000","last_unstale":"2023-10-17T06:07:15.291408+0000","last_undegraded":"2023-10-17T06:07:15.291408+0000","last_fullsized":"2023-10-17T06:07:15.291408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:49:57.036218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876863+0000","last_change":"2023-10-17T06:07:08.589887+0000","last_active":"2023-10-17T06:07:14.876863+0000","last_peered":"2023-10-17T06:07:14.876863+0000","last_clean":"2023-10-17T06:07:14.876863+0000","last_became_active":"2023-10-17T06:07:08.589511+0000","last_became_peered":"2023-10-17T06:07:08.589511+0000","last_unstale":"2023-10-17T06:07:14.876863+0000","last_undegraded":"2023-10-17T06:07:14.876863+0000","last_fullsized":"2023-10-17T06:07:14.876863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:16:05.759169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292842+0000","last_change":"2023-10-17T06:07:09.818359+0000","last_active":"2023-10-17T06:07:15.292842+0000","last_peered":"2023-10-17T06:07:15.292842+0000","last_clean":"2023-10-17T06:07:15.292842+0000","last_became_active":"2023-10-17T06:07:09.818092+0000","last_became_peered":"2023-10-17T06:07:09.818092+0000","last_unstale":"2023-10-17T06:07:15.292842+0000","last_undegraded":"2023-10-17T06:07:15.292842+0000","last_fullsized":"2023-10-17T06:07:15.292842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:59:42.620914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291756+0000","last_change":"2023-10-17T06:07:08.585166+0000","last_active":"2023-10-17T06:07:15.291756+0000","last_peered":"2023-10-17T06:07:15.291756+0000","last_clean":"2023-10-17T06:07:15.291756+0000","last_became_active":"2023-10-17T06:07:08.583972+0000","last_became_peered":"2023-10-17T06:07:08.583972+0000","last_unstale":"2023-10-17T06:07:15.291756+0000","last_undegraded":"2023-10-17T06:07:15.291756+0000","last_fullsized":"2023-10-17T06:07:15.291756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:02:40.893599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883659+0000","last_change":"2023-10-17T06:07:09.816356+0000","last_active":"2023-10-17T06:07:14.883659+0000","last_peered":"2023-10-17T06:07:14.883659+0000","last_clean":"2023-10-17T06:07:14.883659+0000","last_became_active":"2023-10-17T06:07:09.816066+0000","last_became_peered":"2023-10-17T06:07:09.816066+0000","last_unstale":"2023-10-17T06:07:14.883659+0000","last_undegraded":"2023-10-17T06:07:14.883659+0000","last_fullsized":"2023-10-17T06:07:14.883659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:40:06.008865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290633+0000","last_change":"2023-10-17T06:07:13.885847+0000","last_active":"2023-10-17T06:07:15.290633+0000","last_peered":"2023-10-17T06:07:15.290633+0000","last_clean":"2023-10-17T06:07:15.290633+0000","last_became_active":"2023-10-17T06:07:13.883713+0000","last_became_peered":"2023-10-17T06:07:13.883713+0000","last_unstale":"2023-10-17T06:07:15.290633+0000","last_undegraded":"2023-10-17T06:07:15.290633+0000","last_fullsized":"2023-10-17T06:07:15.290633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:40:10.287699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876962+0000","last_change":"2023-10-17T06:07:08.590802+0000","last_active":"2023-10-17T06:07:14.876962+0000","last_peered":"2023-10-17T06:07:14.876962+0000","last_clean":"2023-10-17T06:07:14.876962+0000","last_became_active":"2023-10-17T06:07:08.590520+0000","last_became_peered":"2023-10-17T06:07:08.590520+0000","last_unstale":"2023-10-17T06:07:14.876962+0000","last_undegraded":"2023-10-17T06:07:14.876962+0000","last_fullsized":"2023-10-17T06:07:14.876962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:20.494951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290839+0000","last_change":"2023-10-17T06:07:09.819059+0000","last_active":"2023-10-17T06:07:15.290839+0000","last_peered":"2023-10-17T06:07:15.290839+0000","last_clean":"2023-10-17T06:07:15.290839+0000","last_became_active":"2023-10-17T06:07:09.818796+0000","last_became_peered":"2023-10-17T06:07:09.818796+0000","last_unstale":"2023-10-17T06:07:15.290839+0000","last_undegraded":"2023-10-17T06:07:15.290839+0000","last_fullsized":"2023-10-17T06:07:15.290839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:40:16.847674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883411+0000","last_change":"2023-10-17T06:07:13.891595+0000","last_active":"2023-10-17T06:07:14.883411+0000","last_peered":"2023-10-17T06:07:14.883411+0000","last_clean":"2023-10-17T06:07:14.883411+0000","last_became_active":"2023-10-17T06:07:13.891300+0000","last_became_peered":"2023-10-17T06:07:13.891300+0000","last_unstale":"2023-10-17T06:07:14.883411+0000","last_undegraded":"2023-10-17T06:07:14.883411+0000","last_fullsized":"2023-10-17T06:07:14.883411+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:39:43.311635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289114+0000","last_change":"2023-10-17T06:07:09.830559+0000","last_active":"2023-10-17T06:07:15.289114+0000","last_peered":"2023-10-17T06:07:15.289114+0000","last_clean":"2023-10-17T06:07:15.289114+0000","last_became_active":"2023-10-17T06:07:09.830247+0000","last_became_peered":"2023-10-17T06:07:09.830247+0000","last_unstale":"2023-10-17T06:07:15.289114+0000","last_undegraded":"2023-10-17T06:07:15.289114+0000","last_fullsized":"2023-10-17T06:07:15.289114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:16:06.924811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.288720+0000","last_change":"2023-10-17T06:07:09.817481+0000","last_active":"2023-10-17T06:07:15.288720+0000","last_peered":"2023-10-17T06:07:15.288720+0000","last_clean":"2023-10-17T06:07:15.288720+0000","last_became_active":"2023-10-17T06:07:09.814576+0000","last_became_peered":"2023-10-17T06:07:09.814576+0000","last_unstale":"2023-10-17T06:07:15.288720+0000","last_undegraded":"2023-10-17T06:07:15.288720+0000","last_fullsized":"2023-10-17T06:07:15.288720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:17:19.424257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878534+0000","last_change":"2023-10-17T06:07:09.820385+0000","last_active":"2023-10-17T06:07:14.878534+0000","last_peered":"2023-10-17T06:07:14.878534+0000","last_clean":"2023-10-17T06:07:14.878534+0000","last_became_active":"2023-10-17T06:07:09.820110+0000","last_became_peered":"2023-10-17T06:07:09.820110+0000","last_unstale":"2023-10-17T06:07:14.878534+0000","last_undegraded":"2023-10-17T06:07:14.878534+0000","last_fullsized":"2023-10-17T06:07:14.878534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:11:35.023099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289802+0000","last_change":"2023-10-17T06:07:09.822056+0000","last_active":"2023-10-17T06:07:15.289802+0000","last_peered":"2023-10-17T06:07:15.289802+0000","last_clean":"2023-10-17T06:07:15.289802+0000","last_became_active":"2023-10-17T06:07:09.821742+0000","last_became_peered":"2023-10-17T06:07:09.821742+0000","last_unstale":"2023-10-17T06:07:15.289802+0000","last_undegraded":"2023-10-17T06:07:15.289802+0000","last_fullsized":"2023-10-17T06:07:15.289802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:31.461649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292457+0000","last_change":"2023-10-17T06:07:09.837676+0000","last_active":"2023-10-17T06:07:15.292457+0000","last_peered":"2023-10-17T06:07:15.292457+0000","last_clean":"2023-10-17T06:07:15.292457+0000","last_became_active":"2023-10-17T06:07:09.837404+0000","last_became_peered":"2023-10-17T06:07:09.837404+0000","last_unstale":"2023-10-17T06:07:15.292457+0000","last_undegraded":"2023-10-17T06:07:15.292457+0000","last_fullsized":"2023-10-17T06:07:15.292457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:16:45.547751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883628+0000","last_change":"2023-10-17T06:07:09.815486+0000","last_active":"2023-10-17T06:07:14.883628+0000","last_peered":"2023-10-17T06:07:14.883628+0000","last_clean":"2023-10-17T06:07:14.883628+0000","last_became_active":"2023-10-17T06:07:09.815216+0000","last_became_peered":"2023-10-17T06:07:09.815216+0000","last_unstale":"2023-10-17T06:07:14.883628+0000","last_undegraded":"2023-10-17T06:07:14.883628+0000","last_fullsized":"2023-10-17T06:07:14.883628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:47:27.513466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292809+0000","last_change":"2023-10-17T06:07:09.832482+0000","last_active":"2023-10-17T06:07:15.292809+0000","last_peered":"2023-10-17T06:07:15.292809+0000","last_clean":"2023-10-17T06:07:15.292809+0000","last_became_active":"2023-10-17T06:07:09.829842+0000","last_became_peered":"2023-10-17T06:07:09.829842+0000","last_unstale":"2023-10-17T06:07:15.292809+0000","last_undegraded":"2023-10-17T06:07:15.292809+0000","last_fullsized":"2023-10-17T06:07:15.292809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:17:19.424257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292847+0000","last_change":"2023-10-17T06:07:09.825942+0000","last_active":"2023-10-17T06:07:15.292847+0000","last_peered":"2023-10-17T06:07:15.292847+0000","last_clean":"2023-10-17T06:07:15.292847+0000","last_became_active":"2023-10-17T06:07:09.825679+0000","last_became_peered":"2023-10-17T06:07:09.825679+0000","last_unstale":"2023-10-17T06:07:15.292847+0000","last_undegraded":"2023-10-17T06:07:15.292847+0000","last_fullsized":"2023-10-17T06:07:15.292847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:11:05.795490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876229+0000","last_change":"2023-10-17T06:07:09.823556+0000","last_active":"2023-10-17T06:07:14.876229+0000","last_peered":"2023-10-17T06:07:14.876229+0000","last_clean":"2023-10-17T06:07:14.876229+0000","last_became_active":"2023-10-17T06:07:09.823156+0000","last_became_peered":"2023-10-17T06:07:09.823156+0000","last_unstale":"2023-10-17T06:07:14.876229+0000","last_undegraded":"2023-10-17T06:07:14.876229+0000","last_fullsized":"2023-10-17T06:07:14.876229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:13:26.091146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.288516+0000","last_change":"2023-10-17T06:07:09.839598+0000","last_active":"2023-10-17T06:07:15.288516+0000","last_peered":"2023-10-17T06:07:15.288516+0000","last_clean":"2023-10-17T06:07:15.288516+0000","last_became_active":"2023-10-17T06:07:09.839335+0000","last_became_peered":"2023-10-17T06:07:09.839335+0000","last_unstale":"2023-10-17T06:07:15.288516+0000","last_undegraded":"2023-10-17T06:07:15.288516+0000","last_fullsized":"2023-10-17T06:07:15.288516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:50:22.863407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291642+0000","last_change":"2023-10-17T06:07:09.833987+0000","last_active":"2023-10-17T06:07:15.291642+0000","last_peered":"2023-10-17T06:07:15.291642+0000","last_clean":"2023-10-17T06:07:15.291642+0000","last_became_active":"2023-10-17T06:07:09.829996+0000","last_became_peered":"2023-10-17T06:07:09.829996+0000","last_unstale":"2023-10-17T06:07:15.291642+0000","last_undegraded":"2023-10-17T06:07:15.291642+0000","last_fullsized":"2023-10-17T06:07:15.291642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:02:25.494146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877356+0000","last_change":"2023-10-17T06:07:09.823715+0000","last_active":"2023-10-17T06:07:14.877356+0000","last_peered":"2023-10-17T06:07:14.877356+0000","last_clean":"2023-10-17T06:07:14.877356+0000","last_became_active":"2023-10-17T06:07:09.823129+0000","last_became_peered":"2023-10-17T06:07:09.823129+0000","last_unstale":"2023-10-17T06:07:14.877356+0000","last_undegraded":"2023-10-17T06:07:14.877356+0000","last_fullsized":"2023-10-17T06:07:14.877356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:36:11.487607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878693+0000","last_change":"2023-10-17T06:07:09.820940+0000","last_active":"2023-10-17T06:07:14.878693+0000","last_peered":"2023-10-17T06:07:14.878693+0000","last_clean":"2023-10-17T06:07:14.878693+0000","last_became_active":"2023-10-17T06:07:09.820736+0000","last_became_peered":"2023-10-17T06:07:09.820736+0000","last_unstale":"2023-10-17T06:07:14.878693+0000","last_undegraded":"2023-10-17T06:07:14.878693+0000","last_fullsized":"2023-10-17T06:07:14.878693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:23:39.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877433+0000","last_change":"2023-10-17T06:07:09.830379+0000","last_active":"2023-10-17T06:07:14.877433+0000","last_peered":"2023-10-17T06:07:14.877433+0000","last_clean":"2023-10-17T06:07:14.877433+0000","last_became_active":"2023-10-17T06:07:09.830134+0000","last_became_peered":"2023-10-17T06:07:09.830134+0000","last_unstale":"2023-10-17T06:07:14.877433+0000","last_undegraded":"2023-10-17T06:07:14.877433+0000","last_fullsized":"2023-10-17T06:07:14.877433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:37:37.680937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877600+0000","last_change":"2023-10-17T06:07:09.819191+0000","last_active":"2023-10-17T06:07:14.877600+0000","last_peered":"2023-10-17T06:07:14.877600+0000","last_clean":"2023-10-17T06:07:14.877600+0000","last_became_active":"2023-10-17T06:07:09.818894+0000","last_became_peered":"2023-10-17T06:07:09.818894+0000","last_unstale":"2023-10-17T06:07:14.877600+0000","last_undegraded":"2023-10-17T06:07:14.877600+0000","last_fullsized":"2023-10-17T06:07:14.877600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:40:29.612977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292543+0000","last_change":"2023-10-17T06:07:09.825371+0000","last_active":"2023-10-17T06:07:15.292543+0000","last_peered":"2023-10-17T06:07:15.292543+0000","last_clean":"2023-10-17T06:07:15.292543+0000","last_became_active":"2023-10-17T06:07:09.825096+0000","last_became_peered":"2023-10-17T06:07:09.825096+0000","last_unstale":"2023-10-17T06:07:15.292543+0000","last_undegraded":"2023-10-17T06:07:15.292543+0000","last_fullsized":"2023-10-17T06:07:15.292543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:30:13.596885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878194+0000","last_change":"2023-10-17T06:07:09.834663+0000","last_active":"2023-10-17T06:07:14.878194+0000","last_peered":"2023-10-17T06:07:14.878194+0000","last_clean":"2023-10-17T06:07:14.878194+0000","last_became_active":"2023-10-17T06:07:09.834468+0000","last_became_peered":"2023-10-17T06:07:09.834468+0000","last_unstale":"2023-10-17T06:07:14.878194+0000","last_undegraded":"2023-10-17T06:07:14.878194+0000","last_fullsized":"2023-10-17T06:07:14.878194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:36:13.053365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876830+0000","last_change":"2023-10-17T06:07:09.832756+0000","last_active":"2023-10-17T06:07:14.876830+0000","last_peered":"2023-10-17T06:07:14.876830+0000","last_clean":"2023-10-17T06:07:14.876830+0000","last_became_active":"2023-10-17T06:07:09.832258+0000","last_became_peered":"2023-10-17T06:07:09.832258+0000","last_unstale":"2023-10-17T06:07:14.876830+0000","last_undegraded":"2023-10-17T06:07:14.876830+0000","last_fullsized":"2023-10-17T06:07:14.876830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:19:22.830429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883010+0000","last_change":"2023-10-17T06:07:09.820030+0000","last_active":"2023-10-17T06:07:14.883010+0000","last_peered":"2023-10-17T06:07:14.883010+0000","last_clean":"2023-10-17T06:07:14.883010+0000","last_became_active":"2023-10-17T06:07:09.819756+0000","last_became_peered":"2023-10-17T06:07:09.819756+0000","last_unstale":"2023-10-17T06:07:14.883010+0000","last_undegraded":"2023-10-17T06:07:14.883010+0000","last_fullsized":"2023-10-17T06:07:14.883010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:50:22.863407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877122+0000","last_change":"2023-10-17T06:07:09.826587+0000","last_active":"2023-10-17T06:07:14.877122+0000","last_peered":"2023-10-17T06:07:14.877122+0000","last_clean":"2023-10-17T06:07:14.877122+0000","last_became_active":"2023-10-17T06:07:09.825860+0000","last_became_peered":"2023-10-17T06:07:09.825860+0000","last_unstale":"2023-10-17T06:07:14.877122+0000","last_undegraded":"2023-10-17T06:07:14.877122+0000","last_fullsized":"2023-10-17T06:07:14.877122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:59:29.208159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877138+0000","last_change":"2023-10-17T06:07:09.810586+0000","last_active":"2023-10-17T06:07:14.877138+0000","last_peered":"2023-10-17T06:07:14.877138+0000","last_clean":"2023-10-17T06:07:14.877138+0000","last_became_active":"2023-10-17T06:07:09.809875+0000","last_became_peered":"2023-10-17T06:07:09.809875+0000","last_unstale":"2023-10-17T06:07:14.877138+0000","last_undegraded":"2023-10-17T06:07:14.877138+0000","last_fullsized":"2023-10-17T06:07:14.877138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:20:16.424591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879359+0000","last_change":"2023-10-17T06:07:09.820690+0000","last_active":"2023-10-17T06:07:14.879359+0000","last_peered":"2023-10-17T06:07:14.879359+0000","last_clean":"2023-10-17T06:07:14.879359+0000","last_became_active":"2023-10-17T06:07:09.820404+0000","last_became_peered":"2023-10-17T06:07:09.820404+0000","last_unstale":"2023-10-17T06:07:14.879359+0000","last_undegraded":"2023-10-17T06:07:14.879359+0000","last_fullsized":"2023-10-17T06:07:14.879359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:51:00.656359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883627+0000","last_change":"2023-10-17T06:07:09.840730+0000","last_active":"2023-10-17T06:07:14.883627+0000","last_peered":"2023-10-17T06:07:14.883627+0000","last_clean":"2023-10-17T06:07:14.883627+0000","last_became_active":"2023-10-17T06:07:09.839503+0000","last_became_peered":"2023-10-17T06:07:09.839503+0000","last_unstale":"2023-10-17T06:07:14.883627+0000","last_undegraded":"2023-10-17T06:07:14.883627+0000","last_fullsized":"2023-10-17T06:07:14.883627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:53:37.426543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292422+0000","last_change":"2023-10-17T06:07:09.833449+0000","last_active":"2023-10-17T06:07:15.292422+0000","last_peered":"2023-10-17T06:07:15.292422+0000","last_clean":"2023-10-17T06:07:15.292422+0000","last_became_active":"2023-10-17T06:07:09.833054+0000","last_became_peered":"2023-10-17T06:07:09.833054+0000","last_unstale":"2023-10-17T06:07:15.292422+0000","last_undegraded":"2023-10-17T06:07:15.292422+0000","last_fullsized":"2023-10-17T06:07:15.292422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:30:04.900751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.882634+0000","last_change":"2023-10-17T06:07:09.809269+0000","last_active":"2023-10-17T06:07:14.882634+0000","last_peered":"2023-10-17T06:07:14.882634+0000","last_clean":"2023-10-17T06:07:14.882634+0000","last_became_active":"2023-10-17T06:07:09.808823+0000","last_became_peered":"2023-10-17T06:07:09.808823+0000","last_unstale":"2023-10-17T06:07:14.882634+0000","last_undegraded":"2023-10-17T06:07:14.882634+0000","last_fullsized":"2023-10-17T06:07:14.882634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:00:19.054030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876659+0000","last_change":"2023-10-17T06:07:09.837236+0000","last_active":"2023-10-17T06:07:14.876659+0000","last_peered":"2023-10-17T06:07:14.876659+0000","last_clean":"2023-10-17T06:07:14.876659+0000","last_became_active":"2023-10-17T06:07:09.831813+0000","last_became_peered":"2023-10-17T06:07:09.831813+0000","last_unstale":"2023-10-17T06:07:14.876659+0000","last_undegraded":"2023-10-17T06:07:14.876659+0000","last_fullsized":"2023-10-17T06:07:14.876659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:30:04.900751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877874+0000","last_change":"2023-10-17T06:07:09.818210+0000","last_active":"2023-10-17T06:07:14.877874+0000","last_peered":"2023-10-17T06:07:14.877874+0000","last_clean":"2023-10-17T06:07:14.877874+0000","last_became_active":"2023-10-17T06:07:09.817925+0000","last_became_peered":"2023-10-17T06:07:09.817925+0000","last_unstale":"2023-10-17T06:07:14.877874+0000","last_undegraded":"2023-10-17T06:07:14.877874+0000","last_fullsized":"2023-10-17T06:07:14.877874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:49:52.757385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292096+0000","last_change":"2023-10-17T06:07:09.825092+0000","last_active":"2023-10-17T06:07:15.292096+0000","last_peered":"2023-10-17T06:07:15.292096+0000","last_clean":"2023-10-17T06:07:15.292096+0000","last_became_active":"2023-10-17T06:07:09.824830+0000","last_became_peered":"2023-10-17T06:07:09.824830+0000","last_unstale":"2023-10-17T06:07:15.292096+0000","last_undegraded":"2023-10-17T06:07:15.292096+0000","last_fullsized":"2023-10-17T06:07:15.292096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:13:26.091146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289991+0000","last_change":"2023-10-17T06:07:09.839421+0000","last_active":"2023-10-17T06:07:15.289991+0000","last_peered":"2023-10-17T06:07:15.289991+0000","last_clean":"2023-10-17T06:07:15.289991+0000","last_became_active":"2023-10-17T06:07:09.839171+0000","last_became_peered":"2023-10-17T06:07:09.839171+0000","last_unstale":"2023-10-17T06:07:15.289991+0000","last_undegraded":"2023-10-17T06:07:15.289991+0000","last_fullsized":"2023-10-17T06:07:15.289991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:47:47.791448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879222+0000","last_change":"2023-10-17T06:07:09.834207+0000","last_active":"2023-10-17T06:07:14.879222+0000","last_peered":"2023-10-17T06:07:14.879222+0000","last_clean":"2023-10-17T06:07:14.879222+0000","last_became_active":"2023-10-17T06:07:09.833966+0000","last_became_peered":"2023-10-17T06:07:09.833966+0000","last_unstale":"2023-10-17T06:07:14.879222+0000","last_undegraded":"2023-10-17T06:07:14.879222+0000","last_fullsized":"2023-10-17T06:07:14.879222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:54:25.125826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883402+0000","last_change":"2023-10-17T06:07:09.823776+0000","last_active":"2023-10-17T06:07:14.883402+0000","last_peered":"2023-10-17T06:07:14.883402+0000","last_clean":"2023-10-17T06:07:14.883402+0000","last_became_active":"2023-10-17T06:07:09.823394+0000","last_became_peered":"2023-10-17T06:07:09.823394+0000","last_unstale":"2023-10-17T06:07:14.883402+0000","last_undegraded":"2023-10-17T06:07:14.883402+0000","last_fullsized":"2023-10-17T06:07:14.883402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:45:39.252622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877489+0000","last_change":"2023-10-17T06:07:09.818284+0000","last_active":"2023-10-17T06:07:14.877489+0000","last_peered":"2023-10-17T06:07:14.877489+0000","last_clean":"2023-10-17T06:07:14.877489+0000","last_became_active":"2023-10-17T06:07:09.817980+0000","last_became_peered":"2023-10-17T06:07:09.817980+0000","last_unstale":"2023-10-17T06:07:14.877489+0000","last_undegraded":"2023-10-17T06:07:14.877489+0000","last_fullsized":"2023-10-17T06:07:14.877489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:42:16.038333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":122060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":122712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":125957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":917504,"data_stored":716485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7230000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5129999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.611}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6779999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":122150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":122060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5089999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":122060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6220000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":711019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5409999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-17T06:07:36.918 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-17T06:07:37.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.127+0000 7f4c5d93e700 1 Processor -- start 2023-10-17T06:07:37.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.131+0000 7f4c5d93e700 1 -- start start 2023-10-17T06:07:37.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.131+0000 7f4c5d93e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4c580d2e00 0x7f4c580b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:37.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.131+0000 7f4c5d93e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c58160710 0x7f4c580d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:37.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.131+0000 7f4c5d93e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4c580b5ae0 0x7f4c5806db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:37.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.131+0000 7f4c5d93e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5815df90 con 0x7f4c580d2e00 2023-10-17T06:07:37.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.131+0000 7f4c5d93e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5815d0d0 con 0x7f4c580b5ae0 2023-10-17T06:07:37.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.131+0000 7f4c5d93e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5806f0f0 con 0x7f4c58160710 2023-10-17T06:07:37.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.131+0000 7f4c5c93c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4c580d2e00 0x7f4c580b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:37.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.131+0000 7f4c5c93c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4c580d2e00 0x7f4c580b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48542/0 (socket says 172.21.15.125:48542) 2023-10-17T06:07:37.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.131+0000 7f4c5c93c700 1 -- 172.21.15.125:0/1928419802 learned_addr learned my addr 172.21.15.125:0/1928419802 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:37.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.131+0000 7f4c4ffff700 1 --2- 172.21.15.125:0/1928419802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c58160710 0x7f4c580d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:37.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.131+0000 7f4c5d13d700 1 --2- 172.21.15.125:0/1928419802 >> v2:172.21.15.184:3300/0 conn(0x7f4c580b5ae0 0x7f4c5806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:37.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.131+0000 7f4c5c93c700 1 -- 172.21.15.125:0/1928419802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c58160710 msgr2=0x7f4c580d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:37.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.131+0000 7f4c5c93c700 1 --2- 172.21.15.125:0/1928419802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c58160710 0x7f4c580d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.131+0000 7f4c5c93c700 1 -- 172.21.15.125:0/1928419802 >> v2:172.21.15.184:3300/0 conn(0x7f4c580b5ae0 msgr2=0x7f4c5806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:37.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.131+0000 7f4c5c93c700 1 --2- 172.21.15.125:0/1928419802 >> v2:172.21.15.184:3300/0 conn(0x7f4c580b5ae0 0x7f4c5806db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.135+0000 7f4c5c93c700 1 -- 172.21.15.125:0/1928419802 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c580d3720 con 0x7f4c580d2e00 2023-10-17T06:07:37.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.135+0000 7f4c5c93c700 1 --2- 172.21.15.125:0/1928419802 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c580d2e00 0x7f4c580b6e00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009e50 tx=0x7f4c5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d47d5873924a4b server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:37.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.135+0000 7f4c4f7fe700 1 -- 172.21.15.125:0/1928419802 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5400e070 con 0x7f4c580d2e00 2023-10-17T06:07:37.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.135+0000 7f4c4f7fe700 1 -- 172.21.15.125:0/1928419802 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5400b8d0 con 0x7f4c580d2e00 2023-10-17T06:07:37.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.135+0000 7f4c4f7fe700 1 -- 172.21.15.125:0/1928419802 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5400bc80 con 0x7f4c580d2e00 2023-10-17T06:07:37.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.135+0000 7f4c5d93e700 1 -- 172.21.15.125:0/1928419802 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c580d2e00 msgr2=0x7f4c580b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:37.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.135+0000 7f4c5d93e700 1 --2- 172.21.15.125:0/1928419802 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c580d2e00 0x7f4c580b6e00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4c54009e50 tx=0x7f4c5400b330 comp rx=0 tx=0).stop 2023-10-17T06:07:37.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.135+0000 7f4c5d93e700 1 -- 172.21.15.125:0/1928419802 shutdown_connections 2023-10-17T06:07:37.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.135+0000 7f4c5d93e700 1 --2- 172.21.15.125:0/1928419802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c58160710 0x7f4c580d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.135+0000 7f4c5d93e700 1 --2- 172.21.15.125:0/1928419802 >> v2:172.21.15.184:3300/0 conn(0x7f4c580b5ae0 0x7f4c5806db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.135+0000 7f4c5d93e700 1 --2- 172.21.15.125:0/1928419802 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c580d2e00 0x7f4c580b6e00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.135+0000 7f4c5d93e700 1 -- 172.21.15.125:0/1928419802 >> 172.21.15.125:0/1928419802 conn(0x7f4c58069f20 msgr2=0x7f4c5806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:37.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.135+0000 7f4c5d93e700 1 -- 172.21.15.125:0/1928419802 shutdown_connections 2023-10-17T06:07:37.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.135+0000 7f4c5d93e700 1 -- 172.21.15.125:0/1928419802 wait complete. 2023-10-17T06:07:37.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.139+0000 7f4c5d93e700 1 Processor -- start 2023-10-17T06:07:37.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.139+0000 7f4c5d93e700 1 -- start start 2023-10-17T06:07:37.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c5d93e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c580b5ae0 0x7f4c580b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:37.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c5d93e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c580d2e00 0x7f4c580b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:37.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c5d93e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c58160710 0x7f4c58151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:37.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c5d93e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c580b43e0 con 0x7f4c580d2e00 2023-10-17T06:07:37.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c5d93e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c580b46c0 con 0x7f4c58160710 2023-10-17T06:07:37.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c5d93e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c580b49a0 con 0x7f4c580b5ae0 2023-10-17T06:07:37.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c4ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c580d2e00 0x7f4c580b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:37.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c4ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c580d2e00 0x7f4c580b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48554/0 (socket says 172.21.15.125:48554) 2023-10-17T06:07:37.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c4ffff700 1 -- 172.21.15.125:0/3330051828 learned_addr learned my addr 172.21.15.125:0/3330051828 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:37.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c5d13d700 1 --2- 172.21.15.125:0/3330051828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c58160710 0x7f4c58151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:37.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c5c93c700 1 --2- 172.21.15.125:0/3330051828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c580b5ae0 0x7f4c580b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:37.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c4ffff700 1 -- 172.21.15.125:0/3330051828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c580b5ae0 msgr2=0x7f4c580b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:37.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c4ffff700 1 --2- 172.21.15.125:0/3330051828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c580b5ae0 0x7f4c580b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c4ffff700 1 -- 172.21.15.125:0/3330051828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c58160710 msgr2=0x7f4c58151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:37.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c4ffff700 1 --2- 172.21.15.125:0/3330051828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c58160710 0x7f4c58151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c4ffff700 1 -- 172.21.15.125:0/3330051828 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c54009b30 con 0x7f4c580d2e00 2023-10-17T06:07:37.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c4ffff700 1 --2- 172.21.15.125:0/3330051828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c580d2e00 0x7f4c580b3a00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4c48009fd0 tx=0x7f4c4800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:37.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c4d7fa700 1 -- 172.21.15.125:0/3330051828 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c480095a0 con 0x7f4c580d2e00 2023-10-17T06:07:37.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c4d7fa700 1 -- 172.21.15.125:0/3330051828 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c48013680 con 0x7f4c580d2e00 2023-10-17T06:07:37.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c5d93e700 1 -- 172.21.15.125:0/3330051828 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c580b4c80 con 0x7f4c580d2e00 2023-10-17T06:07:37.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c4d7fa700 1 -- 172.21.15.125:0/3330051828 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c48013a10 con 0x7f4c580d2e00 2023-10-17T06:07:37.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.143+0000 7f4c5d93e700 1 -- 172.21.15.125:0/3330051828 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c58158190 con 0x7f4c580d2e00 2023-10-17T06:07:37.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.147+0000 7f4c5d93e700 1 -- 172.21.15.125:0/3330051828 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c58072e60 con 0x7f4c580d2e00 2023-10-17T06:07:37.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.147+0000 7f4c4d7fa700 1 -- 172.21.15.125:0/3330051828 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4c48013b70 con 0x7f4c580d2e00 2023-10-17T06:07:37.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.147+0000 7f4c4d7fa700 1 --2- 172.21.15.125:0/3330051828 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4c440656f0 0x7f4c44067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:37.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.147+0000 7f4c4d7fa700 1 -- 172.21.15.125:0/3330051828 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4c48082ec0 con 0x7f4c580d2e00 2023-10-17T06:07:37.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.147+0000 7f4c5c93c700 1 --2- 172.21.15.125:0/3330051828 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4c440656f0 0x7f4c44067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:37.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.151+0000 7f4c5c93c700 1 --2- 172.21.15.125:0/3330051828 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4c440656f0 0x7f4c44067bb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4c5400b370 tx=0x7f4c54009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:37.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.151+0000 7f4c4d7fa700 1 -- 172.21.15.125:0/3330051828 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f4c48054130 con 0x7f4c580d2e00 2023-10-17T06:07:37.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.327+0000 7f4c5d93e700 1 -- 172.21.15.125:0/3330051828 --> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4c581583b0 con 0x7f4c440656f0 2023-10-17T06:07:37.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.335+0000 7f4c4d7fa700 1 -- 172.21.15.125:0/3330051828 <== mgr.4107 v2:172.21.15.125:6832/2516570548 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367197 (secure 0 0 0) 0x7f4c581583b0 con 0x7f4c440656f0 2023-10-17T06:07:37.345 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:37.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.343+0000 7f4c5d93e700 1 -- 172.21.15.125:0/3330051828 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4c440656f0 msgr2=0x7f4c44067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:37.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.343+0000 7f4c5d93e700 1 --2- 172.21.15.125:0/3330051828 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4c440656f0 0x7f4c44067bb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4c5400b370 tx=0x7f4c54009000 comp rx=0 tx=0).stop 2023-10-17T06:07:37.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.343+0000 7f4c5d93e700 1 -- 172.21.15.125:0/3330051828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c580d2e00 msgr2=0x7f4c580b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:37.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.343+0000 7f4c5d93e700 1 --2- 172.21.15.125:0/3330051828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c580d2e00 0x7f4c580b3a00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4c48009fd0 tx=0x7f4c4800eb20 comp rx=0 tx=0).stop 2023-10-17T06:07:37.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.343+0000 7f4c5d93e700 1 -- 172.21.15.125:0/3330051828 shutdown_connections 2023-10-17T06:07:37.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.343+0000 7f4c5d93e700 1 --2- 172.21.15.125:0/3330051828 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4c440656f0 0x7f4c44067bb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.343+0000 7f4c5d93e700 1 --2- 172.21.15.125:0/3330051828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c58160710 0x7f4c58151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.343+0000 7f4c5d93e700 1 --2- 172.21.15.125:0/3330051828 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c580d2e00 0x7f4c580b3a00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.343+0000 7f4c5d93e700 1 --2- 172.21.15.125:0/3330051828 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c580b5ae0 0x7f4c580b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.343+0000 7f4c5d93e700 1 -- 172.21.15.125:0/3330051828 >> 172.21.15.125:0/3330051828 conn(0x7f4c58069f20 msgr2=0x7f4c5815c590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:37.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.343+0000 7f4c5d93e700 1 -- 172.21.15.125:0/3330051828 shutdown_connections 2023-10-17T06:07:37.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.343+0000 7f4c5d93e700 1 -- 172.21.15.125:0/3330051828 wait complete. 2023-10-17T06:07:37.350 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-17T06:07:37.369 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-10-17T06:07:35.952630+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219680,"kb_used_data":3524,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755040,"statfs":{"total":773094113280,"available":772869160960,"internally_reserved":0,"allocated":3608576,"data_stored":2164503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005101"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290252+0000","last_change":"2023-10-17T06:07:13.901434+0000","last_active":"2023-10-17T06:07:15.290252+0000","last_peered":"2023-10-17T06:07:15.290252+0000","last_clean":"2023-10-17T06:07:15.290252+0000","last_became_active":"2023-10-17T06:07:13.901040+0000","last_became_peered":"2023-10-17T06:07:13.901040+0000","last_unstale":"2023-10-17T06:07:15.290252+0000","last_undegraded":"2023-10-17T06:07:15.290252+0000","last_fullsized":"2023-10-17T06:07:15.290252+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:36:26.363513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292800+0000","last_change":"2023-10-17T06:07:08.591346+0000","last_active":"2023-10-17T06:07:15.292800+0000","last_peered":"2023-10-17T06:07:15.292800+0000","last_clean":"2023-10-17T06:07:15.292800+0000","last_became_active":"2023-10-17T06:07:08.591043+0000","last_became_peered":"2023-10-17T06:07:08.591043+0000","last_unstale":"2023-10-17T06:07:15.292800+0000","last_undegraded":"2023-10-17T06:07:15.292800+0000","last_fullsized":"2023-10-17T06:07:15.292800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:20.494951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879068+0000","last_change":"2023-10-17T06:07:09.836025+0000","last_active":"2023-10-17T06:07:14.879068+0000","last_peered":"2023-10-17T06:07:14.879068+0000","last_clean":"2023-10-17T06:07:14.879068+0000","last_became_active":"2023-10-17T06:07:09.835767+0000","last_became_peered":"2023-10-17T06:07:09.835767+0000","last_unstale":"2023-10-17T06:07:14.879068+0000","last_undegraded":"2023-10-17T06:07:14.879068+0000","last_fullsized":"2023-10-17T06:07:14.879068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:42:27.021964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878105+0000","last_change":"2023-10-17T06:07:13.895224+0000","last_active":"2023-10-17T06:07:14.878105+0000","last_peered":"2023-10-17T06:07:14.878105+0000","last_clean":"2023-10-17T06:07:14.878105+0000","last_became_active":"2023-10-17T06:07:13.894817+0000","last_became_peered":"2023-10-17T06:07:13.894817+0000","last_unstale":"2023-10-17T06:07:14.878105+0000","last_undegraded":"2023-10-17T06:07:14.878105+0000","last_fullsized":"2023-10-17T06:07:14.878105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:48:43.184952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290660+0000","last_change":"2023-10-17T06:07:08.593335+0000","last_active":"2023-10-17T06:07:15.290660+0000","last_peered":"2023-10-17T06:07:15.290660+0000","last_clean":"2023-10-17T06:07:15.290660+0000","last_became_active":"2023-10-17T06:07:08.592714+0000","last_became_peered":"2023-10-17T06:07:08.592714+0000","last_unstale":"2023-10-17T06:07:15.290660+0000","last_undegraded":"2023-10-17T06:07:15.290660+0000","last_fullsized":"2023-10-17T06:07:15.290660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:19:27.180864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289199+0000","last_change":"2023-10-17T06:07:09.826416+0000","last_active":"2023-10-17T06:07:15.289199+0000","last_peered":"2023-10-17T06:07:15.289199+0000","last_clean":"2023-10-17T06:07:15.289199+0000","last_became_active":"2023-10-17T06:07:09.826166+0000","last_became_peered":"2023-10-17T06:07:09.826166+0000","last_unstale":"2023-10-17T06:07:15.289199+0000","last_undegraded":"2023-10-17T06:07:15.289199+0000","last_fullsized":"2023-10-17T06:07:15.289199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:40:00.062457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883131+0000","last_change":"2023-10-17T06:07:13.882442+0000","last_active":"2023-10-17T06:07:14.883131+0000","last_peered":"2023-10-17T06:07:14.883131+0000","last_clean":"2023-10-17T06:07:14.883131+0000","last_became_active":"2023-10-17T06:07:13.882071+0000","last_became_peered":"2023-10-17T06:07:13.882071+0000","last_unstale":"2023-10-17T06:07:14.883131+0000","last_undegraded":"2023-10-17T06:07:14.883131+0000","last_fullsized":"2023-10-17T06:07:14.883131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:17:23.703090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883798+0000","last_change":"2023-10-17T06:07:08.596020+0000","last_active":"2023-10-17T06:07:14.883798+0000","last_peered":"2023-10-17T06:07:14.883798+0000","last_clean":"2023-10-17T06:07:14.883798+0000","last_became_active":"2023-10-17T06:07:08.595675+0000","last_became_peered":"2023-10-17T06:07:08.595675+0000","last_unstale":"2023-10-17T06:07:14.883798+0000","last_undegraded":"2023-10-17T06:07:14.883798+0000","last_fullsized":"2023-10-17T06:07:14.883798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:49:51.752101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878221+0000","last_change":"2023-10-17T06:07:09.810995+0000","last_active":"2023-10-17T06:07:14.878221+0000","last_peered":"2023-10-17T06:07:14.878221+0000","last_clean":"2023-10-17T06:07:14.878221+0000","last_became_active":"2023-10-17T06:07:09.810703+0000","last_became_peered":"2023-10-17T06:07:09.810703+0000","last_unstale":"2023-10-17T06:07:14.878221+0000","last_undegraded":"2023-10-17T06:07:14.878221+0000","last_fullsized":"2023-10-17T06:07:14.878221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:47:31.281761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876631+0000","last_change":"2023-10-17T06:07:13.895957+0000","last_active":"2023-10-17T06:07:14.876631+0000","last_peered":"2023-10-17T06:07:14.876631+0000","last_clean":"2023-10-17T06:07:14.876631+0000","last_became_active":"2023-10-17T06:07:13.895553+0000","last_became_peered":"2023-10-17T06:07:13.895553+0000","last_unstale":"2023-10-17T06:07:14.876631+0000","last_undegraded":"2023-10-17T06:07:14.876631+0000","last_fullsized":"2023-10-17T06:07:14.876631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:26.493795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883297+0000","last_change":"2023-10-17T06:07:08.596194+0000","last_active":"2023-10-17T06:07:14.883297+0000","last_peered":"2023-10-17T06:07:14.883297+0000","last_clean":"2023-10-17T06:07:14.883297+0000","last_became_active":"2023-10-17T06:07:08.595660+0000","last_became_peered":"2023-10-17T06:07:08.595660+0000","last_unstale":"2023-10-17T06:07:14.883297+0000","last_undegraded":"2023-10-17T06:07:14.883297+0000","last_fullsized":"2023-10-17T06:07:14.883297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:39:59.057172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880325+0000","last_change":"2023-10-17T06:07:09.807993+0000","last_active":"2023-10-17T06:07:14.880325+0000","last_peered":"2023-10-17T06:07:14.880325+0000","last_clean":"2023-10-17T06:07:14.880325+0000","last_became_active":"2023-10-17T06:07:09.807693+0000","last_became_peered":"2023-10-17T06:07:09.807693+0000","last_unstale":"2023-10-17T06:07:14.880325+0000","last_undegraded":"2023-10-17T06:07:14.880325+0000","last_fullsized":"2023-10-17T06:07:14.880325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:35:18.327855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292566+0000","last_change":"2023-10-17T06:07:13.889302+0000","last_active":"2023-10-17T06:07:15.292566+0000","last_peered":"2023-10-17T06:07:15.292566+0000","last_clean":"2023-10-17T06:07:15.292566+0000","last_became_active":"2023-10-17T06:07:13.888782+0000","last_became_peered":"2023-10-17T06:07:13.888782+0000","last_unstale":"2023-10-17T06:07:15.292566+0000","last_undegraded":"2023-10-17T06:07:15.292566+0000","last_fullsized":"2023-10-17T06:07:15.292566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:00:23.332863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292161+0000","last_change":"2023-10-17T06:07:08.594447+0000","last_active":"2023-10-17T06:07:15.292161+0000","last_peered":"2023-10-17T06:07:15.292161+0000","last_clean":"2023-10-17T06:07:15.292161+0000","last_became_active":"2023-10-17T06:07:08.594176+0000","last_became_peered":"2023-10-17T06:07:08.594176+0000","last_unstale":"2023-10-17T06:07:15.292161+0000","last_undegraded":"2023-10-17T06:07:15.292161+0000","last_fullsized":"2023-10-17T06:07:15.292161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:15:03.640415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877356+0000","last_change":"2023-10-17T06:07:09.819893+0000","last_active":"2023-10-17T06:07:14.877356+0000","last_peered":"2023-10-17T06:07:14.877356+0000","last_clean":"2023-10-17T06:07:14.877356+0000","last_became_active":"2023-10-17T06:07:09.819607+0000","last_became_peered":"2023-10-17T06:07:09.819607+0000","last_unstale":"2023-10-17T06:07:14.877356+0000","last_undegraded":"2023-10-17T06:07:14.877356+0000","last_fullsized":"2023-10-17T06:07:14.877356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:21:39.864171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878555+0000","last_change":"2023-10-17T06:07:13.880508+0000","last_active":"2023-10-17T06:07:14.878555+0000","last_peered":"2023-10-17T06:07:14.878555+0000","last_clean":"2023-10-17T06:07:14.878555+0000","last_became_active":"2023-10-17T06:07:13.879917+0000","last_became_peered":"2023-10-17T06:07:13.879917+0000","last_unstale":"2023-10-17T06:07:14.878555+0000","last_undegraded":"2023-10-17T06:07:14.878555+0000","last_fullsized":"2023-10-17T06:07:14.878555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:40:59.144753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878410+0000","last_change":"2023-10-17T06:07:08.588962+0000","last_active":"2023-10-17T06:07:14.878410+0000","last_peered":"2023-10-17T06:07:14.878410+0000","last_clean":"2023-10-17T06:07:14.878410+0000","last_became_active":"2023-10-17T06:07:08.588620+0000","last_became_peered":"2023-10-17T06:07:08.588620+0000","last_unstale":"2023-10-17T06:07:14.878410+0000","last_undegraded":"2023-10-17T06:07:14.878410+0000","last_fullsized":"2023-10-17T06:07:14.878410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:54:25.029489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291108+0000","last_change":"2023-10-17T06:07:09.828789+0000","last_active":"2023-10-17T06:07:15.291108+0000","last_peered":"2023-10-17T06:07:15.291108+0000","last_clean":"2023-10-17T06:07:15.291108+0000","last_became_active":"2023-10-17T06:07:09.828222+0000","last_became_peered":"2023-10-17T06:07:09.828222+0000","last_unstale":"2023-10-17T06:07:15.291108+0000","last_undegraded":"2023-10-17T06:07:15.291108+0000","last_fullsized":"2023-10-17T06:07:15.291108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:40:29.612977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290241+0000","last_change":"2023-10-17T06:07:13.884632+0000","last_active":"2023-10-17T06:07:15.290241+0000","last_peered":"2023-10-17T06:07:15.290241+0000","last_clean":"2023-10-17T06:07:15.290241+0000","last_became_active":"2023-10-17T06:07:13.883506+0000","last_became_peered":"2023-10-17T06:07:13.883506+0000","last_unstale":"2023-10-17T06:07:15.290241+0000","last_undegraded":"2023-10-17T06:07:15.290241+0000","last_fullsized":"2023-10-17T06:07:15.290241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:58:02.371449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291061+0000","last_change":"2023-10-17T06:07:08.596112+0000","last_active":"2023-10-17T06:07:15.291061+0000","last_peered":"2023-10-17T06:07:15.291061+0000","last_clean":"2023-10-17T06:07:15.291061+0000","last_became_active":"2023-10-17T06:07:08.595385+0000","last_became_peered":"2023-10-17T06:07:08.595385+0000","last_unstale":"2023-10-17T06:07:15.291061+0000","last_undegraded":"2023-10-17T06:07:15.291061+0000","last_fullsized":"2023-10-17T06:07:15.291061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:25:55.002475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292431+0000","last_change":"2023-10-17T06:07:09.839412+0000","last_active":"2023-10-17T06:07:15.292431+0000","last_peered":"2023-10-17T06:07:15.292431+0000","last_clean":"2023-10-17T06:07:15.292431+0000","last_became_active":"2023-10-17T06:07:09.838904+0000","last_became_peered":"2023-10-17T06:07:09.838904+0000","last_unstale":"2023-10-17T06:07:15.292431+0000","last_undegraded":"2023-10-17T06:07:15.292431+0000","last_fullsized":"2023-10-17T06:07:15.292431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:19:22.830429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292307+0000","last_change":"2023-10-17T06:07:13.888543+0000","last_active":"2023-10-17T06:07:15.292307+0000","last_peered":"2023-10-17T06:07:15.292307+0000","last_clean":"2023-10-17T06:07:15.292307+0000","last_became_active":"2023-10-17T06:07:13.888176+0000","last_became_peered":"2023-10-17T06:07:13.888176+0000","last_unstale":"2023-10-17T06:07:15.292307+0000","last_undegraded":"2023-10-17T06:07:15.292307+0000","last_fullsized":"2023-10-17T06:07:15.292307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:26.493795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289600+0000","last_change":"2023-10-17T06:07:08.589779+0000","last_active":"2023-10-17T06:07:15.289600+0000","last_peered":"2023-10-17T06:07:15.289600+0000","last_clean":"2023-10-17T06:07:15.289600+0000","last_became_active":"2023-10-17T06:07:08.587389+0000","last_became_peered":"2023-10-17T06:07:08.587389+0000","last_unstale":"2023-10-17T06:07:15.289600+0000","last_undegraded":"2023-10-17T06:07:15.289600+0000","last_fullsized":"2023-10-17T06:07:15.289600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:45:38.247338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290377+0000","last_change":"2023-10-17T06:07:09.824706+0000","last_active":"2023-10-17T06:07:15.290377+0000","last_peered":"2023-10-17T06:07:15.290377+0000","last_clean":"2023-10-17T06:07:15.290377+0000","last_became_active":"2023-10-17T06:07:09.824384+0000","last_became_peered":"2023-10-17T06:07:09.824384+0000","last_unstale":"2023-10-17T06:07:15.290377+0000","last_undegraded":"2023-10-17T06:07:15.290377+0000","last_fullsized":"2023-10-17T06:07:15.290377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:33:14.304674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291416+0000","last_change":"2023-10-17T06:07:09.814976+0000","last_active":"2023-10-17T06:07:15.291416+0000","last_peered":"2023-10-17T06:07:15.291416+0000","last_clean":"2023-10-17T06:07:15.291416+0000","last_became_active":"2023-10-17T06:07:09.814529+0000","last_became_peered":"2023-10-17T06:07:09.814529+0000","last_unstale":"2023-10-17T06:07:15.291416+0000","last_undegraded":"2023-10-17T06:07:15.291416+0000","last_fullsized":"2023-10-17T06:07:15.291416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:48:38.906119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292919+0000","last_change":"2023-10-17T06:07:08.596874+0000","last_active":"2023-10-17T06:07:15.292919+0000","last_peered":"2023-10-17T06:07:15.292919+0000","last_clean":"2023-10-17T06:07:15.292919+0000","last_became_active":"2023-10-17T06:07:08.596349+0000","last_became_peered":"2023-10-17T06:07:08.596349+0000","last_unstale":"2023-10-17T06:07:15.292919+0000","last_undegraded":"2023-10-17T06:07:15.292919+0000","last_fullsized":"2023-10-17T06:07:15.292919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:37:33.810500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289117+0000","last_change":"2023-10-17T06:07:13.888460+0000","last_active":"2023-10-17T06:07:15.289117+0000","last_peered":"2023-10-17T06:07:15.289117+0000","last_clean":"2023-10-17T06:07:15.289117+0000","last_became_active":"2023-10-17T06:07:13.887943+0000","last_became_peered":"2023-10-17T06:07:13.887943+0000","last_unstale":"2023-10-17T06:07:15.289117+0000","last_undegraded":"2023-10-17T06:07:15.289117+0000","last_fullsized":"2023-10-17T06:07:15.289117+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:33:38.048460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.288908+0000","last_change":"2023-10-17T06:07:09.823031+0000","last_active":"2023-10-17T06:07:15.288908+0000","last_peered":"2023-10-17T06:07:15.288908+0000","last_clean":"2023-10-17T06:07:15.288908+0000","last_became_active":"2023-10-17T06:07:09.821733+0000","last_became_peered":"2023-10-17T06:07:09.821733+0000","last_unstale":"2023-10-17T06:07:15.288908+0000","last_undegraded":"2023-10-17T06:07:15.288908+0000","last_fullsized":"2023-10-17T06:07:15.288908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:38.659545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883705+0000","last_change":"2023-10-17T06:07:08.588590+0000","last_active":"2023-10-17T06:07:14.883705+0000","last_peered":"2023-10-17T06:07:14.883705+0000","last_clean":"2023-10-17T06:07:14.883705+0000","last_became_active":"2023-10-17T06:07:08.587376+0000","last_became_peered":"2023-10-17T06:07:08.587376+0000","last_unstale":"2023-10-17T06:07:14.883705+0000","last_undegraded":"2023-10-17T06:07:14.883705+0000","last_fullsized":"2023-10-17T06:07:14.883705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:19:27.180864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876041+0000","last_change":"2023-10-17T06:07:13.890283+0000","last_active":"2023-10-17T06:07:14.876041+0000","last_peered":"2023-10-17T06:07:14.876041+0000","last_clean":"2023-10-17T06:07:14.876041+0000","last_became_active":"2023-10-17T06:07:13.889919+0000","last_became_peered":"2023-10-17T06:07:13.889919+0000","last_unstale":"2023-10-17T06:07:14.876041+0000","last_undegraded":"2023-10-17T06:07:14.876041+0000","last_fullsized":"2023-10-17T06:07:14.876041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:37:49.339156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877482+0000","last_change":"2023-10-17T06:07:08.600096+0000","last_active":"2023-10-17T06:07:14.877482+0000","last_peered":"2023-10-17T06:07:14.877482+0000","last_clean":"2023-10-17T06:07:14.877482+0000","last_became_active":"2023-10-17T06:07:08.599786+0000","last_became_peered":"2023-10-17T06:07:08.599786+0000","last_unstale":"2023-10-17T06:07:14.877482+0000","last_undegraded":"2023-10-17T06:07:14.877482+0000","last_fullsized":"2023-10-17T06:07:14.877482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:37:33.810500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290765+0000","last_change":"2023-10-17T06:07:09.827852+0000","last_active":"2023-10-17T06:07:15.290765+0000","last_peered":"2023-10-17T06:07:15.290765+0000","last_clean":"2023-10-17T06:07:15.290765+0000","last_became_active":"2023-10-17T06:07:09.827571+0000","last_became_peered":"2023-10-17T06:07:09.827571+0000","last_unstale":"2023-10-17T06:07:15.290765+0000","last_undegraded":"2023-10-17T06:07:15.290765+0000","last_fullsized":"2023-10-17T06:07:15.290765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:53:34.063175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289369+0000","last_change":"2023-10-17T06:07:13.888236+0000","last_active":"2023-10-17T06:07:15.289369+0000","last_peered":"2023-10-17T06:07:15.289369+0000","last_clean":"2023-10-17T06:07:15.289369+0000","last_became_active":"2023-10-17T06:07:13.887862+0000","last_became_peered":"2023-10-17T06:07:13.887862+0000","last_unstale":"2023-10-17T06:07:15.289369+0000","last_undegraded":"2023-10-17T06:07:15.289369+0000","last_fullsized":"2023-10-17T06:07:15.289369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:39:43.311635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:26.389600+0000","last_change":"2023-10-17T06:07:08.585396+0000","last_active":"2023-10-17T06:07:26.389600+0000","last_peered":"2023-10-17T06:07:26.389600+0000","last_clean":"2023-10-17T06:07:26.389600+0000","last_became_active":"2023-10-17T06:07:08.585072+0000","last_became_peered":"2023-10-17T06:07:08.585072+0000","last_unstale":"2023-10-17T06:07:26.389600+0000","last_undegraded":"2023-10-17T06:07:26.389600+0000","last_fullsized":"2023-10-17T06:07:26.389600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:45:24.700330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880432+0000","last_change":"2023-10-17T06:07:09.821236+0000","last_active":"2023-10-17T06:07:14.880432+0000","last_peered":"2023-10-17T06:07:14.880432+0000","last_clean":"2023-10-17T06:07:14.880432+0000","last_became_active":"2023-10-17T06:07:09.820316+0000","last_became_peered":"2023-10-17T06:07:09.820316+0000","last_unstale":"2023-10-17T06:07:14.880432+0000","last_undegraded":"2023-10-17T06:07:14.880432+0000","last_fullsized":"2023-10-17T06:07:14.880432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:57:46.498866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290002+0000","last_change":"2023-10-17T06:07:13.889504+0000","last_active":"2023-10-17T06:07:15.290002+0000","last_peered":"2023-10-17T06:07:15.290002+0000","last_clean":"2023-10-17T06:07:15.290002+0000","last_became_active":"2023-10-17T06:07:13.889086+0000","last_became_peered":"2023-10-17T06:07:13.889086+0000","last_unstale":"2023-10-17T06:07:15.290002+0000","last_undegraded":"2023-10-17T06:07:15.290002+0000","last_fullsized":"2023-10-17T06:07:15.290002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:11:54.644012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880973+0000","last_change":"2023-10-17T06:07:09.808679+0000","last_active":"2023-10-17T06:07:14.880973+0000","last_peered":"2023-10-17T06:07:14.880973+0000","last_clean":"2023-10-17T06:07:14.880973+0000","last_became_active":"2023-10-17T06:07:09.808378+0000","last_became_peered":"2023-10-17T06:07:09.808378+0000","last_unstale":"2023-10-17T06:07:14.880973+0000","last_undegraded":"2023-10-17T06:07:14.880973+0000","last_fullsized":"2023-10-17T06:07:14.880973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:25:25.772710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290420+0000","last_change":"2023-10-17T06:07:02.749481+0000","last_active":"2023-10-17T06:07:15.290420+0000","last_peered":"2023-10-17T06:07:15.290420+0000","last_clean":"2023-10-17T06:07:15.290420+0000","last_became_active":"2023-10-17T06:07:02.748983+0000","last_became_peered":"2023-10-17T06:07:02.748983+0000","last_unstale":"2023-10-17T06:07:15.290420+0000","last_undegraded":"2023-10-17T06:07:15.290420+0000","last_fullsized":"2023-10-17T06:07:15.290420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:52.302673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292851+0000","last_change":"2023-10-17T06:07:08.590018+0000","last_active":"2023-10-17T06:07:15.292851+0000","last_peered":"2023-10-17T06:07:15.292851+0000","last_clean":"2023-10-17T06:07:15.292851+0000","last_became_active":"2023-10-17T06:07:08.589795+0000","last_became_peered":"2023-10-17T06:07:08.589795+0000","last_unstale":"2023-10-17T06:07:15.292851+0000","last_undegraded":"2023-10-17T06:07:15.292851+0000","last_fullsized":"2023-10-17T06:07:15.292851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:36:10.482323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.288777+0000","last_change":"2023-10-17T06:07:13.896667+0000","last_active":"2023-10-17T06:07:15.288777+0000","last_peered":"2023-10-17T06:07:15.288777+0000","last_clean":"2023-10-17T06:07:15.288777+0000","last_became_active":"2023-10-17T06:07:13.896149+0000","last_became_peered":"2023-10-17T06:07:13.896149+0000","last_unstale":"2023-10-17T06:07:15.288777+0000","last_undegraded":"2023-10-17T06:07:15.288777+0000","last_fullsized":"2023-10-17T06:07:15.288777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:11:10.074323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289308+0000","last_change":"2023-10-17T06:07:09.822567+0000","last_active":"2023-10-17T06:07:15.289308+0000","last_peered":"2023-10-17T06:07:15.289308+0000","last_clean":"2023-10-17T06:07:15.289308+0000","last_became_active":"2023-10-17T06:07:09.822127+0000","last_became_peered":"2023-10-17T06:07:09.822127+0000","last_unstale":"2023-10-17T06:07:15.289308+0000","last_undegraded":"2023-10-17T06:07:15.289308+0000","last_fullsized":"2023-10-17T06:07:15.289308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:34:10.878608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292896+0000","last_change":"2023-10-17T06:07:02.746809+0000","last_active":"2023-10-17T06:07:15.292896+0000","last_peered":"2023-10-17T06:07:15.292896+0000","last_clean":"2023-10-17T06:07:15.292896+0000","last_became_active":"2023-10-17T06:07:02.746404+0000","last_became_peered":"2023-10-17T06:07:02.746404+0000","last_unstale":"2023-10-17T06:07:15.292896+0000","last_undegraded":"2023-10-17T06:07:15.292896+0000","last_fullsized":"2023-10-17T06:07:15.292896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:31.812798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291815+0000","last_change":"2023-10-17T06:07:08.592911+0000","last_active":"2023-10-17T06:07:15.291815+0000","last_peered":"2023-10-17T06:07:15.291815+0000","last_clean":"2023-10-17T06:07:15.291815+0000","last_became_active":"2023-10-17T06:07:08.592015+0000","last_became_peered":"2023-10-17T06:07:08.592015+0000","last_unstale":"2023-10-17T06:07:15.291815+0000","last_undegraded":"2023-10-17T06:07:15.291815+0000","last_fullsized":"2023-10-17T06:07:15.291815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:47:30.276476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880688+0000","last_change":"2023-10-17T06:07:13.886563+0000","last_active":"2023-10-17T06:07:14.880688+0000","last_peered":"2023-10-17T06:07:14.880688+0000","last_clean":"2023-10-17T06:07:14.880688+0000","last_became_active":"2023-10-17T06:07:13.885937+0000","last_became_peered":"2023-10-17T06:07:13.885937+0000","last_unstale":"2023-10-17T06:07:14.880688+0000","last_undegraded":"2023-10-17T06:07:14.880688+0000","last_fullsized":"2023-10-17T06:07:14.880688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:16:52.713610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292036+0000","last_change":"2023-10-17T06:07:09.828851+0000","last_active":"2023-10-17T06:07:15.292036+0000","last_peered":"2023-10-17T06:07:15.292036+0000","last_clean":"2023-10-17T06:07:15.292036+0000","last_became_active":"2023-10-17T06:07:09.828580+0000","last_became_peered":"2023-10-17T06:07:09.828580+0000","last_unstale":"2023-10-17T06:07:15.292036+0000","last_undegraded":"2023-10-17T06:07:15.292036+0000","last_fullsized":"2023-10-17T06:07:15.292036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:37:45.060322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878005+0000","last_change":"2023-10-17T06:07:02.943274+0000","last_active":"2023-10-17T06:07:14.878005+0000","last_peered":"2023-10-17T06:07:14.878005+0000","last_clean":"2023-10-17T06:07:14.878005+0000","last_became_active":"2023-10-17T06:07:02.942674+0000","last_became_peered":"2023-10-17T06:07:02.942674+0000","last_unstale":"2023-10-17T06:07:14.878005+0000","last_undegraded":"2023-10-17T06:07:14.878005+0000","last_fullsized":"2023-10-17T06:07:14.878005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:15:10.401039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291849+0000","last_change":"2023-10-17T06:07:08.589251+0000","last_active":"2023-10-17T06:07:15.291849+0000","last_peered":"2023-10-17T06:07:15.291849+0000","last_clean":"2023-10-17T06:07:15.291849+0000","last_became_active":"2023-10-17T06:07:08.588935+0000","last_became_peered":"2023-10-17T06:07:08.588935+0000","last_unstale":"2023-10-17T06:07:15.291849+0000","last_undegraded":"2023-10-17T06:07:15.291849+0000","last_fullsized":"2023-10-17T06:07:15.291849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:12:42.498064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289409+0000","last_change":"2023-10-17T06:07:13.878939+0000","last_active":"2023-10-17T06:07:15.289409+0000","last_peered":"2023-10-17T06:07:15.289409+0000","last_clean":"2023-10-17T06:07:15.289409+0000","last_became_active":"2023-10-17T06:07:13.878486+0000","last_became_peered":"2023-10-17T06:07:13.878486+0000","last_unstale":"2023-10-17T06:07:15.289409+0000","last_undegraded":"2023-10-17T06:07:15.289409+0000","last_fullsized":"2023-10-17T06:07:15.289409+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:56.529454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291030+0000","last_change":"2023-10-17T06:07:09.811823+0000","last_active":"2023-10-17T06:07:15.291030+0000","last_peered":"2023-10-17T06:07:15.291030+0000","last_clean":"2023-10-17T06:07:15.291030+0000","last_became_active":"2023-10-17T06:07:09.811377+0000","last_became_peered":"2023-10-17T06:07:09.811377+0000","last_unstale":"2023-10-17T06:07:15.291030+0000","last_undegraded":"2023-10-17T06:07:15.291030+0000","last_fullsized":"2023-10-17T06:07:15.291030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:40:59.235159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292614+0000","last_change":"2023-10-17T06:07:02.943009+0000","last_active":"2023-10-17T06:07:15.292614+0000","last_peered":"2023-10-17T06:07:15.292614+0000","last_clean":"2023-10-17T06:07:15.292614+0000","last_became_active":"2023-10-17T06:07:02.942298+0000","last_became_peered":"2023-10-17T06:07:02.942298+0000","last_unstale":"2023-10-17T06:07:15.292614+0000","last_undegraded":"2023-10-17T06:07:15.292614+0000","last_fullsized":"2023-10-17T06:07:15.292614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:50:16.016660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883796+0000","last_change":"2023-10-17T06:07:08.593524+0000","last_active":"2023-10-17T06:07:14.883796+0000","last_peered":"2023-10-17T06:07:14.883796+0000","last_clean":"2023-10-17T06:07:14.883796+0000","last_became_active":"2023-10-17T06:07:08.593028+0000","last_became_peered":"2023-10-17T06:07:08.593028+0000","last_unstale":"2023-10-17T06:07:14.883796+0000","last_undegraded":"2023-10-17T06:07:14.883796+0000","last_fullsized":"2023-10-17T06:07:14.883796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:40:28.607693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291886+0000","last_change":"2023-10-17T06:07:13.894885+0000","last_active":"2023-10-17T06:07:15.291886+0000","last_peered":"2023-10-17T06:07:15.291886+0000","last_clean":"2023-10-17T06:07:15.291886+0000","last_became_active":"2023-10-17T06:07:13.894293+0000","last_became_peered":"2023-10-17T06:07:13.894293+0000","last_unstale":"2023-10-17T06:07:15.291886+0000","last_undegraded":"2023-10-17T06:07:15.291886+0000","last_fullsized":"2023-10-17T06:07:15.291886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:35.048426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291587+0000","last_change":"2023-10-17T06:07:09.821864+0000","last_active":"2023-10-17T06:07:15.291587+0000","last_peered":"2023-10-17T06:07:15.291587+0000","last_clean":"2023-10-17T06:07:15.291587+0000","last_became_active":"2023-10-17T06:07:09.821343+0000","last_became_peered":"2023-10-17T06:07:09.821343+0000","last_unstale":"2023-10-17T06:07:15.291587+0000","last_undegraded":"2023-10-17T06:07:15.291587+0000","last_fullsized":"2023-10-17T06:07:15.291587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:34:13.301999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880514+0000","last_change":"2023-10-17T06:07:08.599322+0000","last_active":"2023-10-17T06:07:14.880514+0000","last_peered":"2023-10-17T06:07:14.880514+0000","last_clean":"2023-10-17T06:07:14.880514+0000","last_became_active":"2023-10-17T06:07:08.598993+0000","last_became_peered":"2023-10-17T06:07:08.598993+0000","last_unstale":"2023-10-17T06:07:14.880514+0000","last_undegraded":"2023-10-17T06:07:14.880514+0000","last_fullsized":"2023-10-17T06:07:14.880514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:58:22.441442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883204+0000","last_change":"2023-10-17T06:07:02.747287+0000","last_active":"2023-10-17T06:07:14.883204+0000","last_peered":"2023-10-17T06:07:14.883204+0000","last_clean":"2023-10-17T06:07:14.883204+0000","last_became_active":"2023-10-17T06:07:02.746659+0000","last_became_peered":"2023-10-17T06:07:02.746659+0000","last_unstale":"2023-10-17T06:07:14.883204+0000","last_undegraded":"2023-10-17T06:07:14.883204+0000","last_fullsized":"2023-10-17T06:07:14.883204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:10:58.948743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292088+0000","last_change":"2023-10-17T06:07:13.889327+0000","last_active":"2023-10-17T06:07:15.292088+0000","last_peered":"2023-10-17T06:07:15.292088+0000","last_clean":"2023-10-17T06:07:15.292088+0000","last_became_active":"2023-10-17T06:07:13.888985+0000","last_became_peered":"2023-10-17T06:07:13.888985+0000","last_unstale":"2023-10-17T06:07:15.292088+0000","last_undegraded":"2023-10-17T06:07:15.292088+0000","last_fullsized":"2023-10-17T06:07:15.292088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:37.345075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292956+0000","last_change":"2023-10-17T06:07:09.831976+0000","last_active":"2023-10-17T06:07:15.292956+0000","last_peered":"2023-10-17T06:07:15.292956+0000","last_clean":"2023-10-17T06:07:15.292956+0000","last_became_active":"2023-10-17T06:07:09.831699+0000","last_became_peered":"2023-10-17T06:07:09.831699+0000","last_unstale":"2023-10-17T06:07:15.292956+0000","last_undegraded":"2023-10-17T06:07:15.292956+0000","last_fullsized":"2023-10-17T06:07:15.292956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:34:10.878608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290153+0000","last_change":"2023-10-17T06:07:08.590078+0000","last_active":"2023-10-17T06:07:15.290153+0000","last_peered":"2023-10-17T06:07:15.290153+0000","last_clean":"2023-10-17T06:07:15.290153+0000","last_became_active":"2023-10-17T06:07:08.589804+0000","last_became_peered":"2023-10-17T06:07:08.589804+0000","last_unstale":"2023-10-17T06:07:15.290153+0000","last_undegraded":"2023-10-17T06:07:15.290153+0000","last_fullsized":"2023-10-17T06:07:15.290153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:31:11.288698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876702+0000","last_change":"2023-10-17T06:07:02.746785+0000","last_active":"2023-10-17T06:07:14.876702+0000","last_peered":"2023-10-17T06:07:14.876702+0000","last_clean":"2023-10-17T06:07:14.876702+0000","last_became_active":"2023-10-17T06:07:02.746431+0000","last_became_peered":"2023-10-17T06:07:02.746431+0000","last_unstale":"2023-10-17T06:07:14.876702+0000","last_undegraded":"2023-10-17T06:07:14.876702+0000","last_fullsized":"2023-10-17T06:07:14.876702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:47:53.439829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877694+0000","last_change":"2023-10-17T06:07:13.894877+0000","last_active":"2023-10-17T06:07:14.877694+0000","last_peered":"2023-10-17T06:07:14.877694+0000","last_clean":"2023-10-17T06:07:14.877694+0000","last_became_active":"2023-10-17T06:07:13.894391+0000","last_became_peered":"2023-10-17T06:07:13.894391+0000","last_unstale":"2023-10-17T06:07:14.877694+0000","last_undegraded":"2023-10-17T06:07:14.877694+0000","last_fullsized":"2023-10-17T06:07:14.877694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:38:55.951805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292434+0000","last_change":"2023-10-17T06:07:09.833782+0000","last_active":"2023-10-17T06:07:15.292434+0000","last_peered":"2023-10-17T06:07:15.292434+0000","last_clean":"2023-10-17T06:07:15.292434+0000","last_became_active":"2023-10-17T06:07:09.833566+0000","last_became_peered":"2023-10-17T06:07:09.833566+0000","last_unstale":"2023-10-17T06:07:15.292434+0000","last_undegraded":"2023-10-17T06:07:15.292434+0000","last_fullsized":"2023-10-17T06:07:15.292434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:16:06.764453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290341+0000","last_change":"2023-10-17T06:07:08.594763+0000","last_active":"2023-10-17T06:07:15.290341+0000","last_peered":"2023-10-17T06:07:15.290341+0000","last_clean":"2023-10-17T06:07:15.290341+0000","last_became_active":"2023-10-17T06:07:08.594251+0000","last_became_peered":"2023-10-17T06:07:08.594251+0000","last_unstale":"2023-10-17T06:07:15.290341+0000","last_undegraded":"2023-10-17T06:07:15.290341+0000","last_fullsized":"2023-10-17T06:07:15.290341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:27:17.766731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876827+0000","last_change":"2023-10-17T06:07:02.746953+0000","last_active":"2023-10-17T06:07:14.876827+0000","last_peered":"2023-10-17T06:07:14.876827+0000","last_clean":"2023-10-17T06:07:14.876827+0000","last_became_active":"2023-10-17T06:07:02.746344+0000","last_became_peered":"2023-10-17T06:07:02.746344+0000","last_unstale":"2023-10-17T06:07:14.876827+0000","last_undegraded":"2023-10-17T06:07:14.876827+0000","last_fullsized":"2023-10-17T06:07:14.876827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:30:18.210606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883947+0000","last_change":"2023-10-17T06:07:13.893870+0000","last_active":"2023-10-17T06:07:14.883947+0000","last_peered":"2023-10-17T06:07:14.883947+0000","last_clean":"2023-10-17T06:07:14.883947+0000","last_became_active":"2023-10-17T06:07:13.893268+0000","last_became_peered":"2023-10-17T06:07:13.893268+0000","last_unstale":"2023-10-17T06:07:14.883947+0000","last_undegraded":"2023-10-17T06:07:14.883947+0000","last_fullsized":"2023-10-17T06:07:14.883947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:48:43.184952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289977+0000","last_change":"2023-10-17T06:07:09.822737+0000","last_active":"2023-10-17T06:07:15.289977+0000","last_peered":"2023-10-17T06:07:15.289977+0000","last_clean":"2023-10-17T06:07:15.289977+0000","last_became_active":"2023-10-17T06:07:09.822425+0000","last_became_peered":"2023-10-17T06:07:09.822425+0000","last_unstale":"2023-10-17T06:07:15.289977+0000","last_undegraded":"2023-10-17T06:07:15.289977+0000","last_fullsized":"2023-10-17T06:07:15.289977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:56:42.475703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291869+0000","last_change":"2023-10-17T06:07:08.593933+0000","last_active":"2023-10-17T06:07:15.291869+0000","last_peered":"2023-10-17T06:07:15.291869+0000","last_clean":"2023-10-17T06:07:15.291869+0000","last_became_active":"2023-10-17T06:07:08.593639+0000","last_became_peered":"2023-10-17T06:07:08.593639+0000","last_unstale":"2023-10-17T06:07:15.291869+0000","last_undegraded":"2023-10-17T06:07:15.291869+0000","last_fullsized":"2023-10-17T06:07:15.291869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:54:25.029489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883311+0000","last_change":"2023-10-17T06:07:02.747957+0000","last_active":"2023-10-17T06:07:14.883311+0000","last_peered":"2023-10-17T06:07:14.883311+0000","last_clean":"2023-10-17T06:07:14.883311+0000","last_became_active":"2023-10-17T06:07:02.747569+0000","last_became_peered":"2023-10-17T06:07:02.747569+0000","last_unstale":"2023-10-17T06:07:14.883311+0000","last_undegraded":"2023-10-17T06:07:14.883311+0000","last_fullsized":"2023-10-17T06:07:14.883311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:34:04.031861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876594+0000","last_change":"2023-10-17T06:06:55.916050+0000","last_active":"2023-10-17T06:07:14.876594+0000","last_peered":"2023-10-17T06:07:14.876594+0000","last_clean":"2023-10-17T06:07:14.876594+0000","last_became_active":"2023-10-17T06:06:55.914009+0000","last_became_peered":"2023-10-17T06:06:55.914009+0000","last_unstale":"2023-10-17T06:07:14.876594+0000","last_undegraded":"2023-10-17T06:07:14.876594+0000","last_fullsized":"2023-10-17T06:07:14.876594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:06:54.658926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:06:54.658926+0000","last_clean_scrub_stamp":"2023-10-17T06:06:54.658926+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:14:50.752002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877158+0000","last_change":"2023-10-17T06:07:13.894679+0000","last_active":"2023-10-17T06:07:14.877158+0000","last_peered":"2023-10-17T06:07:14.877158+0000","last_clean":"2023-10-17T06:07:14.877158+0000","last_became_active":"2023-10-17T06:07:13.894264+0000","last_became_peered":"2023-10-17T06:07:13.894264+0000","last_unstale":"2023-10-17T06:07:14.877158+0000","last_undegraded":"2023-10-17T06:07:14.877158+0000","last_fullsized":"2023-10-17T06:07:14.877158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:59:46.899748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292942+0000","last_change":"2023-10-17T06:07:09.820803+0000","last_active":"2023-10-17T06:07:15.292942+0000","last_peered":"2023-10-17T06:07:15.292942+0000","last_clean":"2023-10-17T06:07:15.292942+0000","last_became_active":"2023-10-17T06:07:09.820566+0000","last_became_peered":"2023-10-17T06:07:09.820566+0000","last_unstale":"2023-10-17T06:07:15.292942+0000","last_undegraded":"2023-10-17T06:07:15.292942+0000","last_fullsized":"2023-10-17T06:07:15.292942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:40:00.062457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289860+0000","last_change":"2023-10-17T06:07:08.589080+0000","last_active":"2023-10-17T06:07:15.289860+0000","last_peered":"2023-10-17T06:07:15.289860+0000","last_clean":"2023-10-17T06:07:15.289860+0000","last_became_active":"2023-10-17T06:07:08.588709+0000","last_became_peered":"2023-10-17T06:07:08.588709+0000","last_unstale":"2023-10-17T06:07:15.289860+0000","last_undegraded":"2023-10-17T06:07:15.289860+0000","last_fullsized":"2023-10-17T06:07:15.289860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:53:36.421259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879485+0000","last_change":"2023-10-17T06:07:13.886705+0000","last_active":"2023-10-17T06:07:14.879485+0000","last_peered":"2023-10-17T06:07:14.879485+0000","last_clean":"2023-10-17T06:07:14.879485+0000","last_became_active":"2023-10-17T06:07:13.883384+0000","last_became_peered":"2023-10-17T06:07:13.883384+0000","last_unstale":"2023-10-17T06:07:14.879485+0000","last_undegraded":"2023-10-17T06:07:14.879485+0000","last_fullsized":"2023-10-17T06:07:14.879485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:52:08.295905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879605+0000","last_change":"2023-10-17T06:07:09.829835+0000","last_active":"2023-10-17T06:07:14.879605+0000","last_peered":"2023-10-17T06:07:14.879605+0000","last_clean":"2023-10-17T06:07:14.879605+0000","last_became_active":"2023-10-17T06:07:09.829477+0000","last_became_peered":"2023-10-17T06:07:09.829477+0000","last_unstale":"2023-10-17T06:07:14.879605+0000","last_undegraded":"2023-10-17T06:07:14.879605+0000","last_fullsized":"2023-10-17T06:07:14.879605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:54:26.203860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880973+0000","last_change":"2023-10-17T06:07:08.598286+0000","last_active":"2023-10-17T06:07:14.880973+0000","last_peered":"2023-10-17T06:07:14.880973+0000","last_clean":"2023-10-17T06:07:14.880973+0000","last_became_active":"2023-10-17T06:07:08.596247+0000","last_became_peered":"2023-10-17T06:07:08.596247+0000","last_unstale":"2023-10-17T06:07:14.880973+0000","last_undegraded":"2023-10-17T06:07:14.880973+0000","last_fullsized":"2023-10-17T06:07:14.880973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:17.909670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883786+0000","last_change":"2023-10-17T06:07:13.881124+0000","last_active":"2023-10-17T06:07:14.883786+0000","last_peered":"2023-10-17T06:07:14.883786+0000","last_clean":"2023-10-17T06:07:14.883786+0000","last_became_active":"2023-10-17T06:07:13.880566+0000","last_became_peered":"2023-10-17T06:07:13.880566+0000","last_unstale":"2023-10-17T06:07:14.883786+0000","last_undegraded":"2023-10-17T06:07:14.883786+0000","last_fullsized":"2023-10-17T06:07:14.883786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:40:21.126507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879496+0000","last_change":"2023-10-17T06:07:09.813992+0000","last_active":"2023-10-17T06:07:14.879496+0000","last_peered":"2023-10-17T06:07:14.879496+0000","last_clean":"2023-10-17T06:07:14.879496+0000","last_became_active":"2023-10-17T06:07:09.813694+0000","last_became_peered":"2023-10-17T06:07:09.813694+0000","last_unstale":"2023-10-17T06:07:14.879496+0000","last_undegraded":"2023-10-17T06:07:14.879496+0000","last_fullsized":"2023-10-17T06:07:14.879496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:47:35.627253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290037+0000","last_change":"2023-10-17T06:07:08.596976+0000","last_active":"2023-10-17T06:07:15.290037+0000","last_peered":"2023-10-17T06:07:15.290037+0000","last_clean":"2023-10-17T06:07:15.290037+0000","last_became_active":"2023-10-17T06:07:08.596039+0000","last_became_peered":"2023-10-17T06:07:08.596039+0000","last_unstale":"2023-10-17T06:07:15.290037+0000","last_undegraded":"2023-10-17T06:07:15.290037+0000","last_fullsized":"2023-10-17T06:07:15.290037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:38:51.815549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292604+0000","last_change":"2023-10-17T06:07:13.903277+0000","last_active":"2023-10-17T06:07:15.292604+0000","last_peered":"2023-10-17T06:07:15.292604+0000","last_clean":"2023-10-17T06:07:15.292604+0000","last_became_active":"2023-10-17T06:07:13.902862+0000","last_became_peered":"2023-10-17T06:07:13.902862+0000","last_unstale":"2023-10-17T06:07:15.292604+0000","last_undegraded":"2023-10-17T06:07:15.292604+0000","last_fullsized":"2023-10-17T06:07:15.292604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:10:38.378978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878801+0000","last_change":"2023-10-17T06:07:09.810979+0000","last_active":"2023-10-17T06:07:14.878801+0000","last_peered":"2023-10-17T06:07:14.878801+0000","last_clean":"2023-10-17T06:07:14.878801+0000","last_became_active":"2023-10-17T06:07:09.810707+0000","last_became_peered":"2023-10-17T06:07:09.810707+0000","last_unstale":"2023-10-17T06:07:14.878801+0000","last_undegraded":"2023-10-17T06:07:14.878801+0000","last_fullsized":"2023-10-17T06:07:14.878801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:27:20.376471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290069+0000","last_change":"2023-10-17T06:07:08.597403+0000","last_active":"2023-10-17T06:07:15.290069+0000","last_peered":"2023-10-17T06:07:15.290069+0000","last_clean":"2023-10-17T06:07:15.290069+0000","last_became_active":"2023-10-17T06:07:08.597116+0000","last_became_peered":"2023-10-17T06:07:08.597116+0000","last_unstale":"2023-10-17T06:07:15.290069+0000","last_undegraded":"2023-10-17T06:07:15.290069+0000","last_fullsized":"2023-10-17T06:07:15.290069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:47:26.508182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877174+0000","last_change":"2023-10-17T06:07:13.886903+0000","last_active":"2023-10-17T06:07:14.877174+0000","last_peered":"2023-10-17T06:07:14.877174+0000","last_clean":"2023-10-17T06:07:14.877174+0000","last_became_active":"2023-10-17T06:07:13.886501+0000","last_became_peered":"2023-10-17T06:07:13.886501+0000","last_unstale":"2023-10-17T06:07:14.877174+0000","last_undegraded":"2023-10-17T06:07:14.877174+0000","last_fullsized":"2023-10-17T06:07:14.877174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:31:21.259203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291890+0000","last_change":"2023-10-17T06:07:09.832883+0000","last_active":"2023-10-17T06:07:15.291890+0000","last_peered":"2023-10-17T06:07:15.291890+0000","last_clean":"2023-10-17T06:07:15.291890+0000","last_became_active":"2023-10-17T06:07:09.832553+0000","last_became_peered":"2023-10-17T06:07:09.832553+0000","last_unstale":"2023-10-17T06:07:15.291890+0000","last_undegraded":"2023-10-17T06:07:15.291890+0000","last_fullsized":"2023-10-17T06:07:15.291890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:55:00.304360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883483+0000","last_change":"2023-10-17T06:07:08.593403+0000","last_active":"2023-10-17T06:07:14.883483+0000","last_peered":"2023-10-17T06:07:14.883483+0000","last_clean":"2023-10-17T06:07:14.883483+0000","last_became_active":"2023-10-17T06:07:08.593066+0000","last_became_peered":"2023-10-17T06:07:08.593066+0000","last_unstale":"2023-10-17T06:07:14.883483+0000","last_undegraded":"2023-10-17T06:07:14.883483+0000","last_fullsized":"2023-10-17T06:07:14.883483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:30.456365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877086+0000","last_change":"2023-10-17T06:07:13.884346+0000","last_active":"2023-10-17T06:07:14.877086+0000","last_peered":"2023-10-17T06:07:14.877086+0000","last_clean":"2023-10-17T06:07:14.877086+0000","last_became_active":"2023-10-17T06:07:13.883456+0000","last_became_peered":"2023-10-17T06:07:13.883456+0000","last_unstale":"2023-10-17T06:07:14.877086+0000","last_undegraded":"2023-10-17T06:07:14.877086+0000","last_fullsized":"2023-10-17T06:07:14.877086+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:21:45.506386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289623+0000","last_change":"2023-10-17T06:07:09.830493+0000","last_active":"2023-10-17T06:07:15.289623+0000","last_peered":"2023-10-17T06:07:15.289623+0000","last_clean":"2023-10-17T06:07:15.289623+0000","last_became_active":"2023-10-17T06:07:09.830215+0000","last_became_peered":"2023-10-17T06:07:09.830215+0000","last_unstale":"2023-10-17T06:07:15.289623+0000","last_undegraded":"2023-10-17T06:07:15.289623+0000","last_fullsized":"2023-10-17T06:07:15.289623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:16:55.493821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877695+0000","last_change":"2023-10-17T06:07:08.591482+0000","last_active":"2023-10-17T06:07:14.877695+0000","last_peered":"2023-10-17T06:07:14.877695+0000","last_clean":"2023-10-17T06:07:14.877695+0000","last_became_active":"2023-10-17T06:07:08.591091+0000","last_became_peered":"2023-10-17T06:07:08.591091+0000","last_unstale":"2023-10-17T06:07:14.877695+0000","last_undegraded":"2023-10-17T06:07:14.877695+0000","last_fullsized":"2023-10-17T06:07:14.877695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:37:06.939408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876853+0000","last_change":"2023-10-17T06:07:13.888286+0000","last_active":"2023-10-17T06:07:14.876853+0000","last_peered":"2023-10-17T06:07:14.876853+0000","last_clean":"2023-10-17T06:07:14.876853+0000","last_became_active":"2023-10-17T06:07:13.887859+0000","last_became_peered":"2023-10-17T06:07:13.887859+0000","last_unstale":"2023-10-17T06:07:14.876853+0000","last_undegraded":"2023-10-17T06:07:14.876853+0000","last_fullsized":"2023-10-17T06:07:14.876853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:16:48.285650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880831+0000","last_change":"2023-10-17T06:07:09.817272+0000","last_active":"2023-10-17T06:07:14.880831+0000","last_peered":"2023-10-17T06:07:14.880831+0000","last_clean":"2023-10-17T06:07:14.880831+0000","last_became_active":"2023-10-17T06:07:09.817017+0000","last_became_peered":"2023-10-17T06:07:09.817017+0000","last_unstale":"2023-10-17T06:07:14.880831+0000","last_undegraded":"2023-10-17T06:07:14.880831+0000","last_fullsized":"2023-10-17T06:07:14.880831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:30:38.008679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877583+0000","last_change":"2023-10-17T06:07:08.595069+0000","last_active":"2023-10-17T06:07:14.877583+0000","last_peered":"2023-10-17T06:07:14.877583+0000","last_clean":"2023-10-17T06:07:14.877583+0000","last_became_active":"2023-10-17T06:07:08.594724+0000","last_became_peered":"2023-10-17T06:07:08.594724+0000","last_unstale":"2023-10-17T06:07:14.877583+0000","last_undegraded":"2023-10-17T06:07:14.877583+0000","last_fullsized":"2023-10-17T06:07:14.877583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:30:12.591601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876486+0000","last_change":"2023-10-17T06:07:13.900939+0000","last_active":"2023-10-17T06:07:14.876486+0000","last_peered":"2023-10-17T06:07:14.876486+0000","last_clean":"2023-10-17T06:07:14.876486+0000","last_became_active":"2023-10-17T06:07:13.900504+0000","last_became_peered":"2023-10-17T06:07:13.900504+0000","last_unstale":"2023-10-17T06:07:14.876486+0000","last_undegraded":"2023-10-17T06:07:14.876486+0000","last_fullsized":"2023-10-17T06:07:14.876486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:57:24.016963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.882704+0000","last_change":"2023-10-17T06:07:09.811667+0000","last_active":"2023-10-17T06:07:14.882704+0000","last_peered":"2023-10-17T06:07:14.882704+0000","last_clean":"2023-10-17T06:07:14.882704+0000","last_became_active":"2023-10-17T06:07:09.811321+0000","last_became_peered":"2023-10-17T06:07:09.811321+0000","last_unstale":"2023-10-17T06:07:14.882704+0000","last_undegraded":"2023-10-17T06:07:14.882704+0000","last_fullsized":"2023-10-17T06:07:14.882704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:10:34.100144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877826+0000","last_change":"2023-10-17T06:07:08.591244+0000","last_active":"2023-10-17T06:07:14.877826+0000","last_peered":"2023-10-17T06:07:14.877826+0000","last_clean":"2023-10-17T06:07:14.877826+0000","last_became_active":"2023-10-17T06:07:08.591000+0000","last_became_peered":"2023-10-17T06:07:08.591000+0000","last_unstale":"2023-10-17T06:07:14.877826+0000","last_undegraded":"2023-10-17T06:07:14.877826+0000","last_fullsized":"2023-10-17T06:07:14.877826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:35:22.580242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876460+0000","last_change":"2023-10-17T06:07:13.885860+0000","last_active":"2023-10-17T06:07:14.876460+0000","last_peered":"2023-10-17T06:07:14.876460+0000","last_clean":"2023-10-17T06:07:14.876460+0000","last_became_active":"2023-10-17T06:07:13.885432+0000","last_became_peered":"2023-10-17T06:07:13.885432+0000","last_unstale":"2023-10-17T06:07:14.876460+0000","last_undegraded":"2023-10-17T06:07:14.876460+0000","last_fullsized":"2023-10-17T06:07:14.876460+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:37.345075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883253+0000","last_change":"2023-10-17T06:07:13.890018+0000","last_active":"2023-10-17T06:07:14.883253+0000","last_peered":"2023-10-17T06:07:14.883253+0000","last_clean":"2023-10-17T06:07:14.883253+0000","last_became_active":"2023-10-17T06:07:13.889612+0000","last_became_peered":"2023-10-17T06:07:13.889612+0000","last_unstale":"2023-10-17T06:07:14.883253+0000","last_undegraded":"2023-10-17T06:07:14.883253+0000","last_fullsized":"2023-10-17T06:07:14.883253+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:42.938379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289398+0000","last_change":"2023-10-17T06:07:08.591493+0000","last_active":"2023-10-17T06:07:15.289398+0000","last_peered":"2023-10-17T06:07:15.289398+0000","last_clean":"2023-10-17T06:07:15.289398+0000","last_became_active":"2023-10-17T06:07:08.591098+0000","last_became_peered":"2023-10-17T06:07:08.591098+0000","last_unstale":"2023-10-17T06:07:15.289398+0000","last_undegraded":"2023-10-17T06:07:15.289398+0000","last_fullsized":"2023-10-17T06:07:15.289398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:30:33.950741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291656+0000","last_change":"2023-10-17T06:07:09.822777+0000","last_active":"2023-10-17T06:07:15.291656+0000","last_peered":"2023-10-17T06:07:15.291656+0000","last_clean":"2023-10-17T06:07:15.291656+0000","last_became_active":"2023-10-17T06:07:09.822160+0000","last_became_peered":"2023-10-17T06:07:09.822160+0000","last_unstale":"2023-10-17T06:07:15.291656+0000","last_undegraded":"2023-10-17T06:07:15.291656+0000","last_fullsized":"2023-10-17T06:07:15.291656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:36:13.053365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291408+0000","last_change":"2023-10-17T06:07:13.895666+0000","last_active":"2023-10-17T06:07:15.291408+0000","last_peered":"2023-10-17T06:07:15.291408+0000","last_clean":"2023-10-17T06:07:15.291408+0000","last_became_active":"2023-10-17T06:07:13.895322+0000","last_became_peered":"2023-10-17T06:07:13.895322+0000","last_unstale":"2023-10-17T06:07:15.291408+0000","last_undegraded":"2023-10-17T06:07:15.291408+0000","last_fullsized":"2023-10-17T06:07:15.291408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:49:57.036218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876863+0000","last_change":"2023-10-17T06:07:08.589887+0000","last_active":"2023-10-17T06:07:14.876863+0000","last_peered":"2023-10-17T06:07:14.876863+0000","last_clean":"2023-10-17T06:07:14.876863+0000","last_became_active":"2023-10-17T06:07:08.589511+0000","last_became_peered":"2023-10-17T06:07:08.589511+0000","last_unstale":"2023-10-17T06:07:14.876863+0000","last_undegraded":"2023-10-17T06:07:14.876863+0000","last_fullsized":"2023-10-17T06:07:14.876863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:16:05.759169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292842+0000","last_change":"2023-10-17T06:07:09.818359+0000","last_active":"2023-10-17T06:07:15.292842+0000","last_peered":"2023-10-17T06:07:15.292842+0000","last_clean":"2023-10-17T06:07:15.292842+0000","last_became_active":"2023-10-17T06:07:09.818092+0000","last_became_peered":"2023-10-17T06:07:09.818092+0000","last_unstale":"2023-10-17T06:07:15.292842+0000","last_undegraded":"2023-10-17T06:07:15.292842+0000","last_fullsized":"2023-10-17T06:07:15.292842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:59:42.620914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291756+0000","last_change":"2023-10-17T06:07:08.585166+0000","last_active":"2023-10-17T06:07:15.291756+0000","last_peered":"2023-10-17T06:07:15.291756+0000","last_clean":"2023-10-17T06:07:15.291756+0000","last_became_active":"2023-10-17T06:07:08.583972+0000","last_became_peered":"2023-10-17T06:07:08.583972+0000","last_unstale":"2023-10-17T06:07:15.291756+0000","last_undegraded":"2023-10-17T06:07:15.291756+0000","last_fullsized":"2023-10-17T06:07:15.291756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:02:40.893599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883659+0000","last_change":"2023-10-17T06:07:09.816356+0000","last_active":"2023-10-17T06:07:14.883659+0000","last_peered":"2023-10-17T06:07:14.883659+0000","last_clean":"2023-10-17T06:07:14.883659+0000","last_became_active":"2023-10-17T06:07:09.816066+0000","last_became_peered":"2023-10-17T06:07:09.816066+0000","last_unstale":"2023-10-17T06:07:14.883659+0000","last_undegraded":"2023-10-17T06:07:14.883659+0000","last_fullsized":"2023-10-17T06:07:14.883659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:40:06.008865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290633+0000","last_change":"2023-10-17T06:07:13.885847+0000","last_active":"2023-10-17T06:07:15.290633+0000","last_peered":"2023-10-17T06:07:15.290633+0000","last_clean":"2023-10-17T06:07:15.290633+0000","last_became_active":"2023-10-17T06:07:13.883713+0000","last_became_peered":"2023-10-17T06:07:13.883713+0000","last_unstale":"2023-10-17T06:07:15.290633+0000","last_undegraded":"2023-10-17T06:07:15.290633+0000","last_fullsized":"2023-10-17T06:07:15.290633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:40:10.287699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876962+0000","last_change":"2023-10-17T06:07:08.590802+0000","last_active":"2023-10-17T06:07:14.876962+0000","last_peered":"2023-10-17T06:07:14.876962+0000","last_clean":"2023-10-17T06:07:14.876962+0000","last_became_active":"2023-10-17T06:07:08.590520+0000","last_became_peered":"2023-10-17T06:07:08.590520+0000","last_unstale":"2023-10-17T06:07:14.876962+0000","last_undegraded":"2023-10-17T06:07:14.876962+0000","last_fullsized":"2023-10-17T06:07:14.876962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:20.494951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290839+0000","last_change":"2023-10-17T06:07:09.819059+0000","last_active":"2023-10-17T06:07:15.290839+0000","last_peered":"2023-10-17T06:07:15.290839+0000","last_clean":"2023-10-17T06:07:15.290839+0000","last_became_active":"2023-10-17T06:07:09.818796+0000","last_became_peered":"2023-10-17T06:07:09.818796+0000","last_unstale":"2023-10-17T06:07:15.290839+0000","last_undegraded":"2023-10-17T06:07:15.290839+0000","last_fullsized":"2023-10-17T06:07:15.290839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:40:16.847674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883411+0000","last_change":"2023-10-17T06:07:13.891595+0000","last_active":"2023-10-17T06:07:14.883411+0000","last_peered":"2023-10-17T06:07:14.883411+0000","last_clean":"2023-10-17T06:07:14.883411+0000","last_became_active":"2023-10-17T06:07:13.891300+0000","last_became_peered":"2023-10-17T06:07:13.891300+0000","last_unstale":"2023-10-17T06:07:14.883411+0000","last_undegraded":"2023-10-17T06:07:14.883411+0000","last_fullsized":"2023-10-17T06:07:14.883411+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:39:43.311635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289114+0000","last_change":"2023-10-17T06:07:09.830559+0000","last_active":"2023-10-17T06:07:15.289114+0000","last_peered":"2023-10-17T06:07:15.289114+0000","last_clean":"2023-10-17T06:07:15.289114+0000","last_became_active":"2023-10-17T06:07:09.830247+0000","last_became_peered":"2023-10-17T06:07:09.830247+0000","last_unstale":"2023-10-17T06:07:15.289114+0000","last_undegraded":"2023-10-17T06:07:15.289114+0000","last_fullsized":"2023-10-17T06:07:15.289114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:16:06.924811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.288720+0000","last_change":"2023-10-17T06:07:09.817481+0000","last_active":"2023-10-17T06:07:15.288720+0000","last_peered":"2023-10-17T06:07:15.288720+0000","last_clean":"2023-10-17T06:07:15.288720+0000","last_became_active":"2023-10-17T06:07:09.814576+0000","last_became_peered":"2023-10-17T06:07:09.814576+0000","last_unstale":"2023-10-17T06:07:15.288720+0000","last_undegraded":"2023-10-17T06:07:15.288720+0000","last_fullsized":"2023-10-17T06:07:15.288720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:17:19.424257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878534+0000","last_change":"2023-10-17T06:07:09.820385+0000","last_active":"2023-10-17T06:07:14.878534+0000","last_peered":"2023-10-17T06:07:14.878534+0000","last_clean":"2023-10-17T06:07:14.878534+0000","last_became_active":"2023-10-17T06:07:09.820110+0000","last_became_peered":"2023-10-17T06:07:09.820110+0000","last_unstale":"2023-10-17T06:07:14.878534+0000","last_undegraded":"2023-10-17T06:07:14.878534+0000","last_fullsized":"2023-10-17T06:07:14.878534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:11:35.023099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289802+0000","last_change":"2023-10-17T06:07:09.822056+0000","last_active":"2023-10-17T06:07:15.289802+0000","last_peered":"2023-10-17T06:07:15.289802+0000","last_clean":"2023-10-17T06:07:15.289802+0000","last_became_active":"2023-10-17T06:07:09.821742+0000","last_became_peered":"2023-10-17T06:07:09.821742+0000","last_unstale":"2023-10-17T06:07:15.289802+0000","last_undegraded":"2023-10-17T06:07:15.289802+0000","last_fullsized":"2023-10-17T06:07:15.289802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:31.461649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292457+0000","last_change":"2023-10-17T06:07:09.837676+0000","last_active":"2023-10-17T06:07:15.292457+0000","last_peered":"2023-10-17T06:07:15.292457+0000","last_clean":"2023-10-17T06:07:15.292457+0000","last_became_active":"2023-10-17T06:07:09.837404+0000","last_became_peered":"2023-10-17T06:07:09.837404+0000","last_unstale":"2023-10-17T06:07:15.292457+0000","last_undegraded":"2023-10-17T06:07:15.292457+0000","last_fullsized":"2023-10-17T06:07:15.292457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:16:45.547751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883628+0000","last_change":"2023-10-17T06:07:09.815486+0000","last_active":"2023-10-17T06:07:14.883628+0000","last_peered":"2023-10-17T06:07:14.883628+0000","last_clean":"2023-10-17T06:07:14.883628+0000","last_became_active":"2023-10-17T06:07:09.815216+0000","last_became_peered":"2023-10-17T06:07:09.815216+0000","last_unstale":"2023-10-17T06:07:14.883628+0000","last_undegraded":"2023-10-17T06:07:14.883628+0000","last_fullsized":"2023-10-17T06:07:14.883628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:47:27.513466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292809+0000","last_change":"2023-10-17T06:07:09.832482+0000","last_active":"2023-10-17T06:07:15.292809+0000","last_peered":"2023-10-17T06:07:15.292809+0000","last_clean":"2023-10-17T06:07:15.292809+0000","last_became_active":"2023-10-17T06:07:09.829842+0000","last_became_peered":"2023-10-17T06:07:09.829842+0000","last_unstale":"2023-10-17T06:07:15.292809+0000","last_undegraded":"2023-10-17T06:07:15.292809+0000","last_fullsized":"2023-10-17T06:07:15.292809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:17:19.424257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292847+0000","last_change":"2023-10-17T06:07:09.825942+0000","last_active":"2023-10-17T06:07:15.292847+0000","last_peered":"2023-10-17T06:07:15.292847+0000","last_clean":"2023-10-17T06:07:15.292847+0000","last_became_active":"2023-10-17T06:07:09.825679+0000","last_became_peered":"2023-10-17T06:07:09.825679+0000","last_unstale":"2023-10-17T06:07:15.292847+0000","last_undegraded":"2023-10-17T06:07:15.292847+0000","last_fullsized":"2023-10-17T06:07:15.292847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:11:05.795490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876229+0000","last_change":"2023-10-17T06:07:09.823556+0000","last_active":"2023-10-17T06:07:14.876229+0000","last_peered":"2023-10-17T06:07:14.876229+0000","last_clean":"2023-10-17T06:07:14.876229+0000","last_became_active":"2023-10-17T06:07:09.823156+0000","last_became_peered":"2023-10-17T06:07:09.823156+0000","last_unstale":"2023-10-17T06:07:14.876229+0000","last_undegraded":"2023-10-17T06:07:14.876229+0000","last_fullsized":"2023-10-17T06:07:14.876229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:13:26.091146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.288516+0000","last_change":"2023-10-17T06:07:09.839598+0000","last_active":"2023-10-17T06:07:15.288516+0000","last_peered":"2023-10-17T06:07:15.288516+0000","last_clean":"2023-10-17T06:07:15.288516+0000","last_became_active":"2023-10-17T06:07:09.839335+0000","last_became_peered":"2023-10-17T06:07:09.839335+0000","last_unstale":"2023-10-17T06:07:15.288516+0000","last_undegraded":"2023-10-17T06:07:15.288516+0000","last_fullsized":"2023-10-17T06:07:15.288516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:50:22.863407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291642+0000","last_change":"2023-10-17T06:07:09.833987+0000","last_active":"2023-10-17T06:07:15.291642+0000","last_peered":"2023-10-17T06:07:15.291642+0000","last_clean":"2023-10-17T06:07:15.291642+0000","last_became_active":"2023-10-17T06:07:09.829996+0000","last_became_peered":"2023-10-17T06:07:09.829996+0000","last_unstale":"2023-10-17T06:07:15.291642+0000","last_undegraded":"2023-10-17T06:07:15.291642+0000","last_fullsized":"2023-10-17T06:07:15.291642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:02:25.494146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877356+0000","last_change":"2023-10-17T06:07:09.823715+0000","last_active":"2023-10-17T06:07:14.877356+0000","last_peered":"2023-10-17T06:07:14.877356+0000","last_clean":"2023-10-17T06:07:14.877356+0000","last_became_active":"2023-10-17T06:07:09.823129+0000","last_became_peered":"2023-10-17T06:07:09.823129+0000","last_unstale":"2023-10-17T06:07:14.877356+0000","last_undegraded":"2023-10-17T06:07:14.877356+0000","last_fullsized":"2023-10-17T06:07:14.877356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:36:11.487607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878693+0000","last_change":"2023-10-17T06:07:09.820940+0000","last_active":"2023-10-17T06:07:14.878693+0000","last_peered":"2023-10-17T06:07:14.878693+0000","last_clean":"2023-10-17T06:07:14.878693+0000","last_became_active":"2023-10-17T06:07:09.820736+0000","last_became_peered":"2023-10-17T06:07:09.820736+0000","last_unstale":"2023-10-17T06:07:14.878693+0000","last_undegraded":"2023-10-17T06:07:14.878693+0000","last_fullsized":"2023-10-17T06:07:14.878693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:23:39.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877433+0000","last_change":"2023-10-17T06:07:09.830379+0000","last_active":"2023-10-17T06:07:14.877433+0000","last_peered":"2023-10-17T06:07:14.877433+0000","last_clean":"2023-10-17T06:07:14.877433+0000","last_became_active":"2023-10-17T06:07:09.830134+0000","last_became_peered":"2023-10-17T06:07:09.830134+0000","last_unstale":"2023-10-17T06:07:14.877433+0000","last_undegraded":"2023-10-17T06:07:14.877433+0000","last_fullsized":"2023-10-17T06:07:14.877433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:37:37.680937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877600+0000","last_change":"2023-10-17T06:07:09.819191+0000","last_active":"2023-10-17T06:07:14.877600+0000","last_peered":"2023-10-17T06:07:14.877600+0000","last_clean":"2023-10-17T06:07:14.877600+0000","last_became_active":"2023-10-17T06:07:09.818894+0000","last_became_peered":"2023-10-17T06:07:09.818894+0000","last_unstale":"2023-10-17T06:07:14.877600+0000","last_undegraded":"2023-10-17T06:07:14.877600+0000","last_fullsized":"2023-10-17T06:07:14.877600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:40:29.612977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292543+0000","last_change":"2023-10-17T06:07:09.825371+0000","last_active":"2023-10-17T06:07:15.292543+0000","last_peered":"2023-10-17T06:07:15.292543+0000","last_clean":"2023-10-17T06:07:15.292543+0000","last_became_active":"2023-10-17T06:07:09.825096+0000","last_became_peered":"2023-10-17T06:07:09.825096+0000","last_unstale":"2023-10-17T06:07:15.292543+0000","last_undegraded":"2023-10-17T06:07:15.292543+0000","last_fullsized":"2023-10-17T06:07:15.292543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:30:13.596885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878194+0000","last_change":"2023-10-17T06:07:09.834663+0000","last_active":"2023-10-17T06:07:14.878194+0000","last_peered":"2023-10-17T06:07:14.878194+0000","last_clean":"2023-10-17T06:07:14.878194+0000","last_became_active":"2023-10-17T06:07:09.834468+0000","last_became_peered":"2023-10-17T06:07:09.834468+0000","last_unstale":"2023-10-17T06:07:14.878194+0000","last_undegraded":"2023-10-17T06:07:14.878194+0000","last_fullsized":"2023-10-17T06:07:14.878194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:36:13.053365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876830+0000","last_change":"2023-10-17T06:07:09.832756+0000","last_active":"2023-10-17T06:07:14.876830+0000","last_peered":"2023-10-17T06:07:14.876830+0000","last_clean":"2023-10-17T06:07:14.876830+0000","last_became_active":"2023-10-17T06:07:09.832258+0000","last_became_peered":"2023-10-17T06:07:09.832258+0000","last_unstale":"2023-10-17T06:07:14.876830+0000","last_undegraded":"2023-10-17T06:07:14.876830+0000","last_fullsized":"2023-10-17T06:07:14.876830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:19:22.830429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883010+0000","last_change":"2023-10-17T06:07:09.820030+0000","last_active":"2023-10-17T06:07:14.883010+0000","last_peered":"2023-10-17T06:07:14.883010+0000","last_clean":"2023-10-17T06:07:14.883010+0000","last_became_active":"2023-10-17T06:07:09.819756+0000","last_became_peered":"2023-10-17T06:07:09.819756+0000","last_unstale":"2023-10-17T06:07:14.883010+0000","last_undegraded":"2023-10-17T06:07:14.883010+0000","last_fullsized":"2023-10-17T06:07:14.883010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:50:22.863407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877122+0000","last_change":"2023-10-17T06:07:09.826587+0000","last_active":"2023-10-17T06:07:14.877122+0000","last_peered":"2023-10-17T06:07:14.877122+0000","last_clean":"2023-10-17T06:07:14.877122+0000","last_became_active":"2023-10-17T06:07:09.825860+0000","last_became_peered":"2023-10-17T06:07:09.825860+0000","last_unstale":"2023-10-17T06:07:14.877122+0000","last_undegraded":"2023-10-17T06:07:14.877122+0000","last_fullsized":"2023-10-17T06:07:14.877122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:59:29.208159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877138+0000","last_change":"2023-10-17T06:07:09.810586+0000","last_active":"2023-10-17T06:07:14.877138+0000","last_peered":"2023-10-17T06:07:14.877138+0000","last_clean":"2023-10-17T06:07:14.877138+0000","last_became_active":"2023-10-17T06:07:09.809875+0000","last_became_peered":"2023-10-17T06:07:09.809875+0000","last_unstale":"2023-10-17T06:07:14.877138+0000","last_undegraded":"2023-10-17T06:07:14.877138+0000","last_fullsized":"2023-10-17T06:07:14.877138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:20:16.424591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879359+0000","last_change":"2023-10-17T06:07:09.820690+0000","last_active":"2023-10-17T06:07:14.879359+0000","last_peered":"2023-10-17T06:07:14.879359+0000","last_clean":"2023-10-17T06:07:14.879359+0000","last_became_active":"2023-10-17T06:07:09.820404+0000","last_became_peered":"2023-10-17T06:07:09.820404+0000","last_unstale":"2023-10-17T06:07:14.879359+0000","last_undegraded":"2023-10-17T06:07:14.879359+0000","last_fullsized":"2023-10-17T06:07:14.879359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:51:00.656359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883627+0000","last_change":"2023-10-17T06:07:09.840730+0000","last_active":"2023-10-17T06:07:14.883627+0000","last_peered":"2023-10-17T06:07:14.883627+0000","last_clean":"2023-10-17T06:07:14.883627+0000","last_became_active":"2023-10-17T06:07:09.839503+0000","last_became_peered":"2023-10-17T06:07:09.839503+0000","last_unstale":"2023-10-17T06:07:14.883627+0000","last_undegraded":"2023-10-17T06:07:14.883627+0000","last_fullsized":"2023-10-17T06:07:14.883627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:53:37.426543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292422+0000","last_change":"2023-10-17T06:07:09.833449+0000","last_active":"2023-10-17T06:07:15.292422+0000","last_peered":"2023-10-17T06:07:15.292422+0000","last_clean":"2023-10-17T06:07:15.292422+0000","last_became_active":"2023-10-17T06:07:09.833054+0000","last_became_peered":"2023-10-17T06:07:09.833054+0000","last_unstale":"2023-10-17T06:07:15.292422+0000","last_undegraded":"2023-10-17T06:07:15.292422+0000","last_fullsized":"2023-10-17T06:07:15.292422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:30:04.900751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.882634+0000","last_change":"2023-10-17T06:07:09.809269+0000","last_active":"2023-10-17T06:07:14.882634+0000","last_peered":"2023-10-17T06:07:14.882634+0000","last_clean":"2023-10-17T06:07:14.882634+0000","last_became_active":"2023-10-17T06:07:09.808823+0000","last_became_peered":"2023-10-17T06:07:09.808823+0000","last_unstale":"2023-10-17T06:07:14.882634+0000","last_undegraded":"2023-10-17T06:07:14.882634+0000","last_fullsized":"2023-10-17T06:07:14.882634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:00:19.054030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876659+0000","last_change":"2023-10-17T06:07:09.837236+0000","last_active":"2023-10-17T06:07:14.876659+0000","last_peered":"2023-10-17T06:07:14.876659+0000","last_clean":"2023-10-17T06:07:14.876659+0000","last_became_active":"2023-10-17T06:07:09.831813+0000","last_became_peered":"2023-10-17T06:07:09.831813+0000","last_unstale":"2023-10-17T06:07:14.876659+0000","last_undegraded":"2023-10-17T06:07:14.876659+0000","last_fullsized":"2023-10-17T06:07:14.876659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:30:04.900751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877874+0000","last_change":"2023-10-17T06:07:09.818210+0000","last_active":"2023-10-17T06:07:14.877874+0000","last_peered":"2023-10-17T06:07:14.877874+0000","last_clean":"2023-10-17T06:07:14.877874+0000","last_became_active":"2023-10-17T06:07:09.817925+0000","last_became_peered":"2023-10-17T06:07:09.817925+0000","last_unstale":"2023-10-17T06:07:14.877874+0000","last_undegraded":"2023-10-17T06:07:14.877874+0000","last_fullsized":"2023-10-17T06:07:14.877874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:49:52.757385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292096+0000","last_change":"2023-10-17T06:07:09.825092+0000","last_active":"2023-10-17T06:07:15.292096+0000","last_peered":"2023-10-17T06:07:15.292096+0000","last_clean":"2023-10-17T06:07:15.292096+0000","last_became_active":"2023-10-17T06:07:09.824830+0000","last_became_peered":"2023-10-17T06:07:09.824830+0000","last_unstale":"2023-10-17T06:07:15.292096+0000","last_undegraded":"2023-10-17T06:07:15.292096+0000","last_fullsized":"2023-10-17T06:07:15.292096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:13:26.091146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289991+0000","last_change":"2023-10-17T06:07:09.839421+0000","last_active":"2023-10-17T06:07:15.289991+0000","last_peered":"2023-10-17T06:07:15.289991+0000","last_clean":"2023-10-17T06:07:15.289991+0000","last_became_active":"2023-10-17T06:07:09.839171+0000","last_became_peered":"2023-10-17T06:07:09.839171+0000","last_unstale":"2023-10-17T06:07:15.289991+0000","last_undegraded":"2023-10-17T06:07:15.289991+0000","last_fullsized":"2023-10-17T06:07:15.289991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:47:47.791448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879222+0000","last_change":"2023-10-17T06:07:09.834207+0000","last_active":"2023-10-17T06:07:14.879222+0000","last_peered":"2023-10-17T06:07:14.879222+0000","last_clean":"2023-10-17T06:07:14.879222+0000","last_became_active":"2023-10-17T06:07:09.833966+0000","last_became_peered":"2023-10-17T06:07:09.833966+0000","last_unstale":"2023-10-17T06:07:14.879222+0000","last_undegraded":"2023-10-17T06:07:14.879222+0000","last_fullsized":"2023-10-17T06:07:14.879222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:54:25.125826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883402+0000","last_change":"2023-10-17T06:07:09.823776+0000","last_active":"2023-10-17T06:07:14.883402+0000","last_peered":"2023-10-17T06:07:14.883402+0000","last_clean":"2023-10-17T06:07:14.883402+0000","last_became_active":"2023-10-17T06:07:09.823394+0000","last_became_peered":"2023-10-17T06:07:09.823394+0000","last_unstale":"2023-10-17T06:07:14.883402+0000","last_undegraded":"2023-10-17T06:07:14.883402+0000","last_fullsized":"2023-10-17T06:07:14.883402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:45:39.252622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877489+0000","last_change":"2023-10-17T06:07:09.818284+0000","last_active":"2023-10-17T06:07:14.877489+0000","last_peered":"2023-10-17T06:07:14.877489+0000","last_clean":"2023-10-17T06:07:14.877489+0000","last_became_active":"2023-10-17T06:07:09.817980+0000","last_became_peered":"2023-10-17T06:07:09.817980+0000","last_unstale":"2023-10-17T06:07:14.877489+0000","last_undegraded":"2023-10-17T06:07:14.877489+0000","last_fullsized":"2023-10-17T06:07:14.877489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:42:16.038333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":122060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":122712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":125957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":917504,"data_stored":716485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7230000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5129999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.611}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6779999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":122150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":122060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5089999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":122060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6220000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":711019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5409999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-17T06:07:37.376 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-17T06:07:37.376 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-17T06:07:37.377 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-17T06:07:37.377 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-17T06:07:37.378 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-17T06:07:37.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.587+0000 7f3543fff700 1 Processor -- start 2023-10-17T06:07:37.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.587+0000 7f3543fff700 1 -- start start 2023-10-17T06:07:37.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.591+0000 7f3543fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f35440d2e00 0x7f35440b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:37.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.591+0000 7f3543fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3544160710 0x7f35440d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:37.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.591+0000 7f3543fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354415d0d0 con 0x7f35440b5ae0 2023-10-17T06:07:37.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.591+0000 7f3543fff700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354415df90 con 0x7f35440d2e00 2023-10-17T06:07:37.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.591+0000 7f3543fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354406f0f0 con 0x7f3544160710 2023-10-17T06:07:37.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.591+0000 7f3542ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f35440d2e00 0x7f35440b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:37.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.591+0000 7f3542ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f35440d2e00 0x7f35440b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48560/0 (socket says 172.21.15.125:48560) 2023-10-17T06:07:37.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.591+0000 7f3542ffd700 1 -- 172.21.15.125:0/2655269951 learned_addr learned my addr 172.21.15.125:0/2655269951 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:37.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.591+0000 7f35427fc700 1 --2- 172.21.15.125:0/2655269951 >> v2:172.21.15.184:3300/0 conn(0x7f3544160710 0x7f35440d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:37.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.591+0000 7f3542ffd700 1 -- 172.21.15.125:0/2655269951 >> v2:172.21.15.184:3300/0 conn(0x7f3544160710 msgr2=0x7f35440d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:37.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.591+0000 7f3542ffd700 1 --2- 172.21.15.125:0/2655269951 >> v2:172.21.15.184:3300/0 conn(0x7f3544160710 0x7f35440d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.591+0000 7f3542ffd700 1 -- 172.21.15.125:0/2655269951 >> v1:172.21.15.184:6789/0 conn(0x7f35440b5ae0 legacy=0x7f354406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:37.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.591+0000 7f3542ffd700 1 -- 172.21.15.125:0/2655269951 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35440d3720 con 0x7f35440d2e00 2023-10-17T06:07:37.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.591+0000 7f3542ffd700 1 --2- 172.21.15.125:0/2655269951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35440d2e00 0x7f35440b6e00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f35440d2420 tx=0x7f3534009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfc60ee4690df7c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:37.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.591+0000 7f3541ffb700 1 -- 172.21.15.125:0/2655269951 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3534011830 con 0x7f35440d2e00 2023-10-17T06:07:37.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.591+0000 7f3541ffb700 1 -- 172.21.15.125:0/2655269951 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3534011990 con 0x7f35440d2e00 2023-10-17T06:07:37.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.591+0000 7f3541ffb700 1 -- 172.21.15.125:0/2655269951 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3534011d20 con 0x7f35440d2e00 2023-10-17T06:07:37.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.595+0000 7f3543fff700 1 -- 172.21.15.125:0/2655269951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35440d2e00 msgr2=0x7f35440b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:37.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.595+0000 7f3543fff700 1 --2- 172.21.15.125:0/2655269951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35440d2e00 0x7f35440b6e00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f35440d2420 tx=0x7f3534009bf0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.595+0000 7f3543fff700 1 -- 172.21.15.125:0/2655269951 shutdown_connections 2023-10-17T06:07:37.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.595+0000 7f3543fff700 1 --2- 172.21.15.125:0/2655269951 >> v2:172.21.15.184:3300/0 conn(0x7f3544160710 0x7f35440d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.595+0000 7f3543fff700 1 --2- 172.21.15.125:0/2655269951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35440d2e00 0x7f35440b6e00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.595+0000 7f3543fff700 1 -- 172.21.15.125:0/2655269951 >> 172.21.15.125:0/2655269951 conn(0x7f3544069f20 msgr2=0x7f354406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:37.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.595+0000 7f3543fff700 1 -- 172.21.15.125:0/2655269951 shutdown_connections 2023-10-17T06:07:37.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.595+0000 7f3543fff700 1 -- 172.21.15.125:0/2655269951 wait complete. 2023-10-17T06:07:37.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.595+0000 7f3543fff700 1 Processor -- start 2023-10-17T06:07:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.595+0000 7f3543fff700 1 -- start start 2023-10-17T06:07:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.595+0000 7f3543fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35440b5ae0 0x7f35441493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.595+0000 7f3543fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35440d2e00 0x7f35440b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:37.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.595+0000 7f3543fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3544160710 0x7f35440b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:37.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.595+0000 7f3543fff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354414e850 con 0x7f35440d2e00 2023-10-17T06:07:37.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.595+0000 7f3543fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354414eb30 con 0x7f3544160710 2023-10-17T06:07:37.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.595+0000 7f3543fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354414ee10 con 0x7f35440b5ae0 2023-10-17T06:07:37.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.599+0000 7f35427fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35440d2e00 0x7f35440b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:37.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.599+0000 7f35427fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35440d2e00 0x7f35440b2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48566/0 (socket says 172.21.15.125:48566) 2023-10-17T06:07:37.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.599+0000 7f35427fc700 1 -- 172.21.15.125:0/3282399872 learned_addr learned my addr 172.21.15.125:0/3282399872 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:37.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.599+0000 7f3542ffd700 1 --2- 172.21.15.125:0/3282399872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35440b5ae0 0x7f35441493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:37.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.599+0000 7f35437fe700 1 --2- 172.21.15.125:0/3282399872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3544160710 0x7f35440b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:37.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.599+0000 7f35427fc700 1 -- 172.21.15.125:0/3282399872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35440b5ae0 msgr2=0x7f35441493b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:37.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.599+0000 7f35427fc700 1 --2- 172.21.15.125:0/3282399872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35440b5ae0 0x7f35441493b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.599+0000 7f35427fc700 1 -- 172.21.15.125:0/3282399872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3544160710 msgr2=0x7f35440b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:37.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.599+0000 7f35427fc700 1 --2- 172.21.15.125:0/3282399872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3544160710 0x7f35440b2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.599+0000 7f35427fc700 1 -- 172.21.15.125:0/3282399872 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3534009570 con 0x7f35440d2e00 2023-10-17T06:07:37.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.599+0000 7f35427fc700 1 --2- 172.21.15.125:0/3282399872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35440d2e00 0x7f35440b2750 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f353800e9a0 tx=0x7f353800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:37.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.599+0000 7f352b7fe700 1 -- 172.21.15.125:0/3282399872 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538009720 con 0x7f35440d2e00 2023-10-17T06:07:37.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.599+0000 7f352b7fe700 1 -- 172.21.15.125:0/3282399872 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353800c690 con 0x7f35440d2e00 2023-10-17T06:07:37.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.599+0000 7f3543fff700 1 -- 172.21.15.125:0/3282399872 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3544149ea0 con 0x7f35440d2e00 2023-10-17T06:07:37.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.599+0000 7f352b7fe700 1 -- 172.21.15.125:0/3282399872 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353800ca20 con 0x7f35440d2e00 2023-10-17T06:07:37.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.599+0000 7f3543fff700 1 -- 172.21.15.125:0/3282399872 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354414dbb0 con 0x7f35440d2e00 2023-10-17T06:07:37.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.603+0000 7f3543fff700 1 -- 172.21.15.125:0/3282399872 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354414a030 con 0x7f35440d2e00 2023-10-17T06:07:37.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.603+0000 7f352b7fe700 1 -- 172.21.15.125:0/3282399872 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f353800cb80 con 0x7f35440d2e00 2023-10-17T06:07:37.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.603+0000 7f352b7fe700 1 --2- 172.21.15.125:0/3282399872 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f35300656f0 0x7f3530067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:37.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.603+0000 7f352b7fe700 1 -- 172.21.15.125:0/3282399872 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3538083060 con 0x7f35440d2e00 2023-10-17T06:07:37.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.603+0000 7f3542ffd700 1 --2- 172.21.15.125:0/3282399872 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f35300656f0 0x7f3530067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:37.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.607+0000 7f3542ffd700 1 --2- 172.21.15.125:0/3282399872 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f35300656f0 0x7f3530067bb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3534000c00 tx=0x7f3534008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:37.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.611+0000 7f352b7fe700 1 -- 172.21.15.125:0/3282399872 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f35380508c0 con 0x7f35440d2e00 2023-10-17T06:07:37.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.851+0000 7f3543fff700 1 -- 172.21.15.125:0/3282399872 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f3544072e60 con 0x7f35440d2e00 2023-10-17T06:07:37.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.859+0000 7f352b7fe700 1 -- 172.21.15.125:0/3282399872 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+162897 (secure 0 0 0) 0x7f3538053ee0 con 0x7f35440d2e00 2023-10-17T06:07:37.863 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:37.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.863+0000 7f3543fff700 1 -- 172.21.15.125:0/3282399872 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f35300656f0 msgr2=0x7f3530067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:37.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.863+0000 7f3543fff700 1 --2- 172.21.15.125:0/3282399872 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f35300656f0 0x7f3530067bb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3534000c00 tx=0x7f3534008030 comp rx=0 tx=0).stop 2023-10-17T06:07:37.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.863+0000 7f3543fff700 1 -- 172.21.15.125:0/3282399872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35440d2e00 msgr2=0x7f35440b2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:37.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.863+0000 7f3543fff700 1 --2- 172.21.15.125:0/3282399872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35440d2e00 0x7f35440b2750 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f353800e9a0 tx=0x7f353800ecb0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.863+0000 7f3543fff700 1 -- 172.21.15.125:0/3282399872 shutdown_connections 2023-10-17T06:07:37.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.863+0000 7f3543fff700 1 --2- 172.21.15.125:0/3282399872 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f35300656f0 0x7f3530067bb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.863+0000 7f3543fff700 1 --2- 172.21.15.125:0/3282399872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3544160710 0x7f35440b2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.863+0000 7f3543fff700 1 --2- 172.21.15.125:0/3282399872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35440d2e00 0x7f35440b2750 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.863+0000 7f3543fff700 1 --2- 172.21.15.125:0/3282399872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f35440b5ae0 0x7f35441493b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:37.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.863+0000 7f3543fff700 1 -- 172.21.15.125:0/3282399872 >> 172.21.15.125:0/3282399872 conn(0x7f3544069f20 msgr2=0x7f354406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:37.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.863+0000 7f3543fff700 1 -- 172.21.15.125:0/3282399872 shutdown_connections 2023-10-17T06:07:37.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:37.863+0000 7f3543fff700 1 -- 172.21.15.125:0/3282399872 wait complete. 2023-10-17T06:07:37.892 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":2516570548},{"type":"v1","addr":"172.21.15.125:6833","nonce":2516570548}]},"active_addr":"172.21.15.125:6833/2516570548","active_change":"2023-10-17T06:06:47.920320+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":13105515}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":2198957674}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":1684834849}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":1221536714}]}]} 2023-10-17T06:07:37.896 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-17T06:07:37.897 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-17T06:07:37.897 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:07:38.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.051+0000 7f325d969700 1 Processor -- start 2023-10-17T06:07:38.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.051+0000 7f325d969700 1 -- start start 2023-10-17T06:07:38.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.055+0000 7f325d969700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f32580b5ae0 0x7f32580b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.055+0000 7f325d969700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f325815d0d0 con 0x7f3258160710 2023-10-17T06:07:38.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.055+0000 7f325d969700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f325806f0f0 con 0x7f32580d2e00 2023-10-17T06:07:38.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.055+0000 7f325d969700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f325815df90 con 0x7f32580b5ae0 2023-10-17T06:07:38.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.055+0000 7f325d168700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f32580b5ae0 0x7f32580b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.055+0000 7f324ffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3258160710 0x7f325806db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53924/0 (socket says 172.21.15.125:53924) 2023-10-17T06:07:38.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.055+0000 7f325d168700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f32580b5ae0 0x7f32580b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48580/0 (socket says 172.21.15.125:48580) 2023-10-17T06:07:38.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.055+0000 7f324ffff700 1 -- 172.21.15.125:0/660095071 learned_addr learned my addr 172.21.15.125:0/660095071 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:38.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.055+0000 7f325d168700 1 -- 172.21.15.125:0/660095071 >> v1:172.21.15.184:6789/0 conn(0x7f32580d2e00 legacy=0x7f32580d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.055+0000 7f325d168700 1 -- 172.21.15.125:0/660095071 >> v1:172.21.15.125:6789/0 conn(0x7f3258160710 legacy=0x7f325806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.055+0000 7f325d168700 1 -- 172.21.15.125:0/660095071 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325815d310 con 0x7f32580b5ae0 2023-10-17T06:07:38.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.055+0000 7f325d168700 1 --2- 172.21.15.125:0/660095071 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32580b5ae0 0x7f32580b6e00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3250009840 tx=0x7f3250009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec838b0bae40bed server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:38.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.059+0000 7f324f7fe700 1 -- 172.21.15.125:0/660095071 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250005ea0 con 0x7f32580b5ae0 2023-10-17T06:07:38.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.059+0000 7f324f7fe700 1 -- 172.21.15.125:0/660095071 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3250006030 con 0x7f32580b5ae0 2023-10-17T06:07:38.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.059+0000 7f324f7fe700 1 -- 172.21.15.125:0/660095071 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32500063c0 con 0x7f32580b5ae0 2023-10-17T06:07:38.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.059+0000 7f325d969700 1 -- 172.21.15.125:0/660095071 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32580b5ae0 msgr2=0x7f32580b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.059+0000 7f325d969700 1 --2- 172.21.15.125:0/660095071 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32580b5ae0 0x7f32580b6e00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3250009840 tx=0x7f3250009b50 comp rx=0 tx=0).stop 2023-10-17T06:07:38.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.059+0000 7f325d969700 1 -- 172.21.15.125:0/660095071 shutdown_connections 2023-10-17T06:07:38.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.059+0000 7f325d969700 1 --2- 172.21.15.125:0/660095071 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32580b5ae0 0x7f32580b6e00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.059+0000 7f325d969700 1 -- 172.21.15.125:0/660095071 >> 172.21.15.125:0/660095071 conn(0x7f3258069f20 msgr2=0x7f325806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:38.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.059+0000 7f325d969700 1 -- 172.21.15.125:0/660095071 shutdown_connections 2023-10-17T06:07:38.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.059+0000 7f325d969700 1 -- 172.21.15.125:0/660095071 wait complete. 2023-10-17T06:07:38.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.059+0000 7f325d969700 1 Processor -- start 2023-10-17T06:07:38.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.059+0000 7f325d969700 1 -- start start 2023-10-17T06:07:38.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f325d969700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32580b5ae0 0x7f32581f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f325d969700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32580d2e00 0x7f32581512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f325d969700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3258160710 0x7f325806f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f325d969700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32581f3410 con 0x7f32580b5ae0 2023-10-17T06:07:38.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f325d969700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32581f2930 con 0x7f3258160710 2023-10-17T06:07:38.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f325d969700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32581f37f0 con 0x7f32580d2e00 2023-10-17T06:07:38.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f325c967700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32580b5ae0 0x7f32581f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f325c967700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32580b5ae0 0x7f32581f23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48584/0 (socket says 172.21.15.125:48584) 2023-10-17T06:07:38.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f325c967700 1 -- 172.21.15.125:0/4181834367 learned_addr learned my addr 172.21.15.125:0/4181834367 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:38.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f325d168700 1 --2- 172.21.15.125:0/4181834367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3258160710 0x7f325806f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f324ffff700 1 --2- 172.21.15.125:0/4181834367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32580d2e00 0x7f32581512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f325c967700 1 -- 172.21.15.125:0/4181834367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32580d2e00 msgr2=0x7f32581512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f325c967700 1 --2- 172.21.15.125:0/4181834367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32580d2e00 0x7f32581512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f325c967700 1 -- 172.21.15.125:0/4181834367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3258160710 msgr2=0x7f325806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f325c967700 1 --2- 172.21.15.125:0/4181834367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3258160710 0x7f325806f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f325c967700 1 -- 172.21.15.125:0/4181834367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32500094a0 con 0x7f32580b5ae0 2023-10-17T06:07:38.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f325c967700 1 --2- 172.21.15.125:0/4181834367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32580b5ae0 0x7f32581f23f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f325400cc00 tx=0x7f325400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:38.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f324d7fa700 1 -- 172.21.15.125:0/4181834367 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254003c20 con 0x7f32580b5ae0 2023-10-17T06:07:38.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f324d7fa700 1 -- 172.21.15.125:0/4181834367 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3254003d80 con 0x7f32580b5ae0 2023-10-17T06:07:38.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f324d7fa700 1 -- 172.21.15.125:0/4181834367 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325400ab80 con 0x7f32580b5ae0 2023-10-17T06:07:38.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f325d969700 1 -- 172.21.15.125:0/4181834367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3258151de0 con 0x7f32580b5ae0 2023-10-17T06:07:38.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.063+0000 7f325d969700 1 -- 172.21.15.125:0/4181834367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32581f2e50 con 0x7f32580b5ae0 2023-10-17T06:07:38.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.067+0000 7f325d969700 1 -- 172.21.15.125:0/4181834367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32581f35c0 con 0x7f32580b5ae0 2023-10-17T06:07:38.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.067+0000 7f324d7fa700 1 -- 172.21.15.125:0/4181834367 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f325400ace0 con 0x7f32580b5ae0 2023-10-17T06:07:38.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.067+0000 7f324d7fa700 1 --2- 172.21.15.125:0/4181834367 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f32440656f0 0x7f3244067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.067+0000 7f324d7fa700 1 -- 172.21.15.125:0/4181834367 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3254083170 con 0x7f32580b5ae0 2023-10-17T06:07:38.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.067+0000 7f324ffff700 1 --2- 172.21.15.125:0/4181834367 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f32440656f0 0x7f3244067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.067+0000 7f324ffff700 1 --2- 172.21.15.125:0/4181834367 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f32440656f0 0x7f3244067bb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f32581f5950 tx=0x7f3248009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:38.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.075+0000 7f324d7fa700 1 -- 172.21.15.125:0/4181834367 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f32581f35c0 con 0x7f32580b5ae0 2023-10-17T06:07:38.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.255+0000 7f325d969700 1 -- 172.21.15.125:0/4181834367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32581f35c0 con 0x7f32580b5ae0 2023-10-17T06:07:38.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.259+0000 7f324d7fa700 1 -- 172.21.15.125:0/4181834367 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f32581f35c0 con 0x7f32580b5ae0 2023-10-17T06:07:38.263 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:38.263 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":28,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:14.576796+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:07:38.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.263+0000 7f325d969700 1 -- 172.21.15.125:0/4181834367 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f32440656f0 msgr2=0x7f3244067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.263+0000 7f325d969700 1 --2- 172.21.15.125:0/4181834367 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f32440656f0 0x7f3244067bb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f32581f5950 tx=0x7f3248009040 comp rx=0 tx=0).stop 2023-10-17T06:07:38.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.263+0000 7f325d969700 1 -- 172.21.15.125:0/4181834367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32580b5ae0 msgr2=0x7f32581f23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.263+0000 7f325d969700 1 --2- 172.21.15.125:0/4181834367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32580b5ae0 0x7f32581f23f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f325400cc00 tx=0x7f325400a060 comp rx=0 tx=0).stop 2023-10-17T06:07:38.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.263+0000 7f325d969700 1 -- 172.21.15.125:0/4181834367 shutdown_connections 2023-10-17T06:07:38.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.263+0000 7f325d969700 1 --2- 172.21.15.125:0/4181834367 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f32440656f0 0x7f3244067bb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.263+0000 7f325d969700 1 --2- 172.21.15.125:0/4181834367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3258160710 0x7f325806f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.263+0000 7f325d969700 1 --2- 172.21.15.125:0/4181834367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f32580d2e00 0x7f32581512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.263+0000 7f325d969700 1 --2- 172.21.15.125:0/4181834367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32580b5ae0 0x7f32581f23f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.263+0000 7f325d969700 1 -- 172.21.15.125:0/4181834367 >> 172.21.15.125:0/4181834367 conn(0x7f3258069f20 msgr2=0x7f32580b29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:38.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.263+0000 7f325d969700 1 -- 172.21.15.125:0/4181834367 shutdown_connections 2023-10-17T06:07:38.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.263+0000 7f325d969700 1 -- 172.21.15.125:0/4181834367 wait complete. 2023-10-17T06:07:38.296 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-17T06:07:38.296 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:07:38.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.467+0000 7f43d8d6b700 1 Processor -- start 2023-10-17T06:07:38.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.467+0000 7f43d8d6b700 1 -- start start 2023-10-17T06:07:38.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.471+0000 7f43d8d6b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f43d40d2e00 0x7f43d40b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.471+0000 7f43d8d6b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43d40b5ae0 0x7f43d406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.471+0000 7f43d8d6b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d415d0d0 con 0x7f43d4160710 2023-10-17T06:07:38.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.471+0000 7f43d8d6b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d415df90 con 0x7f43d40d2e00 2023-10-17T06:07:38.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.471+0000 7f43d8d6b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d406f0f0 con 0x7f43d40b5ae0 2023-10-17T06:07:38.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.471+0000 7f43d3fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43d40b5ae0 0x7f43d406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.471+0000 7f43d37fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f43d40d2e00 0x7f43d40b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.471+0000 7f43d3fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43d40b5ae0 0x7f43d406db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:46872/0 (socket says 172.21.15.125:46872) 2023-10-17T06:07:38.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.471+0000 7f43d3fff700 1 -- 172.21.15.125:0/3824480587 learned_addr learned my addr 172.21.15.125:0/3824480587 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:38.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.471+0000 7f43d3fff700 1 -- 172.21.15.125:0/3824480587 >> v2:172.21.15.184:3300/0 conn(0x7f43d40d2e00 msgr2=0x7f43d40b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:38.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.471+0000 7f43d3fff700 1 --2- 172.21.15.125:0/3824480587 >> v2:172.21.15.184:3300/0 conn(0x7f43d40d2e00 0x7f43d40b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.471+0000 7f43d3fff700 1 -- 172.21.15.125:0/3824480587 >> v1:172.21.15.184:6789/0 conn(0x7f43d4160710 legacy=0x7f43d40d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.471+0000 7f43d3fff700 1 -- 172.21.15.125:0/3824480587 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d415d310 con 0x7f43d40b5ae0 2023-10-17T06:07:38.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.475+0000 7f43d3fff700 1 --2- 172.21.15.125:0/3824480587 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43d40b5ae0 0x7f43d406db60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009e50 tx=0x7f43cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8331892fc5874858 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:38.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.475+0000 7f43d27fc700 1 -- 172.21.15.125:0/3824480587 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc00e070 con 0x7f43d40b5ae0 2023-10-17T06:07:38.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.475+0000 7f43d27fc700 1 -- 172.21.15.125:0/3824480587 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc00b910 con 0x7f43d40b5ae0 2023-10-17T06:07:38.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.475+0000 7f43d27fc700 1 -- 172.21.15.125:0/3824480587 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc00bcc0 con 0x7f43d40b5ae0 2023-10-17T06:07:38.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.475+0000 7f43d8d6b700 1 -- 172.21.15.125:0/3824480587 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43d40b5ae0 msgr2=0x7f43d406db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.475+0000 7f43d8d6b700 1 --2- 172.21.15.125:0/3824480587 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43d40b5ae0 0x7f43d406db60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009e50 tx=0x7f43cc00b330 comp rx=0 tx=0).stop 2023-10-17T06:07:38.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.475+0000 7f43d8d6b700 1 -- 172.21.15.125:0/3824480587 shutdown_connections 2023-10-17T06:07:38.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.475+0000 7f43d8d6b700 1 --2- 172.21.15.125:0/3824480587 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43d40b5ae0 0x7f43d406db60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.475+0000 7f43d8d6b700 1 --2- 172.21.15.125:0/3824480587 >> v2:172.21.15.184:3300/0 conn(0x7f43d40d2e00 0x7f43d40b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.475+0000 7f43d8d6b700 1 -- 172.21.15.125:0/3824480587 >> 172.21.15.125:0/3824480587 conn(0x7f43d4069f20 msgr2=0x7f43d406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:38.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.475+0000 7f43d8d6b700 1 -- 172.21.15.125:0/3824480587 shutdown_connections 2023-10-17T06:07:38.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.475+0000 7f43d8d6b700 1 -- 172.21.15.125:0/3824480587 wait complete. 2023-10-17T06:07:38.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.479+0000 7f43d8d6b700 1 Processor -- start 2023-10-17T06:07:38.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.479+0000 7f43d8d6b700 1 -- start start 2023-10-17T06:07:38.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.479+0000 7f43d8d6b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43d40b5ae0 0x7f43d414dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.479+0000 7f43d8d6b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43d40d2e00 0x7f43d40afd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.479+0000 7f43d8d6b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43d4160710 0x7f43d41f2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.479+0000 7f43d8d6b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d414f170 con 0x7f43d4160710 2023-10-17T06:07:38.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.479+0000 7f43d8d6b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d414e290 con 0x7f43d40d2e00 2023-10-17T06:07:38.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.479+0000 7f43d8d6b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d414e560 con 0x7f43d40b5ae0 2023-10-17T06:07:38.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.483+0000 7f43d3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43d4160710 0x7f43d41f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.483+0000 7f43d3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43d4160710 0x7f43d41f2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48588/0 (socket says 172.21.15.125:48588) 2023-10-17T06:07:38.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.483+0000 7f43d3fff700 1 -- 172.21.15.125:0/218014561 learned_addr learned my addr 172.21.15.125:0/218014561 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:38.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.483+0000 7f43d37fe700 1 --2- 172.21.15.125:0/218014561 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43d40b5ae0 0x7f43d414dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.483+0000 7f43d2ffd700 1 --2- 172.21.15.125:0/218014561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43d40d2e00 0x7f43d40afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.483+0000 7f43d3fff700 1 -- 172.21.15.125:0/218014561 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43d40b5ae0 msgr2=0x7f43d414dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.483+0000 7f43d3fff700 1 --2- 172.21.15.125:0/218014561 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43d40b5ae0 0x7f43d414dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.483+0000 7f43d3fff700 1 -- 172.21.15.125:0/218014561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43d40d2e00 msgr2=0x7f43d40afd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.483+0000 7f43d3fff700 1 --2- 172.21.15.125:0/218014561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43d40d2e00 0x7f43d40afd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.483+0000 7f43d3fff700 1 -- 172.21.15.125:0/218014561 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc009b30 con 0x7f43d4160710 2023-10-17T06:07:38.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.483+0000 7f43d3fff700 1 --2- 172.21.15.125:0/218014561 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43d4160710 0x7f43d41f2760 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00b370 tx=0x7f43cc004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:38.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.483+0000 7f43bbfff700 1 -- 172.21.15.125:0/218014561 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc004840 con 0x7f43d4160710 2023-10-17T06:07:38.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.483+0000 7f43bbfff700 1 -- 172.21.15.125:0/218014561 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc0092e0 con 0x7f43d4160710 2023-10-17T06:07:38.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.483+0000 7f43bbfff700 1 -- 172.21.15.125:0/218014561 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc01b670 con 0x7f43d4160710 2023-10-17T06:07:38.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.483+0000 7f43d8d6b700 1 -- 172.21.15.125:0/218014561 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d414e840 con 0x7f43d4160710 2023-10-17T06:07:38.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.483+0000 7f43d8d6b700 1 -- 172.21.15.125:0/218014561 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d414ee00 con 0x7f43d4160710 2023-10-17T06:07:38.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.483+0000 7f43d8d6b700 1 -- 172.21.15.125:0/218014561 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d414f320 con 0x7f43d4160710 2023-10-17T06:07:38.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.487+0000 7f43bbfff700 1 -- 172.21.15.125:0/218014561 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f43cc01b7d0 con 0x7f43d4160710 2023-10-17T06:07:38.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.487+0000 7f43bbfff700 1 --2- 172.21.15.125:0/218014561 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f43c00656f0 0x7f43c0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.487+0000 7f43bbfff700 1 -- 172.21.15.125:0/218014561 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f43cc006e40 con 0x7f43d4160710 2023-10-17T06:07:38.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.487+0000 7f43d37fe700 1 --2- 172.21.15.125:0/218014561 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f43c00656f0 0x7f43c0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.491+0000 7f43d37fe700 1 --2- 172.21.15.125:0/218014561 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f43c00656f0 0x7f43c0067bb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009b50 tx=0x7f43c4009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:38.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.495+0000 7f43bbfff700 1 -- 172.21.15.125:0/218014561 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f43d414f320 con 0x7f43d4160710 2023-10-17T06:07:38.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.679+0000 7f43d8d6b700 1 -- 172.21.15.125:0/218014561 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43d4072e60 con 0x7f43d4160710 2023-10-17T06:07:38.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.683+0000 7f43bbfff700 1 -- 172.21.15.125:0/218014561 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f43cc052170 con 0x7f43d4160710 2023-10-17T06:07:38.687 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:38.687 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":28,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:14.576796+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:07:38.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.687+0000 7f43d8d6b700 1 -- 172.21.15.125:0/218014561 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f43c00656f0 msgr2=0x7f43c0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.687+0000 7f43d8d6b700 1 --2- 172.21.15.125:0/218014561 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f43c00656f0 0x7f43c0067bb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009b50 tx=0x7f43c4009240 comp rx=0 tx=0).stop 2023-10-17T06:07:38.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.687+0000 7f43d8d6b700 1 -- 172.21.15.125:0/218014561 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43d4160710 msgr2=0x7f43d41f2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.687+0000 7f43d8d6b700 1 --2- 172.21.15.125:0/218014561 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43d4160710 0x7f43d41f2760 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00b370 tx=0x7f43cc004b40 comp rx=0 tx=0).stop 2023-10-17T06:07:38.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.687+0000 7f43d8d6b700 1 -- 172.21.15.125:0/218014561 shutdown_connections 2023-10-17T06:07:38.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.687+0000 7f43d8d6b700 1 --2- 172.21.15.125:0/218014561 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f43c00656f0 0x7f43c0067bb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.687+0000 7f43d8d6b700 1 --2- 172.21.15.125:0/218014561 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43d4160710 0x7f43d41f2760 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.687+0000 7f43d8d6b700 1 --2- 172.21.15.125:0/218014561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43d40d2e00 0x7f43d40afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.687+0000 7f43d8d6b700 1 --2- 172.21.15.125:0/218014561 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43d40b5ae0 0x7f43d414dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.687+0000 7f43d8d6b700 1 -- 172.21.15.125:0/218014561 >> 172.21.15.125:0/218014561 conn(0x7f43d4069f20 msgr2=0x7f43d415e310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:38.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.687+0000 7f43d8d6b700 1 -- 172.21.15.125:0/218014561 shutdown_connections 2023-10-17T06:07:38.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.687+0000 7f43d8d6b700 1 -- 172.21.15.125:0/218014561 wait complete. 2023-10-17T06:07:38.711 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-17T06:07:38.711 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-17T06:07:38.712 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-17T06:07:38.712 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-17T06:07:38.713 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-17T06:07:38.713 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-17T06:07:38.714 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-17T06:07:38.714 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-17T06:07:38.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.947+0000 7f2c30400700 1 Processor -- start 2023-10-17T06:07:38.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.947+0000 7f164ad0c700 1 Processor -- start 2023-10-17T06:07:38.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.947+0000 7f2c30400700 1 -- start start 2023-10-17T06:07:38.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.947+0000 7f164ad0c700 1 -- start start 2023-10-17T06:07:38.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7efd52bc1700 1 Processor -- start 2023-10-17T06:07:38.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7efd52bc1700 1 -- start start 2023-10-17T06:07:38.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f2c30400700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c28069d10 0x7f2c28159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f164ad0c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f163c006350 0x7f163c058860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f164ad0c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f163c058da0 0x7f163c03c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f3708764700 1 Processor -- start 2023-10-17T06:07:38.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f2c2d99b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c28069d10 0x7f2c28159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f2c2d99b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c28069d10 0x7f2c28159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:46886/0 (socket says 172.21.15.125:46886) 2023-10-17T06:07:38.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f2c2e99d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2c28159c90 0x7f2c281626b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53938/0 (socket says 172.21.15.125:53938) 2023-10-17T06:07:38.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f2c30400700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2806af90 con 0x7f2c28159c90 2023-10-17T06:07:38.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f2c30400700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2806a380 con 0x7f2c28159370 2023-10-17T06:07:38.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f2c30400700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2806a170 con 0x7f2c28069d10 2023-10-17T06:07:38.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f164ad0c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f163c0583d0 con 0x7f163c038440 2023-10-17T06:07:38.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f2c2d99b700 1 -- 172.21.15.125:0/1626521125 learned_addr learned my addr 172.21.15.125:0/1626521125 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:38.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7efd52bc1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd4c0ceff0 0x7efd4c15be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7efd52bc1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efd4c0c8ee0 0x7efd4c0c9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7efd52bc1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efd4c0c9970 0x7efd4c15c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7efd52bc1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd4c06e750 con 0x7efd4c0c8ee0 2023-10-17T06:07:38.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7efd52bc1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd4c0adbb0 con 0x7efd4c0c9970 2023-10-17T06:07:38.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7efd52bc1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c15fa90 con 0x7efd4c0ceff0 2023-10-17T06:07:38.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f3708764700 1 -- start start 2023-10-17T06:07:38.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f1649509700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f163c058da0 0x7f163c03c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f164ad0c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f163c0e7cd0 con 0x7f163c058da0 2023-10-17T06:07:38.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f164ad0c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163c054620 con 0x7f163c006350 2023-10-17T06:07:38.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f164a50b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f163c038440 0x7f163c03c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53952/0 (socket says 172.21.15.125:53952) 2023-10-17T06:07:38.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f1649d0a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f163c006350 0x7f163c058860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f164a50b700 1 -- 172.21.15.125:0/333410419 learned_addr learned my addr 172.21.15.125:0/333410419 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:38.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f2c2d19a700 1 -- 172.21.15.125:0/1626521125 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594055552 0 0) 0x7f2c2806af90 con 0x7f2c28159c90 2023-10-17T06:07:38.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7f2c2d19a700 1 -- 172.21.15.125:0/1626521125 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c140035d0 con 0x7f2c28159c90 2023-10-17T06:07:38.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7efd4bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efd4c0c8ee0 0x7efd4c0c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7efd4bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efd4c0c8ee0 0x7efd4c0c9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48592/0 (socket says 172.21.15.125:48592) 2023-10-17T06:07:38.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7efd4bfff700 1 -- 172.21.15.125:0/538955242 learned_addr learned my addr 172.21.15.125:0/538955242 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:38.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.951+0000 7efd5115e700 1 --2- 172.21.15.125:0/538955242 >> v2:172.21.15.184:3300/0 conn(0x7efd4c0c9970 0x7efd4c15c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f2c2d99b700 1 -- 172.21.15.125:0/1626521125 >> v1:172.21.15.184:6789/0 conn(0x7f2c28159370 legacy=0x7f2c280b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f2c2d99b700 1 -- 172.21.15.125:0/1626521125 >> v1:172.21.15.125:6789/0 conn(0x7f2c28159c90 legacy=0x7f2c281626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f2c2d99b700 1 -- 172.21.15.125:0/1626521125 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2806a660 con 0x7f2c28069d10 2023-10-17T06:07:38.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f1649d0a700 1 -- 172.21.15.125:0/333410419 >> v2:172.21.15.125:3300/0 conn(0x7f163c058da0 msgr2=0x7f163c03c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:38.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f1649d0a700 1 --2- 172.21.15.125:0/333410419 >> v2:172.21.15.125:3300/0 conn(0x7f163c058da0 0x7f163c03c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f1649d0a700 1 -- 172.21.15.125:0/333410419 >> v1:172.21.15.125:6789/0 conn(0x7f163c038440 legacy=0x7f163c03c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:38.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f1649d0a700 1 -- 172.21.15.125:0/333410419 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c057d80 con 0x7f163c006350 2023-10-17T06:07:38.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f1649509700 1 --2- 172.21.15.125:0/333410419 >> v2:172.21.15.125:3300/0 conn(0x7f163c058da0 0x7f163c03c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:38.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f2c2d99b700 1 --2- 172.21.15.125:0/1626521125 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c28069d10 0x7f2c28159750 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2c20009e80 tx=0x7f2c2000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f73490815b4e50f server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:38.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7efd4bfff700 1 -- 172.21.15.125:0/538955242 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd4c0ceff0 msgr2=0x7efd4c15be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:38.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7efd5095d700 1 --2- 172.21.15.125:0/538955242 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd4c0ceff0 0x7efd4c15be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7efd4bfff700 1 --2- 172.21.15.125:0/538955242 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd4c0ceff0 0x7efd4c15be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f3708764700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3700069d10 0x7f3700159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f1649d0a700 1 --2- 172.21.15.125:0/333410419 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f163c006350 0x7f163c058860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1640009850 tx=0x7f1640009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b21a1756d5a26b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:38.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7efd4bfff700 1 -- 172.21.15.125:0/538955242 >> v2:172.21.15.184:3300/0 conn(0x7efd4c0c9970 msgr2=0x7efd4c15c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:38.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7efd4bfff700 1 --2- 172.21.15.125:0/538955242 >> v2:172.21.15.184:3300/0 conn(0x7efd4c0c9970 0x7efd4c15c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7efd4bfff700 1 -- 172.21.15.125:0/538955242 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c06e090 con 0x7efd4c0c8ee0 2023-10-17T06:07:38.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f3708764700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3700159c90 0x7f37001626b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f280dc82700 1 Processor -- start 2023-10-17T06:07:38.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f280dc82700 1 -- start start 2023-10-17T06:07:38.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f2c2d19a700 1 -- 172.21.15.125:0/1626521125 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2000e070 con 0x7f2c28069d10 2023-10-17T06:07:38.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f2c2d19a700 1 -- 172.21.15.125:0/1626521125 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2000b910 con 0x7f2c28069d10 2023-10-17T06:07:38.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f2c2d19a700 1 -- 172.21.15.125:0/1626521125 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2000bcc0 con 0x7f2c28069d10 2023-10-17T06:07:38.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f3708764700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370006af90 con 0x7f3700159370 2023-10-17T06:07:38.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f3706500700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f3700159370 0x7f37000b2c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:36130/0 (socket says 172.21.15.125:36130) 2023-10-17T06:07:38.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f3706500700 1 -- 172.21.15.125:0/1926210627 learned_addr learned my addr 172.21.15.125:0/1926210627 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:38.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f3708764700 1 -- 172.21.15.125:0/1926210627 --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f370006a170 con 0x7f3700159c90 2023-10-17T06:07:38.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f3708764700 1 -- 172.21.15.125:0/1926210627 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3700156b30 con 0x7f3700069d10 2023-10-17T06:07:38.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7efd5115e700 1 --2- 172.21.15.125:0/538955242 >> v2:172.21.15.184:3300/0 conn(0x7efd4c0c9970 0x7efd4c15c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:07:38.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f3705cff700 1 --2- 172.21.15.125:0/1926210627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3700069d10 0x7f3700159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7efd5095d700 1 --2- 172.21.15.125:0/538955242 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd4c0ceff0 0x7efd4c15be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:38.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7fbaa8c1e700 1 Processor -- start 2023-10-17T06:07:38.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7fbaa8c1e700 1 -- start start 2023-10-17T06:07:38.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f2c30400700 1 -- 172.21.15.125:0/1626521125 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c28069d10 msgr2=0x7f2c28159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f2c30400700 1 --2- 172.21.15.125:0/1626521125 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c28069d10 0x7f2c28159750 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2c20009e80 tx=0x7f2c2000b330 comp rx=0 tx=0).stop 2023-10-17T06:07:38.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7efd4bfff700 1 --2- 172.21.15.125:0/538955242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd4c0c8ee0 0x7efd4c0c9430 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efd4c06f250 tx=0x7efd40009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a11541f0735d70 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:38.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f3706d01700 1 --2- 172.21.15.125:0/1926210627 >> v2:172.21.15.125:3300/0 conn(0x7f3700159c90 0x7f37001626b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f1648d08700 1 -- 172.21.15.125:0/333410419 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640004230 con 0x7f163c006350 2023-10-17T06:07:38.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f1648d08700 1 -- 172.21.15.125:0/333410419 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1640004390 con 0x7f163c006350 2023-10-17T06:07:38.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7f1648d08700 1 -- 172.21.15.125:0/333410419 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16400036c0 con 0x7f163c006350 2023-10-17T06:07:38.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.955+0000 7efd4b7fe700 1 -- 172.21.15.125:0/538955242 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd40011830 con 0x7efd4c0c8ee0 2023-10-17T06:07:38.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f37054fe700 1 -- 172.21.15.125:0/1926210627 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510089027 0 0) 0x7f370006af90 con 0x7f3700159370 2023-10-17T06:07:38.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7efd4b7fe700 1 -- 172.21.15.125:0/538955242 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd40011990 con 0x7efd4c0c8ee0 2023-10-17T06:07:38.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f3706d01700 1 -- 172.21.15.125:0/1926210627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3700069d10 msgr2=0x7f3700159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:38.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f3706d01700 1 --2- 172.21.15.125:0/1926210627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3700069d10 0x7f3700159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f3706d01700 1 -- 172.21.15.125:0/1926210627 >> v1:172.21.15.184:6789/0 conn(0x7f3700159370 legacy=0x7f37000b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7efd4b7fe700 1 -- 172.21.15.125:0/538955242 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd40011d20 con 0x7efd4c0c8ee0 2023-10-17T06:07:38.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f3706d01700 1 -- 172.21.15.125:0/1926210627 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370006a380 con 0x7f3700159c90 2023-10-17T06:07:38.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f3705cff700 1 --2- 172.21.15.125:0/1926210627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3700069d10 0x7f3700159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:07:38.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f2c30400700 1 -- 172.21.15.125:0/1626521125 shutdown_connections 2023-10-17T06:07:38.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f2c30400700 1 --2- 172.21.15.125:0/1626521125 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c28069d10 0x7f2c28159750 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f2c30400700 1 -- 172.21.15.125:0/1626521125 >> 172.21.15.125:0/1626521125 conn(0x7f2c280ce660 msgr2=0x7f2c280cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:38.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f2c30400700 1 -- 172.21.15.125:0/1626521125 shutdown_connections 2023-10-17T06:07:38.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f2c30400700 1 -- 172.21.15.125:0/1626521125 wait complete. 2023-10-17T06:07:38.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f3706d01700 1 --2- 172.21.15.125:0/1926210627 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3700159c90 0x7f37001626b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009d90 tx=0x7f36f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43bd67b980fe7da server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:38.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f164ad0c700 1 -- 172.21.15.125:0/333410419 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f163c006350 msgr2=0x7f163c058860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f164ad0c700 1 --2- 172.21.15.125:0/333410419 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f163c006350 0x7f163c058860 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1640009850 tx=0x7f1640009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:38.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7efd52bc1700 1 -- 172.21.15.125:0/538955242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd4c0c8ee0 msgr2=0x7efd4c0c9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7efd52bc1700 1 --2- 172.21.15.125:0/538955242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd4c0c8ee0 0x7efd4c0c9430 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efd4c06f250 tx=0x7efd40009bf0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f37054fe700 1 -- 172.21.15.125:0/1926210627 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f800e070 con 0x7f3700159c90 2023-10-17T06:07:38.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7fbaa8c1e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbaa4070460 0x7fbaa40ce250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7fbaa8c1e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa415edc0 con 0x7fbaa40aeaf0 2023-10-17T06:07:38.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7fbaa8c1e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa415f0a0 con 0x7fbaa415e600 2023-10-17T06:07:38.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7fbaa8c1e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa40ae3c0 con 0x7fbaa4070460 2023-10-17T06:07:38.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f280dc82700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f280815cf40 0x7f28080ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f280dc82700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2808070b80 0x7f28080cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:38.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f280dc82700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280815e1f0 con 0x7f28080cb370 2023-10-17T06:07:38.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f280dc82700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280806d290 con 0x7f280815cf40 2023-10-17T06:07:38.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f280dc82700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28080cb800 con 0x7f2808070b80 2023-10-17T06:07:38.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f164ad0c700 1 -- 172.21.15.125:0/333410419 shutdown_connections 2023-10-17T06:07:38.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f164ad0c700 1 --2- 172.21.15.125:0/333410419 >> v2:172.21.15.125:3300/0 conn(0x7f163c058da0 0x7f163c03c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f164ad0c700 1 --2- 172.21.15.125:0/333410419 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f163c006350 0x7f163c058860 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7efd52bc1700 1 -- 172.21.15.125:0/538955242 shutdown_connections 2023-10-17T06:07:38.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7efd52bc1700 1 --2- 172.21.15.125:0/538955242 >> v2:172.21.15.184:3300/0 conn(0x7efd4c0c9970 0x7efd4c15c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7efd52bc1700 1 --2- 172.21.15.125:0/538955242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd4c0c8ee0 0x7efd4c0c9430 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7efd52bc1700 1 --2- 172.21.15.125:0/538955242 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd4c0ceff0 0x7efd4c15be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:38.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7efd52bc1700 1 -- 172.21.15.125:0/538955242 >> 172.21.15.125:0/538955242 conn(0x7efd4c0ce4d0 msgr2=0x7efd4c0ce8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:38.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7efd52bc1700 1 -- 172.21.15.125:0/538955242 shutdown_connections 2023-10-17T06:07:38.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7efd52bc1700 1 -- 172.21.15.125:0/538955242 wait complete. 2023-10-17T06:07:38.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f28077fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f280815cf40 0x7f28080ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f28077fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f280815cf40 0x7f28080ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48608/0 (socket says 172.21.15.125:48608) 2023-10-17T06:07:38.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f28077fe700 1 -- 172.21.15.125:0/1927056072 learned_addr learned my addr 172.21.15.125:0/1927056072 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:38.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f164ad0c700 1 -- 172.21.15.125:0/333410419 >> 172.21.15.125:0/333410419 conn(0x7f163c059200 msgr2=0x7f163c059610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:38.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f2806ffd700 1 --2- 172.21.15.125:0/1927056072 >> v2:172.21.15.184:3300/0 conn(0x7f2808070b80 0x7f28080cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f164ad0c700 1 -- 172.21.15.125:0/333410419 shutdown_connections 2023-10-17T06:07:38.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f164ad0c700 1 -- 172.21.15.125:0/333410419 wait complete. 2023-10-17T06:07:38.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f37054fe700 1 -- 172.21.15.125:0/1926210627 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f800bb20 con 0x7f3700159c90 2023-10-17T06:07:38.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7fbaa259c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbaa4070460 0x7fbaa40ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:38.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7fbaa1d9b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fbaa415e600 0x7fbaa4070840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:36132/0 (socket says 172.21.15.125:36132) 2023-10-17T06:07:38.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7fbaa259c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbaa4070460 0x7fbaa40ce250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:35694/0 (socket says 172.21.15.125:35694) 2023-10-17T06:07:38.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7fbaa1d9b700 1 -- 172.21.15.125:0/2967133009 learned_addr learned my addr 172.21.15.125:0/2967133009 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:38.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.959+0000 7f2c30400700 1 Processor -- start 2023-10-17T06:07:38.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f2c30400700 1 -- start start 2023-10-17T06:07:38.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f3708764700 1 -- 172.21.15.125:0/1926210627 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3700159c90 msgr2=0x7f37001626b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f37054fe700 1 -- 172.21.15.125:0/1926210627 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f800e070 con 0x7f3700159c90 2023-10-17T06:07:38.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f3708764700 1 --2- 172.21.15.125:0/1926210627 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3700159c90 0x7f37001626b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009d90 tx=0x7f36f800b330 comp rx=0 tx=0).stop 2023-10-17T06:07:38.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7fbaa159a700 1 -- 172.21.15.125:0/2967133009 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151068765 0 0) 0x7fbaa415f0a0 con 0x7fbaa415e600 2023-10-17T06:07:38.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7fbaa159a700 1 -- 172.21.15.125:0/2967133009 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba8c0035d0 con 0x7fbaa415e600 2023-10-17T06:07:38.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7fbaa159a700 1 -- 172.21.15.125:0/2967133009 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934160009 0 0) 0x7fbaa415edc0 con 0x7fbaa40aeaf0 2023-10-17T06:07:38.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7fbaa159a700 1 -- 172.21.15.125:0/2967133009 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba8c004950 con 0x7fbaa40aeaf0 2023-10-17T06:07:38.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7fbaa259c700 1 -- 172.21.15.125:0/2967133009 >> v1:172.21.15.184:6789/0 conn(0x7fbaa415e600 legacy=0x7fbaa4070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7fbaa259c700 1 -- 172.21.15.125:0/2967133009 >> v1:172.21.15.125:6789/0 conn(0x7fbaa40aeaf0 legacy=0x7fbaa40af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:38.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f337e1f6700 1 Processor -- start 2023-10-17T06:07:38.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7fbaa259c700 1 -- 172.21.15.125:0/2967133009 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa415f380 con 0x7fbaa4070460 2023-10-17T06:07:38.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f28077fe700 1 -- 172.21.15.125:0/1927056072 >> v2:172.21.15.184:3300/0 conn(0x7f2808070b80 msgr2=0x7f28080cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:39.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f337e1f6700 1 -- start start 2023-10-17T06:07:39.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7efd52bc1700 1 Processor -- start 2023-10-17T06:07:39.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f28077fe700 1 --2- 172.21.15.125:0/1927056072 >> v2:172.21.15.184:3300/0 conn(0x7f2808070b80 0x7f28080cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f28077fe700 1 -- 172.21.15.125:0/1927056072 >> v1:172.21.15.125:6789/0 conn(0x7f28080cb370 legacy=0x7f2808160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f28077fe700 1 -- 172.21.15.125:0/1927056072 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280806e8a0 con 0x7f280815cf40 2023-10-17T06:07:39.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7fbaa259c700 1 --2- 172.21.15.125:0/2967133009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaa4070460 0x7fbaa40ce250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fba9c009850 tx=0x7fba9c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3c00a4bdacab40 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7efd52bc1700 1 -- start start 2023-10-17T06:07:39.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f3708764700 1 -- 172.21.15.125:0/1926210627 shutdown_connections 2023-10-17T06:07:39.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f3708764700 1 --2- 172.21.15.125:0/1926210627 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3700159c90 0x7f37001626b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f3708764700 1 --2- 172.21.15.125:0/1926210627 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3700069d10 0x7f3700159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f3708764700 1 -- 172.21.15.125:0/1926210627 >> 172.21.15.125:0/1926210627 conn(0x7f37000ce660 msgr2=0x7f37000cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7fbaa159a700 1 -- 172.21.15.125:0/2967133009 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c011830 con 0x7fbaa4070460 2023-10-17T06:07:39.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7fbaa159a700 1 -- 172.21.15.125:0/2967133009 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c011990 con 0x7fbaa4070460 2023-10-17T06:07:39.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7fbaa159a700 1 -- 172.21.15.125:0/2967133009 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c011d40 con 0x7fbaa4070460 2023-10-17T06:07:39.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f28077fe700 1 --2- 172.21.15.125:0/1927056072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f280815cf40 0x7f28080ab8e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f280806e050 tx=0x7f27f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e72d69ab142e0a server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f2c30400700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c28069d10 0x7f2c28144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f2c30400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c28159370 0x7f2c28158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f3708764700 1 -- 172.21.15.125:0/1926210627 shutdown_connections 2023-10-17T06:07:39.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f3708764700 1 -- 172.21.15.125:0/1926210627 wait complete. 2023-10-17T06:07:39.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f2c30400700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c28159c90 0x7f2c281482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f2c30400700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c280cc550 con 0x7f2c28159c90 2023-10-17T06:07:39.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f2c30400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2815ba50 con 0x7f2c28159370 2023-10-17T06:07:39.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f2c30400700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2815bd30 con 0x7f2c28069d10 2023-10-17T06:07:39.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f164ad0c700 1 Processor -- start 2023-10-17T06:07:39.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f28067fc700 1 -- 172.21.15.125:0/1927056072 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f000e070 con 0x7f280815cf40 2023-10-17T06:07:39.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f164ad0c700 1 -- start start 2023-10-17T06:07:39.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f2c2d99b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c28159370 0x7f2c28158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f2c2e99d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c28159c90 0x7f2c281482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7efd52bc1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd4c0c8ee0 0x7efd4c0c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7fbaa8c1e700 1 -- 172.21.15.125:0/2967133009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaa4070460 msgr2=0x7fbaa40ce250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7fbaa8c1e700 1 --2- 172.21.15.125:0/2967133009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaa4070460 0x7fbaa40ce250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fba9c009850 tx=0x7fba9c009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:39.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f28067fc700 1 -- 172.21.15.125:0/1927056072 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f0003a40 con 0x7f280815cf40 2023-10-17T06:07:39.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7efd52bc1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd4c0c9970 0x7efd4c0c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7efd52bc1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd4c0ceff0 0x7efd4c0c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7efd52bc1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c150b00 con 0x7efd4c0ceff0 2023-10-17T06:07:39.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7efd52bc1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c152010 con 0x7efd4c0c9970 2023-10-17T06:07:39.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7efd52bc1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c1522f0 con 0x7efd4c0c8ee0 2023-10-17T06:07:39.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7efd5095d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd4c0c8ee0 0x7efd4c0c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7efd5115e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd4c0ceff0 0x7efd4c0c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7efd4bfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd4c0c9970 0x7efd4c0c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7efd5115e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd4c0ceff0 0x7efd4c0c74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48630/0 (socket says 172.21.15.125:48630) 2023-10-17T06:07:39.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7efd5115e700 1 -- 172.21.15.125:0/1651203313 learned_addr learned my addr 172.21.15.125:0/1651203313 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7fbaa8c1e700 1 -- 172.21.15.125:0/2967133009 shutdown_connections 2023-10-17T06:07:39.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7fbaa8c1e700 1 --2- 172.21.15.125:0/2967133009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaa4070460 0x7fbaa40ce250 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7fbaa8c1e700 1 -- 172.21.15.125:0/2967133009 >> 172.21.15.125:0/2967133009 conn(0x7fbaa40cebe0 msgr2=0x7fbaa40ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f280dc82700 1 -- 172.21.15.125:0/1927056072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f280815cf40 msgr2=0x7f28080ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f280dc82700 1 --2- 172.21.15.125:0/1927056072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f280815cf40 0x7f28080ab8e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f280806e050 tx=0x7f27f000b330 comp rx=0 tx=0).stop 2023-10-17T06:07:39.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f2c2d99b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c28159370 0x7f2c28158460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:35708/0 (socket says 172.21.15.125:35708) 2023-10-17T06:07:39.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f2c2d99b700 1 -- 172.21.15.125:0/2435629585 learned_addr learned my addr 172.21.15.125:0/2435629585 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7f2c2e19c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c28069d10 0x7f2c28144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.963+0000 7fbaa8c1e700 1 -- 172.21.15.125:0/2967133009 shutdown_connections 2023-10-17T06:07:39.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f2c2d99b700 1 -- 172.21.15.125:0/2435629585 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c28069d10 msgr2=0x7f2c28144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f2c2d99b700 1 --2- 172.21.15.125:0/2435629585 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c28069d10 0x7f2c28144300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f2c2d99b700 1 -- 172.21.15.125:0/2435629585 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c28159c90 msgr2=0x7f2c281482d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f2c2d99b700 1 --2- 172.21.15.125:0/2435629585 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c28159c90 0x7f2c281482d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f2c2d99b700 1 -- 172.21.15.125:0/2435629585 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c20009b30 con 0x7f2c28159370 2023-10-17T06:07:39.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f164ad0c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f163c006350 0x7f163c180710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f2c2d99b700 1 --2- 172.21.15.125:0/2435629585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c28159370 0x7f2c28158460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2c20000f80 tx=0x7f2c20004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f164ad0c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f163c038440 0x7f163c03ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f164ad0c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f163c00df50 0x7f163c03b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f164ad0c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c181640 con 0x7f163c006350 2023-10-17T06:07:39.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f164ad0c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c03b8e0 con 0x7f163c00df50 2023-10-17T06:07:39.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f164ad0c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163c181080 con 0x7f163c038440 2023-10-17T06:07:39.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7efd5115e700 1 -- 172.21.15.125:0/1651203313 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd4c0c8ee0 msgr2=0x7efd4c0c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7efd5115e700 1 --2- 172.21.15.125:0/1651203313 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd4c0c8ee0 0x7efd4c0c3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7efd5115e700 1 -- 172.21.15.125:0/1651203313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd4c0c9970 msgr2=0x7efd4c0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7efd5115e700 1 --2- 172.21.15.125:0/1651203313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd4c0c9970 0x7efd4c0c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7efd5115e700 1 -- 172.21.15.125:0/1651203313 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd44007920 con 0x7efd4c0ceff0 2023-10-17T06:07:39.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f337e1f6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f337003a790 0x7f3370038860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f3708764700 1 Processor -- start 2023-10-17T06:07:39.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f2c1effd700 1 -- 172.21.15.125:0/2435629585 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20004250 con 0x7f2c28159370 2023-10-17T06:07:39.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f2c1effd700 1 -- 172.21.15.125:0/2435629585 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c200043b0 con 0x7f2c28159370 2023-10-17T06:07:39.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f2c1effd700 1 -- 172.21.15.125:0/2435629585 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20004760 con 0x7f2c28159370 2023-10-17T06:07:39.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f280dc82700 1 -- 172.21.15.125:0/1927056072 shutdown_connections 2023-10-17T06:07:39.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f280dc82700 1 --2- 172.21.15.125:0/1927056072 >> v2:172.21.15.184:3300/0 conn(0x7f2808070b80 0x7f28080cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f280dc82700 1 --2- 172.21.15.125:0/1927056072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f280815cf40 0x7f28080ab8e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f280dc82700 1 -- 172.21.15.125:0/1927056072 >> 172.21.15.125:0/1927056072 conn(0x7f280806a340 msgr2=0x7f28080b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f3708764700 1 -- start start 2023-10-17T06:07:39.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f2c30400700 1 -- 172.21.15.125:0/2435629585 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2815c010 con 0x7f2c28159370 2023-10-17T06:07:39.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f2c30400700 1 -- 172.21.15.125:0/2435629585 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c280cd860 con 0x7f2c28159370 2023-10-17T06:07:39.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f2c30400700 1 -- 172.21.15.125:0/2435629585 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c280cc3d0 con 0x7f2c28159370 2023-10-17T06:07:39.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f1649d0a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f163c006350 0x7f163c180710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f1649d0a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f163c006350 0x7f163c180710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48632/0 (socket says 172.21.15.125:48632) 2023-10-17T06:07:39.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f1649d0a700 1 -- 172.21.15.125:0/3351073908 learned_addr learned my addr 172.21.15.125:0/3351073908 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f1649509700 1 --2- 172.21.15.125:0/3351073908 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f163c038440 0x7f163c03ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f1649d0a700 1 -- 172.21.15.125:0/3351073908 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f163c038440 msgr2=0x7f163c03ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f1649d0a700 1 --2- 172.21.15.125:0/3351073908 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f163c038440 0x7f163c03ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f1649d0a700 1 -- 172.21.15.125:0/3351073908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f163c00df50 msgr2=0x7f163c03b3a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-17T06:07:39.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f1649d0a700 1 --2- 172.21.15.125:0/3351073908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f163c00df50 0x7f163c03b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f1649d0a700 1 -- 172.21.15.125:0/3351073908 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16400094b0 con 0x7f163c006350 2023-10-17T06:07:39.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7efd5115e700 1 --2- 172.21.15.125:0/1651203313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd4c0ceff0 0x7efd4c0c74e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efd4400fdc0 tx=0x7efd4400d4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7efd497fa700 1 -- 172.21.15.125:0/1651203313 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd44012400 con 0x7efd4c0ceff0 2023-10-17T06:07:39.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7efd52bc1700 1 -- 172.21.15.125:0/1651203313 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd40009570 con 0x7efd4c0ceff0 2023-10-17T06:07:39.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7efd497fa700 1 -- 172.21.15.125:0/1651203313 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd44012560 con 0x7efd4c0ceff0 2023-10-17T06:07:39.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7efd497fa700 1 -- 172.21.15.125:0/1651203313 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd440128d0 con 0x7efd4c0ceff0 2023-10-17T06:07:39.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7efd52bc1700 1 -- 172.21.15.125:0/1651203313 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd4c14e040 con 0x7efd4c0ceff0 2023-10-17T06:07:39.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7fbaa8c1e700 1 -- 172.21.15.125:0/2967133009 wait complete. 2023-10-17T06:07:39.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7fbaa8c1e700 1 Processor -- start 2023-10-17T06:07:39.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f280dc82700 1 -- 172.21.15.125:0/1927056072 shutdown_connections 2023-10-17T06:07:39.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f337e1f6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3370051090 con 0x7f337004eba0 2023-10-17T06:07:39.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f337d9f5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f337003a790 0x7f3370038860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f337d9f5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f337003a790 0x7f3370038860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48642/0 (socket says 172.21.15.125:48642) 2023-10-17T06:07:39.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f337e1f6700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f337004f8e0 con 0x7f33700e0fb0 2023-10-17T06:07:39.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f337d9f5700 1 -- 172.21.15.125:0/1468894213 learned_addr learned my addr 172.21.15.125:0/1468894213 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f337e1f6700 1 -- 172.21.15.125:0/1468894213 --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337004fbc0 con 0x7f337003a790 2023-10-17T06:07:39.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f337d9f5700 1 -- 172.21.15.125:0/1468894213 >> v1:172.21.15.184:6789/0 conn(0x7f33700e0fb0 legacy=0x7f3370050980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:39.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f337d9f5700 1 -- 172.21.15.125:0/1468894213 >> v1:172.21.15.125:6789/0 conn(0x7f337004eba0 legacy=0x7f337003a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:39.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f337d9f5700 1 -- 172.21.15.125:0/1468894213 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337004fea0 con 0x7f337003a790 2023-10-17T06:07:39.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.967+0000 7f337d9f5700 1 --2- 172.21.15.125:0/1468894213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f337003a790 0x7f3370038860 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3378073230 tx=0x7f337804f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0404edb5af4e686 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f1649d0a700 1 --2- 172.21.15.125:0/3351073908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f163c006350 0x7f163c180710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1640000c00 tx=0x7f1640004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f280dc82700 1 -- 172.21.15.125:0/1927056072 wait complete. 2023-10-17T06:07:39.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7fbaa8c1e700 1 -- start start 2023-10-17T06:07:39.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7efd52bc1700 1 -- 172.21.15.125:0/1651203313 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efd4c06e370 con 0x7efd4c0ceff0 2023-10-17T06:07:39.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f3708764700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3700069d10 0x7f37000aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f3708764700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3700159370 0x7f370015b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f3708764700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3700159c90 0x7f370015b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f3708764700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3700147a30 con 0x7f3700069d10 2023-10-17T06:07:39.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f3708764700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3700146e20 con 0x7f3700159c90 2023-10-17T06:07:39.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f3708764700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3700147100 con 0x7f3700159370 2023-10-17T06:07:39.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f3706500700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3700069d10 0x7f37000aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f3706d01700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3700159c90 0x7f370015b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f3706d01700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3700159c90 0x7f370015b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:35724/0 (socket says 172.21.15.125:35724) 2023-10-17T06:07:39.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f3706d01700 1 -- 172.21.15.125:0/4023909220 learned_addr learned my addr 172.21.15.125:0/4023909220 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f3705cff700 1 --2- 172.21.15.125:0/4023909220 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3700159370 0x7f370015b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f163a7fc700 1 -- 172.21.15.125:0/3351073908 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640011830 con 0x7f163c006350 2023-10-17T06:07:39.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f336bfff700 1 -- 172.21.15.125:0/1468894213 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378091070 con 0x7f337003a790 2023-10-17T06:07:39.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f3706d01700 1 -- 172.21.15.125:0/4023909220 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3700159370 msgr2=0x7f370015b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f3706d01700 1 --2- 172.21.15.125:0/4023909220 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3700159370 0x7f370015b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f3706d01700 1 -- 172.21.15.125:0/4023909220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3700069d10 msgr2=0x7f37000aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f3706d01700 1 --2- 172.21.15.125:0/4023909220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3700069d10 0x7f37000aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f3706d01700 1 -- 172.21.15.125:0/4023909220 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc0094b0 con 0x7f3700159c90 2023-10-17T06:07:39.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f163a7fc700 1 -- 172.21.15.125:0/3351073908 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164001e070 con 0x7f163c006350 2023-10-17T06:07:39.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f163a7fc700 1 -- 172.21.15.125:0/3351073908 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640011bb0 con 0x7f163c006350 2023-10-17T06:07:39.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7fbaa8c1e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaa4070460 0x7fbaa4142490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7fbaa8c1e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaa40aeaf0 0x7fbaa415af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7fbaa8c1e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbaa415e600 0x7fbaa41ff170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f2c1effd700 1 -- 172.21.15.125:0/2435629585 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2c2001c440 con 0x7f2c28159370 2023-10-17T06:07:39.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f3706d01700 1 --2- 172.21.15.125:0/4023909220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3700159c90 0x7f370015b7c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f36f8014040 tx=0x7f36f8004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7fbaa1d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaa40aeaf0 0x7fbaa415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7fbaa259c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaa4070460 0x7fbaa4142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7fbaa1d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaa40aeaf0 0x7fbaa415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48652/0 (socket says 172.21.15.125:48652) 2023-10-17T06:07:39.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7fbaa1d9b700 1 -- 172.21.15.125:0/722469543 learned_addr learned my addr 172.21.15.125:0/722469543 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f336bfff700 1 -- 172.21.15.125:0/1468894213 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3378072e60 con 0x7f337003a790 2023-10-17T06:07:39.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f336bfff700 1 -- 172.21.15.125:0/1468894213 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378073760 con 0x7f337003a790 2023-10-17T06:07:39.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f36f6ffd700 1 -- 172.21.15.125:0/4023909220 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8004900 con 0x7f3700159c90 2023-10-17T06:07:39.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f36f6ffd700 1 -- 172.21.15.125:0/4023909220 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f8020070 con 0x7f3700159c90 2023-10-17T06:07:39.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f36f6ffd700 1 -- 172.21.15.125:0/4023909220 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f80276c0 con 0x7f3700159c90 2023-10-17T06:07:39.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7fbaa8c1e700 1 -- 172.21.15.125:0/722469543 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa41429d0 con 0x7fbaa40aeaf0 2023-10-17T06:07:39.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7fbaa2d9d700 1 --2- 172.21.15.125:0/722469543 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbaa415e600 0x7fbaa41ff170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7fbaa8c1e700 1 -- 172.21.15.125:0/722469543 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa415b870 con 0x7fbaa4070460 2023-10-17T06:07:39.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7fbaa8c1e700 1 -- 172.21.15.125:0/722469543 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa415bb50 con 0x7fbaa415e600 2023-10-17T06:07:39.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f2c1effd700 1 --2- 172.21.15.125:0/2435629585 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2c0c0657c0 0x7f2c0c067c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f2c1effd700 1 -- 172.21.15.125:0/2435629585 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2c20084d50 con 0x7f2c28159370 2023-10-17T06:07:39.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f164ad0c700 1 -- 172.21.15.125:0/3351073908 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f163c181360 con 0x7f163c006350 2023-10-17T06:07:39.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7f164ad0c700 1 -- 172.21.15.125:0/3351073908 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f163c04e170 con 0x7f163c006350 2023-10-17T06:07:39.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f280dc82700 1 Processor -- start 2023-10-17T06:07:39.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7f2c1effd700 1 --2- 172.21.15.125:0/2435629585 >> [v2:172.21.15.125:6824/4039629234,v1:172.21.15.125:6825/4039629234] conn(0x7f2c0c06f4a0 0x7f2c0c0718e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7f2c1effd700 1 -- 172.21.15.125:0/2435629585 --> [v2:172.21.15.125:6824/4039629234,v1:172.21.15.125:6825/4039629234] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c0c071fb0 con 0x7f2c0c06f4a0 2023-10-17T06:07:39.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7f2c1effd700 1 -- 172.21.15.125:0/2435629585 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c20085100 con 0x7f2c28159370 2023-10-17T06:07:39.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.971+0000 7f3708764700 1 -- 172.21.15.125:0/4023909220 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f8009a70 con 0x7f3700159c90 2023-10-17T06:07:39.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7f3708764700 1 -- 172.21.15.125:0/4023909220 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37001476c0 con 0x7f3700159c90 2023-10-17T06:07:39.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7fbaa2d9d700 1 -- 172.21.15.125:0/722469543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaa4070460 msgr2=0x7fbaa4142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7fbaa2d9d700 1 --2- 172.21.15.125:0/722469543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbaa4070460 0x7fbaa4142490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7fbaa2d9d700 1 -- 172.21.15.125:0/722469543 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaa40aeaf0 msgr2=0x7fbaa415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7fbaa2d9d700 1 --2- 172.21.15.125:0/722469543 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbaa40aeaf0 0x7fbaa415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7fbaa2d9d700 1 -- 172.21.15.125:0/722469543 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c0094b0 con 0x7fbaa415e600 2023-10-17T06:07:39.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7fbaa2d9d700 1 --2- 172.21.15.125:0/722469543 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbaa415e600 0x7fbaa41ff170 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fba9400c9f0 tx=0x7fba9400cd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7f164ad0c700 1 -- 172.21.15.125:0/3351073908 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f163c054900 con 0x7f163c006350 2023-10-17T06:07:39.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7fba92ffd700 1 -- 172.21.15.125:0/722469543 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba94003c70 con 0x7fbaa415e600 2023-10-17T06:07:39.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7fbaa8c1e700 1 -- 172.21.15.125:0/722469543 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa415be30 con 0x7fbaa415e600 2023-10-17T06:07:39.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7fba92ffd700 1 -- 172.21.15.125:0/722469543 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba94003df0 con 0x7fbaa415e600 2023-10-17T06:07:39.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7f36f4ff9700 1 -- 172.21.15.125:0/4023909220 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f36dc000fc0 con 0x7f3700159c90 2023-10-17T06:07:39.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7f337e1f6700 1 -- 172.21.15.125:0/1468894213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f337003a790 msgr2=0x7f3370038860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7f337e1f6700 1 --2- 172.21.15.125:0/1468894213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f337003a790 0x7f3370038860 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3378073230 tx=0x7f337804f110 comp rx=0 tx=0).stop 2023-10-17T06:07:39.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7fbaa8c1e700 1 -- 172.21.15.125:0/722469543 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa415c3f0 con 0x7fbaa415e600 2023-10-17T06:07:39.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7f5a59308700 1 Processor -- start 2023-10-17T06:07:39.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7f2c2e99d700 1 --2- 172.21.15.125:0/2435629585 >> [v2:172.21.15.125:6824/4039629234,v1:172.21.15.125:6825/4039629234] conn(0x7f2c0c06f4a0 0x7f2c0c0718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7fba92ffd700 1 -- 172.21.15.125:0/722469543 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9400aa20 con 0x7fbaa415e600 2023-10-17T06:07:39.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7f337e1f6700 1 -- 172.21.15.125:0/1468894213 shutdown_connections 2023-10-17T06:07:39.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7f337e1f6700 1 --2- 172.21.15.125:0/1468894213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f337003a790 0x7f3370038860 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7f337e1f6700 1 -- 172.21.15.125:0/1468894213 >> 172.21.15.125:0/1468894213 conn(0x7f3370054cf0 msgr2=0x7f33700550d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7f337e1f6700 1 -- 172.21.15.125:0/1468894213 shutdown_connections 2023-10-17T06:07:39.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7f5a59308700 1 -- start start 2023-10-17T06:07:39.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7efd497fa700 1 -- 172.21.15.125:0/1651203313 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7efd44010040 con 0x7efd4c0ceff0 2023-10-17T06:07:39.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7efd497fa700 1 --2- 172.21.15.125:0/1651203313 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efd380657f0 0x7efd38067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7efd497fa700 1 -- 172.21.15.125:0/1651203313 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efd4400d040 con 0x7efd4c0ceff0 2023-10-17T06:07:39.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7efd5095d700 1 --2- 172.21.15.125:0/1651203313 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efd380657f0 0x7efd38067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7efd497fa700 1 --2- 172.21.15.125:0/1651203313 >> [v2:172.21.15.125:6808/4280413072,v1:172.21.15.125:6810/4280413072] conn(0x7efd3806f4d0 0x7efd38071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7efd497fa700 1 -- 172.21.15.125:0/1651203313 --> [v2:172.21.15.125:6808/4280413072,v1:172.21.15.125:6810/4280413072] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd38071fe0 con 0x7efd3806f4d0 2023-10-17T06:07:39.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7efd497fa700 1 -- 172.21.15.125:0/1651203313 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd44083e30 con 0x7efd4c0ceff0 2023-10-17T06:07:39.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7f2c2e19c700 1 --2- 172.21.15.125:0/2435629585 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2c0c0657c0 0x7f2c0c067c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7f280dc82700 1 -- start start 2023-10-17T06:07:39.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7f2c2e99d700 1 --2- 172.21.15.125:0/2435629585 >> [v2:172.21.15.125:6824/4039629234,v1:172.21.15.125:6825/4039629234] conn(0x7f2c0c06f4a0 0x7f2c0c0718e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f36f6ffd700 1 -- 172.21.15.125:0/4023909220 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f36f8027820 con 0x7f3700159c90 2023-10-17T06:07:39.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f5a59308700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5a5406f450 0x7f5a5406f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f5a59308700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5a540cd690 0x7f5a540cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f5a59308700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a540b1870 con 0x7f5a540ce780 2023-10-17T06:07:39.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f5a59308700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a5406fe40 con 0x7f5a540cd690 2023-10-17T06:07:39.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f5a59308700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a540b1b50 con 0x7f5a5406f450 2023-10-17T06:07:39.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f280dc82700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2808070b80 0x7f280815b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.975+0000 7f337e1f6700 1 -- 172.21.15.125:0/1468894213 wait complete. 2023-10-17T06:07:39.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f337e1f6700 1 Processor -- start 2023-10-17T06:07:39.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f280dc82700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28080cb370 0x7f28081f9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f280dc82700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f280815cf40 0x7f28081fa350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f280dc82700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28080cc9d0 con 0x7f280815cf40 2023-10-17T06:07:39.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f280dc82700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28080b2a50 con 0x7f2808070b80 2023-10-17T06:07:39.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f280dc82700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28080b1e40 con 0x7f28080cb370 2023-10-17T06:07:39.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f337e1f6700 1 -- start start 2023-10-17T06:07:39.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f2c1effd700 1 -- 172.21.15.125:0/2435629585 <== osd.0 v2:172.21.15.125:6824/4039629234 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f2c0c071fb0 con 0x7f2c0c06f4a0 2023-10-17T06:07:39.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f163a7fc700 1 -- 172.21.15.125:0/3351073908 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1640011d10 con 0x7f163c006350 2023-10-17T06:07:39.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7efd5095d700 1 --2- 172.21.15.125:0/1651203313 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efd380657f0 0x7efd38067cb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00ab60 tx=0x7efd3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f36f6ffd700 1 --2- 172.21.15.125:0/4023909220 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36e40657c0 0x7f36e4067c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f28077fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2808070b80 0x7f280815b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f2806ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28080cb370 0x7f28081f9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f5a527fc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5a5406f450 0x7f5a5406f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f5a537fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5a540cd690 0x7f5a540cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f5a537fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5a540cd690 0x7f5a540cdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48656/0 (socket says 172.21.15.125:48656) 2023-10-17T06:07:39.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f5a537fe700 1 -- 172.21.15.125:0/4226900597 learned_addr learned my addr 172.21.15.125:0/4226900597 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f36f6ffd700 1 -- 172.21.15.125:0/4023909220 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f36f8022070 con 0x7f3700159c90 2023-10-17T06:07:39.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7efd4bfff700 1 --2- 172.21.15.125:0/1651203313 >> [v2:172.21.15.125:6808/4280413072,v1:172.21.15.125:6810/4280413072] conn(0x7efd3806f4d0 0x7efd38071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7fbaa8c1e700 1 -- 172.21.15.125:0/722469543 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbaa415ea60 con 0x7fbaa415e600 2023-10-17T06:07:39.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7fba92ffd700 1 -- 172.21.15.125:0/722469543 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fba9400ab80 con 0x7fbaa415e600 2023-10-17T06:07:39.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f2807fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f280815cf40 0x7f28081fa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f28077fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2808070b80 0x7f280815b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:35760/0 (socket says 172.21.15.125:35760) 2023-10-17T06:07:39.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f28077fe700 1 -- 172.21.15.125:0/796732014 learned_addr learned my addr 172.21.15.125:0/796732014 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f2c2e19c700 1 --2- 172.21.15.125:0/2435629585 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2c0c0657c0 0x7f2c0c067c80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2c240016e0 tx=0x7f2c24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f36f6ffd700 1 --2- 172.21.15.125:0/4023909220 >> [v2:172.21.15.125:6800/128096809,v1:172.21.15.125:6801/128096809] conn(0x7f36e406f4a0 0x7f36e40718e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f5a537fe700 1 -- 172.21.15.125:0/4226900597 >> v2:172.21.15.184:3300/0 conn(0x7f5a5406f450 msgr2=0x7f5a5406f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:39.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f5a537fe700 1 --2- 172.21.15.125:0/4226900597 >> v2:172.21.15.184:3300/0 conn(0x7f5a5406f450 0x7f5a5406f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f5a537fe700 1 -- 172.21.15.125:0/4226900597 >> v1:172.21.15.125:6789/0 conn(0x7f5a540ce780 legacy=0x7f5a5413ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f5a537fe700 1 -- 172.21.15.125:0/4226900597 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a540b1e30 con 0x7f5a540cd690 2023-10-17T06:07:39.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f36f6ffd700 1 -- 172.21.15.125:0/4023909220 --> [v2:172.21.15.125:6800/128096809,v1:172.21.15.125:6801/128096809] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36e4071fb0 con 0x7f36e406f4a0 2023-10-17T06:07:39.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f36f6ffd700 1 -- 172.21.15.125:0/4023909220 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36f8085d50 con 0x7f3700159c90 2023-10-17T06:07:39.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f3706500700 1 --2- 172.21.15.125:0/4023909220 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36e40657c0 0x7f36e4067c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f28077fe700 1 -- 172.21.15.125:0/796732014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28080cb370 msgr2=0x7f28081f9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f28077fe700 1 --2- 172.21.15.125:0/796732014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28080cb370 0x7f28081f9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f28077fe700 1 -- 172.21.15.125:0/796732014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f280815cf40 msgr2=0x7f28081fa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f28077fe700 1 --2- 172.21.15.125:0/796732014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f280815cf40 0x7f28081fa350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.979+0000 7f28077fe700 1 -- 172.21.15.125:0/796732014 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f0009b30 con 0x7f2808070b80 2023-10-17T06:07:39.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f3705cff700 1 --2- 172.21.15.125:0/4023909220 >> [v2:172.21.15.125:6800/128096809,v1:172.21.15.125:6801/128096809] conn(0x7f36e406f4a0 0x7f36e40718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f163a7fc700 1 --2- 172.21.15.125:0/3351073908 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1628065740 0x7f1628067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f163a7fc700 1 -- 172.21.15.125:0/3351073908 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1640084a10 con 0x7f163c006350 2023-10-17T06:07:39.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f5a537fe700 1 --2- 172.21.15.125:0/4226900597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a540cd690 0x7f5a540cdb00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5a540cf7b0 tx=0x7f5a4c00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6acd460c6a305ae9 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7efd4bfff700 1 --2- 172.21.15.125:0/1651203313 >> [v2:172.21.15.125:6808/4280413072,v1:172.21.15.125:6810/4280413072] conn(0x7efd3806f4d0 0x7efd38071910 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f163a7fc700 1 --2- 172.21.15.125:0/3351073908 >> [v2:172.21.15.125:6809/1606722802,v1:172.21.15.125:6811/1606722802] conn(0x7f162806f420 0x7f1628071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f163a7fc700 1 -- 172.21.15.125:0/3351073908 --> [v2:172.21.15.125:6809/1606722802,v1:172.21.15.125:6811/1606722802] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1628071f30 con 0x7f162806f420 2023-10-17T06:07:39.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f163a7fc700 1 -- 172.21.15.125:0/3351073908 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1640084d80 con 0x7f163c006350 2023-10-17T06:07:39.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f1649509700 1 --2- 172.21.15.125:0/3351073908 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1628065740 0x7f1628067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f3706500700 1 --2- 172.21.15.125:0/4023909220 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36e40657c0 0x7f36e4067c80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f36f0007b30 tx=0x7f36f0007a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7fba92ffd700 1 --2- 172.21.15.125:0/722469543 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fba840656f0 0x7fba84067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f5a51ffb700 1 -- 172.21.15.125:0/4226900597 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c010070 con 0x7f5a540cd690 2023-10-17T06:07:39.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f5a51ffb700 1 -- 172.21.15.125:0/4226900597 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4c00dd90 con 0x7f5a540cd690 2023-10-17T06:07:39.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f5a51ffb700 1 -- 172.21.15.125:0/4226900597 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c010070 con 0x7f5a540cd690 2023-10-17T06:07:39.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f28077fe700 1 --2- 172.21.15.125:0/796732014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2808070b80 0x7f280815b480 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f280806b340 tx=0x7f27f0004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f337e1f6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f337003a790 0x7f337004e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f337e1f6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f337004eba0 0x7f337004c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f337e1f6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33700e0fb0 0x7f337004a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f337e1f6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33700e1390 con 0x7f337003a790 2023-10-17T06:07:39.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f337e1f6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337004c5e0 con 0x7f337004eba0 2023-10-17T06:07:39.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f337e1f6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337004c8b0 con 0x7f33700e0fb0 2023-10-17T06:07:39.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f337d9f5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33700e0fb0 0x7f337004a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f337d9f5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33700e0fb0 0x7f337004a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:46978/0 (socket says 172.21.15.125:46978) 2023-10-17T06:07:39.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f337d9f5700 1 -- 172.21.15.125:0/3378150957 learned_addr learned my addr 172.21.15.125:0/3378150957 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7fbaa259c700 1 --2- 172.21.15.125:0/722469543 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fba840656f0 0x7fba84067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f27fffff700 1 -- 172.21.15.125:0/796732014 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f00048a0 con 0x7f2808070b80 2023-10-17T06:07:39.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f27fffff700 1 -- 172.21.15.125:0/796732014 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f00092e0 con 0x7f2808070b80 2023-10-17T06:07:39.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f27fffff700 1 -- 172.21.15.125:0/796732014 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f00048a0 con 0x7f2808070b80 2023-10-17T06:07:39.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f5a59308700 1 -- 172.21.15.125:0/4226900597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a540cd690 msgr2=0x7f5a540cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f5a59308700 1 --2- 172.21.15.125:0/4226900597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a540cd690 0x7f5a540cdb00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5a540cf7b0 tx=0x7f5a4c00d430 comp rx=0 tx=0).stop 2023-10-17T06:07:39.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7efd497fa700 1 -- 172.21.15.125:0/1651203313 <== osd.2 v2:172.21.15.125:6808/4280413072 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7efd38071fe0 con 0x7efd3806f4d0 2023-10-17T06:07:39.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f337d9f5700 1 -- 172.21.15.125:0/3378150957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f337004eba0 msgr2=0x7f337004c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f337d9f5700 1 --2- 172.21.15.125:0/3378150957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f337004eba0 0x7f337004c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f337d9f5700 1 -- 172.21.15.125:0/3378150957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f337003a790 msgr2=0x7f337004e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f337d9f5700 1 --2- 172.21.15.125:0/3378150957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f337003a790 0x7f337004e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f337d9f5700 1 -- 172.21.15.125:0/3378150957 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337804ef80 con 0x7f33700e0fb0 2023-10-17T06:07:39.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f164a50b700 1 --2- 172.21.15.125:0/3351073908 >> [v2:172.21.15.125:6809/1606722802,v1:172.21.15.125:6811/1606722802] conn(0x7f162806f420 0x7f1628071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f3705cff700 1 --2- 172.21.15.125:0/4023909220 >> [v2:172.21.15.125:6800/128096809,v1:172.21.15.125:6801/128096809] conn(0x7f36e406f4a0 0x7f36e40718e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f337d9f5700 1 --2- 172.21.15.125:0/3378150957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33700e0fb0 0x7f337004a700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f33780639e0 tx=0x7f3378069c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f5a59308700 1 -- 172.21.15.125:0/4226900597 shutdown_connections 2023-10-17T06:07:39.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f5a59308700 1 --2- 172.21.15.125:0/4226900597 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a540cd690 0x7f5a540cdb00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f5a59308700 1 --2- 172.21.15.125:0/4226900597 >> v2:172.21.15.184:3300/0 conn(0x7f5a5406f450 0x7f5a5406f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f5a59308700 1 -- 172.21.15.125:0/4226900597 >> 172.21.15.125:0/4226900597 conn(0x7f5a54069ef0 msgr2=0x7f5a5406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f164a50b700 1 --2- 172.21.15.125:0/3351073908 >> [v2:172.21.15.125:6809/1606722802,v1:172.21.15.125:6811/1606722802] conn(0x7f162806f420 0x7f1628071860 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f36f6ffd700 1 -- 172.21.15.125:0/4023909220 <== osd.3 v2:172.21.15.125:6800/128096809 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f36e4071fb0 con 0x7f36e406f4a0 2023-10-17T06:07:39.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7fbaa259c700 1 --2- 172.21.15.125:0/722469543 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fba840656f0 0x7fba84067bb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0090b0 tx=0x7fba9c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7fba92ffd700 1 -- 172.21.15.125:0/722469543 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fba94083000 con 0x7fbaa415e600 2023-10-17T06:07:39.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7fba92ffd700 1 --2- 172.21.15.125:0/722469543 >> [v2:172.21.15.184:6800/514892137,v1:172.21.15.184:6801/514892137] conn(0x7fba8406f2d0 0x7fba84071710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7fba92ffd700 1 -- 172.21.15.125:0/722469543 --> [v2:172.21.15.184:6800/514892137,v1:172.21.15.184:6801/514892137] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba84071de0 con 0x7fba8406f2d0 2023-10-17T06:07:39.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7fba92ffd700 1 -- 172.21.15.125:0/722469543 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba940856c0 con 0x7fbaa415e600 2023-10-17T06:07:39.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7fbaa1d9b700 1 --2- 172.21.15.125:0/722469543 >> [v2:172.21.15.184:6800/514892137,v1:172.21.15.184:6801/514892137] conn(0x7fba8406f2d0 0x7fba84071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f280dc82700 1 -- 172.21.15.125:0/796732014 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28080b2120 con 0x7f2808070b80 2023-10-17T06:07:39.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f280dc82700 1 -- 172.21.15.125:0/796732014 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28080b26e0 con 0x7f2808070b80 2023-10-17T06:07:39.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f3369ffb700 1 -- 172.21.15.125:0/3378150957 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378066e70 con 0x7f33700e0fb0 2023-10-17T06:07:39.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f3369ffb700 1 -- 172.21.15.125:0/3378150957 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3378066fd0 con 0x7f33700e0fb0 2023-10-17T06:07:39.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f3369ffb700 1 -- 172.21.15.125:0/3378150957 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33780705d0 con 0x7f33700e0fb0 2023-10-17T06:07:39.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.983+0000 7f5a59308700 1 -- 172.21.15.125:0/4226900597 shutdown_connections 2023-10-17T06:07:39.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.987+0000 7fbaa1d9b700 1 --2- 172.21.15.125:0/722469543 >> [v2:172.21.15.184:6800/514892137,v1:172.21.15.184:6801/514892137] conn(0x7fba8406f2d0 0x7fba84071710 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.987+0000 7f1649509700 1 --2- 172.21.15.125:0/3351073908 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1628065740 0x7f1628067c00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f163c17e270 tx=0x7f1634008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.987+0000 7f337e1f6700 1 -- 172.21.15.125:0/3378150957 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f337004cb90 con 0x7f33700e0fb0 2023-10-17T06:07:39.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.987+0000 7f5a59308700 1 -- 172.21.15.125:0/4226900597 wait complete. 2023-10-17T06:07:39.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.987+0000 7f163a7fc700 1 -- 172.21.15.125:0/3351073908 <== osd.1 v2:172.21.15.125:6809/1606722802 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f1628071f30 con 0x7f162806f420 2023-10-17T06:07:39.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.987+0000 7f280dc82700 1 -- 172.21.15.125:0/796732014 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f28080cbb20 con 0x7f2808070b80 2023-10-17T06:07:39.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.987+0000 7f337e1f6700 1 -- 172.21.15.125:0/3378150957 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33700e15a0 con 0x7f33700e0fb0 2023-10-17T06:07:39.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.987+0000 7fba92ffd700 1 -- 172.21.15.125:0/722469543 <== osd.4 v2:172.21.15.184:6800/514892137 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fba84071de0 con 0x7fba8406f2d0 2023-10-17T06:07:39.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.987+0000 7f337e1f6700 1 -- 172.21.15.125:0/3378150957 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3370050460 con 0x7f33700e0fb0 2023-10-17T06:07:39.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.987+0000 7f5a59308700 1 Processor -- start 2023-10-17T06:07:39.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f27fffff700 1 -- 172.21.15.125:0/796732014 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f27f0012430 con 0x7f2808070b80 2023-10-17T06:07:39.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f27fffff700 1 --2- 172.21.15.125:0/796732014 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f27e8065750 0x7f27e8067c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f27fffff700 1 -- 172.21.15.125:0/796732014 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f27f0084410 con 0x7f2808070b80 2023-10-17T06:07:39.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f5a59308700 1 -- start start 2023-10-17T06:07:39.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f5a59308700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a5406f450 0x7f5a54156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f27fffff700 1 --2- 172.21.15.125:0/796732014 >> [v2:172.21.15.184:6824/3287748739,v1:172.21.15.184:6825/3287748739] conn(0x7f27e806f330 0x7f27e8071770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f5a59308700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a540cd690 0x7f5a540a7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f5a59308700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a540ce780 0x7f5a541f9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f3369ffb700 1 -- 172.21.15.125:0/3378150957 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f337809d020 con 0x7f33700e0fb0 2023-10-17T06:07:39.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f2806ffd700 1 --2- 172.21.15.125:0/796732014 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f27e8065750 0x7f27e8067c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f5a59308700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a541f8d70 con 0x7f5a540ce780 2023-10-17T06:07:39.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f5a59308700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a541f8160 con 0x7f5a540cd690 2023-10-17T06:07:39.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f5a59308700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a541f8440 con 0x7f5a5406f450 2023-10-17T06:07:39.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f5a52ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a5406f450 0x7f5a54156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f5a52ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a5406f450 0x7f5a54156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:46982/0 (socket says 172.21.15.125:46982) 2023-10-17T06:07:39.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f5a52ffd700 1 -- 172.21.15.125:0/2466349471 learned_addr learned my addr 172.21.15.125:0/2466349471 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f5a537fe700 1 --2- 172.21.15.125:0/2466349471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a540ce780 0x7f5a541f9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f27fffff700 1 -- 172.21.15.125:0/796732014 --> [v2:172.21.15.184:6824/3287748739,v1:172.21.15.184:6825/3287748739] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27e8071e40 con 0x7f27e806f330 2023-10-17T06:07:39.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.995+0000 7f27fffff700 1 -- 172.21.15.125:0/796732014 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27f0003df0 con 0x7f2808070b80 2023-10-17T06:07:39.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f5a527fc700 1 --2- 172.21.15.125:0/2466349471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a540cd690 0x7f5a540a7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.995+0000 7f3369ffb700 1 --2- 172.21.15.125:0/3378150957 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f335c0656f0 0x7f335c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f5a52ffd700 1 -- 172.21.15.125:0/2466349471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a540cd690 msgr2=0x7f5a540a7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f5a52ffd700 1 --2- 172.21.15.125:0/2466349471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a540cd690 0x7f5a540a7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f5a52ffd700 1 -- 172.21.15.125:0/2466349471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a540ce780 msgr2=0x7f5a541f9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f5a52ffd700 1 --2- 172.21.15.125:0/2466349471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a540ce780 0x7f5a541f9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f5a52ffd700 1 -- 172.21.15.125:0/2466349471 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c00bd40 con 0x7f5a5406f450 2023-10-17T06:07:39.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.991+0000 7f5a527fc700 1 --2- 172.21.15.125:0/2466349471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a540cd690 0x7f5a540a7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:39.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.995+0000 7f5a52ffd700 1 --2- 172.21.15.125:0/2466349471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a5406f450 0x7f5a54156d30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800c410 tx=0x7f5a4800c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.995+0000 7f2806ffd700 1 --2- 172.21.15.125:0/796732014 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f27e8065750 0x7f27e8067c10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2808157c40 tx=0x7f27f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.995+0000 7f3369ffb700 1 -- 172.21.15.125:0/3378150957 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3378101330 con 0x7f33700e0fb0 2023-10-17T06:07:39.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.995+0000 7f2807fff700 1 --2- 172.21.15.125:0/796732014 >> [v2:172.21.15.184:6824/3287748739,v1:172.21.15.184:6825/3287748739] conn(0x7f27e806f330 0x7f27e8071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.995+0000 7f5a3b7fe700 1 -- 172.21.15.125:0/2466349471 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a480052d0 con 0x7f5a5406f450 2023-10-17T06:07:39.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.995+0000 7f3369ffb700 1 --2- 172.21.15.125:0/3378150957 >> [v2:172.21.15.184:6816/2471937715,v1:172.21.15.184:6817/2471937715] conn(0x7f335c06f350 0x7f335c071790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.995+0000 7f3369ffb700 1 -- 172.21.15.125:0/3378150957 --> [v2:172.21.15.184:6816/2471937715,v1:172.21.15.184:6817/2471937715] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f335c071e60 con 0x7f335c06f350 2023-10-17T06:07:39.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.995+0000 7f3369ffb700 1 -- 172.21.15.125:0/3378150957 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33781015f0 con 0x7f33700e0fb0 2023-10-17T06:07:39.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.995+0000 7f5a3b7fe700 1 -- 172.21.15.125:0/2466349471 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a48005430 con 0x7f5a5406f450 2023-10-17T06:07:39.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.995+0000 7f5a3b7fe700 1 -- 172.21.15.125:0/2466349471 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a480055a0 con 0x7f5a5406f450 2023-10-17T06:07:39.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.995+0000 7f5a59308700 1 -- 172.21.15.125:0/2466349471 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a541f8720 con 0x7f5a5406f450 2023-10-17T06:07:39.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.995+0000 7f5a59308700 1 -- 172.21.15.125:0/2466349471 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a541574b0 con 0x7f5a5406f450 2023-10-17T06:07:39.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.995+0000 7f2807fff700 1 --2- 172.21.15.125:0/796732014 >> [v2:172.21.15.184:6824/3287748739,v1:172.21.15.184:6825/3287748739] conn(0x7f27e806f330 0x7f27e8071770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.995+0000 7f337c9f3700 1 --2- 172.21.15.125:0/3378150957 >> [v2:172.21.15.184:6816/2471937715,v1:172.21.15.184:6817/2471937715] conn(0x7f335c06f350 0x7f335c071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.995+0000 7f5a59308700 1 -- 172.21.15.125:0/2466349471 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5a5413f630 con 0x7f5a5406f450 2023-10-17T06:07:39.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.995+0000 7f337d1f4700 1 --2- 172.21.15.125:0/3378150957 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f335c0656f0 0x7f335c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.995+0000 7f337c9f3700 1 --2- 172.21.15.125:0/3378150957 >> [v2:172.21.15.184:6816/2471937715,v1:172.21.15.184:6817/2471937715] conn(0x7f335c06f350 0x7f335c071790 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.995+0000 7f337d1f4700 1 --2- 172.21.15.125:0/3378150957 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f335c0656f0 0x7f335c067bb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f336c003e30 tx=0x7f336c007a60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.999+0000 7f27fffff700 1 -- 172.21.15.125:0/796732014 <== osd.5 v2:172.21.15.184:6824/3287748739 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f27e8071e40 con 0x7f27e806f330 2023-10-17T06:07:39.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.999+0000 7f3369ffb700 1 -- 172.21.15.125:0/3378150957 <== osd.6 v2:172.21.15.184:6816/2471937715 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f335c071e60 con 0x7f335c06f350 2023-10-17T06:07:39.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.999+0000 7f5a3b7fe700 1 -- 172.21.15.125:0/2466349471 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5a480036a0 con 0x7f5a5406f450 2023-10-17T06:07:39.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.999+0000 7f5a3b7fe700 1 --2- 172.21.15.125:0/2466349471 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5a40065770 0x7f5a40067c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.999+0000 7f5a3b7fe700 1 -- 172.21.15.125:0/2466349471 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5a48054aa0 con 0x7f5a5406f450 2023-10-17T06:07:39.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.999+0000 7f5a527fc700 1 --2- 172.21.15.125:0/2466349471 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5a40065770 0x7f5a40067c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.999+0000 7f5a3b7fe700 1 --2- 172.21.15.125:0/2466349471 >> [v2:172.21.15.184:6808/1153151577,v1:172.21.15.184:6809/1153151577] conn(0x7f5a400700a0 0x7f5a40072540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.999+0000 7f5a3b7fe700 1 -- 172.21.15.125:0/2466349471 --> [v2:172.21.15.184:6808/1153151577,v1:172.21.15.184:6809/1153151577] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5a40072c10 con 0x7f5a400700a0 2023-10-17T06:07:39.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:38.999+0000 7f5a3b7fe700 1 -- 172.21.15.125:0/2466349471 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a480541e0 con 0x7f5a5406f450 2023-10-17T06:07:39.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.003+0000 7f5a537fe700 1 --2- 172.21.15.125:0/2466349471 >> [v2:172.21.15.184:6808/1153151577,v1:172.21.15.184:6809/1153151577] conn(0x7f5a400700a0 0x7f5a40072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.003+0000 7f5a537fe700 1 --2- 172.21.15.125:0/2466349471 >> [v2:172.21.15.184:6808/1153151577,v1:172.21.15.184:6809/1153151577] conn(0x7f5a400700a0 0x7f5a40072540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.007+0000 7f5a3b7fe700 1 -- 172.21.15.125:0/2466349471 <== osd.7 v2:172.21.15.184:6808/1153151577 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f5a40072c10 con 0x7f5a400700a0 2023-10-17T06:07:39.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.007+0000 7f5a527fc700 1 --2- 172.21.15.125:0/2466349471 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5a40065770 0x7f5a40067c30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5a54158260 tx=0x7f5a44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.007+0000 7efd52bc1700 1 -- 172.21.15.125:0/1651203313 --> [v2:172.21.15.125:6808/4280413072,v1:172.21.15.125:6810/4280413072] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efd4c072e60 con 0x7efd3806f4d0 2023-10-17T06:07:39.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.011+0000 7efd497fa700 1 -- 172.21.15.125:0/1651203313 <== osd.2 v2:172.21.15.125:6808/4280413072 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efd4c072e60 con 0x7efd3806f4d0 2023-10-17T06:07:39.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.011+0000 7efd52bc1700 1 -- 172.21.15.125:0/1651203313 >> [v2:172.21.15.125:6808/4280413072,v1:172.21.15.125:6810/4280413072] conn(0x7efd3806f4d0 msgr2=0x7efd38071910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.011+0000 7efd52bc1700 1 --2- 172.21.15.125:0/1651203313 >> [v2:172.21.15.125:6808/4280413072,v1:172.21.15.125:6810/4280413072] conn(0x7efd3806f4d0 0x7efd38071910 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.011+0000 7efd52bc1700 1 -- 172.21.15.125:0/1651203313 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efd380657f0 msgr2=0x7efd38067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.011+0000 7efd52bc1700 1 --2- 172.21.15.125:0/1651203313 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efd380657f0 0x7efd38067cb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00ab60 tx=0x7efd3c008040 comp rx=0 tx=0).stop 2023-10-17T06:07:39.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.011+0000 7efd52bc1700 1 -- 172.21.15.125:0/1651203313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd4c0ceff0 msgr2=0x7efd4c0c74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.011+0000 7efd52bc1700 1 --2- 172.21.15.125:0/1651203313 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd4c0ceff0 0x7efd4c0c74e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efd4400fdc0 tx=0x7efd4400d4e0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.011+0000 7efd5115e700 1 -- 172.21.15.125:0/1651203313 reap_dead start 2023-10-17T06:07:39.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.011+0000 7efd52bc1700 1 -- 172.21.15.125:0/1651203313 shutdown_connections 2023-10-17T06:07:39.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.011+0000 7efd52bc1700 1 -- 172.21.15.125:0/1651203313 >> 172.21.15.125:0/1651203313 conn(0x7efd4c0ce4d0 msgr2=0x7efd4c15c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.011+0000 7efd52bc1700 1 -- 172.21.15.125:0/1651203313 shutdown_connections 2023-10-17T06:07:39.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.011+0000 7efd52bc1700 1 -- 172.21.15.125:0/1651203313 wait complete. 2023-10-17T06:07:39.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.015+0000 7f164ad0c700 1 -- 172.21.15.125:0/3351073908 --> [v2:172.21.15.125:6809/1606722802,v1:172.21.15.125:6811/1606722802] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f163c058060 con 0x7f162806f420 2023-10-17T06:07:39.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.015+0000 7f2c30400700 1 -- 172.21.15.125:0/2435629585 --> [v2:172.21.15.125:6824/4039629234,v1:172.21.15.125:6825/4039629234] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2c2806a940 con 0x7f2c0c06f4a0 2023-10-17T06:07:39.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.015+0000 7f2c1effd700 1 -- 172.21.15.125:0/2435629585 <== osd.0 v2:172.21.15.125:6824/4039629234 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2c180059a0 con 0x7f2c0c06f4a0 2023-10-17T06:07:39.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.015+0000 7f2c30400700 1 -- 172.21.15.125:0/2435629585 >> [v2:172.21.15.125:6824/4039629234,v1:172.21.15.125:6825/4039629234] conn(0x7f2c0c06f4a0 msgr2=0x7f2c0c0718e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.015+0000 7f2c30400700 1 --2- 172.21.15.125:0/2435629585 >> [v2:172.21.15.125:6824/4039629234,v1:172.21.15.125:6825/4039629234] conn(0x7f2c0c06f4a0 0x7f2c0c0718e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.015+0000 7f2c30400700 1 -- 172.21.15.125:0/2435629585 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2c0c0657c0 msgr2=0x7f2c0c067c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.015+0000 7f2c30400700 1 --2- 172.21.15.125:0/2435629585 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2c0c0657c0 0x7f2c0c067c80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2c240016e0 tx=0x7f2c24009040 comp rx=0 tx=0).stop 2023-10-17T06:07:39.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.015+0000 7f2c30400700 1 -- 172.21.15.125:0/2435629585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c28159370 msgr2=0x7f2c28158460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.015+0000 7f2c30400700 1 --2- 172.21.15.125:0/2435629585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c28159370 0x7f2c28158460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2c20000f80 tx=0x7f2c20004af0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.015+0000 7f2c2e99d700 1 -- 172.21.15.125:0/2435629585 reap_dead start 2023-10-17T06:07:39.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.019+0000 7f2c30400700 1 -- 172.21.15.125:0/2435629585 shutdown_connections 2023-10-17T06:07:39.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.019+0000 7f2c30400700 1 -- 172.21.15.125:0/2435629585 >> 172.21.15.125:0/2435629585 conn(0x7f2c280ce660 msgr2=0x7f2c2814a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.019+0000 7f163a7fc700 1 -- 172.21.15.125:0/3351073908 <== osd.1 v2:172.21.15.125:6809/1606722802 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f164406f130 con 0x7f162806f420 2023-10-17T06:07:39.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.019+0000 7f2c30400700 1 -- 172.21.15.125:0/2435629585 shutdown_connections 2023-10-17T06:07:39.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.019+0000 7f2c30400700 1 -- 172.21.15.125:0/2435629585 wait complete. 2023-10-17T06:07:39.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.019+0000 7f164ad0c700 1 -- 172.21.15.125:0/3351073908 >> [v2:172.21.15.125:6809/1606722802,v1:172.21.15.125:6811/1606722802] conn(0x7f162806f420 msgr2=0x7f1628071860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.019+0000 7f164ad0c700 1 --2- 172.21.15.125:0/3351073908 >> [v2:172.21.15.125:6809/1606722802,v1:172.21.15.125:6811/1606722802] conn(0x7f162806f420 0x7f1628071860 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.019+0000 7f164ad0c700 1 -- 172.21.15.125:0/3351073908 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1628065740 msgr2=0x7f1628067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.019+0000 7f164ad0c700 1 --2- 172.21.15.125:0/3351073908 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1628065740 0x7f1628067c00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f163c17e270 tx=0x7f1634008040 comp rx=0 tx=0).stop 2023-10-17T06:07:39.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.019+0000 7f164ad0c700 1 -- 172.21.15.125:0/3351073908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f163c006350 msgr2=0x7f163c180710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.019+0000 7f164ad0c700 1 --2- 172.21.15.125:0/3351073908 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f163c006350 0x7f163c180710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1640000c00 tx=0x7f1640004770 comp rx=0 tx=0).stop 2023-10-17T06:07:39.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.019+0000 7f164a50b700 1 -- 172.21.15.125:0/3351073908 reap_dead start 2023-10-17T06:07:39.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.019+0000 7f164ad0c700 1 -- 172.21.15.125:0/3351073908 shutdown_connections 2023-10-17T06:07:39.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.019+0000 7f164ad0c700 1 -- 172.21.15.125:0/3351073908 >> 172.21.15.125:0/3351073908 conn(0x7f163c059200 msgr2=0x7f163c03d070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.023+0000 7f164ad0c700 1 -- 172.21.15.125:0/3351073908 shutdown_connections 2023-10-17T06:07:39.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.023+0000 7f164ad0c700 1 -- 172.21.15.125:0/3351073908 wait complete. 2023-10-17T06:07:39.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.023+0000 7f36f4ff9700 1 -- 172.21.15.125:0/4023909220 --> [v2:172.21.15.125:6800/128096809,v1:172.21.15.125:6801/128096809] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f36dc002d60 con 0x7f36e406f4a0 2023-10-17T06:07:39.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.023+0000 7f280dc82700 1 -- 172.21.15.125:0/796732014 --> [v2:172.21.15.184:6824/3287748739,v1:172.21.15.184:6825/3287748739] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f280815dec0 con 0x7f27e806f330 2023-10-17T06:07:39.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.023+0000 7fbaa8c1e700 1 -- 172.21.15.125:0/722469543 --> [v2:172.21.15.184:6800/514892137,v1:172.21.15.184:6801/514892137] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbaa40ae5d0 con 0x7fba8406f2d0 2023-10-17T06:07:39.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.023+0000 7f36f6ffd700 1 -- 172.21.15.125:0/4023909220 <== osd.3 v2:172.21.15.125:6800/128096809 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f36dc002d60 con 0x7f36e406f4a0 2023-10-17T06:07:39.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.023+0000 7f27fffff700 1 -- 172.21.15.125:0/796732014 <== osd.5 v2:172.21.15.184:6824/3287748739 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2800001450 con 0x7f27e806f330 2023-10-17T06:07:39.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f36f4ff9700 1 -- 172.21.15.125:0/4023909220 >> [v2:172.21.15.125:6800/128096809,v1:172.21.15.125:6801/128096809] conn(0x7f36e406f4a0 msgr2=0x7f36e40718e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f36f4ff9700 1 --2- 172.21.15.125:0/4023909220 >> [v2:172.21.15.125:6800/128096809,v1:172.21.15.125:6801/128096809] conn(0x7f36e406f4a0 0x7f36e40718e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f36f4ff9700 1 -- 172.21.15.125:0/4023909220 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36e40657c0 msgr2=0x7f36e4067c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7fba92ffd700 1 -- 172.21.15.125:0/722469543 <== osd.4 v2:172.21.15.184:6800/514892137 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fba98005ac0 con 0x7fba8406f2d0 2023-10-17T06:07:39.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f36f4ff9700 1 --2- 172.21.15.125:0/4023909220 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36e40657c0 0x7f36e4067c80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f36f0007b30 tx=0x7f36f0007a80 comp rx=0 tx=0).stop 2023-10-17T06:07:39.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f36f4ff9700 1 -- 172.21.15.125:0/4023909220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3700159c90 msgr2=0x7f370015b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f36f4ff9700 1 --2- 172.21.15.125:0/4023909220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3700159c90 0x7f370015b7c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f36f8014040 tx=0x7f36f8004af0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f3706d01700 1 -- 172.21.15.125:0/4023909220 reap_dead start 2023-10-17T06:07:39.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f36f4ff9700 1 -- 172.21.15.125:0/4023909220 shutdown_connections 2023-10-17T06:07:39.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f36f4ff9700 1 -- 172.21.15.125:0/4023909220 >> 172.21.15.125:0/4023909220 conn(0x7f37000ce660 msgr2=0x7f370014c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7fbaa8c1e700 1 -- 172.21.15.125:0/722469543 >> [v2:172.21.15.184:6800/514892137,v1:172.21.15.184:6801/514892137] conn(0x7fba8406f2d0 msgr2=0x7fba84071710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7fbaa8c1e700 1 --2- 172.21.15.125:0/722469543 >> [v2:172.21.15.184:6800/514892137,v1:172.21.15.184:6801/514892137] conn(0x7fba8406f2d0 0x7fba84071710 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f36f4ff9700 1 -- 172.21.15.125:0/4023909220 shutdown_connections 2023-10-17T06:07:39.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f36f4ff9700 1 -- 172.21.15.125:0/4023909220 wait complete. 2023-10-17T06:07:39.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7fbaa8c1e700 1 -- 172.21.15.125:0/722469543 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fba840656f0 msgr2=0x7fba84067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7fbaa8c1e700 1 --2- 172.21.15.125:0/722469543 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fba840656f0 0x7fba84067bb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fba9c0090b0 tx=0x7fba9c01c040 comp rx=0 tx=0).stop 2023-10-17T06:07:39.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7fbaa8c1e700 1 -- 172.21.15.125:0/722469543 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbaa415e600 msgr2=0x7fbaa41ff170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7fbaa8c1e700 1 --2- 172.21.15.125:0/722469543 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbaa415e600 0x7fbaa41ff170 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fba9400c9f0 tx=0x7fba9400cd00 comp rx=0 tx=0).stop 2023-10-17T06:07:39.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f280dc82700 1 -- 172.21.15.125:0/796732014 >> [v2:172.21.15.184:6824/3287748739,v1:172.21.15.184:6825/3287748739] conn(0x7f27e806f330 msgr2=0x7f27e8071770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f280dc82700 1 --2- 172.21.15.125:0/796732014 >> [v2:172.21.15.184:6824/3287748739,v1:172.21.15.184:6825/3287748739] conn(0x7f27e806f330 0x7f27e8071770 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f337e1f6700 1 -- 172.21.15.125:0/3378150957 --> [v2:172.21.15.184:6816/2471937715,v1:172.21.15.184:6817/2471937715] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3370050180 con 0x7f335c06f350 2023-10-17T06:07:39.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7fbaa2d9d700 1 -- 172.21.15.125:0/722469543 reap_dead start 2023-10-17T06:07:39.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7fbaa8c1e700 1 -- 172.21.15.125:0/722469543 shutdown_connections 2023-10-17T06:07:39.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7fbaa8c1e700 1 -- 172.21.15.125:0/722469543 >> 172.21.15.125:0/722469543 conn(0x7fbaa40cebe0 msgr2=0x7fbaa40cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f3369ffb700 1 -- 172.21.15.125:0/3378150957 <== osd.6 v2:172.21.15.184:6816/2471937715 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3374004020 con 0x7f335c06f350 2023-10-17T06:07:39.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.031+0000 7fbaa8c1e700 1 -- 172.21.15.125:0/722469543 shutdown_connections 2023-10-17T06:07:39.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.031+0000 7fbaa8c1e700 1 -- 172.21.15.125:0/722469543 wait complete. 2023-10-17T06:07:39.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f280dc82700 1 -- 172.21.15.125:0/796732014 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f27e8065750 msgr2=0x7f27e8067c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f280dc82700 1 --2- 172.21.15.125:0/796732014 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f27e8065750 0x7f27e8067c10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2808157c40 tx=0x7f27f8008040 comp rx=0 tx=0).stop 2023-10-17T06:07:39.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f280dc82700 1 -- 172.21.15.125:0/796732014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2808070b80 msgr2=0x7f280815b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f280dc82700 1 --2- 172.21.15.125:0/796732014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2808070b80 0x7f280815b480 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f280806b340 tx=0x7f27f0004af0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f2807fff700 1 -- 172.21.15.125:0/796732014 reap_dead start 2023-10-17T06:07:39.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.031+0000 7f280dc82700 1 -- 172.21.15.125:0/796732014 shutdown_connections 2023-10-17T06:07:39.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.031+0000 7f280dc82700 1 -- 172.21.15.125:0/796732014 >> 172.21.15.125:0/796732014 conn(0x7f280806a340 msgr2=0x7f280815e520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f337e1f6700 1 -- 172.21.15.125:0/3378150957 >> [v2:172.21.15.184:6816/2471937715,v1:172.21.15.184:6817/2471937715] conn(0x7f335c06f350 msgr2=0x7f335c071790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.027+0000 7f337e1f6700 1 --2- 172.21.15.125:0/3378150957 >> [v2:172.21.15.184:6816/2471937715,v1:172.21.15.184:6817/2471937715] conn(0x7f335c06f350 0x7f335c071790 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.031+0000 7f337e1f6700 1 -- 172.21.15.125:0/3378150957 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f335c0656f0 msgr2=0x7f335c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.031+0000 7f337e1f6700 1 --2- 172.21.15.125:0/3378150957 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f335c0656f0 0x7f335c067bb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f336c003e30 tx=0x7f336c007a60 comp rx=0 tx=0).stop 2023-10-17T06:07:39.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.031+0000 7f337e1f6700 1 -- 172.21.15.125:0/3378150957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33700e0fb0 msgr2=0x7f337004a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.031+0000 7f337e1f6700 1 --2- 172.21.15.125:0/3378150957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33700e0fb0 0x7f337004a700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f33780639e0 tx=0x7f3378069c30 comp rx=0 tx=0).stop 2023-10-17T06:07:39.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.031+0000 7f337d9f5700 1 -- 172.21.15.125:0/3378150957 reap_dead start 2023-10-17T06:07:39.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.031+0000 7f337e1f6700 1 -- 172.21.15.125:0/3378150957 shutdown_connections 2023-10-17T06:07:39.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.031+0000 7f337e1f6700 1 -- 172.21.15.125:0/3378150957 >> 172.21.15.125:0/3378150957 conn(0x7f3370054cf0 msgr2=0x7f3370052f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.031+0000 7f280dc82700 1 -- 172.21.15.125:0/796732014 shutdown_connections 2023-10-17T06:07:39.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.031+0000 7f280dc82700 1 -- 172.21.15.125:0/796732014 wait complete. 2023-10-17T06:07:39.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.031+0000 7f337e1f6700 1 -- 172.21.15.125:0/3378150957 shutdown_connections 2023-10-17T06:07:39.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.031+0000 7f337e1f6700 1 -- 172.21.15.125:0/3378150957 wait complete. 2023-10-17T06:07:39.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.035+0000 7f5a59308700 1 -- 172.21.15.125:0/2466349471 --> [v2:172.21.15.184:6808/1153151577,v1:172.21.15.184:6809/1153151577] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5a540ce040 con 0x7f5a400700a0 2023-10-17T06:07:39.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.035+0000 7f5a3b7fe700 1 -- 172.21.15.125:0/2466349471 <== osd.7 v2:172.21.15.184:6808/1153151577 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5a4c00bbc0 con 0x7f5a400700a0 2023-10-17T06:07:39.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.035+0000 7f5a397fa700 1 -- 172.21.15.125:0/2466349471 >> [v2:172.21.15.184:6808/1153151577,v1:172.21.15.184:6809/1153151577] conn(0x7f5a400700a0 msgr2=0x7f5a40072540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.035+0000 7f5a397fa700 1 --2- 172.21.15.125:0/2466349471 >> [v2:172.21.15.184:6808/1153151577,v1:172.21.15.184:6809/1153151577] conn(0x7f5a400700a0 0x7f5a40072540 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.035+0000 7f5a397fa700 1 -- 172.21.15.125:0/2466349471 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5a40065770 msgr2=0x7f5a40067c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.035+0000 7f5a397fa700 1 --2- 172.21.15.125:0/2466349471 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5a40065770 0x7f5a40067c30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5a54158260 tx=0x7f5a44008040 comp rx=0 tx=0).stop 2023-10-17T06:07:39.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.035+0000 7f5a397fa700 1 -- 172.21.15.125:0/2466349471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a5406f450 msgr2=0x7f5a54156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.035+0000 7f5a397fa700 1 --2- 172.21.15.125:0/2466349471 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5a5406f450 0x7f5a54156d30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800c410 tx=0x7f5a4800c7d0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.039+0000 7f5a537fe700 1 -- 172.21.15.125:0/2466349471 reap_dead start 2023-10-17T06:07:39.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.039+0000 7f5a397fa700 1 -- 172.21.15.125:0/2466349471 shutdown_connections 2023-10-17T06:07:39.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.039+0000 7f5a397fa700 1 -- 172.21.15.125:0/2466349471 >> 172.21.15.125:0/2466349471 conn(0x7f5a54069ef0 msgr2=0x7f5a540b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.039+0000 7f5a397fa700 1 -- 172.21.15.125:0/2466349471 shutdown_connections 2023-10-17T06:07:39.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.039+0000 7f5a397fa700 1 -- 172.21.15.125:0/2466349471 wait complete. 2023-10-17T06:07:39.144 INFO:teuthology.orchestra.run.smithi125.stdout:60129542156 2023-10-17T06:07:39.144 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-17T06:07:39.145 INFO:teuthology.orchestra.run.smithi125.stdout:60129542156 2023-10-17T06:07:39.146 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-17T06:07:39.147 INFO:teuthology.orchestra.run.smithi125.stdout:60129542156 2023-10-17T06:07:39.147 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-17T06:07:39.148 INFO:teuthology.orchestra.run.smithi125.stdout:64424509450 2023-10-17T06:07:39.148 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-17T06:07:39.149 INFO:teuthology.orchestra.run.smithi125.stdout:64424509450 2023-10-17T06:07:39.150 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-17T06:07:39.150 INFO:teuthology.orchestra.run.smithi125.stdout:64424509451 2023-10-17T06:07:39.151 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-17T06:07:39.152 INFO:teuthology.orchestra.run.smithi125.stdout:60129542155 2023-10-17T06:07:39.152 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-17T06:07:39.153 INFO:teuthology.orchestra.run.smithi125.stdout:60129542155 2023-10-17T06:07:39.154 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-17T06:07:39.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.415+0000 7f6eaaeeb700 1 Processor -- start 2023-10-17T06:07:39.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.415+0000 7f8fc89c0700 1 Processor -- start 2023-10-17T06:07:39.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.415+0000 7f6eaaeeb700 1 -- start start 2023-10-17T06:07:39.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.415+0000 7f8fc89c0700 1 -- start start 2023-10-17T06:07:39.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.415+0000 7f5ae49d6700 1 Processor -- start 2023-10-17T06:07:39.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.415+0000 7f565d31d700 1 Processor -- start 2023-10-17T06:07:39.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.415+0000 7f5ae49d6700 1 -- start start 2023-10-17T06:07:39.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.415+0000 7f565d31d700 1 -- start start 2023-10-17T06:07:39.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f6eaaeeb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6ea40d30e0 0x7f6ea40d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f6eaaeeb700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6ea40b1df0 0x7f6ea4070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f8fc89c0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fbc0e3270 0x7f8fbc03ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f8fc89c0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8fbc054580 0x7f8fbc0574c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f8fc89c0700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fbc03ef40 con 0x7f8fbc038260 2023-10-17T06:07:39.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f8fc89c0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fbc03f1e0 con 0x7f8fbc054580 2023-10-17T06:07:39.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f8fc89c0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc007d20 con 0x7f8fbc0e3270 2023-10-17T06:07:39.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f6eaaeeb700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea415d060 con 0x7f6ea415cc80 2023-10-17T06:07:39.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f6eaaeeb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea406d830 con 0x7f6ea40d30e0 2023-10-17T06:07:39.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f6eaaeeb700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea406dd60 con 0x7f6ea40b1df0 2023-10-17T06:07:39.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f5ae49d6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5ae00b2bd0 0x7f5ae015a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7fddc18df700 1 Processor -- start 2023-10-17T06:07:39.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f8fc2d9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fbc0e3270 0x7f8fbc03ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f6ea9ee9700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f6ea415cc80 0x7f6ea40d29d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:36160/0 (socket says 172.21.15.125:36160) 2023-10-17T06:07:39.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f565d31d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56580cb8a0 0x7f56580cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f8fc2d9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fbc0e3270 0x7f8fbc03ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:46994/0 (socket says 172.21.15.125:46994) 2023-10-17T06:07:39.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f565d31d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f56580b22f0 0x7f56580b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f6ea9ee9700 1 -- 172.21.15.125:0/1350237925 learned_addr learned my addr 172.21.15.125:0/1350237925 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:39.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f8fc2d9d700 1 -- 172.21.15.125:0/2310343303 learned_addr learned my addr 172.21.15.125:0/2310343303 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f565d31d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56580cc240 con 0x7f5658144150 2023-10-17T06:07:39.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f565d31d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5658070de0 con 0x7f56580b22f0 2023-10-17T06:07:39.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f565d31d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56580701d0 con 0x7f56580cb8a0 2023-10-17T06:07:39.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f6eaa6ea700 1 --2- 172.21.15.125:0/1350237925 >> v2:172.21.15.184:3300/0 conn(0x7f6ea40b1df0 0x7f6ea4070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f6ea96e8700 1 --2- 172.21.15.125:0/1350237925 >> v2:172.21.15.125:3300/0 conn(0x7f6ea40d30e0 0x7f6ea40d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f5ae49d6700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5ae00b2fb0 0x7f5ae00b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f5ae49d6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae00ca6b0 0x7f5ae00cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f5ae49d6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae00b1dd0 con 0x7f5ae00b2bd0 2023-10-17T06:07:39.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f5ae49d6700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae00b20b0 con 0x7f5ae00b2fb0 2023-10-17T06:07:39.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f5ae49d6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae00b2390 con 0x7f5ae00ca6b0 2023-10-17T06:07:39.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f5adf7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5ae00b2bd0 0x7f5ae015a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f5adf7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5ae00b2bd0 0x7f5ae015a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48720/0 (socket says 172.21.15.125:48720) 2023-10-17T06:07:39.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f5adf7fe700 1 -- 172.21.15.125:0/3613285156 learned_addr learned my addr 172.21.15.125:0/3613285156 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f5adeffd700 1 --2- 172.21.15.125:0/3613285156 >> v2:172.21.15.184:3300/0 conn(0x7f5ae00b2fb0 0x7f5ae00b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f5adffff700 1 --2- 172.21.15.125:0/3613285156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae00ca6b0 0x7f5ae00cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f8fc359e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8fbc054580 0x7f8fbc0574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f8fc259c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f8fbc038260 0x7f8fbc053e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:36170/0 (socket says 172.21.15.125:36170) 2023-10-17T06:07:39.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7fddc18df700 1 -- start start 2023-10-17T06:07:39.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f5657fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5658144150 0x7f56580cdc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:54002/0 (socket says 172.21.15.125:54002) 2023-10-17T06:07:39.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f5657fff700 1 -- 172.21.15.125:0/3684700562 learned_addr learned my addr 172.21.15.125:0/3684700562 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:39.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f56577fe700 1 --2- 172.21.15.125:0/3684700562 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56580cb8a0 0x7f56580cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f8fc2d9d700 1 -- 172.21.15.125:0/2310343303 >> v2:172.21.15.125:3300/0 conn(0x7f8fbc054580 msgr2=0x7f8fbc0574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:39.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f8fc2d9d700 1 --2- 172.21.15.125:0/2310343303 >> v2:172.21.15.125:3300/0 conn(0x7f8fbc054580 0x7f8fbc0574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f8fc2d9d700 1 -- 172.21.15.125:0/2310343303 >> v1:172.21.15.184:6789/0 conn(0x7f8fbc038260 legacy=0x7f8fbc053e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f8fc2d9d700 1 -- 172.21.15.125:0/2310343303 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc006f60 con 0x7f8fbc0e3270 2023-10-17T06:07:39.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f565cb1c700 1 --2- 172.21.15.125:0/3684700562 >> v2:172.21.15.125:3300/0 conn(0x7f56580b22f0 0x7f56580b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f5adffff700 1 -- 172.21.15.125:0/3613285156 >> v2:172.21.15.184:3300/0 conn(0x7f5ae00b2fb0 msgr2=0x7f5ae00b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:39.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f5adffff700 1 --2- 172.21.15.125:0/3613285156 >> v2:172.21.15.184:3300/0 conn(0x7f5ae00b2fb0 0x7f5ae00b16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f5adffff700 1 -- 172.21.15.125:0/3613285156 >> v2:172.21.15.125:3300/0 conn(0x7f5ae00b2bd0 msgr2=0x7f5ae015a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:39.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f5adffff700 1 --2- 172.21.15.125:0/3613285156 >> v2:172.21.15.125:3300/0 conn(0x7f5ae00b2bd0 0x7f5ae015a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f5adffff700 1 -- 172.21.15.125:0/3613285156 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae00b2670 con 0x7f5ae00ca6b0 2023-10-17T06:07:39.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f5656ffd700 1 -- 172.21.15.125:0/3684700562 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987008785 0 0) 0x7f56580cc240 con 0x7f5658144150 2023-10-17T06:07:39.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.419+0000 7f8fc1d9b700 1 -- 172.21.15.125:0/2310343303 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183499454 0 0) 0x7f8fbc03ef40 con 0x7f8fbc038260 2023-10-17T06:07:39.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f8fc2d9d700 1 --2- 172.21.15.125:0/2310343303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fbc0e3270 0x7f8fbc03ea00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4073230 tx=0x7f8fc404f0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e769bf8e01bdea7 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f5656ffd700 1 -- 172.21.15.125:0/3684700562 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56400035d0 con 0x7f5658144150 2023-10-17T06:07:39.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f56577fe700 1 -- 172.21.15.125:0/3684700562 >> v2:172.21.15.125:3300/0 conn(0x7f56580b22f0 msgr2=0x7f56580b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:39.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f56577fe700 1 --2- 172.21.15.125:0/3684700562 >> v2:172.21.15.125:3300/0 conn(0x7f56580b22f0 0x7f56580b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f56577fe700 1 -- 172.21.15.125:0/3684700562 >> v1:172.21.15.125:6789/0 conn(0x7f5658144150 legacy=0x7f56580cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f6ea96e8700 1 -- 172.21.15.125:0/1350237925 >> v2:172.21.15.184:3300/0 conn(0x7f6ea40b1df0 msgr2=0x7f6ea4070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:39.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f8fc1d9b700 1 -- 172.21.15.125:0/2310343303 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4073540 con 0x7f8fbc0e3270 2023-10-17T06:07:39.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f56577fe700 1 -- 172.21.15.125:0/3684700562 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56580704b0 con 0x7f56580cb8a0 2023-10-17T06:07:39.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f6ea8ee7700 1 -- 172.21.15.125:0/1350237925 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368369495 0 0) 0x7f6ea415d060 con 0x7f6ea415cc80 2023-10-17T06:07:39.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f8fc1d9b700 1 -- 172.21.15.125:0/2310343303 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc408d070 con 0x7f8fbc0e3270 2023-10-17T06:07:39.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f8fc1d9b700 1 -- 172.21.15.125:0/2310343303 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc40720d0 con 0x7f8fbc0e3270 2023-10-17T06:07:39.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f5adffff700 1 --2- 172.21.15.125:0/3613285156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae00ca6b0 0x7f5ae00cab40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5ae006f270 tx=0x7f5ad000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27a0daddc47f4879 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f6ea96e8700 1 --2- 172.21.15.125:0/1350237925 >> v2:172.21.15.184:3300/0 conn(0x7f6ea40b1df0 0x7f6ea4070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f6ea96e8700 1 -- 172.21.15.125:0/1350237925 >> v1:172.21.15.184:6789/0 conn(0x7f6ea415cc80 legacy=0x7f6ea40d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f6ea96e8700 1 -- 172.21.15.125:0/1350237925 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea406da80 con 0x7f6ea40d30e0 2023-10-17T06:07:39.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f6eaa6ea700 1 --2- 172.21.15.125:0/1350237925 >> v2:172.21.15.184:3300/0 conn(0x7f6ea40b1df0 0x7f6ea4070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:07:39.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7fddc18df700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fddb4054320 0x7fddb4058220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7fddc18df700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb4057680 con 0x7fddb4053e90 2023-10-17T06:07:39.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7fddc18df700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb4007670 con 0x7fddb40e68c0 2023-10-17T06:07:39.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7fddc18df700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb4007950 con 0x7fddb4054320 2023-10-17T06:07:39.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f56577fe700 1 --2- 172.21.15.125:0/3684700562 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56580cb8a0 0x7f56580cbd00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5648009850 tx=0x7f5648009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62647a11db83eaba server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7fddbb7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fddb4054320 0x7fddb4058220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f6ea96e8700 1 --2- 172.21.15.125:0/1350237925 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ea40d30e0 0x7f6ea40d13c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40d3b10 tx=0x7f6ea0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5d551b6b8b806c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f5656ffd700 1 -- 172.21.15.125:0/3684700562 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648011830 con 0x7f56580cb8a0 2023-10-17T06:07:39.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7fddba7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fddb4053e90 0x7fddb4057b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:54012/0 (socket says 172.21.15.125:54012) 2023-10-17T06:07:39.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7fddbaffd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fddb40e68c0 0x7fddb4006c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:36184/0 (socket says 172.21.15.125:36184) 2023-10-17T06:07:39.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7fddba7fc700 1 -- 172.21.15.125:0/2958490120 learned_addr learned my addr 172.21.15.125:0/2958490120 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:39.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f8fc89c0700 1 -- 172.21.15.125:0/2310343303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fbc0e3270 msgr2=0x7f8fbc03ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f8fc89c0700 1 --2- 172.21.15.125:0/2310343303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fbc0e3270 0x7f8fbc03ea00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4073230 tx=0x7f8fc404f0b0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7fddbb7fe700 1 -- 172.21.15.125:0/2958490120 >> v1:172.21.15.184:6789/0 conn(0x7fddb40e68c0 legacy=0x7fddb4006c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7fddbb7fe700 1 -- 172.21.15.125:0/2958490120 >> v1:172.21.15.125:6789/0 conn(0x7fddb4053e90 legacy=0x7fddb4057b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7fddbb7fe700 1 -- 172.21.15.125:0/2958490120 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb4057310 con 0x7fddb4054320 2023-10-17T06:07:39.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f5ade7fc700 1 -- 172.21.15.125:0/3613285156 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000e070 con 0x7f5ae00ca6b0 2023-10-17T06:07:39.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f8fc89c0700 1 -- 172.21.15.125:0/2310343303 shutdown_connections 2023-10-17T06:07:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f8fc89c0700 1 --2- 172.21.15.125:0/2310343303 >> v2:172.21.15.125:3300/0 conn(0x7f8fbc054580 0x7f8fbc0574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f8fc89c0700 1 --2- 172.21.15.125:0/2310343303 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fbc0e3270 0x7f8fbc03ea00 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4073230 tx=0x7f8fc404f0b0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f8fc89c0700 1 -- 172.21.15.125:0/2310343303 >> 172.21.15.125:0/2310343303 conn(0x7f8fbc0591a0 msgr2=0x7f8fbc0595b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f5ade7fc700 1 -- 172.21.15.125:0/3613285156 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad000bb20 con 0x7f5ae00ca6b0 2023-10-17T06:07:39.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f5ade7fc700 1 -- 172.21.15.125:0/3613285156 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000e070 con 0x7f5ae00ca6b0 2023-10-17T06:07:39.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f6ea8ee7700 1 -- 172.21.15.125:0/1350237925 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0011830 con 0x7f6ea40d30e0 2023-10-17T06:07:39.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f5656ffd700 1 -- 172.21.15.125:0/3684700562 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5648011990 con 0x7f56580cb8a0 2023-10-17T06:07:39.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f6ea8ee7700 1 -- 172.21.15.125:0/1350237925 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea0011990 con 0x7f6ea40d30e0 2023-10-17T06:07:39.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f5656ffd700 1 -- 172.21.15.125:0/3684700562 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648011d00 con 0x7f56580cb8a0 2023-10-17T06:07:39.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f6ea8ee7700 1 -- 172.21.15.125:0/1350237925 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0011830 con 0x7f6ea40d30e0 2023-10-17T06:07:39.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f8fc89c0700 1 -- 172.21.15.125:0/2310343303 shutdown_connections 2023-10-17T06:07:39.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7fddbb7fe700 1 --2- 172.21.15.125:0/2958490120 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddb4054320 0x7fddb4058220 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fddb0009850 tx=0x7fddb0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35660d23a839b0d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f8fc89c0700 1 -- 172.21.15.125:0/2310343303 wait complete. 2023-10-17T06:07:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f565d31d700 1 -- 172.21.15.125:0/3684700562 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56580cb8a0 msgr2=0x7f56580cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f565d31d700 1 --2- 172.21.15.125:0/3684700562 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56580cb8a0 0x7f56580cbd00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5648009850 tx=0x7f5648009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:39.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f5ae49d6700 1 -- 172.21.15.125:0/3613285156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae00ca6b0 msgr2=0x7f5ae00cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f5ae49d6700 1 --2- 172.21.15.125:0/3613285156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae00ca6b0 0x7f5ae00cab40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5ae006f270 tx=0x7f5ad000b330 comp rx=0 tx=0).stop 2023-10-17T06:07:39.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f565d31d700 1 -- 172.21.15.125:0/3684700562 shutdown_connections 2023-10-17T06:07:39.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f565d31d700 1 --2- 172.21.15.125:0/3684700562 >> v2:172.21.15.125:3300/0 conn(0x7f56580b22f0 0x7f56580b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f565d31d700 1 --2- 172.21.15.125:0/3684700562 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56580cb8a0 0x7f56580cbd00 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5648009850 tx=0x7f5648009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:39.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f565d31d700 1 -- 172.21.15.125:0/3684700562 >> 172.21.15.125:0/3684700562 conn(0x7f56580b0bf0 msgr2=0x7f56580ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.423+0000 7f5ae49d6700 1 -- 172.21.15.125:0/3613285156 shutdown_connections 2023-10-17T06:07:39.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f565d31d700 1 -- 172.21.15.125:0/3684700562 shutdown_connections 2023-10-17T06:07:39.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f5ae49d6700 1 --2- 172.21.15.125:0/3613285156 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae00ca6b0 0x7f5ae00cab40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f6eaaeeb700 1 -- 172.21.15.125:0/1350237925 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ea40d30e0 msgr2=0x7f6ea40d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f6eaaeeb700 1 --2- 172.21.15.125:0/1350237925 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ea40d30e0 0x7f6ea40d13c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40d3b10 tx=0x7f6ea0009b30 comp rx=0 tx=0).stop 2023-10-17T06:07:39.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7fddb9ffb700 1 -- 172.21.15.125:0/2958490120 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0011830 con 0x7fddb4054320 2023-10-17T06:07:39.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f6eaaeeb700 1 -- 172.21.15.125:0/1350237925 shutdown_connections 2023-10-17T06:07:39.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f6eaaeeb700 1 --2- 172.21.15.125:0/1350237925 >> v2:172.21.15.184:3300/0 conn(0x7f6ea40b1df0 0x7f6ea4070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f6eaaeeb700 1 --2- 172.21.15.125:0/1350237925 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ea40d30e0 0x7f6ea40d13c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f6eaaeeb700 1 -- 172.21.15.125:0/1350237925 >> 172.21.15.125:0/1350237925 conn(0x7f6ea40cf530 msgr2=0x7f6ea40cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f5ae49d6700 1 --2- 172.21.15.125:0/3613285156 >> v2:172.21.15.184:3300/0 conn(0x7f5ae00b2fb0 0x7f5ae00b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f5ae49d6700 1 --2- 172.21.15.125:0/3613285156 >> v2:172.21.15.125:3300/0 conn(0x7f5ae00b2bd0 0x7f5ae015a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f5ae49d6700 1 -- 172.21.15.125:0/3613285156 >> 172.21.15.125:0/3613285156 conn(0x7f5ae00b0bf0 msgr2=0x7f5ae00ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f5ae49d6700 1 -- 172.21.15.125:0/3613285156 shutdown_connections 2023-10-17T06:07:39.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f5ae49d6700 1 -- 172.21.15.125:0/3613285156 wait complete. 2023-10-17T06:07:39.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7fddb9ffb700 1 -- 172.21.15.125:0/2958490120 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb0011990 con 0x7fddb4054320 2023-10-17T06:07:39.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7fddb9ffb700 1 -- 172.21.15.125:0/2958490120 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0011d20 con 0x7fddb4054320 2023-10-17T06:07:39.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f8fc89c0700 1 Processor -- start 2023-10-17T06:07:39.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f8fc89c0700 1 -- start start 2023-10-17T06:07:39.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7fddc18df700 1 -- 172.21.15.125:0/2958490120 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddb4054320 msgr2=0x7fddb4058220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7fddc18df700 1 --2- 172.21.15.125:0/2958490120 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddb4054320 0x7fddb4058220 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fddb0009850 tx=0x7fddb0009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:39.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7fddc18df700 1 -- 172.21.15.125:0/2958490120 shutdown_connections 2023-10-17T06:07:39.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7fddc18df700 1 --2- 172.21.15.125:0/2958490120 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddb4054320 0x7fddb4058220 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7fddc18df700 1 -- 172.21.15.125:0/2958490120 >> 172.21.15.125:0/2958490120 conn(0x7fddb40590c0 msgr2=0x7fddb40594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7fddc18df700 1 -- 172.21.15.125:0/2958490120 shutdown_connections 2023-10-17T06:07:39.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7fddc18df700 1 -- 172.21.15.125:0/2958490120 wait complete. 2023-10-17T06:07:39.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f565d31d700 1 -- 172.21.15.125:0/3684700562 wait complete. 2023-10-17T06:07:39.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f565d31d700 1 Processor -- start 2023-10-17T06:07:39.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f8fc89c0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fbc038260 0x7f8fbc00a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f8fc89c0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fbc054580 0x7f8fbc17aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f8fc89c0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fbc178580 0x7f8fbc17af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f565d31d700 1 -- start start 2023-10-17T06:07:39.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f5ae49d6700 1 Processor -- start 2023-10-17T06:07:39.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f6eaaeeb700 1 -- 172.21.15.125:0/1350237925 shutdown_connections 2023-10-17T06:07:39.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f8fc89c0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc00b430 con 0x7f8fbc054580 2023-10-17T06:07:39.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f8fc89c0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc185d80 con 0x7f8fbc038260 2023-10-17T06:07:39.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f8fc89c0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc186040 con 0x7f8fbc178580 2023-10-17T06:07:39.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f8fc2d9d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fbc038260 0x7f8fbc00a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f8fc2d9d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fbc038260 0x7f8fbc00a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:35786/0 (socket says 172.21.15.125:35786) 2023-10-17T06:07:39.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f8fc2d9d700 1 -- 172.21.15.125:0/1190296268 learned_addr learned my addr 172.21.15.125:0/1190296268 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f8fc359e700 1 --2- 172.21.15.125:0/1190296268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fbc178580 0x7f8fbc17af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7fddc18df700 1 Processor -- start 2023-10-17T06:07:39.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f8fc2d9d700 1 -- 172.21.15.125:0/1190296268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fbc178580 msgr2=0x7f8fbc17af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f8fc2d9d700 1 --2- 172.21.15.125:0/1190296268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fbc178580 0x7f8fbc17af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f8fc2d9d700 1 -- 172.21.15.125:0/1190296268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fbc054580 msgr2=0x7f8fbc17aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f8fc2d9d700 1 --2- 172.21.15.125:0/1190296268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fbc054580 0x7f8fbc17aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f8fc2d9d700 1 -- 172.21.15.125:0/1190296268 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc186320 con 0x7f8fbc038260 2023-10-17T06:07:39.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f8fc2d9d700 1 --2- 172.21.15.125:0/1190296268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fbc038260 0x7f8fbc00a970 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40639e0 tx=0x7f8fc4069c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f565d31d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56580b22f0 0x7f565806ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5ae49d6700 1 -- start start 2023-10-17T06:07:39.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5ae49d6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ae00b2bd0 0x7f5ae01566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5ae49d6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae00b2fb0 0x7f5ae0152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5ae49d6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae00ca6b0 0x7f5ae0157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5ae49d6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae0152e90 con 0x7f5ae00b2bd0 2023-10-17T06:07:39.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5ae49d6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae0155650 con 0x7f5ae00b2fb0 2023-10-17T06:07:39.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5ae49d6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae0155930 con 0x7f5ae00ca6b0 2023-10-17T06:07:39.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f565d31d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5658144150 0x7f565815af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f8fab7fe700 1 -- 172.21.15.125:0/1190296268 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4073830 con 0x7f8fbc038260 2023-10-17T06:07:39.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f8fab7fe700 1 -- 172.21.15.125:0/1190296268 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc40727b0 con 0x7f8fbc038260 2023-10-17T06:07:39.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f8fab7fe700 1 -- 172.21.15.125:0/1190296268 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4072b20 con 0x7f8fbc038260 2023-10-17T06:07:39.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f565d31d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56581f67b0 0x7f56581f9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f565d31d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56581f6c60 con 0x7f56580b22f0 2023-10-17T06:07:39.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f565d31d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565813e540 con 0x7f5658144150 2023-10-17T06:07:39.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f565d31d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565815b5a0 con 0x7f56581f67b0 2023-10-17T06:07:39.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f56577fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5658144150 0x7f565815af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f565cb1c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56581f67b0 0x7f56581f9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5657fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56580b22f0 0x7f565806ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5657fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56580b22f0 0x7f565806ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48764/0 (socket says 172.21.15.125:48764) 2023-10-17T06:07:39.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5657fff700 1 -- 172.21.15.125:0/2213135367 learned_addr learned my addr 172.21.15.125:0/2213135367 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5adffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae00ca6b0 0x7f5ae0157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5adffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae00ca6b0 0x7f5ae0157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:47050/0 (socket says 172.21.15.125:47050) 2023-10-17T06:07:39.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5adffff700 1 -- 172.21.15.125:0/317464801 learned_addr learned my addr 172.21.15.125:0/317464801 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5adeffd700 1 --2- 172.21.15.125:0/317464801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae00b2fb0 0x7f5ae0152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5adf7fe700 1 --2- 172.21.15.125:0/317464801 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ae00b2bd0 0x7f5ae01566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.427+0000 7f6eaaeeb700 1 -- 172.21.15.125:0/1350237925 wait complete. 2023-10-17T06:07:39.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f6eaaeeb700 1 Processor -- start 2023-10-17T06:07:39.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f6eaaeeb700 1 -- start start 2023-10-17T06:07:39.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7fddc18df700 1 -- start start 2023-10-17T06:07:39.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7fc1c69aa700 1 Processor -- start 2023-10-17T06:07:39.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f523a11a700 1 Processor -- start 2023-10-17T06:07:39.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f8fc89c0700 1 -- 172.21.15.125:0/1190296268 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fbc186600 con 0x7f8fbc038260 2023-10-17T06:07:39.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f8fc89c0700 1 -- 172.21.15.125:0/1190296268 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fbc186e00 con 0x7f8fbc038260 2023-10-17T06:07:39.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5657fff700 1 -- 172.21.15.125:0/2213135367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56581f67b0 msgr2=0x7f56581f9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5657fff700 1 --2- 172.21.15.125:0/2213135367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56581f67b0 0x7f56581f9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5657fff700 1 -- 172.21.15.125:0/2213135367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5658144150 msgr2=0x7f565815af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5657fff700 1 --2- 172.21.15.125:0/2213135367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5658144150 0x7f565815af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5657fff700 1 -- 172.21.15.125:0/2213135367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56480094b0 con 0x7f56580b22f0 2023-10-17T06:07:39.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f5657fff700 1 --2- 172.21.15.125:0/2213135367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56580b22f0 0x7f565806ea80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f564c00c4d0 tx=0x7f564c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5adffff700 1 -- 172.21.15.125:0/317464801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae00b2fb0 msgr2=0x7f5ae0152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5adffff700 1 --2- 172.21.15.125:0/317464801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae00b2fb0 0x7f5ae0152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5adffff700 1 -- 172.21.15.125:0/317464801 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ae00b2bd0 msgr2=0x7f5ae01566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5adffff700 1 --2- 172.21.15.125:0/317464801 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ae00b2bd0 0x7f5ae01566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5adffff700 1 -- 172.21.15.125:0/317464801 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad0009a70 con 0x7f5ae00ca6b0 2023-10-17T06:07:39.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7f5adffff700 1 --2- 172.21.15.125:0/317464801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae00ca6b0 0x7f5ae0157f10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00b24d0 tx=0x7f5ad0004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f5ad7fff700 1 -- 172.21.15.125:0/317464801 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000e070 con 0x7f5ae00ca6b0 2023-10-17T06:07:39.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.431+0000 7fc1c69aa700 1 -- start start 2023-10-17T06:07:39.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f523a11a700 1 -- start start 2023-10-17T06:07:39.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f5ad7fff700 1 -- 172.21.15.125:0/317464801 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad00098f0 con 0x7f5ae00ca6b0 2023-10-17T06:07:39.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f5ad7fff700 1 -- 172.21.15.125:0/317464801 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0004990 con 0x7f5ae00ca6b0 2023-10-17T06:07:39.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f4e84e5e700 1 Processor -- start 2023-10-17T06:07:39.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f4e84e5e700 1 -- start start 2023-10-17T06:07:39.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fddc18df700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddb4053e90 0x7fddb404eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fddc18df700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddb4054320 0x7fddb40e4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fddc18df700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fddb40e68c0 0x7fddb40e6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fddc18df700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb4038b20 con 0x7fddb4053e90 2023-10-17T06:07:39.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fddc18df700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb4038e00 con 0x7fddb4054320 2023-10-17T06:07:39.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fddc18df700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb40390e0 con 0x7fddb40e68c0 2023-10-17T06:07:39.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fddba7fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddb4054320 0x7fddb40e4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fddbb7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fddb40e68c0 0x7fddb40e6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f6eaaeeb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ea40b1df0 0x7f6ea4156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fddbb7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fddb40e68c0 0x7fddb40e6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:47074/0 (socket says 172.21.15.125:47074) 2023-10-17T06:07:39.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fddbb7fe700 1 -- 172.21.15.125:0/326607451 learned_addr learned my addr 172.21.15.125:0/326607451 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f8fa97fa700 1 -- 172.21.15.125:0/1190296268 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9c005310 con 0x7f8fbc038260 2023-10-17T06:07:39.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f5654ff9700 1 -- 172.21.15.125:0/2213135367 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c005d90 con 0x7f56580b22f0 2023-10-17T06:07:39.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f5654ff9700 1 -- 172.21.15.125:0/2213135367 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c0070d0 con 0x7f56580b22f0 2023-10-17T06:07:39.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f5654ff9700 1 -- 172.21.15.125:0/2213135367 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c007480 con 0x7f56580b22f0 2023-10-17T06:07:39.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f5ae49d6700 1 -- 172.21.15.125:0/317464801 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae0155c10 con 0x7f5ae00ca6b0 2023-10-17T06:07:39.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f5ae49d6700 1 -- 172.21.15.125:0/317464801 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae01561d0 con 0x7f5ae00ca6b0 2023-10-17T06:07:39.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f6eaaeeb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ea40d30e0 0x7f6ea40b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f6eaaeeb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ea415cc80 0x7f6ea40b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f6eaaeeb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea41fec10 con 0x7f6ea40d30e0 2023-10-17T06:07:39.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f6eaaeeb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea4157a10 con 0x7f6ea415cc80 2023-10-17T06:07:39.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f6eaaeeb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea415f970 con 0x7f6ea40b1df0 2023-10-17T06:07:39.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f6ea9ee9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ea40b1df0 0x7f6ea4156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f6eaa6ea700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ea415cc80 0x7f6ea40b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f6eaa6ea700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ea415cc80 0x7f6ea40b39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:35806/0 (socket says 172.21.15.125:35806) 2023-10-17T06:07:39.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f6eaa6ea700 1 -- 172.21.15.125:0/3969338913 learned_addr learned my addr 172.21.15.125:0/3969338913 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fddbaffd700 1 --2- 172.21.15.125:0/326607451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddb4053e90 0x7fddb404eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fddbb7fe700 1 -- 172.21.15.125:0/326607451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddb4054320 msgr2=0x7fddb40e4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fddbb7fe700 1 --2- 172.21.15.125:0/326607451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddb4054320 0x7fddb40e4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fddbb7fe700 1 -- 172.21.15.125:0/326607451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddb4053e90 msgr2=0x7fddb404eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fddbb7fe700 1 --2- 172.21.15.125:0/326607451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddb4053e90 0x7fddb404eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fddbb7fe700 1 -- 172.21.15.125:0/326607451 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb00094b0 con 0x7fddb40e68c0 2023-10-17T06:07:39.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f523a11a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5234161230 0x7f523406ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f523a11a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f52340cb8a0 0x7f52340cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f523a11a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5234165770 con 0x7f52340adb60 2023-10-17T06:07:39.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f523a11a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523406ea40 con 0x7f5234161230 2023-10-17T06:07:39.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f523a11a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5234161610 con 0x7f52340cb8a0 2023-10-17T06:07:39.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f565d31d700 1 -- 172.21.15.125:0/2213135367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565815b880 con 0x7f56580b22f0 2023-10-17T06:07:39.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f565d31d700 1 -- 172.21.15.125:0/2213135367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565815be40 con 0x7f56580b22f0 2023-10-17T06:07:39.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fc1bffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc1b8053770 0x7fc1b8053b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:54020/0 (socket says 172.21.15.125:54020) 2023-10-17T06:07:39.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f8fab7fe700 1 -- 172.21.15.125:0/1190296268 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8fc4066c60 con 0x7f8fbc038260 2023-10-17T06:07:39.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fc1c69aa700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc1b8056cf0 0x7fc1b803bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fc1c69aa700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b8057180 con 0x7fc1b8053770 2023-10-17T06:07:39.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fc1c69aa700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b8057460 con 0x7fc1b803c4b0 2023-10-17T06:07:39.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f52337fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5234161230 0x7f523406ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fc1c69aa700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b8057740 con 0x7fc1b8056cf0 2023-10-17T06:07:39.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f52337fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5234161230 0x7f523406ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48790/0 (socket says 172.21.15.125:48790) 2023-10-17T06:07:39.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f52337fe700 1 -- 172.21.15.125:0/3273718944 learned_addr learned my addr 172.21.15.125:0/3273718944 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f6eaa6ea700 1 -- 172.21.15.125:0/3969338913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ea40b1df0 msgr2=0x7f6ea4156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f6eaa6ea700 1 --2- 172.21.15.125:0/3969338913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ea40b1df0 0x7f6ea4156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f4e84e5e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e80161230 0x7f4e8006ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f4e84e5e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e80165770 con 0x7f4e800adb60 2023-10-17T06:07:39.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f4e84e5e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8006ea40 con 0x7f4e800cb8a0 2023-10-17T06:07:39.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f4e84e5e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e80161610 con 0x7f4e80161230 2023-10-17T06:07:39.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f6eaa6ea700 1 -- 172.21.15.125:0/3969338913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ea40d30e0 msgr2=0x7f6ea40b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7f6eaa6ea700 1 --2- 172.21.15.125:0/3969338913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ea40d30e0 0x7f6ea40b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fc1bffff700 1 -- 172.21.15.125:0/2720760381 learned_addr learned my addr 172.21.15.125:0/2720760381 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:39.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.435+0000 7fc1bf7fe700 1 --2- 172.21.15.125:0/2720760381 >> v2:172.21.15.184:3300/0 conn(0x7fc1b8056cf0 0x7fc1b803bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7fddbb7fe700 1 --2- 172.21.15.125:0/326607451 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fddb40e68c0 0x7fddb40e6ca0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fddb0009fd0 tx=0x7fddb0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f5233fff700 1 --2- 172.21.15.125:0/3273718944 >> v2:172.21.15.184:3300/0 conn(0x7f52340cb8a0 0x7f52340cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f6eaa6ea700 1 -- 172.21.15.125:0/3969338913 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c009a70 con 0x7f6ea415cc80 2023-10-17T06:07:39.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f8fab7fe700 1 --2- 172.21.15.125:0/1190296268 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8fb00656f0 0x7f8fb0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f8fab7fe700 1 -- 172.21.15.125:0/1190296268 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8fc40fd3b0 con 0x7f8fbc038260 2023-10-17T06:07:39.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f8fc259c700 1 --2- 172.21.15.125:0/1190296268 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8fb00656f0 0x7f8fb0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f565d31d700 1 -- 172.21.15.125:0/2213135367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5658072e60 con 0x7f56580b22f0 2023-10-17T06:07:39.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f5654ff9700 1 -- 172.21.15.125:0/2213135367 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f564c0075e0 con 0x7f56580b22f0 2023-10-17T06:07:39.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f5654ff9700 1 --2- 172.21.15.125:0/2213135367 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f56440657c0 0x7f5644067c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f5654ff9700 1 -- 172.21.15.125:0/2213135367 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f564c082670 con 0x7f56580b22f0 2023-10-17T06:07:39.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f5ae49d6700 1 -- 172.21.15.125:0/317464801 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae01563f0 con 0x7f5ae00ca6b0 2023-10-17T06:07:39.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f5ad7fff700 1 -- 172.21.15.125:0/317464801 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5ad0012430 con 0x7f5ae00ca6b0 2023-10-17T06:07:39.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f6ea9ee9700 1 --2- 172.21.15.125:0/3969338913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ea40b1df0 0x7f6ea4156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:07:39.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f6eaa6ea700 1 --2- 172.21.15.125:0/3969338913 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ea415cc80 0x7f6ea40b39a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00efc0 tx=0x7f6e9c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7fdda3fff700 1 -- 172.21.15.125:0/326607451 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb00036c0 con 0x7fddb40e68c0 2023-10-17T06:07:39.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7fdda3fff700 1 -- 172.21.15.125:0/326607451 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb001f070 con 0x7fddb40e68c0 2023-10-17T06:07:39.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7fddc18df700 1 -- 172.21.15.125:0/326607451 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb40393c0 con 0x7fddb40e68c0 2023-10-17T06:07:39.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7fdda3fff700 1 -- 172.21.15.125:0/326607451 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0003a40 con 0x7fddb40e68c0 2023-10-17T06:07:39.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7fddc18df700 1 -- 172.21.15.125:0/326607451 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb4039980 con 0x7fddb40e68c0 2023-10-17T06:07:39.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7fddc18df700 1 -- 172.21.15.125:0/326607451 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb4005840 con 0x7fddb40e68c0 2023-10-17T06:07:39.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7fc1bf7fe700 1 -- 172.21.15.125:0/2720760381 >> v1:172.21.15.184:6789/0 conn(0x7fc1b803c4b0 legacy=0x7fc1b8058220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7fc1bf7fe700 1 -- 172.21.15.125:0/2720760381 >> v1:172.21.15.125:6789/0 conn(0x7fc1b8053770 legacy=0x7fc1b8053b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7fc1bf7fe700 1 -- 172.21.15.125:0/2720760381 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b8057a20 con 0x7fc1b8056cf0 2023-10-17T06:07:39.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7fc1bf7fe700 1 --2- 172.21.15.125:0/2720760381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1b8056cf0 0x7fc1b803bf70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009850 tx=0x7fc1b4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae178f8be146e23c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f52337fe700 1 -- 172.21.15.125:0/3273718944 >> v2:172.21.15.184:3300/0 conn(0x7f52340cb8a0 msgr2=0x7f52340cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:39.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f52337fe700 1 --2- 172.21.15.125:0/3273718944 >> v2:172.21.15.184:3300/0 conn(0x7f52340cb8a0 0x7f52340cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f52337fe700 1 -- 172.21.15.125:0/3273718944 >> v1:172.21.15.125:6789/0 conn(0x7f52340adb60 legacy=0x7f52340cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:39.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f52337fe700 1 -- 172.21.15.125:0/3273718944 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5234165ca0 con 0x7f5234161230 2023-10-17T06:07:39.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f52337fe700 1 --2- 172.21.15.125:0/3273718944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5234161230 0x7f523406ced0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5234164c90 tx=0x7f522c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5562f182d031370d server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f52327fc700 1 -- 172.21.15.125:0/3273718944 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c00e070 con 0x7f5234161230 2023-10-17T06:07:39.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f52327fc700 1 -- 172.21.15.125:0/3273718944 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c003a40 con 0x7f5234161230 2023-10-17T06:07:39.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f52327fc700 1 -- 172.21.15.125:0/3273718944 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c003df0 con 0x7f5234161230 2023-10-17T06:07:39.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f4e7e59c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e80161230 0x7f4e8006ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f4e7e59c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e80161230 0x7f4e8006ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:47088/0 (socket says 172.21.15.125:47088) 2023-10-17T06:07:39.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f4e7ed9d700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f4e800cb8a0 0x7f4e800cc9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:36192/0 (socket says 172.21.15.125:36192) 2023-10-17T06:07:39.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f4e7ed9d700 1 -- 172.21.15.125:0/810034849 learned_addr learned my addr 172.21.15.125:0/810034849 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:39.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f4e7e59c700 1 -- 172.21.15.125:0/810034849 >> v1:172.21.15.184:6789/0 conn(0x7f4e800cb8a0 legacy=0x7f4e800cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f4e7e59c700 1 -- 172.21.15.125:0/810034849 >> v1:172.21.15.125:6789/0 conn(0x7f4e800adb60 legacy=0x7f4e800cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:39.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f4e7e59c700 1 -- 172.21.15.125:0/810034849 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e80165ca0 con 0x7f4e80161230 2023-10-17T06:07:39.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f4e7e59c700 1 --2- 172.21.15.125:0/810034849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e80161230 0x7f4e8006ced0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4e74009880 tx=0x7f4e74009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=732ffee25b4f535f server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f56577fe700 1 --2- 172.21.15.125:0/2213135367 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f56440657c0 0x7f5644067c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f8fc259c700 1 --2- 172.21.15.125:0/1190296268 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8fb00656f0 0x7f8fb0067bb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80011e0 tx=0x7f8fb80079d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f523a11a700 1 -- 172.21.15.125:0/3273718944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5234161230 msgr2=0x7f523406ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f523a11a700 1 --2- 172.21.15.125:0/3273718944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5234161230 0x7f523406ced0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5234164c90 tx=0x7f522c00b330 comp rx=0 tx=0).stop 2023-10-17T06:07:39.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.439+0000 7f56577fe700 1 --2- 172.21.15.125:0/2213135367 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f56440657c0 0x7f5644067c80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f56580adcf0 tx=0x7f5648008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.443+0000 7f523a11a700 1 -- 172.21.15.125:0/3273718944 shutdown_connections 2023-10-17T06:07:39.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.443+0000 7f523a11a700 1 --2- 172.21.15.125:0/3273718944 >> v2:172.21.15.184:3300/0 conn(0x7f52340cb8a0 0x7f52340cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.443+0000 7f523a11a700 1 --2- 172.21.15.125:0/3273718944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5234161230 0x7f523406ced0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.443+0000 7f523a11a700 1 -- 172.21.15.125:0/3273718944 >> 172.21.15.125:0/3273718944 conn(0x7f523406a340 msgr2=0x7f52340b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.443+0000 7f5ad7fff700 1 --2- 172.21.15.125:0/317464801 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5ac0065770 0x7f5ac0067c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.443+0000 7f5ad7fff700 1 -- 172.21.15.125:0/317464801 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5ad0084fe0 con 0x7f5ae00ca6b0 2023-10-17T06:07:39.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.443+0000 7fdda3fff700 1 -- 172.21.15.125:0/326607451 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fddb0003ba0 con 0x7fddb40e68c0 2023-10-17T06:07:39.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.443+0000 7f5adf7fe700 1 --2- 172.21.15.125:0/317464801 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5ac0065770 0x7f5ac0067c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.443+0000 7f523a11a700 1 -- 172.21.15.125:0/3273718944 shutdown_connections 2023-10-17T06:07:39.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.443+0000 7f523a11a700 1 -- 172.21.15.125:0/3273718944 wait complete. 2023-10-17T06:07:39.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.443+0000 7f5adf7fe700 1 --2- 172.21.15.125:0/317464801 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5ac0065770 0x7f5ac0067c30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009b20 tx=0x7f5ad8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.443+0000 7fdda3fff700 1 --2- 172.21.15.125:0/326607451 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdda80656f0 0x7fdda8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.443+0000 7fdda3fff700 1 -- 172.21.15.125:0/326607451 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fddb0021070 con 0x7fddb40e68c0 2023-10-17T06:07:39.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.443+0000 7fddbaffd700 1 --2- 172.21.15.125:0/326607451 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdda80656f0 0x7fdda8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.443+0000 7fddbaffd700 1 --2- 172.21.15.125:0/326607451 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdda80656f0 0x7fdda8067bb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fddbc04ee40 tx=0x7fddbc069410 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.443+0000 7f523a11a700 1 Processor -- start 2023-10-17T06:07:39.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.443+0000 7f523a11a700 1 -- start start 2023-10-17T06:07:39.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f6e967fc700 1 -- 172.21.15.125:0/3969338913 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c00cb40 con 0x7f6ea415cc80 2023-10-17T06:07:39.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f6e967fc700 1 -- 172.21.15.125:0/3969338913 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9c00f040 con 0x7f6ea415cc80 2023-10-17T06:07:39.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f6e967fc700 1 -- 172.21.15.125:0/3969338913 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c00cb40 con 0x7f6ea415cc80 2023-10-17T06:07:39.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f523a11a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52340adb60 0x7f5234158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f523a11a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52340cb8a0 0x7f523415b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f6eaaeeb700 1 -- 172.21.15.125:0/3969338913 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea00094b0 con 0x7f6ea415cc80 2023-10-17T06:07:39.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f523a11a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5234161230 0x7f5234159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f523a11a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5234158fa0 con 0x7f52340cb8a0 2023-10-17T06:07:39.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f523a11a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523415c2e0 con 0x7f52340adb60 2023-10-17T06:07:39.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f523a11a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523415c5c0 con 0x7f5234161230 2023-10-17T06:07:39.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f8fab7fe700 1 -- 172.21.15.125:0/1190296268 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f8fc40cab70 con 0x7f8fbc038260 2023-10-17T06:07:39.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f6eaaeeb700 1 -- 172.21.15.125:0/3969338913 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea415f690 con 0x7f6ea415cc80 2023-10-17T06:07:39.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7fc1beffd700 1 -- 172.21.15.125:0/2720760381 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4011830 con 0x7fc1b8056cf0 2023-10-17T06:07:39.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7fc1beffd700 1 -- 172.21.15.125:0/2720760381 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b4011990 con 0x7fc1b8056cf0 2023-10-17T06:07:39.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7fc1beffd700 1 -- 172.21.15.125:0/2720760381 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4011d20 con 0x7fc1b8056cf0 2023-10-17T06:07:39.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f5232ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52340cb8a0 0x7f523415b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f5232ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52340cb8a0 0x7f523415b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48806/0 (socket says 172.21.15.125:48806) 2023-10-17T06:07:39.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f5232ffd700 1 -- 172.21.15.125:0/2143885128 learned_addr learned my addr 172.21.15.125:0/2143885128 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f5233fff700 1 --2- 172.21.15.125:0/2143885128 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5234161230 0x7f5234159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f5232ffd700 1 -- 172.21.15.125:0/2143885128 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5234161230 msgr2=0x7f5234159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f5232ffd700 1 --2- 172.21.15.125:0/2143885128 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5234161230 0x7f5234159410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f5232ffd700 1 -- 172.21.15.125:0/2143885128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52340adb60 msgr2=0x7f5234158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f5232ffd700 1 --2- 172.21.15.125:0/2143885128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52340adb60 0x7f5234158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f5232ffd700 1 -- 172.21.15.125:0/2143885128 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c009b30 con 0x7f52340cb8a0 2023-10-17T06:07:39.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f5233fff700 1 --2- 172.21.15.125:0/2143885128 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5234161230 0x7f5234159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:39.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f5654ff9700 1 -- 172.21.15.125:0/2213135367 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f564c04fe20 con 0x7f56580b22f0 2023-10-17T06:07:39.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7fc1c69aa700 1 -- 172.21.15.125:0/2720760381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1b8056cf0 msgr2=0x7fc1b803bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7fc1c69aa700 1 --2- 172.21.15.125:0/2720760381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1b8056cf0 0x7fc1b803bf70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009850 tx=0x7fc1b4009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:39.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f6eaaeeb700 1 -- 172.21.15.125:0/3969338913 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea4072e60 con 0x7f6ea415cc80 2023-10-17T06:07:39.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f5232ffd700 1 --2- 172.21.15.125:0/2143885128 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52340cb8a0 0x7f523415b9e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f522400b4a0 tx=0x7f522400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f521bfff700 1 -- 172.21.15.125:0/2143885128 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5224011830 con 0x7f52340cb8a0 2023-10-17T06:07:39.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7fc1c69aa700 1 -- 172.21.15.125:0/2720760381 shutdown_connections 2023-10-17T06:07:39.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7fc1c69aa700 1 --2- 172.21.15.125:0/2720760381 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1b8056cf0 0x7fc1b803bf70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7fc1c69aa700 1 -- 172.21.15.125:0/2720760381 >> 172.21.15.125:0/2720760381 conn(0x7fc1b8059120 msgr2=0x7fc1b8059530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f523a11a700 1 -- 172.21.15.125:0/2143885128 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523415cee0 con 0x7f52340cb8a0 2023-10-17T06:07:39.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f523a11a700 1 -- 172.21.15.125:0/2143885128 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523415d4a0 con 0x7f52340cb8a0 2023-10-17T06:07:39.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7fc1c69aa700 1 -- 172.21.15.125:0/2720760381 shutdown_connections 2023-10-17T06:07:39.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f521bfff700 1 -- 172.21.15.125:0/2143885128 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5224011990 con 0x7f52340cb8a0 2023-10-17T06:07:39.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f521bfff700 1 -- 172.21.15.125:0/2143885128 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5224011830 con 0x7f52340cb8a0 2023-10-17T06:07:39.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7fc1c69aa700 1 -- 172.21.15.125:0/2720760381 wait complete. 2023-10-17T06:07:39.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f4e7d59a700 1 -- 172.21.15.125:0/810034849 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e74004230 con 0x7f4e80161230 2023-10-17T06:07:39.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.447+0000 7f523a11a700 1 -- 172.21.15.125:0/2143885128 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5214005310 con 0x7f52340cb8a0 2023-10-17T06:07:39.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.451+0000 7fc1c69aa700 1 Processor -- start 2023-10-17T06:07:39.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.451+0000 7f5ad7fff700 1 -- 172.21.15.125:0/317464801 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f5ad00528b0 con 0x7f5ae00ca6b0 2023-10-17T06:07:39.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.451+0000 7fc1c69aa700 1 -- start start 2023-10-17T06:07:39.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.451+0000 7f6e967fc700 1 -- 172.21.15.125:0/3969338913 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6e9c00cca0 con 0x7f6ea415cc80 2023-10-17T06:07:39.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.451+0000 7f6e967fc700 1 --2- 172.21.15.125:0/3969338913 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6e88065750 0x7f6e88067c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.451+0000 7f6e967fc700 1 -- 172.21.15.125:0/3969338913 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6e9c083750 con 0x7f6ea415cc80 2023-10-17T06:07:39.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.451+0000 7f6ea9ee9700 1 --2- 172.21.15.125:0/3969338913 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6e88065750 0x7f6e88067c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.451+0000 7f521bfff700 1 -- 172.21.15.125:0/2143885128 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5224011b00 con 0x7f52340cb8a0 2023-10-17T06:07:39.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.451+0000 7f521bfff700 1 --2- 172.21.15.125:0/2143885128 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5220065750 0x7f5220067c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.451+0000 7f6ea9ee9700 1 --2- 172.21.15.125:0/3969338913 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6e88065750 0x7f6e88067c10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6e98004fb0 tx=0x7f6e98004a70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.451+0000 7fc1c69aa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1b803c4b0 0x7fc1b8180850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.451+0000 7f521bfff700 1 -- 172.21.15.125:0/2143885128 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5224054d80 con 0x7f52340cb8a0 2023-10-17T06:07:39.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1c69aa700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1b8053770 0x7fc1b80ea530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1c69aa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1b80eaa70 0x7fc1b80e2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1bf7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1b8053770 0x7fc1b80ea530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1bf7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1b8053770 0x7fc1b80ea530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:35858/0 (socket says 172.21.15.125:35858) 2023-10-17T06:07:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1bffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1b803c4b0 0x7fc1b8180850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1bffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1b803c4b0 0x7fc1b8180850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:47094/0 (socket says 172.21.15.125:47094) 2023-10-17T06:07:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1c4f47700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1b80eaa70 0x7fc1b80e2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1c4f47700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1b80eaa70 0x7fc1b80e2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48812/0 (socket says 172.21.15.125:48812) 2023-10-17T06:07:39.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1bf7fe700 1 -- 172.21.15.125:0/531608015 learned_addr learned my addr 172.21.15.125:0/531608015 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1c69aa700 1 -- 172.21.15.125:0/531608015 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80e7d80 con 0x7fc1b80eaa70 2023-10-17T06:07:39.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7f52337fe700 1 --2- 172.21.15.125:0/2143885128 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5220065750 0x7f5220067c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1c69aa700 1 -- 172.21.15.125:0/531608015 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80e8060 con 0x7fc1b8053770 2023-10-17T06:07:39.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1c69aa700 1 -- 172.21.15.125:0/531608015 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80e8340 con 0x7fc1b803c4b0 2023-10-17T06:07:39.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7f4e7d59a700 1 -- 172.21.15.125:0/810034849 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e74004390 con 0x7f4e80161230 2023-10-17T06:07:39.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1c4f47700 1 -- 172.21.15.125:0/531608015 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1b803c4b0 msgr2=0x7fc1b8180850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1c4f47700 1 --2- 172.21.15.125:0/531608015 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1b803c4b0 0x7fc1b8180850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1c4f47700 1 -- 172.21.15.125:0/531608015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1b8053770 msgr2=0x7fc1b80ea530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1c4f47700 1 --2- 172.21.15.125:0/531608015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1b8053770 0x7fc1b80ea530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1c4f47700 1 -- 172.21.15.125:0/531608015 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b40094b0 con 0x7fc1b80eaa70 2023-10-17T06:07:39.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7f52337fe700 1 --2- 172.21.15.125:0/2143885128 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5220065750 0x7f5220067c10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f522c00b370 tx=0x7f522c010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1bf7fe700 1 --2- 172.21.15.125:0/531608015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1b8053770 0x7fc1b80ea530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:39.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1c4f47700 1 --2- 172.21.15.125:0/531608015 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1b80eaa70 0x7fc1b80e2d70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc1c004f300 tx=0x7fc1c004e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7f521bfff700 1 -- 172.21.15.125:0/2143885128 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f52240511c0 con 0x7f52340cb8a0 2023-10-17T06:07:39.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1bcff9700 1 -- 172.21.15.125:0/531608015 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0072af0 con 0x7fc1b80eaa70 2023-10-17T06:07:39.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7f4e84e5e700 1 -- 172.21.15.125:0/810034849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e80161230 msgr2=0x7f4e8006ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7f4e7d59a700 1 -- 172.21.15.125:0/810034849 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e740036c0 con 0x7f4e80161230 2023-10-17T06:07:39.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fdda3fff700 1 -- 172.21.15.125:0/326607451 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fddb0051f20 con 0x7fddb40e68c0 2023-10-17T06:07:39.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1bcff9700 1 -- 172.21.15.125:0/531608015 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c008d070 con 0x7fc1b80eaa70 2023-10-17T06:07:39.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7f4e84e5e700 1 --2- 172.21.15.125:0/810034849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e80161230 0x7f4e8006ced0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4e74009880 tx=0x7f4e74009b90 comp rx=0 tx=0).stop 2023-10-17T06:07:39.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1c69aa700 1 -- 172.21.15.125:0/531608015 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b80e8620 con 0x7fc1b80eaa70 2023-10-17T06:07:39.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.455+0000 7fc1c69aa700 1 -- 172.21.15.125:0/531608015 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b80e8be0 con 0x7fc1b80eaa70 2023-10-17T06:07:39.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.459+0000 7f4e84e5e700 1 -- 172.21.15.125:0/810034849 shutdown_connections 2023-10-17T06:07:39.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.459+0000 7fc1bcff9700 1 -- 172.21.15.125:0/531608015 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0066ea0 con 0x7fc1b80eaa70 2023-10-17T06:07:39.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.459+0000 7f4e84e5e700 1 --2- 172.21.15.125:0/810034849 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e80161230 0x7f4e8006ced0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.459+0000 7f4e84e5e700 1 -- 172.21.15.125:0/810034849 >> 172.21.15.125:0/810034849 conn(0x7f4e8006a340 msgr2=0x7f4e800b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.459+0000 7f4e84e5e700 1 -- 172.21.15.125:0/810034849 shutdown_connections 2023-10-17T06:07:39.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.459+0000 7f4e84e5e700 1 -- 172.21.15.125:0/810034849 wait complete. 2023-10-17T06:07:39.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.459+0000 7f6e967fc700 1 -- 172.21.15.125:0/3969338913 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f6e9c050e80 con 0x7f6ea415cc80 2023-10-17T06:07:39.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.459+0000 7fc1c69aa700 1 -- 172.21.15.125:0/531608015 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a0005310 con 0x7fc1b80eaa70 2023-10-17T06:07:39.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.463+0000 7f4e84e5e700 1 Processor -- start 2023-10-17T06:07:39.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.463+0000 7f4e84e5e700 1 -- start start 2023-10-17T06:07:39.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.463+0000 7fc1bcff9700 1 -- 172.21.15.125:0/531608015 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc1c0067000 con 0x7fc1b80eaa70 2023-10-17T06:07:39.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.463+0000 7fc1bcff9700 1 --2- 172.21.15.125:0/531608015 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc1a4065720 0x7fc1a4067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.463+0000 7fc1bcff9700 1 -- 172.21.15.125:0/531608015 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc1c00fc5b0 con 0x7fc1b80eaa70 2023-10-17T06:07:39.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.463+0000 7f4e84e5e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e800adb60 0x7f4e801facc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.463+0000 7fc1bffff700 1 --2- 172.21.15.125:0/531608015 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc1a4065720 0x7fc1a4067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.463+0000 7f4e84e5e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e800cb8a0 0x7f4e80151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.463+0000 7f4e84e5e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e80161230 0x7f4e800b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.463+0000 7f4e84e5e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e80151fa0 con 0x7f4e800cb8a0 2023-10-17T06:07:39.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.463+0000 7f4e84e5e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e800b1890 con 0x7f4e800adb60 2023-10-17T06:07:39.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.463+0000 7f4e84e5e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e800b1b10 con 0x7f4e80161230 2023-10-17T06:07:39.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.463+0000 7f4e7dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e800cb8a0 0x7f4e80151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.463+0000 7f4e7dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e800cb8a0 0x7f4e80151a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48826/0 (socket says 172.21.15.125:48826) 2023-10-17T06:07:39.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.463+0000 7f4e7dd9b700 1 -- 172.21.15.125:0/622391189 learned_addr learned my addr 172.21.15.125:0/622391189 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:39.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.463+0000 7f4e7ed9d700 1 --2- 172.21.15.125:0/622391189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e80161230 0x7f4e800b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.467+0000 7fc1bffff700 1 --2- 172.21.15.125:0/531608015 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc1a4065720 0x7fc1a4067be0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac000f60 tx=0x7fc1ac007f30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.463+0000 7f4e7e59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e800adb60 0x7f4e801facc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.467+0000 7f4e7ed9d700 1 -- 172.21.15.125:0/622391189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e800adb60 msgr2=0x7f4e801facc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.467+0000 7f4e7ed9d700 1 --2- 172.21.15.125:0/622391189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e800adb60 0x7f4e801facc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.467+0000 7f4e7ed9d700 1 -- 172.21.15.125:0/622391189 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e800cb8a0 msgr2=0x7f4e80151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.467+0000 7f4e7ed9d700 1 --2- 172.21.15.125:0/622391189 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e800cb8a0 0x7f4e80151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.467+0000 7f4e7ed9d700 1 -- 172.21.15.125:0/622391189 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e740094b0 con 0x7f4e80161230 2023-10-17T06:07:39.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.467+0000 7f4e7ed9d700 1 --2- 172.21.15.125:0/622391189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e80161230 0x7f4e800b1350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800caa0 tx=0x7f4e7800cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.467+0000 7f4e6effd700 1 -- 172.21.15.125:0/622391189 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e78007480 con 0x7f4e80161230 2023-10-17T06:07:39.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.467+0000 7f4e6effd700 1 -- 172.21.15.125:0/622391189 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e780075e0 con 0x7f4e80161230 2023-10-17T06:07:39.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.467+0000 7f4e6effd700 1 -- 172.21.15.125:0/622391189 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e78007950 con 0x7f4e80161230 2023-10-17T06:07:39.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.467+0000 7f4e84e5e700 1 -- 172.21.15.125:0/622391189 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e800b1df0 con 0x7f4e80161230 2023-10-17T06:07:39.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.467+0000 7f4e84e5e700 1 -- 172.21.15.125:0/622391189 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e800b23b0 con 0x7f4e80161230 2023-10-17T06:07:39.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.471+0000 7f4e84e5e700 1 -- 172.21.15.125:0/622391189 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8006ec90 con 0x7f4e80161230 2023-10-17T06:07:39.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.471+0000 7fc1bcff9700 1 -- 172.21.15.125:0/531608015 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc1c00c9d70 con 0x7fc1b80eaa70 2023-10-17T06:07:39.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.471+0000 7f4e6effd700 1 -- 172.21.15.125:0/622391189 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4e7801b3b0 con 0x7f4e80161230 2023-10-17T06:07:39.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.475+0000 7f4e6effd700 1 --2- 172.21.15.125:0/622391189 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4e60065740 0x7f4e60067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:39.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.475+0000 7f4e6effd700 1 -- 172.21.15.125:0/622391189 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4e78082620 con 0x7f4e80161230 2023-10-17T06:07:39.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.479+0000 7f4e7e59c700 1 --2- 172.21.15.125:0/622391189 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4e60065740 0x7f4e60067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:39.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.479+0000 7f4e7e59c700 1 --2- 172.21.15.125:0/622391189 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4e60065740 0x7f4e60067c00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4e74009880 tx=0x7f4e74008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:39.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.483+0000 7f4e6effd700 1 -- 172.21.15.125:0/622391189 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f4e8006ec90 con 0x7f4e80161230 2023-10-17T06:07:39.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.791+0000 7f8fa97fa700 1 -- 172.21.15.125:0/1190296268 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8f9c0055c0 con 0x7f8fbc038260 2023-10-17T06:07:39.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.791+0000 7f8fab7fe700 1 -- 172.21.15.125:0/1190296268 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8fc4072c80 con 0x7f8fbc038260 2023-10-17T06:07:39.795 INFO:teuthology.orchestra.run.smithi125.stdout:60129542154 2023-10-17T06:07:39.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.795+0000 7f565d31d700 1 -- 172.21.15.125:0/2213135367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f565806f860 con 0x7f56580b22f0 2023-10-17T06:07:39.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.795+0000 7f5654ff9700 1 -- 172.21.15.125:0/2213135367 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f564c053440 con 0x7f56580b22f0 2023-10-17T06:07:39.798 INFO:teuthology.orchestra.run.smithi125.stdout:60129542154 2023-10-17T06:07:39.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.795+0000 7f5ae49d6700 1 -- 172.21.15.125:0/317464801 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5ae0155a70 con 0x7f5ae00ca6b0 2023-10-17T06:07:39.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.795+0000 7f8fa97fa700 1 -- 172.21.15.125:0/1190296268 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8fb00656f0 msgr2=0x7f8fb0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.795+0000 7f8fa97fa700 1 --2- 172.21.15.125:0/1190296268 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8fb00656f0 0x7f8fb0067bb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80011e0 tx=0x7f8fb80079d0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.795+0000 7f8fa97fa700 1 -- 172.21.15.125:0/1190296268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fbc038260 msgr2=0x7f8fbc00a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.795+0000 7f8fa97fa700 1 --2- 172.21.15.125:0/1190296268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fbc038260 0x7f8fbc00a970 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40639e0 tx=0x7f8fc4069c30 comp rx=0 tx=0).stop 2023-10-17T06:07:39.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.795+0000 7f8fa97fa700 1 -- 172.21.15.125:0/1190296268 shutdown_connections 2023-10-17T06:07:39.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.795+0000 7f8fa97fa700 1 --2- 172.21.15.125:0/1190296268 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8fb00656f0 0x7f8fb0067bb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.795+0000 7f8fa97fa700 1 --2- 172.21.15.125:0/1190296268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fbc178580 0x7f8fbc17af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.795+0000 7f8fa97fa700 1 --2- 172.21.15.125:0/1190296268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fbc054580 0x7f8fbc17aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.795+0000 7f8fa97fa700 1 --2- 172.21.15.125:0/1190296268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fbc038260 0x7f8fbc00a970 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.795+0000 7f8fa97fa700 1 -- 172.21.15.125:0/1190296268 >> 172.21.15.125:0/1190296268 conn(0x7f8fbc0591a0 msgr2=0x7f8fbc0399f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.799+0000 7f565d31d700 1 -- 172.21.15.125:0/2213135367 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f56440657c0 msgr2=0x7f5644067c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.799+0000 7f565d31d700 1 --2- 172.21.15.125:0/2213135367 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f56440657c0 0x7f5644067c80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f56580adcf0 tx=0x7f5648008030 comp rx=0 tx=0).stop 2023-10-17T06:07:39.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.799+0000 7f565d31d700 1 -- 172.21.15.125:0/2213135367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56580b22f0 msgr2=0x7f565806ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.799+0000 7f565d31d700 1 --2- 172.21.15.125:0/2213135367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56580b22f0 0x7f565806ea80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f564c00c4d0 tx=0x7f564c00c890 comp rx=0 tx=0).stop 2023-10-17T06:07:39.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.799+0000 7f565d31d700 1 -- 172.21.15.125:0/2213135367 shutdown_connections 2023-10-17T06:07:39.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.799+0000 7f565d31d700 1 --2- 172.21.15.125:0/2213135367 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f56440657c0 0x7f5644067c80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.799+0000 7f565d31d700 1 --2- 172.21.15.125:0/2213135367 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56581f67b0 0x7f56581f9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.799+0000 7f565d31d700 1 --2- 172.21.15.125:0/2213135367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5658144150 0x7f565815af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.799+0000 7f565d31d700 1 --2- 172.21.15.125:0/2213135367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56580b22f0 0x7f565806ea80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.799+0000 7f565d31d700 1 -- 172.21.15.125:0/2213135367 >> 172.21.15.125:0/2213135367 conn(0x7f56580b0bf0 msgr2=0x7f56580b3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.799+0000 7f5ad7fff700 1 -- 172.21.15.125:0/317464801 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ae0155a70 con 0x7f5ae00ca6b0 2023-10-17T06:07:39.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.799+0000 7fddc18df700 1 -- 172.21.15.125:0/326607451 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fddb4050910 con 0x7fddb40e68c0 2023-10-17T06:07:39.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.803+0000 7f8fa97fa700 1 -- 172.21.15.125:0/1190296268 shutdown_connections 2023-10-17T06:07:39.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.803+0000 7f8fa97fa700 1 -- 172.21.15.125:0/1190296268 wait complete. 2023-10-17T06:07:39.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.803+0000 7f565d31d700 1 -- 172.21.15.125:0/2213135367 shutdown_connections 2023-10-17T06:07:39.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.803+0000 7f565d31d700 1 -- 172.21.15.125:0/2213135367 wait complete. 2023-10-17T06:07:39.807 INFO:teuthology.orchestra.run.smithi125.stdout:60129542154 2023-10-17T06:07:39.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.803+0000 7fdda3fff700 1 -- 172.21.15.125:0/326607451 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fddb0055540 con 0x7fddb40e68c0 2023-10-17T06:07:39.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.803+0000 7f5ae49d6700 1 -- 172.21.15.125:0/317464801 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5ac0065770 msgr2=0x7f5ac0067c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.803+0000 7f5ae49d6700 1 --2- 172.21.15.125:0/317464801 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5ac0065770 0x7f5ac0067c30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009b20 tx=0x7f5ad8008040 comp rx=0 tx=0).stop 2023-10-17T06:07:39.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.803+0000 7f5ae49d6700 1 -- 172.21.15.125:0/317464801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae00ca6b0 msgr2=0x7f5ae0157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.803+0000 7f5ae49d6700 1 --2- 172.21.15.125:0/317464801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae00ca6b0 0x7f5ae0157f10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00b24d0 tx=0x7f5ad0004af0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.803+0000 7f5ae49d6700 1 -- 172.21.15.125:0/317464801 shutdown_connections 2023-10-17T06:07:39.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.803+0000 7f5ae49d6700 1 --2- 172.21.15.125:0/317464801 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5ac0065770 0x7f5ac0067c30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.803+0000 7f5ae49d6700 1 --2- 172.21.15.125:0/317464801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5ae00ca6b0 0x7f5ae0157f10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.803+0000 7f5ae49d6700 1 --2- 172.21.15.125:0/317464801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ae00b2fb0 0x7f5ae0152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.803+0000 7f5ae49d6700 1 --2- 172.21.15.125:0/317464801 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ae00b2bd0 0x7f5ae01566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.803+0000 7f5ae49d6700 1 -- 172.21.15.125:0/317464801 >> 172.21.15.125:0/317464801 conn(0x7f5ae00b0bf0 msgr2=0x7f5ae0159e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.810 INFO:teuthology.orchestra.run.smithi125.stdout:64424509449 2023-10-17T06:07:39.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.807+0000 7f6eaaeeb700 1 -- 172.21.15.125:0/3969338913 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6ea40b8bb0 con 0x7f6ea415cc80 2023-10-17T06:07:39.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.807+0000 7fddc18df700 1 -- 172.21.15.125:0/326607451 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdda80656f0 msgr2=0x7fdda8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.807+0000 7fddc18df700 1 --2- 172.21.15.125:0/326607451 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdda80656f0 0x7fdda8067bb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fddbc04ee40 tx=0x7fddbc069410 comp rx=0 tx=0).stop 2023-10-17T06:07:39.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.807+0000 7fddc18df700 1 -- 172.21.15.125:0/326607451 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fddb40e68c0 msgr2=0x7fddb40e6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.807+0000 7fddc18df700 1 --2- 172.21.15.125:0/326607451 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fddb40e68c0 0x7fddb40e6ca0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fddb0009fd0 tx=0x7fddb0004770 comp rx=0 tx=0).stop 2023-10-17T06:07:39.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.807+0000 7fddc18df700 1 -- 172.21.15.125:0/326607451 shutdown_connections 2023-10-17T06:07:39.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.807+0000 7fddc18df700 1 --2- 172.21.15.125:0/326607451 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdda80656f0 0x7fdda8067bb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.807+0000 7fddc18df700 1 --2- 172.21.15.125:0/326607451 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fddb40e68c0 0x7fddb40e6ca0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.807+0000 7fddc18df700 1 --2- 172.21.15.125:0/326607451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddb4054320 0x7fddb40e4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.807+0000 7fddc18df700 1 --2- 172.21.15.125:0/326607451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddb4053e90 0x7fddb404eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.807+0000 7fddc18df700 1 -- 172.21.15.125:0/326607451 >> 172.21.15.125:0/326607451 conn(0x7fddb40590c0 msgr2=0x7fddb403e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.807+0000 7f5ae49d6700 1 -- 172.21.15.125:0/317464801 shutdown_connections 2023-10-17T06:07:39.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.807+0000 7f5ae49d6700 1 -- 172.21.15.125:0/317464801 wait complete. 2023-10-17T06:07:39.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.807+0000 7f6e967fc700 1 -- 172.21.15.125:0/3969338913 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e9c009d70 con 0x7f6ea415cc80 2023-10-17T06:07:39.815 INFO:teuthology.orchestra.run.smithi125.stdout:64424509449 2023-10-17T06:07:39.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.811+0000 7fddc18df700 1 -- 172.21.15.125:0/326607451 shutdown_connections 2023-10-17T06:07:39.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.811+0000 7f523a11a700 1 -- 172.21.15.125:0/2143885128 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5214005890 con 0x7f52340cb8a0 2023-10-17T06:07:39.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.811+0000 7fddc18df700 1 -- 172.21.15.125:0/326607451 wait complete. 2023-10-17T06:07:39.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.811+0000 7f521bfff700 1 -- 172.21.15.125:0/2143885128 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5224051360 con 0x7f52340cb8a0 2023-10-17T06:07:39.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f6eaaeeb700 1 -- 172.21.15.125:0/3969338913 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6e88065750 msgr2=0x7f6e88067c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f6eaaeeb700 1 --2- 172.21.15.125:0/3969338913 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6e88065750 0x7f6e88067c10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6e98004fb0 tx=0x7f6e98004a70 comp rx=0 tx=0).stop 2023-10-17T06:07:39.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f6eaaeeb700 1 -- 172.21.15.125:0/3969338913 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ea415cc80 msgr2=0x7f6ea40b39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f6eaaeeb700 1 --2- 172.21.15.125:0/3969338913 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ea415cc80 0x7f6ea40b39a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00efc0 tx=0x7f6e9c00c3a0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f6eaaeeb700 1 -- 172.21.15.125:0/3969338913 shutdown_connections 2023-10-17T06:07:39.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f6eaaeeb700 1 --2- 172.21.15.125:0/3969338913 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6e88065750 0x7f6e88067c10 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6e98004fb0 tx=0x7f6e98004a70 comp rx=0 tx=0).stop 2023-10-17T06:07:39.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f6eaaeeb700 1 --2- 172.21.15.125:0/3969338913 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ea415cc80 0x7f6ea40b39a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f6eaaeeb700 1 --2- 172.21.15.125:0/3969338913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ea40d30e0 0x7f6ea40b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f6eaaeeb700 1 --2- 172.21.15.125:0/3969338913 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6ea40b1df0 0x7f6ea4156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f6eaaeeb700 1 -- 172.21.15.125:0/3969338913 >> 172.21.15.125:0/3969338913 conn(0x7f6ea40cf530 msgr2=0x7f6ea4159030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.819 INFO:teuthology.orchestra.run.smithi125.stdout:60129542153 2023-10-17T06:07:39.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f523a11a700 1 -- 172.21.15.125:0/2143885128 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5220065750 msgr2=0x7f5220067c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f523a11a700 1 --2- 172.21.15.125:0/2143885128 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5220065750 0x7f5220067c10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f522c00b370 tx=0x7f522c010000 comp rx=0 tx=0).stop 2023-10-17T06:07:39.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f523a11a700 1 -- 172.21.15.125:0/2143885128 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52340cb8a0 msgr2=0x7f523415b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f523a11a700 1 --2- 172.21.15.125:0/2143885128 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52340cb8a0 0x7f523415b9e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f522400b4a0 tx=0x7f522400b860 comp rx=0 tx=0).stop 2023-10-17T06:07:39.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f6eaaeeb700 1 -- 172.21.15.125:0/3969338913 shutdown_connections 2023-10-17T06:07:39.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f6eaaeeb700 1 -- 172.21.15.125:0/3969338913 wait complete. 2023-10-17T06:07:39.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f523a11a700 1 -- 172.21.15.125:0/2143885128 shutdown_connections 2023-10-17T06:07:39.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f523a11a700 1 --2- 172.21.15.125:0/2143885128 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5220065750 0x7f5220067c10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f523a11a700 1 --2- 172.21.15.125:0/2143885128 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5234161230 0x7f5234159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f523a11a700 1 --2- 172.21.15.125:0/2143885128 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52340cb8a0 0x7f523415b9e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f523a11a700 1 --2- 172.21.15.125:0/2143885128 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52340adb60 0x7f5234158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f523a11a700 1 -- 172.21.15.125:0/2143885128 >> 172.21.15.125:0/2143885128 conn(0x7f523406a340 msgr2=0x7f523406f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.815+0000 7f523a11a700 1 -- 172.21.15.125:0/2143885128 shutdown_connections 2023-10-17T06:07:39.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.819+0000 7f523a11a700 1 -- 172.21.15.125:0/2143885128 wait complete. 2023-10-17T06:07:39.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.819+0000 7f4e84e5e700 1 -- 172.21.15.125:0/622391189 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f4e8006ec90 con 0x7f4e80161230 2023-10-17T06:07:39.825 INFO:teuthology.orchestra.run.smithi125.stdout:60129542153 2023-10-17T06:07:39.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.819+0000 7f4e6effd700 1 -- 172.21.15.125:0/622391189 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4e8006ec90 con 0x7f4e80161230 2023-10-17T06:07:39.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.823+0000 7fc1c69aa700 1 -- 172.21.15.125:0/531608015 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc1a00055c0 con 0x7fc1b80eaa70 2023-10-17T06:07:39.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.823+0000 7fc1bcff9700 1 -- 172.21.15.125:0/531608015 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc1c00cd390 con 0x7fc1b80eaa70 2023-10-17T06:07:39.826 INFO:teuthology.orchestra.run.smithi125.stdout:64424509450 2023-10-17T06:07:39.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7f4e84e5e700 1 -- 172.21.15.125:0/622391189 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4e60065740 msgr2=0x7f4e60067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7f4e84e5e700 1 --2- 172.21.15.125:0/622391189 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4e60065740 0x7f4e60067c00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4e74009880 tx=0x7f4e74008030 comp rx=0 tx=0).stop 2023-10-17T06:07:39.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7f4e84e5e700 1 -- 172.21.15.125:0/622391189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e80161230 msgr2=0x7f4e800b1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7f4e84e5e700 1 --2- 172.21.15.125:0/622391189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e80161230 0x7f4e800b1350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4e7800caa0 tx=0x7f4e7800cad0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7fc1c69aa700 1 -- 172.21.15.125:0/531608015 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc1a4065720 msgr2=0x7fc1a4067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7fc1c69aa700 1 --2- 172.21.15.125:0/531608015 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc1a4065720 0x7fc1a4067be0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac000f60 tx=0x7fc1ac007f30 comp rx=0 tx=0).stop 2023-10-17T06:07:39.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7fc1c69aa700 1 -- 172.21.15.125:0/531608015 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1b80eaa70 msgr2=0x7fc1b80e2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:39.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7fc1c69aa700 1 --2- 172.21.15.125:0/531608015 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1b80eaa70 0x7fc1b80e2d70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc1c004f300 tx=0x7fc1c004e720 comp rx=0 tx=0).stop 2023-10-17T06:07:39.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7fc1c69aa700 1 -- 172.21.15.125:0/531608015 shutdown_connections 2023-10-17T06:07:39.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7fc1c69aa700 1 --2- 172.21.15.125:0/531608015 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc1a4065720 0x7fc1a4067be0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7fc1c69aa700 1 --2- 172.21.15.125:0/531608015 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1b80eaa70 0x7fc1b80e2d70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7fc1c69aa700 1 --2- 172.21.15.125:0/531608015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1b8053770 0x7fc1b80ea530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7fc1c69aa700 1 --2- 172.21.15.125:0/531608015 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1b803c4b0 0x7fc1b8180850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7fc1c69aa700 1 -- 172.21.15.125:0/531608015 >> 172.21.15.125:0/531608015 conn(0x7fc1b8059120 msgr2=0x7fc1b8006a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7fc1c69aa700 1 -- 172.21.15.125:0/531608015 shutdown_connections 2023-10-17T06:07:39.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7fc1c69aa700 1 -- 172.21.15.125:0/531608015 wait complete. 2023-10-17T06:07:39.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542154 for osd.2 2023-10-17T06:07:39.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7f4e84e5e700 1 -- 172.21.15.125:0/622391189 shutdown_connections 2023-10-17T06:07:39.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7f4e84e5e700 1 --2- 172.21.15.125:0/622391189 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4e60065740 0x7f4e60067c00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7f4e84e5e700 1 --2- 172.21.15.125:0/622391189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4e80161230 0x7f4e800b1350 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7f4e84e5e700 1 --2- 172.21.15.125:0/622391189 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e800cb8a0 0x7f4e80151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7f4e84e5e700 1 --2- 172.21.15.125:0/622391189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e800adb60 0x7f4e801facc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:39.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7f4e84e5e700 1 -- 172.21.15.125:0/622391189 >> 172.21.15.125:0/622391189 conn(0x7f4e8006a340 msgr2=0x7f4e8015e820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:39.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7f4e84e5e700 1 -- 172.21.15.125:0/622391189 shutdown_connections 2023-10-17T06:07:39.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:39.827+0000 7f4e84e5e700 1 -- 172.21.15.125:0/622391189 wait complete. 2023-10-17T06:07:39.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542154 for osd.0 2023-10-17T06:07:39.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542154 for osd.1 2023-10-17T06:07:39.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.6 2023-10-17T06:07:39.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.4 2023-10-17T06:07:39.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.3 2023-10-17T06:07:39.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.7 2023-10-17T06:07:39.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.5 2023-10-17T06:07:40.837 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-17T06:07:40.839 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-17T06:07:40.840 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-17T06:07:40.841 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-17T06:07:40.848 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-17T06:07:40.850 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-17T06:07:40.852 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-17T06:07:40.855 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-17T06:07:41.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.051+0000 7f1a526eb700 1 Processor -- start 2023-10-17T06:07:41.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.055+0000 7f1a526eb700 1 -- start start 2023-10-17T06:07:41.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.055+0000 7f77de04d700 1 Processor -- start 2023-10-17T06:07:41.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.055+0000 7f77de04d700 1 -- start start 2023-10-17T06:07:41.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.055+0000 7f77de04d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77d8161230 0x7f77d806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.055+0000 7f1a526eb700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1a4c0cbd30 0x7f1a4c0b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.055+0000 7f77de04d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f77d80adb60 0x7f77d80cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.055+0000 7f28af4d0700 1 Processor -- start 2023-10-17T06:07:41.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.055+0000 7f77de04d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d8165770 con 0x7f77d80cb6d0 2023-10-17T06:07:41.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.055+0000 7f77de04d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d80cbb00 con 0x7f77d80adb60 2023-10-17T06:07:41.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.055+0000 7f77de04d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d806ea40 con 0x7f77d8161230 2023-10-17T06:07:41.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.055+0000 7f1a526eb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a4c070de0 con 0x7f1a4c0cb8a0 2023-10-17T06:07:41.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.055+0000 7f28af4d0700 1 -- start start 2023-10-17T06:07:41.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.055+0000 7f1a526eb700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a4c0701d0 con 0x7f1a4c144150 2023-10-17T06:07:41.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.055+0000 7f1a526eb700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4c0704b0 con 0x7f1a4c0cbd30 2023-10-17T06:07:41.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.055+0000 7f77d7fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f77d80cb6d0 0x7f77d806f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:54050/0 (socket says 172.21.15.125:54050) 2023-10-17T06:07:41.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.055+0000 7f77d7fff700 1 -- 172.21.15.125:0/3967054150 learned_addr learned my addr 172.21.15.125:0/3967054150 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:41.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.055+0000 7f77d6ffd700 1 --2- 172.21.15.125:0/3967054150 >> v2:172.21.15.184:3300/0 conn(0x7f77d80adb60 0x7f77d80cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.055+0000 7f1a50ee8700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1a4c0cb8a0 0x7f1a4c0b22f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:54052/0 (socket says 172.21.15.125:54052) 2023-10-17T06:07:41.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.055+0000 7f1a50ee8700 1 -- 172.21.15.125:0/2791663966 learned_addr learned my addr 172.21.15.125:0/2791663966 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:41.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.055+0000 7f1a51eea700 1 --2- 172.21.15.125:0/2791663966 >> v2:172.21.15.184:3300/0 conn(0x7f1a4c0cbd30 0x7f1a4c0b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f77d6ffd700 1 -- 172.21.15.125:0/3967054150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77d8161230 msgr2=0x7f77d806ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:41.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f77d6ffd700 1 --2- 172.21.15.125:0/3967054150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77d8161230 0x7f77d806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f77d6ffd700 1 -- 172.21.15.125:0/3967054150 >> v1:172.21.15.125:6789/0 conn(0x7f77d80cb6d0 legacy=0x7f77d806f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f77d6ffd700 1 -- 172.21.15.125:0/3967054150 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d8161610 con 0x7f77d80adb60 2023-10-17T06:07:41.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f77d67fc700 1 -- 172.21.15.125:0/3967054150 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4157489679 0 0) 0x7f77d8165770 con 0x7f77d80cb6d0 2023-10-17T06:07:41.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f1a43fff700 1 -- 172.21.15.125:0/2791663966 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721585480 0 0) 0x7f1a4c070de0 con 0x7f1a4c0cb8a0 2023-10-17T06:07:41.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f28af4d0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28a0033f20 0x7f28a00547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f77d6ffd700 1 --2- 172.21.15.125:0/3967054150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77d80adb60 0x7f77d80cb190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f77c8009850 tx=0x7f77c8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3471520ca5bed634 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f1a43fff700 1 -- 172.21.15.125:0/2791663966 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a380035d0 con 0x7f1a4c0cb8a0 2023-10-17T06:07:41.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f77d67fc700 1 -- 172.21.15.125:0/3967054150 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c8011830 con 0x7f77d80adb60 2023-10-17T06:07:41.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f77d67fc700 1 -- 172.21.15.125:0/3967054150 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c8011990 con 0x7f77d80adb60 2023-10-17T06:07:41.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f77d67fc700 1 -- 172.21.15.125:0/3967054150 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c8011d20 con 0x7f77d80adb60 2023-10-17T06:07:41.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f1a51eea700 1 -- 172.21.15.125:0/2791663966 >> v1:172.21.15.184:6789/0 conn(0x7f1a4c144150 legacy=0x7f1a4c0cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f1a51eea700 1 -- 172.21.15.125:0/2791663966 >> v1:172.21.15.125:6789/0 conn(0x7f1a4c0cb8a0 legacy=0x7f1a4c0b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f1a51eea700 1 -- 172.21.15.125:0/2791663966 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c070790 con 0x7f1a4c0cbd30 2023-10-17T06:07:41.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f28af4d0700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f28a0006950 0x7f28a0006e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f28af4d0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a00e3500 con 0x7f28a003a790 2023-10-17T06:07:41.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f28af4d0700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a0007340 con 0x7f28a0006950 2023-10-17T06:07:41.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f28af4d0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a0050320 con 0x7f28a0033f20 2023-10-17T06:07:41.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f28adccd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28a0033f20 0x7f28a00547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f28adccd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28a0033f20 0x7f28a00547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:47138/0 (socket says 172.21.15.125:47138) 2023-10-17T06:07:41.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f1a51eea700 1 --2- 172.21.15.125:0/2791663966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a4c0cbd30 0x7f1a4c0b2a00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a44009d90 tx=0x7f1a4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11fb055ea64f3ce9 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f28adccd700 1 -- 172.21.15.125:0/2847986610 learned_addr learned my addr 172.21.15.125:0/2847986610 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:41.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f28aeccf700 1 --2- 172.21.15.125:0/2847986610 >> v2:172.21.15.184:3300/0 conn(0x7f28a0006950 0x7f28a0006e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f1a43fff700 1 -- 172.21.15.125:0/2791663966 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4400e070 con 0x7f1a4c0cbd30 2023-10-17T06:07:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f28ad4cc700 1 -- 172.21.15.125:0/2847986610 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935555463 0 0) 0x7f28a00e3500 con 0x7f28a003a790 2023-10-17T06:07:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f28ad4cc700 1 -- 172.21.15.125:0/2847986610 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28940035d0 con 0x7f28a003a790 2023-10-17T06:07:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f28adccd700 1 -- 172.21.15.125:0/2847986610 >> v2:172.21.15.184:3300/0 conn(0x7f28a0006950 msgr2=0x7f28a0006e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f28adccd700 1 --2- 172.21.15.125:0/2847986610 >> v2:172.21.15.184:3300/0 conn(0x7f28a0006950 0x7f28a0006e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f28adccd700 1 -- 172.21.15.125:0/2847986610 >> v1:172.21.15.125:6789/0 conn(0x7f28a003a790 legacy=0x7f28a0038750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f28adccd700 1 -- 172.21.15.125:0/2847986610 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a0050600 con 0x7f28a0033f20 2023-10-17T06:07:41.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f1a43fff700 1 -- 172.21.15.125:0/2791663966 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4400bb20 con 0x7f1a4c0cbd30 2023-10-17T06:07:41.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.059+0000 7f1a43fff700 1 -- 172.21.15.125:0/2791663966 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4400be90 con 0x7f1a4c0cbd30 2023-10-17T06:07:41.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f28adccd700 1 --2- 172.21.15.125:0/2847986610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28a0033f20 0x7f28a00547b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f28a4006fd0 tx=0x7f28a400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9e01aaa4870752c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f77de04d700 1 -- 172.21.15.125:0/3967054150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77d80adb60 msgr2=0x7f77d80cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f77de04d700 1 --2- 172.21.15.125:0/3967054150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77d80adb60 0x7f77d80cb190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f77c8009850 tx=0x7f77c8009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:41.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f1a526eb700 1 -- 172.21.15.125:0/2791663966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a4c0cbd30 msgr2=0x7f1a4c0b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f1a526eb700 1 --2- 172.21.15.125:0/2791663966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a4c0cbd30 0x7f1a4c0b2a00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a44009d90 tx=0x7f1a4400b330 comp rx=0 tx=0).stop 2023-10-17T06:07:41.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f28ad4cc700 1 -- 172.21.15.125:0/2847986610 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4009040 con 0x7f28a0033f20 2023-10-17T06:07:41.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f28ad4cc700 1 -- 172.21.15.125:0/2847986610 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a400dd70 con 0x7f28a0033f20 2023-10-17T06:07:41.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f28ad4cc700 1 -- 172.21.15.125:0/2847986610 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4009040 con 0x7f28a0033f20 2023-10-17T06:07:41.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f77de04d700 1 -- 172.21.15.125:0/3967054150 shutdown_connections 2023-10-17T06:07:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f77de04d700 1 --2- 172.21.15.125:0/3967054150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77d80adb60 0x7f77d80cb190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f77de04d700 1 --2- 172.21.15.125:0/3967054150 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77d8161230 0x7f77d806ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f77de04d700 1 -- 172.21.15.125:0/3967054150 >> 172.21.15.125:0/3967054150 conn(0x7f77d806a340 msgr2=0x7f77d80b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f77de04d700 1 -- 172.21.15.125:0/3967054150 shutdown_connections 2023-10-17T06:07:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f77de04d700 1 -- 172.21.15.125:0/3967054150 wait complete. 2023-10-17T06:07:41.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f1a526eb700 1 -- 172.21.15.125:0/2791663966 shutdown_connections 2023-10-17T06:07:41.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f1a526eb700 1 --2- 172.21.15.125:0/2791663966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a4c0cbd30 0x7f1a4c0b2a00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f1a526eb700 1 -- 172.21.15.125:0/2791663966 >> 172.21.15.125:0/2791663966 conn(0x7f1a4c0b0bf0 msgr2=0x7f1a4c0ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:41.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f77de04d700 1 Processor -- start 2023-10-17T06:07:41.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f28af4d0700 1 -- 172.21.15.125:0/2847986610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28a0033f20 msgr2=0x7f28a00547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f28af4d0700 1 --2- 172.21.15.125:0/2847986610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28a0033f20 0x7f28a00547b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f28a4006fd0 tx=0x7f28a400bea0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f77de04d700 1 -- start start 2023-10-17T06:07:41.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f77de04d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77d80adb60 0x7f77d8158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f77de04d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77d80cb6d0 0x7f77d8162550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f77d77fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77d80adb60 0x7f77d8158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f77de04d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77d8161230 0x7f77d8162a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f77de04d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d8159010 con 0x7f77d80cb6d0 2023-10-17T06:07:41.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f77de04d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d80b1480 con 0x7f77d80adb60 2023-10-17T06:07:41.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f77de04d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d80b1760 con 0x7f77d8161230 2023-10-17T06:07:41.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f77d77fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77d80adb60 0x7f77d8158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:35892/0 (socket says 172.21.15.125:35892) 2023-10-17T06:07:41.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f77d77fe700 1 -- 172.21.15.125:0/233280739 learned_addr learned my addr 172.21.15.125:0/233280739 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:41.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f77d6ffd700 1 --2- 172.21.15.125:0/233280739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77d80cb6d0 0x7f77d8162550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f77d7fff700 1 --2- 172.21.15.125:0/233280739 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77d8161230 0x7f77d8162a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f1a526eb700 1 -- 172.21.15.125:0/2791663966 shutdown_connections 2023-10-17T06:07:41.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7f1a526eb700 1 -- 172.21.15.125:0/2791663966 wait complete. 2023-10-17T06:07:41.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f1a526eb700 1 Processor -- start 2023-10-17T06:07:41.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.063+0000 7fe9074f4700 1 Processor -- start 2023-10-17T06:07:41.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7fe9074f4700 1 -- start start 2023-10-17T06:07:41.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f28af4d0700 1 -- 172.21.15.125:0/2847986610 shutdown_connections 2023-10-17T06:07:41.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f28af4d0700 1 --2- 172.21.15.125:0/2847986610 >> v2:172.21.15.184:3300/0 conn(0x7f28a0006950 0x7f28a0006e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f28af4d0700 1 --2- 172.21.15.125:0/2847986610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28a0033f20 0x7f28a00547b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f28af4d0700 1 -- 172.21.15.125:0/2847986610 >> 172.21.15.125:0/2847986610 conn(0x7f28a0054cf0 msgr2=0x7f28a00550d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:41.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7fe9074f4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe9000d30e0 0x7fe9000d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f1a526eb700 1 -- start start 2023-10-17T06:07:41.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7fe9074f4700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe9000b1df0 0x7fe900070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7fe9074f4700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe90015d060 con 0x7fe90015cc80 2023-10-17T06:07:41.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7fe9074f4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe90006d830 con 0x7fe9000d30e0 2023-10-17T06:07:41.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7fe9074f4700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe90006dd60 con 0x7fe9000b1df0 2023-10-17T06:07:41.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7fe9064f2700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fe90015cc80 0x7fe9000d29d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:36218/0 (socket says 172.21.15.125:36218) 2023-10-17T06:07:41.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7fe9064f2700 1 -- 172.21.15.125:0/2168382246 learned_addr learned my addr 172.21.15.125:0/2168382246 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:41.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7fe905cf1700 1 --2- 172.21.15.125:0/2168382246 >> v2:172.21.15.125:3300/0 conn(0x7fe9000d30e0 0x7fe9000d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7fe905cf1700 1 -- 172.21.15.125:0/2168382246 >> v2:172.21.15.184:3300/0 conn(0x7fe9000b1df0 msgr2=0x7fe900070a50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-17T06:07:41.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7fe905cf1700 1 --2- 172.21.15.125:0/2168382246 >> v2:172.21.15.184:3300/0 conn(0x7fe9000b1df0 0x7fe900070a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7fe905cf1700 1 -- 172.21.15.125:0/2168382246 >> v1:172.21.15.184:6789/0 conn(0x7fe90015cc80 legacy=0x7fe9000d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7fe905cf1700 1 -- 172.21.15.125:0/2168382246 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90006da80 con 0x7fe9000d30e0 2023-10-17T06:07:41.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f28af4d0700 1 -- 172.21.15.125:0/2847986610 shutdown_connections 2023-10-17T06:07:41.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f28af4d0700 1 -- 172.21.15.125:0/2847986610 wait complete. 2023-10-17T06:07:41.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7fe905cf1700 1 --2- 172.21.15.125:0/2168382246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9000d30e0 0x7fe9000d13c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe9000d3b10 tx=0x7fe8fc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815c08257cc7db93 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f1a526eb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a4c0cb8a0 0x7f1a4c0c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f77d6ffd700 1 -- 172.21.15.125:0/233280739 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77d8161230 msgr2=0x7f77d8162a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f77d6ffd700 1 --2- 172.21.15.125:0/233280739 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77d8161230 0x7f77d8162a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f77d6ffd700 1 -- 172.21.15.125:0/233280739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77d80adb60 msgr2=0x7f77d8158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f77d6ffd700 1 --2- 172.21.15.125:0/233280739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77d80adb60 0x7f77d8158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f77d6ffd700 1 -- 172.21.15.125:0/233280739 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c80094b0 con 0x7f77d80cb6d0 2023-10-17T06:07:41.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.067+0000 7f77d6ffd700 1 --2- 172.21.15.125:0/233280739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77d80cb6d0 0x7f77d8162550 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f77c8016000 tx=0x7f77c8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f77bffff700 1 -- 172.21.15.125:0/233280739 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c80036c0 con 0x7f77d80cb6d0 2023-10-17T06:07:41.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f77bffff700 1 -- 172.21.15.125:0/233280739 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c801e070 con 0x7f77d80cb6d0 2023-10-17T06:07:41.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f77bffff700 1 -- 172.21.15.125:0/233280739 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c8003a20 con 0x7f77d80cb6d0 2023-10-17T06:07:41.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f77de04d700 1 -- 172.21.15.125:0/233280739 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d80b1a40 con 0x7f77d80cb6d0 2023-10-17T06:07:41.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f77de04d700 1 -- 172.21.15.125:0/233280739 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d80ad530 con 0x7f77d80cb6d0 2023-10-17T06:07:41.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f1a526eb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4c0cbd30 0x7f1a4c15e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f1a526eb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a4c144150 0x7f1a4c0ab910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f1a526eb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c0ac970 con 0x7f1a4c144150 2023-10-17T06:07:41.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f1a526eb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c0a9bc0 con 0x7f1a4c0cb8a0 2023-10-17T06:07:41.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f1a526eb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c0ac3b0 con 0x7f1a4c0cbd30 2023-10-17T06:07:41.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f1a516e9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a4c0cb8a0 0x7f1a4c0c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f1a51eea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a4c144150 0x7f1a4c0ab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f1a516e9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a4c0cb8a0 0x7f1a4c0c3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:35914/0 (socket says 172.21.15.125:35914) 2023-10-17T06:07:41.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f1a516e9700 1 -- 172.21.15.125:0/430478199 learned_addr learned my addr 172.21.15.125:0/430478199 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:41.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f1a50ee8700 1 --2- 172.21.15.125:0/430478199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4c0cbd30 0x7f1a4c15e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7fe9054f0700 1 -- 172.21.15.125:0/2168382246 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc004230 con 0x7fe9000d30e0 2023-10-17T06:07:41.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7fe9054f0700 1 -- 172.21.15.125:0/2168382246 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8fc004390 con 0x7fe9000d30e0 2023-10-17T06:07:41.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7fe9054f0700 1 -- 172.21.15.125:0/2168382246 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc0036c0 con 0x7fe9000d30e0 2023-10-17T06:07:41.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f1a51eea700 1 -- 172.21.15.125:0/430478199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4c0cbd30 msgr2=0x7f1a4c15e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f1a51eea700 1 --2- 172.21.15.125:0/430478199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4c0cbd30 0x7f1a4c15e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f1a51eea700 1 -- 172.21.15.125:0/430478199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a4c0cb8a0 msgr2=0x7f1a4c0c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f1a51eea700 1 --2- 172.21.15.125:0/430478199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a4c0cb8a0 0x7f1a4c0c3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f1a51eea700 1 -- 172.21.15.125:0/430478199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a44009a70 con 0x7f1a4c144150 2023-10-17T06:07:41.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f28af4d0700 1 Processor -- start 2023-10-17T06:07:41.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f1a51eea700 1 --2- 172.21.15.125:0/430478199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a4c144150 0x7f1a4c0ab910 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1a44016000 tx=0x7f1a44004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f28af4d0700 1 -- start start 2023-10-17T06:07:41.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f11e1cec700 1 Processor -- start 2023-10-17T06:07:41.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f11e1cec700 1 -- start start 2023-10-17T06:07:41.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f77de04d700 1 -- 172.21.15.125:0/233280739 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d8072e60 con 0x7f77d80cb6d0 2023-10-17T06:07:41.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f77bffff700 1 -- 172.21.15.125:0/233280739 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f77c8003b80 con 0x7f77d80cb6d0 2023-10-17T06:07:41.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f1a41ffb700 1 -- 172.21.15.125:0/430478199 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4401f7a0 con 0x7f1a4c144150 2023-10-17T06:07:41.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f1a41ffb700 1 -- 172.21.15.125:0/430478199 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a44023070 con 0x7f1a4c144150 2023-10-17T06:07:41.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.071+0000 7f1a41ffb700 1 -- 172.21.15.125:0/430478199 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4401fb40 con 0x7f1a4c144150 2023-10-17T06:07:41.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f1a526eb700 1 -- 172.21.15.125:0/430478199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a4c0ac690 con 0x7f1a4c144150 2023-10-17T06:07:41.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f28af4d0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28a0006950 0x7f28a00dbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f28af4d0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28a0033f20 0x7f28a0034750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f28af4d0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28a003a790 0x7f28a01710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f28af4d0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a0037320 con 0x7f28a0033f20 2023-10-17T06:07:41.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f28af4d0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a00dc2d0 con 0x7f28a0006950 2023-10-17T06:07:41.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f28af4d0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a0034c90 con 0x7f28a003a790 2023-10-17T06:07:41.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f28adccd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28a0033f20 0x7f28a0034750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f28aeccf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28a003a790 0x7f28a01710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f28adccd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28a0033f20 0x7f28a0034750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48872/0 (socket says 172.21.15.125:48872) 2023-10-17T06:07:41.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f28adccd700 1 -- 172.21.15.125:0/1647019431 learned_addr learned my addr 172.21.15.125:0/1647019431 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:41.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f28ae4ce700 1 --2- 172.21.15.125:0/1647019431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28a0006950 0x7f28a00dbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f28aeccf700 1 -- 172.21.15.125:0/1647019431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28a0006950 msgr2=0x7f28a00dbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f28aeccf700 1 --2- 172.21.15.125:0/1647019431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28a0006950 0x7f28a00dbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f28aeccf700 1 -- 172.21.15.125:0/1647019431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28a0033f20 msgr2=0x7f28a0034750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f28aeccf700 1 --2- 172.21.15.125:0/1647019431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28a0033f20 0x7f28a0034750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f28aeccf700 1 -- 172.21.15.125:0/1647019431 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a400b820 con 0x7f28a003a790 2023-10-17T06:07:41.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f11e1cec700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11dc06d490 0x7f11dc1593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f11e1cec700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f11dc159930 0x7f11dc06f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f11e1cec700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11dc06f990 0x7f11dc15c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f11e1cec700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11dc15a400 con 0x7f11dc06f990 2023-10-17T06:07:41.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f11e1cec700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11dc06fde0 con 0x7f11dc159930 2023-10-17T06:07:41.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f11e1cec700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc06d870 con 0x7f11dc06d490 2023-10-17T06:07:41.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f28aeccf700 1 --2- 172.21.15.125:0/1647019431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28a003a790 0x7f28a01710c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f289800d530 tx=0x7f289800d840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7fe9074f4700 1 -- 172.21.15.125:0/2168382246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9000d30e0 msgr2=0x7fe9000d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7fe9074f4700 1 --2- 172.21.15.125:0/2168382246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9000d30e0 0x7fe9000d13c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe9000d3b10 tx=0x7fe8fc009b30 comp rx=0 tx=0).stop 2023-10-17T06:07:41.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f1a526eb700 1 -- 172.21.15.125:0/430478199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4c0a9680 con 0x7f1a4c144150 2023-10-17T06:07:41.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7fe9074f4700 1 -- 172.21.15.125:0/2168382246 shutdown_connections 2023-10-17T06:07:41.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7fe9074f4700 1 --2- 172.21.15.125:0/2168382246 >> v2:172.21.15.184:3300/0 conn(0x7fe9000b1df0 0x7fe900070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7fe9074f4700 1 --2- 172.21.15.125:0/2168382246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9000d30e0 0x7fe9000d13c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7fe9074f4700 1 -- 172.21.15.125:0/2168382246 >> 172.21.15.125:0/2168382246 conn(0x7fe9000cf530 msgr2=0x7fe9000cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:41.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f11db7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11dc06d490 0x7f11dc1593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7fe9074f4700 1 -- 172.21.15.125:0/2168382246 shutdown_connections 2023-10-17T06:07:41.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7fe9074f4700 1 -- 172.21.15.125:0/2168382246 wait complete. 2023-10-17T06:07:41.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f77bffff700 1 --2- 172.21.15.125:0/233280739 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f77c40656f0 0x7f77c4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f11dbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11dc06f990 0x7f11dc15c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f11dbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11dc06f990 0x7f11dc15c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48882/0 (socket says 172.21.15.125:48882) 2023-10-17T06:07:41.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f11dbfff700 1 -- 172.21.15.125:0/2527476343 learned_addr learned my addr 172.21.15.125:0/2527476343 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:41.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f77bffff700 1 -- 172.21.15.125:0/233280739 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f77c8084140 con 0x7f77d80cb6d0 2023-10-17T06:07:41.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.075+0000 7f1a526eb700 1 -- 172.21.15.125:0/430478199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a4c0a9a20 con 0x7f1a4c144150 2023-10-17T06:07:41.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f77d77fe700 1 --2- 172.21.15.125:0/233280739 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f77c40656f0 0x7f77c4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f11dbfff700 1 -- 172.21.15.125:0/2527476343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11dc06d490 msgr2=0x7f11dc1593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:41.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f11dbfff700 1 --2- 172.21.15.125:0/2527476343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11dc06d490 0x7f11dc1593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f11dbfff700 1 -- 172.21.15.125:0/2527476343 >> v2:172.21.15.184:3300/0 conn(0x7f11dc159930 msgr2=0x7f11dc06f450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-17T06:07:41.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f11dbfff700 1 --2- 172.21.15.125:0/2527476343 >> v2:172.21.15.184:3300/0 conn(0x7f11dc159930 0x7f11dc06f450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f11dbfff700 1 -- 172.21.15.125:0/2527476343 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc159e40 con 0x7f11dc06f990 2023-10-17T06:07:41.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f77d77fe700 1 --2- 172.21.15.125:0/233280739 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f77c40656f0 0x7f77c4067bb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f77d000e250 tx=0x7f77d000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f11dbfff700 1 --2- 172.21.15.125:0/2527476343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc06f990 0x7f11dc15c9e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f11dc0cbd30 tx=0x7f11d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9f0d4073c2362e server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7fe9074f4700 1 Processor -- start 2023-10-17T06:07:41.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f1a41ffb700 1 -- 172.21.15.125:0/430478199 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1a4401fca0 con 0x7f1a4c144150 2023-10-17T06:07:41.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f1a41ffb700 1 --2- 172.21.15.125:0/430478199 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1a300656f0 0x7f1a30067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f1a516e9700 1 --2- 172.21.15.125:0/430478199 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1a300656f0 0x7f1a30067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7fe9074f4700 1 -- start start 2023-10-17T06:07:41.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f289effd700 1 -- 172.21.15.125:0/1647019431 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28980125f0 con 0x7f28a003a790 2023-10-17T06:07:41.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f289effd700 1 -- 172.21.15.125:0/1647019431 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2898012750 con 0x7f28a003a790 2023-10-17T06:07:41.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f289effd700 1 -- 172.21.15.125:0/1647019431 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898012ac0 con 0x7f28a003a790 2023-10-17T06:07:41.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f28af4d0700 1 -- 172.21.15.125:0/1647019431 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a01706b0 con 0x7f28a003a790 2023-10-17T06:07:41.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f28af4d0700 1 -- 172.21.15.125:0/1647019431 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a0036cd0 con 0x7f28a003a790 2023-10-17T06:07:41.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.079+0000 7f1a516e9700 1 --2- 172.21.15.125:0/430478199 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1a300656f0 0x7f1a30067bb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c001760 tx=0x7f1a3c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.083+0000 7fe9074f4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9000b1df0 0x7fe90015d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.083+0000 7fe9074f4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9000d30e0 0x7fe900151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.083+0000 7fe9074f4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe90015cc80 0x7fe900150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.083+0000 7fe9074f4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe900152430 con 0x7fe9000b1df0 2023-10-17T06:07:41.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.083+0000 7fe9074f4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe900151580 con 0x7fe9000d30e0 2023-10-17T06:07:41.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.083+0000 7fe9074f4700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe900151820 con 0x7fe90015cc80 2023-10-17T06:07:41.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.083+0000 7fe9064f2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9000b1df0 0x7fe90015d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.083+0000 7fe905cf1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9000d30e0 0x7fe900151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.083+0000 7fe9064f2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9000b1df0 0x7fe90015d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48892/0 (socket says 172.21.15.125:48892) 2023-10-17T06:07:41.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.083+0000 7fe9064f2700 1 -- 172.21.15.125:0/2929175935 learned_addr learned my addr 172.21.15.125:0/2929175935 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:41.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.083+0000 7fe906cf3700 1 --2- 172.21.15.125:0/2929175935 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe90015cc80 0x7fe900150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.083+0000 7fe9064f2700 1 -- 172.21.15.125:0/2929175935 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe90015cc80 msgr2=0x7fe900150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.083+0000 7fe9064f2700 1 --2- 172.21.15.125:0/2929175935 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe90015cc80 0x7fe900150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.083+0000 7fe9064f2700 1 -- 172.21.15.125:0/2929175935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9000d30e0 msgr2=0x7fe900151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.083+0000 7fe9064f2700 1 --2- 172.21.15.125:0/2929175935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9000d30e0 0x7fe900151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.083+0000 7fe9064f2700 1 -- 172.21.15.125:0/2929175935 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8fc0094b0 con 0x7fe9000b1df0 2023-10-17T06:07:41.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.083+0000 7f289cff9700 1 -- 172.21.15.125:0/1647019431 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a0037490 con 0x7f28a003a790 2023-10-17T06:07:41.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.083+0000 7fe9064f2700 1 --2- 172.21.15.125:0/2929175935 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9000b1df0 0x7fe90015d1f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe8f000c780 tx=0x7fe8f000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.087+0000 7fe8f6ffd700 1 -- 172.21.15.125:0/2929175935 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f0004ca0 con 0x7fe9000b1df0 2023-10-17T06:07:41.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.087+0000 7f77bffff700 1 -- 172.21.15.125:0/233280739 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f77c8051900 con 0x7f77d80cb6d0 2023-10-17T06:07:41.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.087+0000 7fe9074f4700 1 -- 172.21.15.125:0/2929175935 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe900151b00 con 0x7fe9000b1df0 2023-10-17T06:07:41.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.087+0000 7fe9074f4700 1 -- 172.21.15.125:0/2929175935 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9001520c0 con 0x7fe9000b1df0 2023-10-17T06:07:41.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.087+0000 7f11daffd700 1 -- 172.21.15.125:0/2527476343 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d400e070 con 0x7f11dc06f990 2023-10-17T06:07:41.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.087+0000 7f289effd700 1 -- 172.21.15.125:0/1647019431 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2898012c20 con 0x7f28a003a790 2023-10-17T06:07:41.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.087+0000 7f289effd700 1 --2- 172.21.15.125:0/1647019431 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f288c0656f0 0x7f288c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.087+0000 7f1a41ffb700 1 -- 172.21.15.125:0/430478199 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1a44025070 con 0x7f1a4c144150 2023-10-17T06:07:41.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.087+0000 7fe9074f4700 1 -- 172.21.15.125:0/2929175935 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9000d0750 con 0x7fe9000b1df0 2023-10-17T06:07:41.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.087+0000 7f289effd700 1 -- 172.21.15.125:0/1647019431 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2898083b10 con 0x7f28a003a790 2023-10-17T06:07:41.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.087+0000 7f28ae4ce700 1 --2- 172.21.15.125:0/1647019431 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f288c0656f0 0x7f288c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.087+0000 7f28ae4ce700 1 --2- 172.21.15.125:0/1647019431 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f288c0656f0 0x7f288c067bb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f28a80688e0 tx=0x7f28a806f150 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.091+0000 7f1a41ffb700 1 -- 172.21.15.125:0/430478199 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f1a4c0a9a20 con 0x7f1a4c144150 2023-10-17T06:07:41.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.091+0000 7f11daffd700 1 -- 172.21.15.125:0/2527476343 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d400b9c0 con 0x7f11dc06f990 2023-10-17T06:07:41.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.091+0000 7f289effd700 1 -- 172.21.15.125:0/1647019431 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f28980513c0 con 0x7f28a003a790 2023-10-17T06:07:41.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.091+0000 7f11e1cec700 1 -- 172.21.15.125:0/2527476343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc06f990 msgr2=0x7f11dc15c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.091+0000 7f11daffd700 1 -- 172.21.15.125:0/2527476343 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d400bd50 con 0x7f11dc06f990 2023-10-17T06:07:41.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.091+0000 7f11e1cec700 1 --2- 172.21.15.125:0/2527476343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc06f990 0x7f11dc15c9e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f11dc0cbd30 tx=0x7f11d400b330 comp rx=0 tx=0).stop 2023-10-17T06:07:41.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.095+0000 7fe8f6ffd700 1 -- 172.21.15.125:0/2929175935 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f0004e00 con 0x7fe9000b1df0 2023-10-17T06:07:41.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.095+0000 7fe8f6ffd700 1 -- 172.21.15.125:0/2929175935 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f00072f0 con 0x7fe9000b1df0 2023-10-17T06:07:41.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.095+0000 7f11e1cec700 1 -- 172.21.15.125:0/2527476343 shutdown_connections 2023-10-17T06:07:41.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.095+0000 7f11e1cec700 1 --2- 172.21.15.125:0/2527476343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc06f990 0x7f11dc15c9e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.095+0000 7f11e1cec700 1 --2- 172.21.15.125:0/2527476343 >> v2:172.21.15.184:3300/0 conn(0x7f11dc159930 0x7f11dc06f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.095+0000 7f11e1cec700 1 --2- 172.21.15.125:0/2527476343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11dc06d490 0x7f11dc1593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.095+0000 7f11e1cec700 1 -- 172.21.15.125:0/2527476343 >> 172.21.15.125:0/2527476343 conn(0x7f11dc06a340 msgr2=0x7f11dc0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:41.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.095+0000 7f11e1cec700 1 -- 172.21.15.125:0/2527476343 shutdown_connections 2023-10-17T06:07:41.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.095+0000 7f11e1cec700 1 -- 172.21.15.125:0/2527476343 wait complete. 2023-10-17T06:07:41.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.099+0000 7fe8f6ffd700 1 -- 172.21.15.125:0/2929175935 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe8f0007490 con 0x7fe9000b1df0 2023-10-17T06:07:41.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.099+0000 7f11e1cec700 1 Processor -- start 2023-10-17T06:07:41.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.099+0000 7f11e1cec700 1 -- start start 2023-10-17T06:07:41.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.099+0000 7fe8f6ffd700 1 --2- 172.21.15.125:0/2929175935 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe8e4065720 0x7fe8e4067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.099+0000 7f11e1cec700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11dc06d490 0x7f11dc14b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.099+0000 7f11e1cec700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc06f990 0x7f11dc149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.099+0000 7f11e1cec700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11dc159930 0x7f11dc14a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.099+0000 7fe8f6ffd700 1 -- 172.21.15.125:0/2929175935 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe8f0083230 con 0x7fe9000b1df0 2023-10-17T06:07:41.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.099+0000 7f11e1cec700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc158a70 con 0x7f11dc06f990 2023-10-17T06:07:41.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.099+0000 7f11e1cec700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc147150 con 0x7f11dc159930 2023-10-17T06:07:41.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.099+0000 7f11e1cec700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc147430 con 0x7f11dc06d490 2023-10-17T06:07:41.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.099+0000 7f11db7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11dc06d490 0x7f11dc14b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.103+0000 7f11db7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11dc06d490 0x7f11dc14b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:47202/0 (socket says 172.21.15.125:47202) 2023-10-17T06:07:41.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.103+0000 7f11db7fe700 1 -- 172.21.15.125:0/340933402 learned_addr learned my addr 172.21.15.125:0/340933402 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:41.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.103+0000 7fe905cf1700 1 --2- 172.21.15.125:0/2929175935 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe8e4065720 0x7fe8e4067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.103+0000 7f11dbfff700 1 --2- 172.21.15.125:0/340933402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11dc159930 0x7f11dc14a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.103+0000 7f11db7fe700 1 -- 172.21.15.125:0/340933402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11dc159930 msgr2=0x7f11dc14a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.103+0000 7f11db7fe700 1 --2- 172.21.15.125:0/340933402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11dc159930 0x7f11dc14a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.103+0000 7f11db7fe700 1 -- 172.21.15.125:0/340933402 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc06f990 msgr2=0x7f11dc149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.103+0000 7f11db7fe700 1 --2- 172.21.15.125:0/340933402 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc06f990 0x7f11dc149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.103+0000 7f11db7fe700 1 -- 172.21.15.125:0/340933402 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d4009b30 con 0x7f11dc06d490 2023-10-17T06:07:41.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.103+0000 7f11db7fe700 1 --2- 172.21.15.125:0/340933402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11dc06d490 0x7f11dc14b950 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f11c400c770 tx=0x7f11c400cb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.103+0000 7fe8f6ffd700 1 -- 172.21.15.125:0/2929175935 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe8f0050950 con 0x7fe9000b1df0 2023-10-17T06:07:41.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.103+0000 7f11d8ff9700 1 -- 172.21.15.125:0/340933402 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4011b00 con 0x7f11dc06d490 2023-10-17T06:07:41.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.103+0000 7f11d8ff9700 1 -- 172.21.15.125:0/340933402 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c4011c60 con 0x7f11dc06d490 2023-10-17T06:07:41.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.103+0000 7f11d8ff9700 1 -- 172.21.15.125:0/340933402 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4019430 con 0x7f11dc06d490 2023-10-17T06:07:41.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.103+0000 7fe905cf1700 1 --2- 172.21.15.125:0/2929175935 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe8e4065720 0x7fe8e4067be0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe9000d3b10 tx=0x7fe8fc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.103+0000 7f11e1cec700 1 -- 172.21.15.125:0/340933402 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11dc147710 con 0x7f11dc06d490 2023-10-17T06:07:41.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.103+0000 7f11e1cec700 1 -- 172.21.15.125:0/340933402 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11dc149670 con 0x7f11dc06d490 2023-10-17T06:07:41.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.107+0000 7f11d8ff9700 1 -- 172.21.15.125:0/340933402 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f11c4019590 con 0x7f11dc06d490 2023-10-17T06:07:41.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.111+0000 7f11e1cec700 1 -- 172.21.15.125:0/340933402 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11dc147c30 con 0x7f11dc06d490 2023-10-17T06:07:41.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.111+0000 7f11d8ff9700 1 --2- 172.21.15.125:0/340933402 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f11bc065740 0x7f11bc067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.111+0000 7f11d2ffd700 1 --2- 172.21.15.125:0/340933402 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f11bc065740 0x7f11bc067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.111+0000 7f11d8ff9700 1 -- 172.21.15.125:0/340933402 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f11c405d030 con 0x7f11dc06d490 2023-10-17T06:07:41.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.115+0000 7f11d2ffd700 1 --2- 172.21.15.125:0/340933402 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f11bc065740 0x7f11bc067c00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f11dc14fe00 tx=0x7f11cc006c50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.119+0000 7ff58487d700 1 Processor -- start 2023-10-17T06:07:41.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.119+0000 7ff58487d700 1 -- start start 2023-10-17T06:07:41.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.123+0000 7ff58487d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff5800b6c70 0x7ff58006a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.123+0000 7ff58487d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff5800b5ae0 0x7ff58006a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.123+0000 7ff58487d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff58006e390 con 0x7ff58015cbd0 2023-10-17T06:07:41.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.123+0000 7ff58487d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff58015cfb0 con 0x7ff5800b5ae0 2023-10-17T06:07:41.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.123+0000 7ff58487d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5800b6050 con 0x7ff5800b6c70 2023-10-17T06:07:41.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.123+0000 7f11d8ff9700 1 -- 172.21.15.125:0/340933402 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f11c4054c40 con 0x7f11dc06d490 2023-10-17T06:07:41.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.123+0000 7ff57ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff5800b5ae0 0x7ff58006a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.123+0000 7ff57ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff5800b5ae0 0x7ff58006a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48906/0 (socket says 172.21.15.125:48906) 2023-10-17T06:07:41.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.123+0000 7ff57ffff700 1 -- 172.21.15.125:0/1952553202 learned_addr learned my addr 172.21.15.125:0/1952553202 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:41.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.123+0000 7ff57effd700 1 --2- 172.21.15.125:0/1952553202 >> v2:172.21.15.184:3300/0 conn(0x7ff5800b6c70 0x7ff58006a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.123+0000 7f1c84f48700 1 Processor -- start 2023-10-17T06:07:41.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.123+0000 7ff57effd700 1 -- 172.21.15.125:0/1952553202 >> v2:172.21.15.125:3300/0 conn(0x7ff5800b5ae0 msgr2=0x7ff58006a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:41.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.123+0000 7ff57effd700 1 --2- 172.21.15.125:0/1952553202 >> v2:172.21.15.125:3300/0 conn(0x7ff5800b5ae0 0x7ff58006a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.123+0000 7ff57effd700 1 -- 172.21.15.125:0/1952553202 >> v1:172.21.15.125:6789/0 conn(0x7ff58015cbd0 legacy=0x7ff5800b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.123+0000 7ff57effd700 1 -- 172.21.15.125:0/1952553202 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58006e5e0 con 0x7ff5800b6c70 2023-10-17T06:07:41.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7ff57effd700 1 --2- 172.21.15.125:0/1952553202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5800b6c70 0x7ff58006a0d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff580071980 tx=0x7ff574009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70f47914c0a27b2e server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7f24b0acb700 1 Processor -- start 2023-10-17T06:07:41.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7f24b0acb700 1 -- start start 2023-10-17T06:07:41.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7ff57e7fc700 1 -- 172.21.15.125:0/1952553202 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff574011830 con 0x7ff5800b6c70 2023-10-17T06:07:41.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7ff57e7fc700 1 -- 172.21.15.125:0/1952553202 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff574011990 con 0x7ff5800b6c70 2023-10-17T06:07:41.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7ff57e7fc700 1 -- 172.21.15.125:0/1952553202 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff574011d20 con 0x7ff5800b6c70 2023-10-17T06:07:41.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.123+0000 7f1c84f48700 1 -- start start 2023-10-17T06:07:41.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7f1c84f48700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1c800d30e0 0x7f1c800d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7f1c84f48700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c800b1df0 0x7f1c80070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7f1c84f48700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8015d060 con 0x7f1c8015cc80 2023-10-17T06:07:41.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7f1c84f48700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8006d830 con 0x7f1c800d30e0 2023-10-17T06:07:41.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7f1c84f48700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8006dd60 con 0x7f1c800b1df0 2023-10-17T06:07:41.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7f1c7ffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c800b1df0 0x7f1c80070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7f1c7ffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c800b1df0 0x7f1c80070a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:47204/0 (socket says 172.21.15.125:47204) 2023-10-17T06:07:41.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7f1c7ffff700 1 -- 172.21.15.125:0/3554149022 learned_addr learned my addr 172.21.15.125:0/3554149022 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:41.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7f24b0acb700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f24a4053f40 0x7f24a40543b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7f24ab7fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f24a40e33f0 0x7f24a4057260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:36234/0 (socket says 172.21.15.125:36234) 2023-10-17T06:07:41.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7ff58487d700 1 -- 172.21.15.125:0/1952553202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5800b6c70 msgr2=0x7ff58006a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7ff58487d700 1 --2- 172.21.15.125:0/1952553202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5800b6c70 0x7ff58006a0d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff580071980 tx=0x7ff574009b30 comp rx=0 tx=0).stop 2023-10-17T06:07:41.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7f1c7ffff700 1 -- 172.21.15.125:0/3554149022 >> v2:172.21.15.184:3300/0 conn(0x7f1c800d30e0 msgr2=0x7f1c800d13c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-17T06:07:41.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7f1c7ffff700 1 --2- 172.21.15.125:0/3554149022 >> v2:172.21.15.184:3300/0 conn(0x7f1c800d30e0 0x7f1c800d13c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7f1c7ffff700 1 -- 172.21.15.125:0/3554149022 >> v1:172.21.15.125:6789/0 conn(0x7f1c8015cc80 legacy=0x7f1c800d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:41.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7f1c7ffff700 1 -- 172.21.15.125:0/3554149022 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8006da80 con 0x7f1c800b1df0 2023-10-17T06:07:41.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7ff58487d700 1 -- 172.21.15.125:0/1952553202 shutdown_connections 2023-10-17T06:07:41.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7ff58487d700 1 --2- 172.21.15.125:0/1952553202 >> v2:172.21.15.125:3300/0 conn(0x7ff5800b5ae0 0x7ff58006a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7ff58487d700 1 --2- 172.21.15.125:0/1952553202 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5800b6c70 0x7ff58006a0d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7ff58487d700 1 -- 172.21.15.125:0/1952553202 >> 172.21.15.125:0/1952553202 conn(0x7ff58006f450 msgr2=0x7ff58006f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:41.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7f1c7ffff700 1 --2- 172.21.15.125:0/3554149022 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c800b1df0 0x7f1c80070a50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1c78009e50 tx=0x7f1c7800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62708f878dfd80e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7ff58487d700 1 -- 172.21.15.125:0/1952553202 shutdown_connections 2023-10-17T06:07:41.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.127+0000 7ff58487d700 1 -- 172.21.15.125:0/1952553202 wait complete. 2023-10-17T06:07:41.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24b0acb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f24a403c2a0 0x7f24a403c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24ab7fe700 1 -- 172.21.15.125:0/1665137902 learned_addr learned my addr 172.21.15.125:0/1665137902 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:41.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24aaffd700 1 --2- 172.21.15.125:0/1665137902 >> v2:172.21.15.184:3300/0 conn(0x7f24a4053f40 0x7f24a40543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24abfff700 1 --2- 172.21.15.125:0/1665137902 >> v2:172.21.15.125:3300/0 conn(0x7f24a403c2a0 0x7f24a403c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24b0acb700 1 -- 172.21.15.125:0/1665137902 --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a40e37d0 con 0x7f24a40e33f0 2023-10-17T06:07:41.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24b0acb700 1 -- 172.21.15.125:0/1665137902 --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a40548f0 con 0x7f24a403c2a0 2023-10-17T06:07:41.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24b0acb700 1 -- 172.21.15.125:0/1665137902 --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a4057d20 con 0x7f24a4053f40 2023-10-17T06:07:41.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24aa7fc700 1 -- 172.21.15.125:0/1665137902 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564272913 0 0) 0x7f24a40e37d0 con 0x7f24a40e33f0 2023-10-17T06:07:41.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24aa7fc700 1 -- 172.21.15.125:0/1665137902 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f249c0035d0 con 0x7f24a40e33f0 2023-10-17T06:07:41.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24aaffd700 1 -- 172.21.15.125:0/1665137902 >> v2:172.21.15.125:3300/0 conn(0x7f24a403c2a0 msgr2=0x7f24a403c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:41.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24aaffd700 1 --2- 172.21.15.125:0/1665137902 >> v2:172.21.15.125:3300/0 conn(0x7f24a403c2a0 0x7f24a403c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24aaffd700 1 -- 172.21.15.125:0/1665137902 >> v1:172.21.15.184:6789/0 conn(0x7f24a40e33f0 legacy=0x7f24a4057260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24aaffd700 1 -- 172.21.15.125:0/1665137902 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a4058000 con 0x7f24a4053f40 2023-10-17T06:07:41.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24aaffd700 1 --2- 172.21.15.125:0/1665137902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24a4053f40 0x7f24a40543b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f24a4010360 tx=0x7f2498009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eb495d608e0d720 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24aa7fc700 1 -- 172.21.15.125:0/1665137902 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498011830 con 0x7f24a4053f40 2023-10-17T06:07:41.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24aa7fc700 1 -- 172.21.15.125:0/1665137902 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2498011990 con 0x7f24a4053f40 2023-10-17T06:07:41.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24aa7fc700 1 -- 172.21.15.125:0/1665137902 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498011d20 con 0x7f24a4053f40 2023-10-17T06:07:41.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f1c7effd700 1 -- 172.21.15.125:0/3554149022 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7800e070 con 0x7f1c800b1df0 2023-10-17T06:07:41.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f1c7effd700 1 -- 172.21.15.125:0/3554149022 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7800b9c0 con 0x7f1c800b1df0 2023-10-17T06:07:41.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f1c7effd700 1 -- 172.21.15.125:0/3554149022 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7800e070 con 0x7f1c800b1df0 2023-10-17T06:07:41.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7ff58487d700 1 Processor -- start 2023-10-17T06:07:41.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24b0acb700 1 -- 172.21.15.125:0/1665137902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24a4053f40 msgr2=0x7f24a40543b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24b0acb700 1 --2- 172.21.15.125:0/1665137902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24a4053f40 0x7f24a40543b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f24a4010360 tx=0x7f2498009b30 comp rx=0 tx=0).stop 2023-10-17T06:07:41.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24b0acb700 1 -- 172.21.15.125:0/1665137902 shutdown_connections 2023-10-17T06:07:41.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24b0acb700 1 --2- 172.21.15.125:0/1665137902 >> v2:172.21.15.125:3300/0 conn(0x7f24a403c2a0 0x7f24a403c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24b0acb700 1 --2- 172.21.15.125:0/1665137902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24a4053f40 0x7f24a40543b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24b0acb700 1 -- 172.21.15.125:0/1665137902 >> 172.21.15.125:0/1665137902 conn(0x7f24a403ac60 msgr2=0x7f24a403b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:41.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24b0acb700 1 -- 172.21.15.125:0/1665137902 shutdown_connections 2023-10-17T06:07:41.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.131+0000 7f24b0acb700 1 -- 172.21.15.125:0/1665137902 wait complete. 2023-10-17T06:07:41.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.135+0000 7ff58487d700 1 -- start start 2023-10-17T06:07:41.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.135+0000 7f1c84f48700 1 -- 172.21.15.125:0/3554149022 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c800b1df0 msgr2=0x7f1c80070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.135+0000 7f1c84f48700 1 --2- 172.21.15.125:0/3554149022 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c800b1df0 0x7f1c80070a50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1c78009e50 tx=0x7f1c7800b330 comp rx=0 tx=0).stop 2023-10-17T06:07:41.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.135+0000 7f24b0acb700 1 Processor -- start 2023-10-17T06:07:41.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.135+0000 7f1c84f48700 1 -- 172.21.15.125:0/3554149022 shutdown_connections 2023-10-17T06:07:41.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.135+0000 7f1c84f48700 1 --2- 172.21.15.125:0/3554149022 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c800b1df0 0x7f1c80070a50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.135+0000 7f1c84f48700 1 --2- 172.21.15.125:0/3554149022 >> v2:172.21.15.184:3300/0 conn(0x7f1c800d30e0 0x7f1c800d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.135+0000 7f1c84f48700 1 -- 172.21.15.125:0/3554149022 >> 172.21.15.125:0/3554149022 conn(0x7f1c800cf530 msgr2=0x7f1c800cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:41.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.135+0000 7ff58487d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5800b5ae0 0x7ff580152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.135+0000 7f1c84f48700 1 -- 172.21.15.125:0/3554149022 shutdown_connections 2023-10-17T06:07:41.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.135+0000 7f1c84f48700 1 -- 172.21.15.125:0/3554149022 wait complete. 2023-10-17T06:07:41.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.135+0000 7ff58487d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5800b6c70 0x7ff5800d1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.135+0000 7ff58487d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff58015cbd0 0x7ff5800d23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.135+0000 7ff58487d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58014e190 con 0x7ff5800b5ae0 2023-10-17T06:07:41.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7ff57f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5800b5ae0 0x7ff580152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7ff58487d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58014e3e0 con 0x7ff5800b6c70 2023-10-17T06:07:41.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7ff57f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5800b5ae0 0x7ff580152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48926/0 (socket says 172.21.15.125:48926) 2023-10-17T06:07:41.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7ff57f7fe700 1 -- 172.21.15.125:0/1549794467 learned_addr learned my addr 172.21.15.125:0/1549794467 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:41.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7ff58487d700 1 -- 172.21.15.125:0/1549794467 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58014e6c0 con 0x7ff58015cbd0 2023-10-17T06:07:41.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7f24b0acb700 1 -- start start 2023-10-17T06:07:41.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7ff57ffff700 1 --2- 172.21.15.125:0/1549794467 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff58015cbd0 0x7ff5800d23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7ff57effd700 1 --2- 172.21.15.125:0/1549794467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5800b6c70 0x7ff5800d1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7f24b0acb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24a403c2a0 0x7f24a4051640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7f24b0acb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24a40e33f0 0x7f24a417c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7f24b0acb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24a4052830 0x7f24a4052ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7f24ab7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24a403c2a0 0x7f24a4051640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7f24ab7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24a403c2a0 0x7f24a4051640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:47228/0 (socket says 172.21.15.125:47228) 2023-10-17T06:07:41.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7f24abfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24a4052830 0x7f24a4052ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7f24aaffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24a40e33f0 0x7f24a417c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7f24aaffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24a40e33f0 0x7f24a417c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:35996/0 (socket says 172.21.15.125:35996) 2023-10-17T06:07:41.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7f24abfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24a4052830 0x7f24a4052ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48936/0 (socket says 172.21.15.125:48936) 2023-10-17T06:07:41.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7f24ab7fe700 1 -- 172.21.15.125:0/1349077401 learned_addr learned my addr 172.21.15.125:0/1349077401 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:41.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7f24b0acb700 1 -- 172.21.15.125:0/1349077401 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a40523a0 con 0x7f24a4052830 2023-10-17T06:07:41.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7ff57ffff700 1 -- 172.21.15.125:0/1549794467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5800b6c70 msgr2=0x7ff5800d1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7ff57ffff700 1 --2- 172.21.15.125:0/1549794467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5800b6c70 0x7ff5800d1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7ff57ffff700 1 -- 172.21.15.125:0/1549794467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5800b5ae0 msgr2=0x7ff580152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7ff57ffff700 1 --2- 172.21.15.125:0/1549794467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5800b5ae0 0x7ff580152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7ff57ffff700 1 -- 172.21.15.125:0/1549794467 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5740094b0 con 0x7ff58015cbd0 2023-10-17T06:07:41.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7ff57f7fe700 1 --2- 172.21.15.125:0/1549794467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5800b5ae0 0x7ff580152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:07:41.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7ff57ffff700 1 --2- 172.21.15.125:0/1549794467 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff58015cbd0 0x7ff5800d23a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff57800efc0 tx=0x7ff57800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7ff567fff700 1 -- 172.21.15.125:0/1549794467 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff578003c40 con 0x7ff58015cbd0 2023-10-17T06:07:41.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7ff567fff700 1 -- 172.21.15.125:0/1549794467 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57800f040 con 0x7ff58015cbd0 2023-10-17T06:07:41.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7ff567fff700 1 -- 172.21.15.125:0/1549794467 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff578009e60 con 0x7ff58015cbd0 2023-10-17T06:07:41.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.143+0000 7ff58487d700 1 -- 172.21.15.125:0/1549794467 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58014e9a0 con 0x7ff58015cbd0 2023-10-17T06:07:41.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7f24b0acb700 1 -- 172.21.15.125:0/1349077401 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a40e6210 con 0x7f24a40e33f0 2023-10-17T06:07:41.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.143+0000 7ff58487d700 1 -- 172.21.15.125:0/1549794467 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58014ef60 con 0x7ff58015cbd0 2023-10-17T06:07:41.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7f24b0acb700 1 -- 172.21.15.125:0/1349077401 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a4052070 con 0x7f24a403c2a0 2023-10-17T06:07:41.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7f24ab7fe700 1 -- 172.21.15.125:0/1349077401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24a40e33f0 msgr2=0x7f24a417c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7f24ab7fe700 1 --2- 172.21.15.125:0/1349077401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24a40e33f0 0x7f24a417c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7f24ab7fe700 1 -- 172.21.15.125:0/1349077401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24a4052830 msgr2=0x7f24a4052ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7f24ab7fe700 1 --2- 172.21.15.125:0/1349077401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24a4052830 0x7f24a4052ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.139+0000 7f24ab7fe700 1 -- 172.21.15.125:0/1349077401 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24980094b0 con 0x7f24a403c2a0 2023-10-17T06:07:41.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.143+0000 7f24ab7fe700 1 --2- 172.21.15.125:0/1349077401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24a403c2a0 0x7f24a4051640 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f24a000c500 tx=0x7f24a000c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.143+0000 7f1c84f48700 1 Processor -- start 2023-10-17T06:07:41.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.143+0000 7f1c84f48700 1 -- start start 2023-10-17T06:07:41.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.143+0000 7f2497fff700 1 -- 172.21.15.125:0/1349077401 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a0005d90 con 0x7f24a403c2a0 2023-10-17T06:07:41.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.143+0000 7f2497fff700 1 -- 172.21.15.125:0/1349077401 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a00070d0 con 0x7f24a403c2a0 2023-10-17T06:07:41.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.143+0000 7f2497fff700 1 -- 172.21.15.125:0/1349077401 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a0007480 con 0x7f24a403c2a0 2023-10-17T06:07:41.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.143+0000 7f24b0acb700 1 -- 172.21.15.125:0/1349077401 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a40e64b0 con 0x7f24a403c2a0 2023-10-17T06:07:41.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.143+0000 7f24b0acb700 1 -- 172.21.15.125:0/1349077401 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a4051b80 con 0x7f24a403c2a0 2023-10-17T06:07:41.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.143+0000 7f1c84f48700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c800b1df0 0x7f1c8014beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.143+0000 7f1c84f48700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c800d30e0 0x7f1c800b4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.143+0000 7f1c84f48700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c8015cc80 0x7f1c800b7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f1c7f7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c800b1df0 0x7f1c8014beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f1c7f7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c800b1df0 0x7f1c8014beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:47240/0 (socket says 172.21.15.125:47240) 2023-10-17T06:07:41.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f1c84f48700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c800b4710 con 0x7f1c800d30e0 2023-10-17T06:07:41.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f1c84f48700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8015d1f0 con 0x7f1c8015cc80 2023-10-17T06:07:41.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f1c84f48700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8015d4d0 con 0x7f1c800b1df0 2023-10-17T06:07:41.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f1c76ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c800d30e0 0x7f1c800b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f1c76ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c800d30e0 0x7f1c800b4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48948/0 (socket says 172.21.15.125:48948) 2023-10-17T06:07:41.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f1c76ffd700 1 -- 172.21.15.125:0/1018832124 learned_addr learned my addr 172.21.15.125:0/1018832124 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:41.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f1c7ffff700 1 --2- 172.21.15.125:0/1018832124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c8015cc80 0x7f1c800b7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f1c7ffff700 1 -- 172.21.15.125:0/1018832124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c800b1df0 msgr2=0x7f1c8014beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f1c7ffff700 1 --2- 172.21.15.125:0/1018832124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c800b1df0 0x7f1c8014beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f1c7ffff700 1 -- 172.21.15.125:0/1018832124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c800d30e0 msgr2=0x7f1c800b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f1c7ffff700 1 --2- 172.21.15.125:0/1018832124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c800d30e0 0x7f1c800b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f1c7ffff700 1 -- 172.21.15.125:0/1018832124 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c78009b30 con 0x7f1c8015cc80 2023-10-17T06:07:41.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f1c7ffff700 1 --2- 172.21.15.125:0/1018832124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c8015cc80 0x7f1c800b7800 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1c78015000 tx=0x7f1c78004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f1c7cff9700 1 -- 172.21.15.125:0/1018832124 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c78004250 con 0x7f1c8015cc80 2023-10-17T06:07:41.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7ff58487d700 1 -- 172.21.15.125:0/1549794467 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58014f150 con 0x7ff58015cbd0 2023-10-17T06:07:41.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f1c7cff9700 1 -- 172.21.15.125:0/1018832124 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c780043d0 con 0x7f1c8015cc80 2023-10-17T06:07:41.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f1c7cff9700 1 -- 172.21.15.125:0/1018832124 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c78004780 con 0x7f1c8015cc80 2023-10-17T06:07:41.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f1c84f48700 1 -- 172.21.15.125:0/1018832124 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8015d7b0 con 0x7f1c8015cc80 2023-10-17T06:07:41.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f2497fff700 1 -- 172.21.15.125:0/1349077401 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f24a00075e0 con 0x7f24a403c2a0 2023-10-17T06:07:41.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f2497fff700 1 --2- 172.21.15.125:0/1349077401 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2490065770 0x7f2490067c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f2497fff700 1 -- 172.21.15.125:0/1349077401 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f24a00824f0 con 0x7f24a403c2a0 2023-10-17T06:07:41.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f1c84f48700 1 -- 172.21.15.125:0/1018832124 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8014cbb0 con 0x7f1c8015cc80 2023-10-17T06:07:41.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7f24aaffd700 1 --2- 172.21.15.125:0/1349077401 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2490065770 0x7f2490067c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.147+0000 7ff567fff700 1 -- 172.21.15.125:0/1549794467 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff57800c880 con 0x7ff58015cbd0 2023-10-17T06:07:41.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.151+0000 7f24b0acb700 1 -- 172.21.15.125:0/1349077401 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a4005980 con 0x7f24a403c2a0 2023-10-17T06:07:41.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.151+0000 7f24aaffd700 1 --2- 172.21.15.125:0/1349077401 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2490065770 0x7f2490067c30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f24a4054320 tx=0x7f2498008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.151+0000 7f1c84f48700 1 -- 172.21.15.125:0/1018832124 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8015dc70 con 0x7f1c8015cc80 2023-10-17T06:07:41.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.151+0000 7f1c7cff9700 1 -- 172.21.15.125:0/1018832124 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1c7801c440 con 0x7f1c8015cc80 2023-10-17T06:07:41.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.151+0000 7ff567fff700 1 --2- 172.21.15.125:0/1549794467 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff56c0657c0 0x7ff56c067c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.151+0000 7ff567fff700 1 -- 172.21.15.125:0/1549794467 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff578083280 con 0x7ff58015cbd0 2023-10-17T06:07:41.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.151+0000 7ff57f7fe700 1 --2- 172.21.15.125:0/1549794467 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff56c0657c0 0x7ff56c067c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.155+0000 7f1c7cff9700 1 --2- 172.21.15.125:0/1018832124 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1c640656f0 0x7f1c64067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.155+0000 7f1c7cff9700 1 -- 172.21.15.125:0/1018832124 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1c780842d0 con 0x7f1c8015cc80 2023-10-17T06:07:41.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.155+0000 7ff57f7fe700 1 --2- 172.21.15.125:0/1549794467 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff56c0657c0 0x7ff56c067c80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff570001c90 tx=0x7ff570009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.155+0000 7f1c7f7fe700 1 --2- 172.21.15.125:0/1018832124 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1c640656f0 0x7f1c64067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.155+0000 7f1c7f7fe700 1 --2- 172.21.15.125:0/1018832124 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1c640656f0 0x7f1c64067bb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1c80159bd0 tx=0x7f1c70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.159+0000 7ff567fff700 1 -- 172.21.15.125:0/1549794467 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff578050b80 con 0x7ff58015cbd0 2023-10-17T06:07:41.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.163+0000 7f1c7cff9700 1 -- 172.21.15.125:0/1018832124 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f1c78051a90 con 0x7f1c8015cc80 2023-10-17T06:07:41.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.163+0000 7f2497fff700 1 -- 172.21.15.125:0/1349077401 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f24a004fd30 con 0x7f24a403c2a0 2023-10-17T06:07:41.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.399+0000 7f77de04d700 1 -- 172.21.15.125:0/233280739 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f77d80b15c0 con 0x7f77d80cb6d0 2023-10-17T06:07:41.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.403+0000 7f77bffff700 1 -- 172.21.15.125:0/233280739 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f77d80b15c0 con 0x7f77d80cb6d0 2023-10-17T06:07:41.405 INFO:teuthology.orchestra.run.smithi125.stdout:60129542156 2023-10-17T06:07:41.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.407+0000 7f77de04d700 1 -- 172.21.15.125:0/233280739 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f77c40656f0 msgr2=0x7f77c4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.407+0000 7f77de04d700 1 --2- 172.21.15.125:0/233280739 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f77c40656f0 0x7f77c4067bb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f77d000e250 tx=0x7f77d000b040 comp rx=0 tx=0).stop 2023-10-17T06:07:41.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.407+0000 7f77de04d700 1 -- 172.21.15.125:0/233280739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77d80cb6d0 msgr2=0x7f77d8162550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.407+0000 7f77de04d700 1 --2- 172.21.15.125:0/233280739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77d80cb6d0 0x7f77d8162550 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f77c8016000 tx=0x7f77c8004770 comp rx=0 tx=0).stop 2023-10-17T06:07:41.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.407+0000 7f77de04d700 1 -- 172.21.15.125:0/233280739 shutdown_connections 2023-10-17T06:07:41.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.407+0000 7f77de04d700 1 --2- 172.21.15.125:0/233280739 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f77c40656f0 0x7f77c4067bb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.407+0000 7f77de04d700 1 --2- 172.21.15.125:0/233280739 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77d8161230 0x7f77d8162a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.407+0000 7f77de04d700 1 --2- 172.21.15.125:0/233280739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77d80cb6d0 0x7f77d8162550 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.407+0000 7f77de04d700 1 --2- 172.21.15.125:0/233280739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77d80adb60 0x7f77d8158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.407+0000 7f77de04d700 1 -- 172.21.15.125:0/233280739 >> 172.21.15.125:0/233280739 conn(0x7f77d806a340 msgr2=0x7f77d80b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:41.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.407+0000 7f77de04d700 1 -- 172.21.15.125:0/233280739 shutdown_connections 2023-10-17T06:07:41.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.407+0000 7f77de04d700 1 -- 172.21.15.125:0/233280739 wait complete. 2023-10-17T06:07:41.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.2 2023-10-17T06:07:41.437 DEBUG:teuthology.parallel:result is None 2023-10-17T06:07:41.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.439+0000 7f289cff9700 1 -- 172.21.15.125:0/1647019431 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f28a0005530 con 0x7f28a003a790 2023-10-17T06:07:41.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.443+0000 7fe9074f4700 1 -- 172.21.15.125:0/2929175935 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe9000d0750 con 0x7fe9000b1df0 2023-10-17T06:07:41.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.443+0000 7f1a526eb700 1 -- 172.21.15.125:0/430478199 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1a4c0a9a20 con 0x7f1a4c144150 2023-10-17T06:07:41.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.443+0000 7fe8f6ffd700 1 -- 172.21.15.125:0/2929175935 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9000d0750 con 0x7fe9000b1df0 2023-10-17T06:07:41.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.443+0000 7f289effd700 1 -- 172.21.15.125:0/1647019431 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2898012ed0 con 0x7f28a003a790 2023-10-17T06:07:41.449 INFO:teuthology.orchestra.run.smithi125.stdout:64424509450 2023-10-17T06:07:41.449 INFO:teuthology.orchestra.run.smithi125.stdout:60129542156 2023-10-17T06:07:41.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7f1a41ffb700 1 -- 172.21.15.125:0/430478199 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a4c0a9a20 con 0x7f1a4c144150 2023-10-17T06:07:41.450 INFO:teuthology.orchestra.run.smithi125.stdout:60129542156 2023-10-17T06:07:41.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7fe9074f4700 1 -- 172.21.15.125:0/2929175935 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe8e4065720 msgr2=0x7fe8e4067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7fe9074f4700 1 --2- 172.21.15.125:0/2929175935 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe8e4065720 0x7fe8e4067be0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe9000d3b10 tx=0x7fe8fc008030 comp rx=0 tx=0).stop 2023-10-17T06:07:41.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7fe9074f4700 1 -- 172.21.15.125:0/2929175935 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9000b1df0 msgr2=0x7fe90015d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7fe9074f4700 1 --2- 172.21.15.125:0/2929175935 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9000b1df0 0x7fe90015d1f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe8f000c780 tx=0x7fe8f000ca90 comp rx=0 tx=0).stop 2023-10-17T06:07:41.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7fe9074f4700 1 -- 172.21.15.125:0/2929175935 shutdown_connections 2023-10-17T06:07:41.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7fe9074f4700 1 --2- 172.21.15.125:0/2929175935 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe8e4065720 0x7fe8e4067be0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7fe9074f4700 1 --2- 172.21.15.125:0/2929175935 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe90015cc80 0x7fe900150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7fe9074f4700 1 --2- 172.21.15.125:0/2929175935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9000d30e0 0x7fe900151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7fe9074f4700 1 --2- 172.21.15.125:0/2929175935 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9000b1df0 0x7fe90015d1f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7fe9074f4700 1 -- 172.21.15.125:0/2929175935 >> 172.21.15.125:0/2929175935 conn(0x7fe9000cf530 msgr2=0x7fe90006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:41.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7fe9074f4700 1 -- 172.21.15.125:0/2929175935 shutdown_connections 2023-10-17T06:07:41.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7fe9074f4700 1 -- 172.21.15.125:0/2929175935 wait complete. 2023-10-17T06:07:41.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7f289cff9700 1 -- 172.21.15.125:0/1647019431 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f288c0656f0 msgr2=0x7f288c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7f289cff9700 1 --2- 172.21.15.125:0/1647019431 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f288c0656f0 0x7f288c067bb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f28a80688e0 tx=0x7f28a806f150 comp rx=0 tx=0).stop 2023-10-17T06:07:41.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7f289cff9700 1 -- 172.21.15.125:0/1647019431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28a003a790 msgr2=0x7f28a01710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7f289cff9700 1 --2- 172.21.15.125:0/1647019431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28a003a790 0x7f28a01710c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f289800d530 tx=0x7f289800d840 comp rx=0 tx=0).stop 2023-10-17T06:07:41.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7f289cff9700 1 -- 172.21.15.125:0/1647019431 shutdown_connections 2023-10-17T06:07:41.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7f289cff9700 1 --2- 172.21.15.125:0/1647019431 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f288c0656f0 0x7f288c067bb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7f289cff9700 1 --2- 172.21.15.125:0/1647019431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28a003a790 0x7f28a01710c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7f289cff9700 1 --2- 172.21.15.125:0/1647019431 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28a0033f20 0x7f28a0034750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7f289cff9700 1 --2- 172.21.15.125:0/1647019431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28a0006950 0x7f28a00dbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.447+0000 7f289cff9700 1 -- 172.21.15.125:0/1647019431 >> 172.21.15.125:0/1647019431 conn(0x7f28a0054cf0 msgr2=0x7f28a0172f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:41.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.451+0000 7f289cff9700 1 -- 172.21.15.125:0/1647019431 shutdown_connections 2023-10-17T06:07:41.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.451+0000 7f289cff9700 1 -- 172.21.15.125:0/1647019431 wait complete. 2023-10-17T06:07:41.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.451+0000 7f1a526eb700 1 -- 172.21.15.125:0/430478199 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1a300656f0 msgr2=0x7f1a30067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.451+0000 7f1a526eb700 1 --2- 172.21.15.125:0/430478199 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1a300656f0 0x7f1a30067bb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c001760 tx=0x7f1a3c009040 comp rx=0 tx=0).stop 2023-10-17T06:07:41.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.451+0000 7f1a526eb700 1 -- 172.21.15.125:0/430478199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a4c144150 msgr2=0x7f1a4c0ab910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.451+0000 7f1a526eb700 1 --2- 172.21.15.125:0/430478199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a4c144150 0x7f1a4c0ab910 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1a44016000 tx=0x7f1a44004af0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.451+0000 7f1a526eb700 1 -- 172.21.15.125:0/430478199 shutdown_connections 2023-10-17T06:07:41.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.451+0000 7f1a526eb700 1 --2- 172.21.15.125:0/430478199 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1a300656f0 0x7f1a30067bb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.451+0000 7f1a526eb700 1 --2- 172.21.15.125:0/430478199 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a4c144150 0x7f1a4c0ab910 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.451+0000 7f1a526eb700 1 --2- 172.21.15.125:0/430478199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a4c0cbd30 0x7f1a4c15e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.451+0000 7f1a526eb700 1 --2- 172.21.15.125:0/430478199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a4c0cb8a0 0x7f1a4c0c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.451+0000 7f1a526eb700 1 -- 172.21.15.125:0/430478199 >> 172.21.15.125:0/430478199 conn(0x7f1a4c0b0bf0 msgr2=0x7f1a4c0aec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:41.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.451+0000 7f1a526eb700 1 -- 172.21.15.125:0/430478199 shutdown_connections 2023-10-17T06:07:41.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.451+0000 7f1a526eb700 1 -- 172.21.15.125:0/430478199 wait complete. 2023-10-17T06:07:41.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.463+0000 7f11e1cec700 1 -- 172.21.15.125:0/340933402 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f11dc147c30 con 0x7f11dc06d490 2023-10-17T06:07:41.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.463+0000 7f11d8ff9700 1 -- 172.21.15.125:0/340933402 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f11dc147c30 con 0x7f11dc06d490 2023-10-17T06:07:41.468 INFO:teuthology.orchestra.run.smithi125.stdout:64424509450 2023-10-17T06:07:41.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.467+0000 7f11e1cec700 1 -- 172.21.15.125:0/340933402 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f11bc065740 msgr2=0x7f11bc067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.467+0000 7f11e1cec700 1 --2- 172.21.15.125:0/340933402 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f11bc065740 0x7f11bc067c00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f11dc14fe00 tx=0x7f11cc006c50 comp rx=0 tx=0).stop 2023-10-17T06:07:41.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.467+0000 7f11e1cec700 1 -- 172.21.15.125:0/340933402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11dc06d490 msgr2=0x7f11dc14b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.467+0000 7f11e1cec700 1 --2- 172.21.15.125:0/340933402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11dc06d490 0x7f11dc14b950 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f11c400c770 tx=0x7f11c400cb30 comp rx=0 tx=0).stop 2023-10-17T06:07:41.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.467+0000 7f11e1cec700 1 -- 172.21.15.125:0/340933402 shutdown_connections 2023-10-17T06:07:41.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.467+0000 7f11e1cec700 1 --2- 172.21.15.125:0/340933402 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f11bc065740 0x7f11bc067c00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.467+0000 7f11e1cec700 1 --2- 172.21.15.125:0/340933402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11dc159930 0x7f11dc14a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.467+0000 7f11e1cec700 1 --2- 172.21.15.125:0/340933402 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc06f990 0x7f11dc149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.467+0000 7f11e1cec700 1 --2- 172.21.15.125:0/340933402 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11dc06d490 0x7f11dc14b950 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.467+0000 7f11e1cec700 1 -- 172.21.15.125:0/340933402 >> 172.21.15.125:0/340933402 conn(0x7f11dc06a340 msgr2=0x7f11dc0ccf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:41.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.467+0000 7f11e1cec700 1 -- 172.21.15.125:0/340933402 shutdown_connections 2023-10-17T06:07:41.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.467+0000 7f11e1cec700 1 -- 172.21.15.125:0/340933402 wait complete. 2023-10-17T06:07:41.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.475+0000 7f24b0acb700 1 -- 172.21.15.125:0/1349077401 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f24a4051e30 con 0x7f24a403c2a0 2023-10-17T06:07:41.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.475+0000 7f2497fff700 1 -- 172.21.15.125:0/1349077401 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f24a0017090 con 0x7f24a403c2a0 2023-10-17T06:07:41.480 INFO:teuthology.orchestra.run.smithi125.stdout:60129542155 2023-10-17T06:07:41.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.1 2023-10-17T06:07:41.482 DEBUG:teuthology.parallel:result is None 2023-10-17T06:07:41.483 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.0 2023-10-17T06:07:41.483 DEBUG:teuthology.parallel:result is None 2023-10-17T06:07:41.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.4 2023-10-17T06:07:41.485 DEBUG:teuthology.parallel:result is None 2023-10-17T06:07:41.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.479+0000 7f24b0acb700 1 -- 172.21.15.125:0/1349077401 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2490065770 msgr2=0x7f2490067c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.479+0000 7f24b0acb700 1 --2- 172.21.15.125:0/1349077401 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2490065770 0x7f2490067c30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f24a4054320 tx=0x7f2498008030 comp rx=0 tx=0).stop 2023-10-17T06:07:41.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.479+0000 7f24b0acb700 1 -- 172.21.15.125:0/1349077401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24a403c2a0 msgr2=0x7f24a4051640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.479+0000 7f24b0acb700 1 --2- 172.21.15.125:0/1349077401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24a403c2a0 0x7f24a4051640 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f24a000c500 tx=0x7f24a000c810 comp rx=0 tx=0).stop 2023-10-17T06:07:41.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.479+0000 7f24b0acb700 1 -- 172.21.15.125:0/1349077401 shutdown_connections 2023-10-17T06:07:41.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.479+0000 7f24b0acb700 1 --2- 172.21.15.125:0/1349077401 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2490065770 0x7f2490067c30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.479+0000 7f24b0acb700 1 --2- 172.21.15.125:0/1349077401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24a4052830 0x7f24a4052ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.479+0000 7f24b0acb700 1 --2- 172.21.15.125:0/1349077401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24a40e33f0 0x7f24a417c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.479+0000 7f24b0acb700 1 --2- 172.21.15.125:0/1349077401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f24a403c2a0 0x7f24a4051640 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.479+0000 7f24b0acb700 1 -- 172.21.15.125:0/1349077401 >> 172.21.15.125:0/1349077401 conn(0x7f24a403ac60 msgr2=0x7f24a403c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:41.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.479+0000 7f24b0acb700 1 -- 172.21.15.125:0/1349077401 shutdown_connections 2023-10-17T06:07:41.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.479+0000 7f24b0acb700 1 -- 172.21.15.125:0/1349077401 wait complete. 2023-10-17T06:07:41.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.6 2023-10-17T06:07:41.492 DEBUG:teuthology.parallel:result is None 2023-10-17T06:07:41.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.491+0000 7f1c84f48700 1 -- 172.21.15.125:0/1018832124 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1c80072e60 con 0x7f1c8015cc80 2023-10-17T06:07:41.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.491+0000 7f1c7cff9700 1 -- 172.21.15.125:0/1018832124 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c78051a90 con 0x7f1c8015cc80 2023-10-17T06:07:41.494 INFO:teuthology.orchestra.run.smithi125.stdout:64424509451 2023-10-17T06:07:41.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.491+0000 7ff58487d700 1 -- 172.21.15.125:0/1549794467 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff580072e60 con 0x7ff58015cbd0 2023-10-17T06:07:41.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.491+0000 7ff567fff700 1 -- 172.21.15.125:0/1549794467 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff5780541a0 con 0x7ff58015cbd0 2023-10-17T06:07:41.495 INFO:teuthology.orchestra.run.smithi125.stdout:60129542155 2023-10-17T06:07:41.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.491+0000 7f1c84f48700 1 -- 172.21.15.125:0/1018832124 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1c640656f0 msgr2=0x7f1c64067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.491+0000 7f1c84f48700 1 --2- 172.21.15.125:0/1018832124 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1c640656f0 0x7f1c64067bb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1c80159bd0 tx=0x7f1c70009040 comp rx=0 tx=0).stop 2023-10-17T06:07:41.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7f1c84f48700 1 -- 172.21.15.125:0/1018832124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c8015cc80 msgr2=0x7f1c800b7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7f1c84f48700 1 --2- 172.21.15.125:0/1018832124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c8015cc80 0x7f1c800b7800 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1c78015000 tx=0x7f1c78004af0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7f1c84f48700 1 -- 172.21.15.125:0/1018832124 shutdown_connections 2023-10-17T06:07:41.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7f1c84f48700 1 --2- 172.21.15.125:0/1018832124 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1c640656f0 0x7f1c64067bb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7f1c84f48700 1 --2- 172.21.15.125:0/1018832124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c8015cc80 0x7f1c800b7800 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7f1c84f48700 1 --2- 172.21.15.125:0/1018832124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1c800d30e0 0x7f1c800b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7f1c84f48700 1 --2- 172.21.15.125:0/1018832124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c800b1df0 0x7f1c8014beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7f1c84f48700 1 -- 172.21.15.125:0/1018832124 >> 172.21.15.125:0/1018832124 conn(0x7f1c800cf530 msgr2=0x7f1c800d29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:41.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7f1c84f48700 1 -- 172.21.15.125:0/1018832124 shutdown_connections 2023-10-17T06:07:41.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7f1c84f48700 1 -- 172.21.15.125:0/1018832124 wait complete. 2023-10-17T06:07:41.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7ff58487d700 1 -- 172.21.15.125:0/1549794467 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff56c0657c0 msgr2=0x7ff56c067c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7ff58487d700 1 --2- 172.21.15.125:0/1549794467 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff56c0657c0 0x7ff56c067c80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff570001c90 tx=0x7ff570009040 comp rx=0 tx=0).stop 2023-10-17T06:07:41.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7ff58487d700 1 -- 172.21.15.125:0/1549794467 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff58015cbd0 msgr2=0x7ff5800d23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7ff58487d700 1 --2- 172.21.15.125:0/1549794467 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff58015cbd0 0x7ff5800d23a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff57800efc0 tx=0x7ff57800c3a0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7ff58487d700 1 -- 172.21.15.125:0/1549794467 shutdown_connections 2023-10-17T06:07:41.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7ff58487d700 1 --2- 172.21.15.125:0/1549794467 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff56c0657c0 0x7ff56c067c80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7ff58487d700 1 --2- 172.21.15.125:0/1549794467 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff58015cbd0 0x7ff5800d23a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7ff58487d700 1 --2- 172.21.15.125:0/1549794467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5800b6c70 0x7ff5800d1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7ff58487d700 1 --2- 172.21.15.125:0/1549794467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5800b5ae0 0x7ff580152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7ff58487d700 1 -- 172.21.15.125:0/1549794467 >> 172.21.15.125:0/1549794467 conn(0x7ff58006f450 msgr2=0x7ff5800b2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:41.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7ff58487d700 1 -- 172.21.15.125:0/1549794467 shutdown_connections 2023-10-17T06:07:41.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.495+0000 7ff58487d700 1 -- 172.21.15.125:0/1549794467 wait complete. 2023-10-17T06:07:41.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.3 2023-10-17T06:07:41.504 DEBUG:teuthology.parallel:result is None 2023-10-17T06:07:41.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.7 2023-10-17T06:07:41.516 DEBUG:teuthology.parallel:result is None 2023-10-17T06:07:41.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.5 2023-10-17T06:07:41.517 DEBUG:teuthology.parallel:result is None 2023-10-17T06:07:41.517 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-17T06:07:41.517 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-17T06:07:41.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.727+0000 7eff0855d700 1 Processor -- start 2023-10-17T06:07:41.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.727+0000 7eff0855d700 1 -- start start 2023-10-17T06:07:41.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.731+0000 7eff0855d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7eff0006e8a0 0x7eff000caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.731+0000 7eff0855d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7eff000cb470 0x7eff0006f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.731+0000 7eff0855d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0006f450 con 0x7eff0015ee50 2023-10-17T06:07:41.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.731+0000 7eff0855d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff0006d4e0 con 0x7eff000cb470 2023-10-17T06:07:41.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.731+0000 7eff0855d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff00162780 con 0x7eff0006e8a0 2023-10-17T06:07:41.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.731+0000 7eff06afa700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7eff000cb470 0x7eff0006f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.731+0000 7eff06afa700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7eff000cb470 0x7eff0006f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48958/0 (socket says 172.21.15.125:48958) 2023-10-17T06:07:41.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.731+0000 7eff06afa700 1 -- 172.21.15.125:0/2729647722 learned_addr learned my addr 172.21.15.125:0/2729647722 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:41.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.731+0000 7eff05af8700 1 --2- 172.21.15.125:0/2729647722 >> v2:172.21.15.184:3300/0 conn(0x7eff0006e8a0 0x7eff000caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.731+0000 7eff06afa700 1 -- 172.21.15.125:0/2729647722 >> v2:172.21.15.184:3300/0 conn(0x7eff0006e8a0 msgr2=0x7eff000caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:41.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.731+0000 7eff06afa700 1 --2- 172.21.15.125:0/2729647722 >> v2:172.21.15.184:3300/0 conn(0x7eff0006e8a0 0x7eff000caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.731+0000 7eff06afa700 1 -- 172.21.15.125:0/2729647722 >> v1:172.21.15.125:6789/0 conn(0x7eff0015ee50 legacy=0x7eff000cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.731+0000 7eff06afa700 1 -- 172.21.15.125:0/2729647722 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff000cb8a0 con 0x7eff000cb470 2023-10-17T06:07:41.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.731+0000 7eff06afa700 1 --2- 172.21.15.125:0/2729647722 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff000cb470 0x7eff0006f8e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7eff000cbce0 tx=0x7efef8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e21de0fea8862d server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.731+0000 7eff052f7700 1 -- 172.21.15.125:0/2729647722 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef800b8a0 con 0x7eff000cb470 2023-10-17T06:07:41.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.731+0000 7eff052f7700 1 -- 172.21.15.125:0/2729647722 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef800ba00 con 0x7eff000cb470 2023-10-17T06:07:41.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.731+0000 7eff052f7700 1 -- 172.21.15.125:0/2729647722 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef800bd90 con 0x7eff000cb470 2023-10-17T06:07:41.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.731+0000 7eff0855d700 1 -- 172.21.15.125:0/2729647722 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff000cb470 msgr2=0x7eff0006f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.731+0000 7eff0855d700 1 --2- 172.21.15.125:0/2729647722 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff000cb470 0x7eff0006f8e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7eff000cbce0 tx=0x7efef8009bf0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.735+0000 7eff0855d700 1 -- 172.21.15.125:0/2729647722 shutdown_connections 2023-10-17T06:07:41.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.735+0000 7eff0855d700 1 --2- 172.21.15.125:0/2729647722 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff000cb470 0x7eff0006f8e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.735+0000 7eff0855d700 1 --2- 172.21.15.125:0/2729647722 >> v2:172.21.15.184:3300/0 conn(0x7eff0006e8a0 0x7eff000caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.735+0000 7eff0855d700 1 -- 172.21.15.125:0/2729647722 >> 172.21.15.125:0/2729647722 conn(0x7eff0006a340 msgr2=0x7eff000b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:41.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.735+0000 7eff0855d700 1 -- 172.21.15.125:0/2729647722 shutdown_connections 2023-10-17T06:07:41.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.735+0000 7eff0855d700 1 -- 172.21.15.125:0/2729647722 wait complete. 2023-10-17T06:07:41.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.735+0000 7eff0855d700 1 Processor -- start 2023-10-17T06:07:41.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.735+0000 7eff0855d700 1 -- start start 2023-10-17T06:07:41.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7eff0855d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff0006e8a0 0x7eff000ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7eff0855d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff000cb470 0x7eff0015d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7eff0855d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff0015ee50 0x7eff0015deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7eff0855d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff000b2140 con 0x7eff0015ee50 2023-10-17T06:07:41.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7eff0855d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff000b2420 con 0x7eff000cb470 2023-10-17T06:07:41.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7eff0855d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff000b2700 con 0x7eff0006e8a0 2023-10-17T06:07:41.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7eff06afa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff0015ee50 0x7eff0015deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7eff06afa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff0015ee50 0x7eff0015deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48972/0 (socket says 172.21.15.125:48972) 2023-10-17T06:07:41.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7eff06afa700 1 -- 172.21.15.125:0/3040634803 learned_addr learned my addr 172.21.15.125:0/3040634803 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:41.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7eff062f9700 1 --2- 172.21.15.125:0/3040634803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff0006e8a0 0x7eff000ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7eff05af8700 1 --2- 172.21.15.125:0/3040634803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff000cb470 0x7eff0015d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7eff06afa700 1 -- 172.21.15.125:0/3040634803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff0006e8a0 msgr2=0x7eff000ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7eff06afa700 1 --2- 172.21.15.125:0/3040634803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff0006e8a0 0x7eff000ad060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7eff06afa700 1 -- 172.21.15.125:0/3040634803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff000cb470 msgr2=0x7eff0015d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7eff06afa700 1 --2- 172.21.15.125:0/3040634803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff000cb470 0x7eff0015d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7eff06afa700 1 -- 172.21.15.125:0/3040634803 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef8009570 con 0x7eff0015ee50 2023-10-17T06:07:41.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7eff062f9700 1 --2- 172.21.15.125:0/3040634803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff0006e8a0 0x7eff000ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:41.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7eff06afa700 1 --2- 172.21.15.125:0/3040634803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff0015ee50 0x7eff0015deb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7eff0006b390 tx=0x7efef8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7efef6ffd700 1 -- 172.21.15.125:0/3040634803 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef80038c0 con 0x7eff0015ee50 2023-10-17T06:07:41.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7efef6ffd700 1 -- 172.21.15.125:0/3040634803 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef801f070 con 0x7eff0015ee50 2023-10-17T06:07:41.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7efef6ffd700 1 -- 172.21.15.125:0/3040634803 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef8003c60 con 0x7eff0015ee50 2023-10-17T06:07:41.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7eff0855d700 1 -- 172.21.15.125:0/3040634803 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff000b29e0 con 0x7eff0015ee50 2023-10-17T06:07:41.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.739+0000 7eff0855d700 1 -- 172.21.15.125:0/3040634803 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff000b13f0 con 0x7eff0015ee50 2023-10-17T06:07:41.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.743+0000 7eff0855d700 1 -- 172.21.15.125:0/3040634803 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0015b3c0 con 0x7eff0015ee50 2023-10-17T06:07:41.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.743+0000 7efef6ffd700 1 -- 172.21.15.125:0/3040634803 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7efef801a430 con 0x7eff0015ee50 2023-10-17T06:07:41.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.743+0000 7efef6ffd700 1 --2- 172.21.15.125:0/3040634803 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efee40656f0 0x7efee4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:41.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.743+0000 7efef6ffd700 1 -- 172.21.15.125:0/3040634803 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efef8021070 con 0x7eff0015ee50 2023-10-17T06:07:41.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.743+0000 7eff062f9700 1 --2- 172.21.15.125:0/3040634803 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efee40656f0 0x7efee4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:41.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.743+0000 7eff062f9700 1 --2- 172.21.15.125:0/3040634803 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efee40656f0 0x7efee4067bb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efefc00e220 tx=0x7efefc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:41.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.751+0000 7efef6ffd700 1 -- 172.21.15.125:0/3040634803 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7eff0015b3c0 con 0x7eff0015ee50 2023-10-17T06:07:41.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.927+0000 7eff0855d700 1 -- 172.21.15.125:0/3040634803 --> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff000b2590 con 0x7efee40656f0 2023-10-17T06:07:41.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.943+0000 7efef6ffd700 1 -- 172.21.15.125:0/3040634803 <== mgr.4107 v2:172.21.15.125:6832/2516570548 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367120 (secure 0 0 0) 0x7eff000b2590 con 0x7efee40656f0 2023-10-17T06:07:41.951 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:41.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.955+0000 7eff0855d700 1 -- 172.21.15.125:0/3040634803 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efee40656f0 msgr2=0x7efee4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.955+0000 7eff0855d700 1 --2- 172.21.15.125:0/3040634803 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efee40656f0 0x7efee4067bb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efefc00e220 tx=0x7efefc009040 comp rx=0 tx=0).stop 2023-10-17T06:07:41.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.955+0000 7eff0855d700 1 -- 172.21.15.125:0/3040634803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff0015ee50 msgr2=0x7eff0015deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:41.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.955+0000 7eff0855d700 1 --2- 172.21.15.125:0/3040634803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff0015ee50 0x7eff0015deb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7eff0006b390 tx=0x7efef8004770 comp rx=0 tx=0).stop 2023-10-17T06:07:41.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.955+0000 7eff0855d700 1 -- 172.21.15.125:0/3040634803 shutdown_connections 2023-10-17T06:07:41.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.955+0000 7eff0855d700 1 --2- 172.21.15.125:0/3040634803 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efee40656f0 0x7efee4067bb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.955+0000 7eff0855d700 1 --2- 172.21.15.125:0/3040634803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff0015ee50 0x7eff0015deb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.955+0000 7eff0855d700 1 --2- 172.21.15.125:0/3040634803 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff000cb470 0x7eff0015d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.955+0000 7eff0855d700 1 --2- 172.21.15.125:0/3040634803 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff0006e8a0 0x7eff000ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:41.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.955+0000 7eff0855d700 1 -- 172.21.15.125:0/3040634803 >> 172.21.15.125:0/3040634803 conn(0x7eff0006a340 msgr2=0x7eff00161b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:41.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.955+0000 7eff0855d700 1 -- 172.21.15.125:0/3040634803 shutdown_connections 2023-10-17T06:07:41.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:41.955+0000 7eff0855d700 1 -- 172.21.15.125:0/3040634803 wait complete. 2023-10-17T06:07:41.960 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-17T06:07:41.977 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-10-17T06:07:39.954444+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219680,"kb_used_data":3524,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755040,"statfs":{"total":773094113280,"available":772869160960,"internally_reserved":0,"allocated":3608576,"data_stored":2164503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005087"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290252+0000","last_change":"2023-10-17T06:07:13.901434+0000","last_active":"2023-10-17T06:07:15.290252+0000","last_peered":"2023-10-17T06:07:15.290252+0000","last_clean":"2023-10-17T06:07:15.290252+0000","last_became_active":"2023-10-17T06:07:13.901040+0000","last_became_peered":"2023-10-17T06:07:13.901040+0000","last_unstale":"2023-10-17T06:07:15.290252+0000","last_undegraded":"2023-10-17T06:07:15.290252+0000","last_fullsized":"2023-10-17T06:07:15.290252+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:36:26.363513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292800+0000","last_change":"2023-10-17T06:07:08.591346+0000","last_active":"2023-10-17T06:07:15.292800+0000","last_peered":"2023-10-17T06:07:15.292800+0000","last_clean":"2023-10-17T06:07:15.292800+0000","last_became_active":"2023-10-17T06:07:08.591043+0000","last_became_peered":"2023-10-17T06:07:08.591043+0000","last_unstale":"2023-10-17T06:07:15.292800+0000","last_undegraded":"2023-10-17T06:07:15.292800+0000","last_fullsized":"2023-10-17T06:07:15.292800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:20.494951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879068+0000","last_change":"2023-10-17T06:07:09.836025+0000","last_active":"2023-10-17T06:07:14.879068+0000","last_peered":"2023-10-17T06:07:14.879068+0000","last_clean":"2023-10-17T06:07:14.879068+0000","last_became_active":"2023-10-17T06:07:09.835767+0000","last_became_peered":"2023-10-17T06:07:09.835767+0000","last_unstale":"2023-10-17T06:07:14.879068+0000","last_undegraded":"2023-10-17T06:07:14.879068+0000","last_fullsized":"2023-10-17T06:07:14.879068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:42:27.021964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878105+0000","last_change":"2023-10-17T06:07:13.895224+0000","last_active":"2023-10-17T06:07:14.878105+0000","last_peered":"2023-10-17T06:07:14.878105+0000","last_clean":"2023-10-17T06:07:14.878105+0000","last_became_active":"2023-10-17T06:07:13.894817+0000","last_became_peered":"2023-10-17T06:07:13.894817+0000","last_unstale":"2023-10-17T06:07:14.878105+0000","last_undegraded":"2023-10-17T06:07:14.878105+0000","last_fullsized":"2023-10-17T06:07:14.878105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:48:43.184952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290660+0000","last_change":"2023-10-17T06:07:08.593335+0000","last_active":"2023-10-17T06:07:15.290660+0000","last_peered":"2023-10-17T06:07:15.290660+0000","last_clean":"2023-10-17T06:07:15.290660+0000","last_became_active":"2023-10-17T06:07:08.592714+0000","last_became_peered":"2023-10-17T06:07:08.592714+0000","last_unstale":"2023-10-17T06:07:15.290660+0000","last_undegraded":"2023-10-17T06:07:15.290660+0000","last_fullsized":"2023-10-17T06:07:15.290660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:19:27.180864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289199+0000","last_change":"2023-10-17T06:07:09.826416+0000","last_active":"2023-10-17T06:07:15.289199+0000","last_peered":"2023-10-17T06:07:15.289199+0000","last_clean":"2023-10-17T06:07:15.289199+0000","last_became_active":"2023-10-17T06:07:09.826166+0000","last_became_peered":"2023-10-17T06:07:09.826166+0000","last_unstale":"2023-10-17T06:07:15.289199+0000","last_undegraded":"2023-10-17T06:07:15.289199+0000","last_fullsized":"2023-10-17T06:07:15.289199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:40:00.062457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883131+0000","last_change":"2023-10-17T06:07:13.882442+0000","last_active":"2023-10-17T06:07:14.883131+0000","last_peered":"2023-10-17T06:07:14.883131+0000","last_clean":"2023-10-17T06:07:14.883131+0000","last_became_active":"2023-10-17T06:07:13.882071+0000","last_became_peered":"2023-10-17T06:07:13.882071+0000","last_unstale":"2023-10-17T06:07:14.883131+0000","last_undegraded":"2023-10-17T06:07:14.883131+0000","last_fullsized":"2023-10-17T06:07:14.883131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:17:23.703090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883798+0000","last_change":"2023-10-17T06:07:08.596020+0000","last_active":"2023-10-17T06:07:14.883798+0000","last_peered":"2023-10-17T06:07:14.883798+0000","last_clean":"2023-10-17T06:07:14.883798+0000","last_became_active":"2023-10-17T06:07:08.595675+0000","last_became_peered":"2023-10-17T06:07:08.595675+0000","last_unstale":"2023-10-17T06:07:14.883798+0000","last_undegraded":"2023-10-17T06:07:14.883798+0000","last_fullsized":"2023-10-17T06:07:14.883798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:49:51.752101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878221+0000","last_change":"2023-10-17T06:07:09.810995+0000","last_active":"2023-10-17T06:07:14.878221+0000","last_peered":"2023-10-17T06:07:14.878221+0000","last_clean":"2023-10-17T06:07:14.878221+0000","last_became_active":"2023-10-17T06:07:09.810703+0000","last_became_peered":"2023-10-17T06:07:09.810703+0000","last_unstale":"2023-10-17T06:07:14.878221+0000","last_undegraded":"2023-10-17T06:07:14.878221+0000","last_fullsized":"2023-10-17T06:07:14.878221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:47:31.281761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876631+0000","last_change":"2023-10-17T06:07:13.895957+0000","last_active":"2023-10-17T06:07:14.876631+0000","last_peered":"2023-10-17T06:07:14.876631+0000","last_clean":"2023-10-17T06:07:14.876631+0000","last_became_active":"2023-10-17T06:07:13.895553+0000","last_became_peered":"2023-10-17T06:07:13.895553+0000","last_unstale":"2023-10-17T06:07:14.876631+0000","last_undegraded":"2023-10-17T06:07:14.876631+0000","last_fullsized":"2023-10-17T06:07:14.876631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:26.493795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883297+0000","last_change":"2023-10-17T06:07:08.596194+0000","last_active":"2023-10-17T06:07:14.883297+0000","last_peered":"2023-10-17T06:07:14.883297+0000","last_clean":"2023-10-17T06:07:14.883297+0000","last_became_active":"2023-10-17T06:07:08.595660+0000","last_became_peered":"2023-10-17T06:07:08.595660+0000","last_unstale":"2023-10-17T06:07:14.883297+0000","last_undegraded":"2023-10-17T06:07:14.883297+0000","last_fullsized":"2023-10-17T06:07:14.883297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:39:59.057172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880325+0000","last_change":"2023-10-17T06:07:09.807993+0000","last_active":"2023-10-17T06:07:14.880325+0000","last_peered":"2023-10-17T06:07:14.880325+0000","last_clean":"2023-10-17T06:07:14.880325+0000","last_became_active":"2023-10-17T06:07:09.807693+0000","last_became_peered":"2023-10-17T06:07:09.807693+0000","last_unstale":"2023-10-17T06:07:14.880325+0000","last_undegraded":"2023-10-17T06:07:14.880325+0000","last_fullsized":"2023-10-17T06:07:14.880325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:35:18.327855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292566+0000","last_change":"2023-10-17T06:07:13.889302+0000","last_active":"2023-10-17T06:07:15.292566+0000","last_peered":"2023-10-17T06:07:15.292566+0000","last_clean":"2023-10-17T06:07:15.292566+0000","last_became_active":"2023-10-17T06:07:13.888782+0000","last_became_peered":"2023-10-17T06:07:13.888782+0000","last_unstale":"2023-10-17T06:07:15.292566+0000","last_undegraded":"2023-10-17T06:07:15.292566+0000","last_fullsized":"2023-10-17T06:07:15.292566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:00:23.332863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292161+0000","last_change":"2023-10-17T06:07:08.594447+0000","last_active":"2023-10-17T06:07:15.292161+0000","last_peered":"2023-10-17T06:07:15.292161+0000","last_clean":"2023-10-17T06:07:15.292161+0000","last_became_active":"2023-10-17T06:07:08.594176+0000","last_became_peered":"2023-10-17T06:07:08.594176+0000","last_unstale":"2023-10-17T06:07:15.292161+0000","last_undegraded":"2023-10-17T06:07:15.292161+0000","last_fullsized":"2023-10-17T06:07:15.292161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:15:03.640415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877356+0000","last_change":"2023-10-17T06:07:09.819893+0000","last_active":"2023-10-17T06:07:14.877356+0000","last_peered":"2023-10-17T06:07:14.877356+0000","last_clean":"2023-10-17T06:07:14.877356+0000","last_became_active":"2023-10-17T06:07:09.819607+0000","last_became_peered":"2023-10-17T06:07:09.819607+0000","last_unstale":"2023-10-17T06:07:14.877356+0000","last_undegraded":"2023-10-17T06:07:14.877356+0000","last_fullsized":"2023-10-17T06:07:14.877356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:21:39.864171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878555+0000","last_change":"2023-10-17T06:07:13.880508+0000","last_active":"2023-10-17T06:07:14.878555+0000","last_peered":"2023-10-17T06:07:14.878555+0000","last_clean":"2023-10-17T06:07:14.878555+0000","last_became_active":"2023-10-17T06:07:13.879917+0000","last_became_peered":"2023-10-17T06:07:13.879917+0000","last_unstale":"2023-10-17T06:07:14.878555+0000","last_undegraded":"2023-10-17T06:07:14.878555+0000","last_fullsized":"2023-10-17T06:07:14.878555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:40:59.144753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878410+0000","last_change":"2023-10-17T06:07:08.588962+0000","last_active":"2023-10-17T06:07:14.878410+0000","last_peered":"2023-10-17T06:07:14.878410+0000","last_clean":"2023-10-17T06:07:14.878410+0000","last_became_active":"2023-10-17T06:07:08.588620+0000","last_became_peered":"2023-10-17T06:07:08.588620+0000","last_unstale":"2023-10-17T06:07:14.878410+0000","last_undegraded":"2023-10-17T06:07:14.878410+0000","last_fullsized":"2023-10-17T06:07:14.878410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:54:25.029489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291108+0000","last_change":"2023-10-17T06:07:09.828789+0000","last_active":"2023-10-17T06:07:15.291108+0000","last_peered":"2023-10-17T06:07:15.291108+0000","last_clean":"2023-10-17T06:07:15.291108+0000","last_became_active":"2023-10-17T06:07:09.828222+0000","last_became_peered":"2023-10-17T06:07:09.828222+0000","last_unstale":"2023-10-17T06:07:15.291108+0000","last_undegraded":"2023-10-17T06:07:15.291108+0000","last_fullsized":"2023-10-17T06:07:15.291108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:40:29.612977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290241+0000","last_change":"2023-10-17T06:07:13.884632+0000","last_active":"2023-10-17T06:07:15.290241+0000","last_peered":"2023-10-17T06:07:15.290241+0000","last_clean":"2023-10-17T06:07:15.290241+0000","last_became_active":"2023-10-17T06:07:13.883506+0000","last_became_peered":"2023-10-17T06:07:13.883506+0000","last_unstale":"2023-10-17T06:07:15.290241+0000","last_undegraded":"2023-10-17T06:07:15.290241+0000","last_fullsized":"2023-10-17T06:07:15.290241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:58:02.371449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291061+0000","last_change":"2023-10-17T06:07:08.596112+0000","last_active":"2023-10-17T06:07:15.291061+0000","last_peered":"2023-10-17T06:07:15.291061+0000","last_clean":"2023-10-17T06:07:15.291061+0000","last_became_active":"2023-10-17T06:07:08.595385+0000","last_became_peered":"2023-10-17T06:07:08.595385+0000","last_unstale":"2023-10-17T06:07:15.291061+0000","last_undegraded":"2023-10-17T06:07:15.291061+0000","last_fullsized":"2023-10-17T06:07:15.291061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:25:55.002475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292431+0000","last_change":"2023-10-17T06:07:09.839412+0000","last_active":"2023-10-17T06:07:15.292431+0000","last_peered":"2023-10-17T06:07:15.292431+0000","last_clean":"2023-10-17T06:07:15.292431+0000","last_became_active":"2023-10-17T06:07:09.838904+0000","last_became_peered":"2023-10-17T06:07:09.838904+0000","last_unstale":"2023-10-17T06:07:15.292431+0000","last_undegraded":"2023-10-17T06:07:15.292431+0000","last_fullsized":"2023-10-17T06:07:15.292431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:19:22.830429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292307+0000","last_change":"2023-10-17T06:07:13.888543+0000","last_active":"2023-10-17T06:07:15.292307+0000","last_peered":"2023-10-17T06:07:15.292307+0000","last_clean":"2023-10-17T06:07:15.292307+0000","last_became_active":"2023-10-17T06:07:13.888176+0000","last_became_peered":"2023-10-17T06:07:13.888176+0000","last_unstale":"2023-10-17T06:07:15.292307+0000","last_undegraded":"2023-10-17T06:07:15.292307+0000","last_fullsized":"2023-10-17T06:07:15.292307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:26.493795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289600+0000","last_change":"2023-10-17T06:07:08.589779+0000","last_active":"2023-10-17T06:07:15.289600+0000","last_peered":"2023-10-17T06:07:15.289600+0000","last_clean":"2023-10-17T06:07:15.289600+0000","last_became_active":"2023-10-17T06:07:08.587389+0000","last_became_peered":"2023-10-17T06:07:08.587389+0000","last_unstale":"2023-10-17T06:07:15.289600+0000","last_undegraded":"2023-10-17T06:07:15.289600+0000","last_fullsized":"2023-10-17T06:07:15.289600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:45:38.247338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290377+0000","last_change":"2023-10-17T06:07:09.824706+0000","last_active":"2023-10-17T06:07:15.290377+0000","last_peered":"2023-10-17T06:07:15.290377+0000","last_clean":"2023-10-17T06:07:15.290377+0000","last_became_active":"2023-10-17T06:07:09.824384+0000","last_became_peered":"2023-10-17T06:07:09.824384+0000","last_unstale":"2023-10-17T06:07:15.290377+0000","last_undegraded":"2023-10-17T06:07:15.290377+0000","last_fullsized":"2023-10-17T06:07:15.290377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:33:14.304674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291416+0000","last_change":"2023-10-17T06:07:09.814976+0000","last_active":"2023-10-17T06:07:15.291416+0000","last_peered":"2023-10-17T06:07:15.291416+0000","last_clean":"2023-10-17T06:07:15.291416+0000","last_became_active":"2023-10-17T06:07:09.814529+0000","last_became_peered":"2023-10-17T06:07:09.814529+0000","last_unstale":"2023-10-17T06:07:15.291416+0000","last_undegraded":"2023-10-17T06:07:15.291416+0000","last_fullsized":"2023-10-17T06:07:15.291416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:48:38.906119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292919+0000","last_change":"2023-10-17T06:07:08.596874+0000","last_active":"2023-10-17T06:07:15.292919+0000","last_peered":"2023-10-17T06:07:15.292919+0000","last_clean":"2023-10-17T06:07:15.292919+0000","last_became_active":"2023-10-17T06:07:08.596349+0000","last_became_peered":"2023-10-17T06:07:08.596349+0000","last_unstale":"2023-10-17T06:07:15.292919+0000","last_undegraded":"2023-10-17T06:07:15.292919+0000","last_fullsized":"2023-10-17T06:07:15.292919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:37:33.810500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289117+0000","last_change":"2023-10-17T06:07:13.888460+0000","last_active":"2023-10-17T06:07:15.289117+0000","last_peered":"2023-10-17T06:07:15.289117+0000","last_clean":"2023-10-17T06:07:15.289117+0000","last_became_active":"2023-10-17T06:07:13.887943+0000","last_became_peered":"2023-10-17T06:07:13.887943+0000","last_unstale":"2023-10-17T06:07:15.289117+0000","last_undegraded":"2023-10-17T06:07:15.289117+0000","last_fullsized":"2023-10-17T06:07:15.289117+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:33:38.048460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.288908+0000","last_change":"2023-10-17T06:07:09.823031+0000","last_active":"2023-10-17T06:07:15.288908+0000","last_peered":"2023-10-17T06:07:15.288908+0000","last_clean":"2023-10-17T06:07:15.288908+0000","last_became_active":"2023-10-17T06:07:09.821733+0000","last_became_peered":"2023-10-17T06:07:09.821733+0000","last_unstale":"2023-10-17T06:07:15.288908+0000","last_undegraded":"2023-10-17T06:07:15.288908+0000","last_fullsized":"2023-10-17T06:07:15.288908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:38.659545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883705+0000","last_change":"2023-10-17T06:07:08.588590+0000","last_active":"2023-10-17T06:07:14.883705+0000","last_peered":"2023-10-17T06:07:14.883705+0000","last_clean":"2023-10-17T06:07:14.883705+0000","last_became_active":"2023-10-17T06:07:08.587376+0000","last_became_peered":"2023-10-17T06:07:08.587376+0000","last_unstale":"2023-10-17T06:07:14.883705+0000","last_undegraded":"2023-10-17T06:07:14.883705+0000","last_fullsized":"2023-10-17T06:07:14.883705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:19:27.180864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876041+0000","last_change":"2023-10-17T06:07:13.890283+0000","last_active":"2023-10-17T06:07:14.876041+0000","last_peered":"2023-10-17T06:07:14.876041+0000","last_clean":"2023-10-17T06:07:14.876041+0000","last_became_active":"2023-10-17T06:07:13.889919+0000","last_became_peered":"2023-10-17T06:07:13.889919+0000","last_unstale":"2023-10-17T06:07:14.876041+0000","last_undegraded":"2023-10-17T06:07:14.876041+0000","last_fullsized":"2023-10-17T06:07:14.876041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:37:49.339156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877482+0000","last_change":"2023-10-17T06:07:08.600096+0000","last_active":"2023-10-17T06:07:14.877482+0000","last_peered":"2023-10-17T06:07:14.877482+0000","last_clean":"2023-10-17T06:07:14.877482+0000","last_became_active":"2023-10-17T06:07:08.599786+0000","last_became_peered":"2023-10-17T06:07:08.599786+0000","last_unstale":"2023-10-17T06:07:14.877482+0000","last_undegraded":"2023-10-17T06:07:14.877482+0000","last_fullsized":"2023-10-17T06:07:14.877482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:37:33.810500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290765+0000","last_change":"2023-10-17T06:07:09.827852+0000","last_active":"2023-10-17T06:07:15.290765+0000","last_peered":"2023-10-17T06:07:15.290765+0000","last_clean":"2023-10-17T06:07:15.290765+0000","last_became_active":"2023-10-17T06:07:09.827571+0000","last_became_peered":"2023-10-17T06:07:09.827571+0000","last_unstale":"2023-10-17T06:07:15.290765+0000","last_undegraded":"2023-10-17T06:07:15.290765+0000","last_fullsized":"2023-10-17T06:07:15.290765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:53:34.063175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289369+0000","last_change":"2023-10-17T06:07:13.888236+0000","last_active":"2023-10-17T06:07:15.289369+0000","last_peered":"2023-10-17T06:07:15.289369+0000","last_clean":"2023-10-17T06:07:15.289369+0000","last_became_active":"2023-10-17T06:07:13.887862+0000","last_became_peered":"2023-10-17T06:07:13.887862+0000","last_unstale":"2023-10-17T06:07:15.289369+0000","last_undegraded":"2023-10-17T06:07:15.289369+0000","last_fullsized":"2023-10-17T06:07:15.289369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:39:43.311635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:26.389600+0000","last_change":"2023-10-17T06:07:08.585396+0000","last_active":"2023-10-17T06:07:26.389600+0000","last_peered":"2023-10-17T06:07:26.389600+0000","last_clean":"2023-10-17T06:07:26.389600+0000","last_became_active":"2023-10-17T06:07:08.585072+0000","last_became_peered":"2023-10-17T06:07:08.585072+0000","last_unstale":"2023-10-17T06:07:26.389600+0000","last_undegraded":"2023-10-17T06:07:26.389600+0000","last_fullsized":"2023-10-17T06:07:26.389600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:45:24.700330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880432+0000","last_change":"2023-10-17T06:07:09.821236+0000","last_active":"2023-10-17T06:07:14.880432+0000","last_peered":"2023-10-17T06:07:14.880432+0000","last_clean":"2023-10-17T06:07:14.880432+0000","last_became_active":"2023-10-17T06:07:09.820316+0000","last_became_peered":"2023-10-17T06:07:09.820316+0000","last_unstale":"2023-10-17T06:07:14.880432+0000","last_undegraded":"2023-10-17T06:07:14.880432+0000","last_fullsized":"2023-10-17T06:07:14.880432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:57:46.498866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290002+0000","last_change":"2023-10-17T06:07:13.889504+0000","last_active":"2023-10-17T06:07:15.290002+0000","last_peered":"2023-10-17T06:07:15.290002+0000","last_clean":"2023-10-17T06:07:15.290002+0000","last_became_active":"2023-10-17T06:07:13.889086+0000","last_became_peered":"2023-10-17T06:07:13.889086+0000","last_unstale":"2023-10-17T06:07:15.290002+0000","last_undegraded":"2023-10-17T06:07:15.290002+0000","last_fullsized":"2023-10-17T06:07:15.290002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:11:54.644012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880973+0000","last_change":"2023-10-17T06:07:09.808679+0000","last_active":"2023-10-17T06:07:14.880973+0000","last_peered":"2023-10-17T06:07:14.880973+0000","last_clean":"2023-10-17T06:07:14.880973+0000","last_became_active":"2023-10-17T06:07:09.808378+0000","last_became_peered":"2023-10-17T06:07:09.808378+0000","last_unstale":"2023-10-17T06:07:14.880973+0000","last_undegraded":"2023-10-17T06:07:14.880973+0000","last_fullsized":"2023-10-17T06:07:14.880973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:25:25.772710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290420+0000","last_change":"2023-10-17T06:07:02.749481+0000","last_active":"2023-10-17T06:07:15.290420+0000","last_peered":"2023-10-17T06:07:15.290420+0000","last_clean":"2023-10-17T06:07:15.290420+0000","last_became_active":"2023-10-17T06:07:02.748983+0000","last_became_peered":"2023-10-17T06:07:02.748983+0000","last_unstale":"2023-10-17T06:07:15.290420+0000","last_undegraded":"2023-10-17T06:07:15.290420+0000","last_fullsized":"2023-10-17T06:07:15.290420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:52.302673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292851+0000","last_change":"2023-10-17T06:07:08.590018+0000","last_active":"2023-10-17T06:07:15.292851+0000","last_peered":"2023-10-17T06:07:15.292851+0000","last_clean":"2023-10-17T06:07:15.292851+0000","last_became_active":"2023-10-17T06:07:08.589795+0000","last_became_peered":"2023-10-17T06:07:08.589795+0000","last_unstale":"2023-10-17T06:07:15.292851+0000","last_undegraded":"2023-10-17T06:07:15.292851+0000","last_fullsized":"2023-10-17T06:07:15.292851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:36:10.482323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.288777+0000","last_change":"2023-10-17T06:07:13.896667+0000","last_active":"2023-10-17T06:07:15.288777+0000","last_peered":"2023-10-17T06:07:15.288777+0000","last_clean":"2023-10-17T06:07:15.288777+0000","last_became_active":"2023-10-17T06:07:13.896149+0000","last_became_peered":"2023-10-17T06:07:13.896149+0000","last_unstale":"2023-10-17T06:07:15.288777+0000","last_undegraded":"2023-10-17T06:07:15.288777+0000","last_fullsized":"2023-10-17T06:07:15.288777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:11:10.074323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289308+0000","last_change":"2023-10-17T06:07:09.822567+0000","last_active":"2023-10-17T06:07:15.289308+0000","last_peered":"2023-10-17T06:07:15.289308+0000","last_clean":"2023-10-17T06:07:15.289308+0000","last_became_active":"2023-10-17T06:07:09.822127+0000","last_became_peered":"2023-10-17T06:07:09.822127+0000","last_unstale":"2023-10-17T06:07:15.289308+0000","last_undegraded":"2023-10-17T06:07:15.289308+0000","last_fullsized":"2023-10-17T06:07:15.289308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:34:10.878608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292896+0000","last_change":"2023-10-17T06:07:02.746809+0000","last_active":"2023-10-17T06:07:15.292896+0000","last_peered":"2023-10-17T06:07:15.292896+0000","last_clean":"2023-10-17T06:07:15.292896+0000","last_became_active":"2023-10-17T06:07:02.746404+0000","last_became_peered":"2023-10-17T06:07:02.746404+0000","last_unstale":"2023-10-17T06:07:15.292896+0000","last_undegraded":"2023-10-17T06:07:15.292896+0000","last_fullsized":"2023-10-17T06:07:15.292896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:31.812798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291815+0000","last_change":"2023-10-17T06:07:08.592911+0000","last_active":"2023-10-17T06:07:15.291815+0000","last_peered":"2023-10-17T06:07:15.291815+0000","last_clean":"2023-10-17T06:07:15.291815+0000","last_became_active":"2023-10-17T06:07:08.592015+0000","last_became_peered":"2023-10-17T06:07:08.592015+0000","last_unstale":"2023-10-17T06:07:15.291815+0000","last_undegraded":"2023-10-17T06:07:15.291815+0000","last_fullsized":"2023-10-17T06:07:15.291815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:47:30.276476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880688+0000","last_change":"2023-10-17T06:07:13.886563+0000","last_active":"2023-10-17T06:07:14.880688+0000","last_peered":"2023-10-17T06:07:14.880688+0000","last_clean":"2023-10-17T06:07:14.880688+0000","last_became_active":"2023-10-17T06:07:13.885937+0000","last_became_peered":"2023-10-17T06:07:13.885937+0000","last_unstale":"2023-10-17T06:07:14.880688+0000","last_undegraded":"2023-10-17T06:07:14.880688+0000","last_fullsized":"2023-10-17T06:07:14.880688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:16:52.713610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292036+0000","last_change":"2023-10-17T06:07:09.828851+0000","last_active":"2023-10-17T06:07:15.292036+0000","last_peered":"2023-10-17T06:07:15.292036+0000","last_clean":"2023-10-17T06:07:15.292036+0000","last_became_active":"2023-10-17T06:07:09.828580+0000","last_became_peered":"2023-10-17T06:07:09.828580+0000","last_unstale":"2023-10-17T06:07:15.292036+0000","last_undegraded":"2023-10-17T06:07:15.292036+0000","last_fullsized":"2023-10-17T06:07:15.292036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:37:45.060322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878005+0000","last_change":"2023-10-17T06:07:02.943274+0000","last_active":"2023-10-17T06:07:14.878005+0000","last_peered":"2023-10-17T06:07:14.878005+0000","last_clean":"2023-10-17T06:07:14.878005+0000","last_became_active":"2023-10-17T06:07:02.942674+0000","last_became_peered":"2023-10-17T06:07:02.942674+0000","last_unstale":"2023-10-17T06:07:14.878005+0000","last_undegraded":"2023-10-17T06:07:14.878005+0000","last_fullsized":"2023-10-17T06:07:14.878005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:15:10.401039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291849+0000","last_change":"2023-10-17T06:07:08.589251+0000","last_active":"2023-10-17T06:07:15.291849+0000","last_peered":"2023-10-17T06:07:15.291849+0000","last_clean":"2023-10-17T06:07:15.291849+0000","last_became_active":"2023-10-17T06:07:08.588935+0000","last_became_peered":"2023-10-17T06:07:08.588935+0000","last_unstale":"2023-10-17T06:07:15.291849+0000","last_undegraded":"2023-10-17T06:07:15.291849+0000","last_fullsized":"2023-10-17T06:07:15.291849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:12:42.498064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289409+0000","last_change":"2023-10-17T06:07:13.878939+0000","last_active":"2023-10-17T06:07:15.289409+0000","last_peered":"2023-10-17T06:07:15.289409+0000","last_clean":"2023-10-17T06:07:15.289409+0000","last_became_active":"2023-10-17T06:07:13.878486+0000","last_became_peered":"2023-10-17T06:07:13.878486+0000","last_unstale":"2023-10-17T06:07:15.289409+0000","last_undegraded":"2023-10-17T06:07:15.289409+0000","last_fullsized":"2023-10-17T06:07:15.289409+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:56.529454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291030+0000","last_change":"2023-10-17T06:07:09.811823+0000","last_active":"2023-10-17T06:07:15.291030+0000","last_peered":"2023-10-17T06:07:15.291030+0000","last_clean":"2023-10-17T06:07:15.291030+0000","last_became_active":"2023-10-17T06:07:09.811377+0000","last_became_peered":"2023-10-17T06:07:09.811377+0000","last_unstale":"2023-10-17T06:07:15.291030+0000","last_undegraded":"2023-10-17T06:07:15.291030+0000","last_fullsized":"2023-10-17T06:07:15.291030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:40:59.235159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292614+0000","last_change":"2023-10-17T06:07:02.943009+0000","last_active":"2023-10-17T06:07:15.292614+0000","last_peered":"2023-10-17T06:07:15.292614+0000","last_clean":"2023-10-17T06:07:15.292614+0000","last_became_active":"2023-10-17T06:07:02.942298+0000","last_became_peered":"2023-10-17T06:07:02.942298+0000","last_unstale":"2023-10-17T06:07:15.292614+0000","last_undegraded":"2023-10-17T06:07:15.292614+0000","last_fullsized":"2023-10-17T06:07:15.292614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:50:16.016660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883796+0000","last_change":"2023-10-17T06:07:08.593524+0000","last_active":"2023-10-17T06:07:14.883796+0000","last_peered":"2023-10-17T06:07:14.883796+0000","last_clean":"2023-10-17T06:07:14.883796+0000","last_became_active":"2023-10-17T06:07:08.593028+0000","last_became_peered":"2023-10-17T06:07:08.593028+0000","last_unstale":"2023-10-17T06:07:14.883796+0000","last_undegraded":"2023-10-17T06:07:14.883796+0000","last_fullsized":"2023-10-17T06:07:14.883796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:40:28.607693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291886+0000","last_change":"2023-10-17T06:07:13.894885+0000","last_active":"2023-10-17T06:07:15.291886+0000","last_peered":"2023-10-17T06:07:15.291886+0000","last_clean":"2023-10-17T06:07:15.291886+0000","last_became_active":"2023-10-17T06:07:13.894293+0000","last_became_peered":"2023-10-17T06:07:13.894293+0000","last_unstale":"2023-10-17T06:07:15.291886+0000","last_undegraded":"2023-10-17T06:07:15.291886+0000","last_fullsized":"2023-10-17T06:07:15.291886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:35.048426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291587+0000","last_change":"2023-10-17T06:07:09.821864+0000","last_active":"2023-10-17T06:07:15.291587+0000","last_peered":"2023-10-17T06:07:15.291587+0000","last_clean":"2023-10-17T06:07:15.291587+0000","last_became_active":"2023-10-17T06:07:09.821343+0000","last_became_peered":"2023-10-17T06:07:09.821343+0000","last_unstale":"2023-10-17T06:07:15.291587+0000","last_undegraded":"2023-10-17T06:07:15.291587+0000","last_fullsized":"2023-10-17T06:07:15.291587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:34:13.301999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880514+0000","last_change":"2023-10-17T06:07:08.599322+0000","last_active":"2023-10-17T06:07:14.880514+0000","last_peered":"2023-10-17T06:07:14.880514+0000","last_clean":"2023-10-17T06:07:14.880514+0000","last_became_active":"2023-10-17T06:07:08.598993+0000","last_became_peered":"2023-10-17T06:07:08.598993+0000","last_unstale":"2023-10-17T06:07:14.880514+0000","last_undegraded":"2023-10-17T06:07:14.880514+0000","last_fullsized":"2023-10-17T06:07:14.880514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:58:22.441442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883204+0000","last_change":"2023-10-17T06:07:02.747287+0000","last_active":"2023-10-17T06:07:14.883204+0000","last_peered":"2023-10-17T06:07:14.883204+0000","last_clean":"2023-10-17T06:07:14.883204+0000","last_became_active":"2023-10-17T06:07:02.746659+0000","last_became_peered":"2023-10-17T06:07:02.746659+0000","last_unstale":"2023-10-17T06:07:14.883204+0000","last_undegraded":"2023-10-17T06:07:14.883204+0000","last_fullsized":"2023-10-17T06:07:14.883204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:10:58.948743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292088+0000","last_change":"2023-10-17T06:07:13.889327+0000","last_active":"2023-10-17T06:07:15.292088+0000","last_peered":"2023-10-17T06:07:15.292088+0000","last_clean":"2023-10-17T06:07:15.292088+0000","last_became_active":"2023-10-17T06:07:13.888985+0000","last_became_peered":"2023-10-17T06:07:13.888985+0000","last_unstale":"2023-10-17T06:07:15.292088+0000","last_undegraded":"2023-10-17T06:07:15.292088+0000","last_fullsized":"2023-10-17T06:07:15.292088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:37.345075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292956+0000","last_change":"2023-10-17T06:07:09.831976+0000","last_active":"2023-10-17T06:07:15.292956+0000","last_peered":"2023-10-17T06:07:15.292956+0000","last_clean":"2023-10-17T06:07:15.292956+0000","last_became_active":"2023-10-17T06:07:09.831699+0000","last_became_peered":"2023-10-17T06:07:09.831699+0000","last_unstale":"2023-10-17T06:07:15.292956+0000","last_undegraded":"2023-10-17T06:07:15.292956+0000","last_fullsized":"2023-10-17T06:07:15.292956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:34:10.878608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290153+0000","last_change":"2023-10-17T06:07:08.590078+0000","last_active":"2023-10-17T06:07:15.290153+0000","last_peered":"2023-10-17T06:07:15.290153+0000","last_clean":"2023-10-17T06:07:15.290153+0000","last_became_active":"2023-10-17T06:07:08.589804+0000","last_became_peered":"2023-10-17T06:07:08.589804+0000","last_unstale":"2023-10-17T06:07:15.290153+0000","last_undegraded":"2023-10-17T06:07:15.290153+0000","last_fullsized":"2023-10-17T06:07:15.290153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:31:11.288698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876702+0000","last_change":"2023-10-17T06:07:02.746785+0000","last_active":"2023-10-17T06:07:14.876702+0000","last_peered":"2023-10-17T06:07:14.876702+0000","last_clean":"2023-10-17T06:07:14.876702+0000","last_became_active":"2023-10-17T06:07:02.746431+0000","last_became_peered":"2023-10-17T06:07:02.746431+0000","last_unstale":"2023-10-17T06:07:14.876702+0000","last_undegraded":"2023-10-17T06:07:14.876702+0000","last_fullsized":"2023-10-17T06:07:14.876702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:47:53.439829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877694+0000","last_change":"2023-10-17T06:07:13.894877+0000","last_active":"2023-10-17T06:07:14.877694+0000","last_peered":"2023-10-17T06:07:14.877694+0000","last_clean":"2023-10-17T06:07:14.877694+0000","last_became_active":"2023-10-17T06:07:13.894391+0000","last_became_peered":"2023-10-17T06:07:13.894391+0000","last_unstale":"2023-10-17T06:07:14.877694+0000","last_undegraded":"2023-10-17T06:07:14.877694+0000","last_fullsized":"2023-10-17T06:07:14.877694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:38:55.951805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292434+0000","last_change":"2023-10-17T06:07:09.833782+0000","last_active":"2023-10-17T06:07:15.292434+0000","last_peered":"2023-10-17T06:07:15.292434+0000","last_clean":"2023-10-17T06:07:15.292434+0000","last_became_active":"2023-10-17T06:07:09.833566+0000","last_became_peered":"2023-10-17T06:07:09.833566+0000","last_unstale":"2023-10-17T06:07:15.292434+0000","last_undegraded":"2023-10-17T06:07:15.292434+0000","last_fullsized":"2023-10-17T06:07:15.292434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:16:06.764453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290341+0000","last_change":"2023-10-17T06:07:08.594763+0000","last_active":"2023-10-17T06:07:15.290341+0000","last_peered":"2023-10-17T06:07:15.290341+0000","last_clean":"2023-10-17T06:07:15.290341+0000","last_became_active":"2023-10-17T06:07:08.594251+0000","last_became_peered":"2023-10-17T06:07:08.594251+0000","last_unstale":"2023-10-17T06:07:15.290341+0000","last_undegraded":"2023-10-17T06:07:15.290341+0000","last_fullsized":"2023-10-17T06:07:15.290341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:27:17.766731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876827+0000","last_change":"2023-10-17T06:07:02.746953+0000","last_active":"2023-10-17T06:07:14.876827+0000","last_peered":"2023-10-17T06:07:14.876827+0000","last_clean":"2023-10-17T06:07:14.876827+0000","last_became_active":"2023-10-17T06:07:02.746344+0000","last_became_peered":"2023-10-17T06:07:02.746344+0000","last_unstale":"2023-10-17T06:07:14.876827+0000","last_undegraded":"2023-10-17T06:07:14.876827+0000","last_fullsized":"2023-10-17T06:07:14.876827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:30:18.210606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883947+0000","last_change":"2023-10-17T06:07:13.893870+0000","last_active":"2023-10-17T06:07:14.883947+0000","last_peered":"2023-10-17T06:07:14.883947+0000","last_clean":"2023-10-17T06:07:14.883947+0000","last_became_active":"2023-10-17T06:07:13.893268+0000","last_became_peered":"2023-10-17T06:07:13.893268+0000","last_unstale":"2023-10-17T06:07:14.883947+0000","last_undegraded":"2023-10-17T06:07:14.883947+0000","last_fullsized":"2023-10-17T06:07:14.883947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:48:43.184952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289977+0000","last_change":"2023-10-17T06:07:09.822737+0000","last_active":"2023-10-17T06:07:15.289977+0000","last_peered":"2023-10-17T06:07:15.289977+0000","last_clean":"2023-10-17T06:07:15.289977+0000","last_became_active":"2023-10-17T06:07:09.822425+0000","last_became_peered":"2023-10-17T06:07:09.822425+0000","last_unstale":"2023-10-17T06:07:15.289977+0000","last_undegraded":"2023-10-17T06:07:15.289977+0000","last_fullsized":"2023-10-17T06:07:15.289977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:56:42.475703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291869+0000","last_change":"2023-10-17T06:07:08.593933+0000","last_active":"2023-10-17T06:07:15.291869+0000","last_peered":"2023-10-17T06:07:15.291869+0000","last_clean":"2023-10-17T06:07:15.291869+0000","last_became_active":"2023-10-17T06:07:08.593639+0000","last_became_peered":"2023-10-17T06:07:08.593639+0000","last_unstale":"2023-10-17T06:07:15.291869+0000","last_undegraded":"2023-10-17T06:07:15.291869+0000","last_fullsized":"2023-10-17T06:07:15.291869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:54:25.029489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883311+0000","last_change":"2023-10-17T06:07:02.747957+0000","last_active":"2023-10-17T06:07:14.883311+0000","last_peered":"2023-10-17T06:07:14.883311+0000","last_clean":"2023-10-17T06:07:14.883311+0000","last_became_active":"2023-10-17T06:07:02.747569+0000","last_became_peered":"2023-10-17T06:07:02.747569+0000","last_unstale":"2023-10-17T06:07:14.883311+0000","last_undegraded":"2023-10-17T06:07:14.883311+0000","last_fullsized":"2023-10-17T06:07:14.883311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:34:04.031861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876594+0000","last_change":"2023-10-17T06:06:55.916050+0000","last_active":"2023-10-17T06:07:14.876594+0000","last_peered":"2023-10-17T06:07:14.876594+0000","last_clean":"2023-10-17T06:07:14.876594+0000","last_became_active":"2023-10-17T06:06:55.914009+0000","last_became_peered":"2023-10-17T06:06:55.914009+0000","last_unstale":"2023-10-17T06:07:14.876594+0000","last_undegraded":"2023-10-17T06:07:14.876594+0000","last_fullsized":"2023-10-17T06:07:14.876594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:06:54.658926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:06:54.658926+0000","last_clean_scrub_stamp":"2023-10-17T06:06:54.658926+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:14:50.752002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877158+0000","last_change":"2023-10-17T06:07:13.894679+0000","last_active":"2023-10-17T06:07:14.877158+0000","last_peered":"2023-10-17T06:07:14.877158+0000","last_clean":"2023-10-17T06:07:14.877158+0000","last_became_active":"2023-10-17T06:07:13.894264+0000","last_became_peered":"2023-10-17T06:07:13.894264+0000","last_unstale":"2023-10-17T06:07:14.877158+0000","last_undegraded":"2023-10-17T06:07:14.877158+0000","last_fullsized":"2023-10-17T06:07:14.877158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:59:46.899748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292942+0000","last_change":"2023-10-17T06:07:09.820803+0000","last_active":"2023-10-17T06:07:15.292942+0000","last_peered":"2023-10-17T06:07:15.292942+0000","last_clean":"2023-10-17T06:07:15.292942+0000","last_became_active":"2023-10-17T06:07:09.820566+0000","last_became_peered":"2023-10-17T06:07:09.820566+0000","last_unstale":"2023-10-17T06:07:15.292942+0000","last_undegraded":"2023-10-17T06:07:15.292942+0000","last_fullsized":"2023-10-17T06:07:15.292942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:40:00.062457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289860+0000","last_change":"2023-10-17T06:07:08.589080+0000","last_active":"2023-10-17T06:07:15.289860+0000","last_peered":"2023-10-17T06:07:15.289860+0000","last_clean":"2023-10-17T06:07:15.289860+0000","last_became_active":"2023-10-17T06:07:08.588709+0000","last_became_peered":"2023-10-17T06:07:08.588709+0000","last_unstale":"2023-10-17T06:07:15.289860+0000","last_undegraded":"2023-10-17T06:07:15.289860+0000","last_fullsized":"2023-10-17T06:07:15.289860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:53:36.421259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879485+0000","last_change":"2023-10-17T06:07:13.886705+0000","last_active":"2023-10-17T06:07:14.879485+0000","last_peered":"2023-10-17T06:07:14.879485+0000","last_clean":"2023-10-17T06:07:14.879485+0000","last_became_active":"2023-10-17T06:07:13.883384+0000","last_became_peered":"2023-10-17T06:07:13.883384+0000","last_unstale":"2023-10-17T06:07:14.879485+0000","last_undegraded":"2023-10-17T06:07:14.879485+0000","last_fullsized":"2023-10-17T06:07:14.879485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:52:08.295905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879605+0000","last_change":"2023-10-17T06:07:09.829835+0000","last_active":"2023-10-17T06:07:14.879605+0000","last_peered":"2023-10-17T06:07:14.879605+0000","last_clean":"2023-10-17T06:07:14.879605+0000","last_became_active":"2023-10-17T06:07:09.829477+0000","last_became_peered":"2023-10-17T06:07:09.829477+0000","last_unstale":"2023-10-17T06:07:14.879605+0000","last_undegraded":"2023-10-17T06:07:14.879605+0000","last_fullsized":"2023-10-17T06:07:14.879605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:54:26.203860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880973+0000","last_change":"2023-10-17T06:07:08.598286+0000","last_active":"2023-10-17T06:07:14.880973+0000","last_peered":"2023-10-17T06:07:14.880973+0000","last_clean":"2023-10-17T06:07:14.880973+0000","last_became_active":"2023-10-17T06:07:08.596247+0000","last_became_peered":"2023-10-17T06:07:08.596247+0000","last_unstale":"2023-10-17T06:07:14.880973+0000","last_undegraded":"2023-10-17T06:07:14.880973+0000","last_fullsized":"2023-10-17T06:07:14.880973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:17.909670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883786+0000","last_change":"2023-10-17T06:07:13.881124+0000","last_active":"2023-10-17T06:07:14.883786+0000","last_peered":"2023-10-17T06:07:14.883786+0000","last_clean":"2023-10-17T06:07:14.883786+0000","last_became_active":"2023-10-17T06:07:13.880566+0000","last_became_peered":"2023-10-17T06:07:13.880566+0000","last_unstale":"2023-10-17T06:07:14.883786+0000","last_undegraded":"2023-10-17T06:07:14.883786+0000","last_fullsized":"2023-10-17T06:07:14.883786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:40:21.126507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879496+0000","last_change":"2023-10-17T06:07:09.813992+0000","last_active":"2023-10-17T06:07:14.879496+0000","last_peered":"2023-10-17T06:07:14.879496+0000","last_clean":"2023-10-17T06:07:14.879496+0000","last_became_active":"2023-10-17T06:07:09.813694+0000","last_became_peered":"2023-10-17T06:07:09.813694+0000","last_unstale":"2023-10-17T06:07:14.879496+0000","last_undegraded":"2023-10-17T06:07:14.879496+0000","last_fullsized":"2023-10-17T06:07:14.879496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:47:35.627253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290037+0000","last_change":"2023-10-17T06:07:08.596976+0000","last_active":"2023-10-17T06:07:15.290037+0000","last_peered":"2023-10-17T06:07:15.290037+0000","last_clean":"2023-10-17T06:07:15.290037+0000","last_became_active":"2023-10-17T06:07:08.596039+0000","last_became_peered":"2023-10-17T06:07:08.596039+0000","last_unstale":"2023-10-17T06:07:15.290037+0000","last_undegraded":"2023-10-17T06:07:15.290037+0000","last_fullsized":"2023-10-17T06:07:15.290037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:38:51.815549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292604+0000","last_change":"2023-10-17T06:07:13.903277+0000","last_active":"2023-10-17T06:07:15.292604+0000","last_peered":"2023-10-17T06:07:15.292604+0000","last_clean":"2023-10-17T06:07:15.292604+0000","last_became_active":"2023-10-17T06:07:13.902862+0000","last_became_peered":"2023-10-17T06:07:13.902862+0000","last_unstale":"2023-10-17T06:07:15.292604+0000","last_undegraded":"2023-10-17T06:07:15.292604+0000","last_fullsized":"2023-10-17T06:07:15.292604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:10:38.378978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878801+0000","last_change":"2023-10-17T06:07:09.810979+0000","last_active":"2023-10-17T06:07:14.878801+0000","last_peered":"2023-10-17T06:07:14.878801+0000","last_clean":"2023-10-17T06:07:14.878801+0000","last_became_active":"2023-10-17T06:07:09.810707+0000","last_became_peered":"2023-10-17T06:07:09.810707+0000","last_unstale":"2023-10-17T06:07:14.878801+0000","last_undegraded":"2023-10-17T06:07:14.878801+0000","last_fullsized":"2023-10-17T06:07:14.878801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:27:20.376471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290069+0000","last_change":"2023-10-17T06:07:08.597403+0000","last_active":"2023-10-17T06:07:15.290069+0000","last_peered":"2023-10-17T06:07:15.290069+0000","last_clean":"2023-10-17T06:07:15.290069+0000","last_became_active":"2023-10-17T06:07:08.597116+0000","last_became_peered":"2023-10-17T06:07:08.597116+0000","last_unstale":"2023-10-17T06:07:15.290069+0000","last_undegraded":"2023-10-17T06:07:15.290069+0000","last_fullsized":"2023-10-17T06:07:15.290069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:47:26.508182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877174+0000","last_change":"2023-10-17T06:07:13.886903+0000","last_active":"2023-10-17T06:07:14.877174+0000","last_peered":"2023-10-17T06:07:14.877174+0000","last_clean":"2023-10-17T06:07:14.877174+0000","last_became_active":"2023-10-17T06:07:13.886501+0000","last_became_peered":"2023-10-17T06:07:13.886501+0000","last_unstale":"2023-10-17T06:07:14.877174+0000","last_undegraded":"2023-10-17T06:07:14.877174+0000","last_fullsized":"2023-10-17T06:07:14.877174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:31:21.259203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291890+0000","last_change":"2023-10-17T06:07:09.832883+0000","last_active":"2023-10-17T06:07:15.291890+0000","last_peered":"2023-10-17T06:07:15.291890+0000","last_clean":"2023-10-17T06:07:15.291890+0000","last_became_active":"2023-10-17T06:07:09.832553+0000","last_became_peered":"2023-10-17T06:07:09.832553+0000","last_unstale":"2023-10-17T06:07:15.291890+0000","last_undegraded":"2023-10-17T06:07:15.291890+0000","last_fullsized":"2023-10-17T06:07:15.291890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:55:00.304360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883483+0000","last_change":"2023-10-17T06:07:08.593403+0000","last_active":"2023-10-17T06:07:14.883483+0000","last_peered":"2023-10-17T06:07:14.883483+0000","last_clean":"2023-10-17T06:07:14.883483+0000","last_became_active":"2023-10-17T06:07:08.593066+0000","last_became_peered":"2023-10-17T06:07:08.593066+0000","last_unstale":"2023-10-17T06:07:14.883483+0000","last_undegraded":"2023-10-17T06:07:14.883483+0000","last_fullsized":"2023-10-17T06:07:14.883483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:30.456365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877086+0000","last_change":"2023-10-17T06:07:13.884346+0000","last_active":"2023-10-17T06:07:14.877086+0000","last_peered":"2023-10-17T06:07:14.877086+0000","last_clean":"2023-10-17T06:07:14.877086+0000","last_became_active":"2023-10-17T06:07:13.883456+0000","last_became_peered":"2023-10-17T06:07:13.883456+0000","last_unstale":"2023-10-17T06:07:14.877086+0000","last_undegraded":"2023-10-17T06:07:14.877086+0000","last_fullsized":"2023-10-17T06:07:14.877086+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:21:45.506386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289623+0000","last_change":"2023-10-17T06:07:09.830493+0000","last_active":"2023-10-17T06:07:15.289623+0000","last_peered":"2023-10-17T06:07:15.289623+0000","last_clean":"2023-10-17T06:07:15.289623+0000","last_became_active":"2023-10-17T06:07:09.830215+0000","last_became_peered":"2023-10-17T06:07:09.830215+0000","last_unstale":"2023-10-17T06:07:15.289623+0000","last_undegraded":"2023-10-17T06:07:15.289623+0000","last_fullsized":"2023-10-17T06:07:15.289623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:16:55.493821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877695+0000","last_change":"2023-10-17T06:07:08.591482+0000","last_active":"2023-10-17T06:07:14.877695+0000","last_peered":"2023-10-17T06:07:14.877695+0000","last_clean":"2023-10-17T06:07:14.877695+0000","last_became_active":"2023-10-17T06:07:08.591091+0000","last_became_peered":"2023-10-17T06:07:08.591091+0000","last_unstale":"2023-10-17T06:07:14.877695+0000","last_undegraded":"2023-10-17T06:07:14.877695+0000","last_fullsized":"2023-10-17T06:07:14.877695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:37:06.939408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876853+0000","last_change":"2023-10-17T06:07:13.888286+0000","last_active":"2023-10-17T06:07:14.876853+0000","last_peered":"2023-10-17T06:07:14.876853+0000","last_clean":"2023-10-17T06:07:14.876853+0000","last_became_active":"2023-10-17T06:07:13.887859+0000","last_became_peered":"2023-10-17T06:07:13.887859+0000","last_unstale":"2023-10-17T06:07:14.876853+0000","last_undegraded":"2023-10-17T06:07:14.876853+0000","last_fullsized":"2023-10-17T06:07:14.876853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:16:48.285650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880831+0000","last_change":"2023-10-17T06:07:09.817272+0000","last_active":"2023-10-17T06:07:14.880831+0000","last_peered":"2023-10-17T06:07:14.880831+0000","last_clean":"2023-10-17T06:07:14.880831+0000","last_became_active":"2023-10-17T06:07:09.817017+0000","last_became_peered":"2023-10-17T06:07:09.817017+0000","last_unstale":"2023-10-17T06:07:14.880831+0000","last_undegraded":"2023-10-17T06:07:14.880831+0000","last_fullsized":"2023-10-17T06:07:14.880831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:30:38.008679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877583+0000","last_change":"2023-10-17T06:07:08.595069+0000","last_active":"2023-10-17T06:07:14.877583+0000","last_peered":"2023-10-17T06:07:14.877583+0000","last_clean":"2023-10-17T06:07:14.877583+0000","last_became_active":"2023-10-17T06:07:08.594724+0000","last_became_peered":"2023-10-17T06:07:08.594724+0000","last_unstale":"2023-10-17T06:07:14.877583+0000","last_undegraded":"2023-10-17T06:07:14.877583+0000","last_fullsized":"2023-10-17T06:07:14.877583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:30:12.591601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876486+0000","last_change":"2023-10-17T06:07:13.900939+0000","last_active":"2023-10-17T06:07:14.876486+0000","last_peered":"2023-10-17T06:07:14.876486+0000","last_clean":"2023-10-17T06:07:14.876486+0000","last_became_active":"2023-10-17T06:07:13.900504+0000","last_became_peered":"2023-10-17T06:07:13.900504+0000","last_unstale":"2023-10-17T06:07:14.876486+0000","last_undegraded":"2023-10-17T06:07:14.876486+0000","last_fullsized":"2023-10-17T06:07:14.876486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:57:24.016963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.882704+0000","last_change":"2023-10-17T06:07:09.811667+0000","last_active":"2023-10-17T06:07:14.882704+0000","last_peered":"2023-10-17T06:07:14.882704+0000","last_clean":"2023-10-17T06:07:14.882704+0000","last_became_active":"2023-10-17T06:07:09.811321+0000","last_became_peered":"2023-10-17T06:07:09.811321+0000","last_unstale":"2023-10-17T06:07:14.882704+0000","last_undegraded":"2023-10-17T06:07:14.882704+0000","last_fullsized":"2023-10-17T06:07:14.882704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:10:34.100144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877826+0000","last_change":"2023-10-17T06:07:08.591244+0000","last_active":"2023-10-17T06:07:14.877826+0000","last_peered":"2023-10-17T06:07:14.877826+0000","last_clean":"2023-10-17T06:07:14.877826+0000","last_became_active":"2023-10-17T06:07:08.591000+0000","last_became_peered":"2023-10-17T06:07:08.591000+0000","last_unstale":"2023-10-17T06:07:14.877826+0000","last_undegraded":"2023-10-17T06:07:14.877826+0000","last_fullsized":"2023-10-17T06:07:14.877826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:35:22.580242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876460+0000","last_change":"2023-10-17T06:07:13.885860+0000","last_active":"2023-10-17T06:07:14.876460+0000","last_peered":"2023-10-17T06:07:14.876460+0000","last_clean":"2023-10-17T06:07:14.876460+0000","last_became_active":"2023-10-17T06:07:13.885432+0000","last_became_peered":"2023-10-17T06:07:13.885432+0000","last_unstale":"2023-10-17T06:07:14.876460+0000","last_undegraded":"2023-10-17T06:07:14.876460+0000","last_fullsized":"2023-10-17T06:07:14.876460+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:37.345075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883253+0000","last_change":"2023-10-17T06:07:13.890018+0000","last_active":"2023-10-17T06:07:14.883253+0000","last_peered":"2023-10-17T06:07:14.883253+0000","last_clean":"2023-10-17T06:07:14.883253+0000","last_became_active":"2023-10-17T06:07:13.889612+0000","last_became_peered":"2023-10-17T06:07:13.889612+0000","last_unstale":"2023-10-17T06:07:14.883253+0000","last_undegraded":"2023-10-17T06:07:14.883253+0000","last_fullsized":"2023-10-17T06:07:14.883253+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:42.938379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289398+0000","last_change":"2023-10-17T06:07:08.591493+0000","last_active":"2023-10-17T06:07:15.289398+0000","last_peered":"2023-10-17T06:07:15.289398+0000","last_clean":"2023-10-17T06:07:15.289398+0000","last_became_active":"2023-10-17T06:07:08.591098+0000","last_became_peered":"2023-10-17T06:07:08.591098+0000","last_unstale":"2023-10-17T06:07:15.289398+0000","last_undegraded":"2023-10-17T06:07:15.289398+0000","last_fullsized":"2023-10-17T06:07:15.289398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:30:33.950741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291656+0000","last_change":"2023-10-17T06:07:09.822777+0000","last_active":"2023-10-17T06:07:15.291656+0000","last_peered":"2023-10-17T06:07:15.291656+0000","last_clean":"2023-10-17T06:07:15.291656+0000","last_became_active":"2023-10-17T06:07:09.822160+0000","last_became_peered":"2023-10-17T06:07:09.822160+0000","last_unstale":"2023-10-17T06:07:15.291656+0000","last_undegraded":"2023-10-17T06:07:15.291656+0000","last_fullsized":"2023-10-17T06:07:15.291656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:36:13.053365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291408+0000","last_change":"2023-10-17T06:07:13.895666+0000","last_active":"2023-10-17T06:07:15.291408+0000","last_peered":"2023-10-17T06:07:15.291408+0000","last_clean":"2023-10-17T06:07:15.291408+0000","last_became_active":"2023-10-17T06:07:13.895322+0000","last_became_peered":"2023-10-17T06:07:13.895322+0000","last_unstale":"2023-10-17T06:07:15.291408+0000","last_undegraded":"2023-10-17T06:07:15.291408+0000","last_fullsized":"2023-10-17T06:07:15.291408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:49:57.036218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876863+0000","last_change":"2023-10-17T06:07:08.589887+0000","last_active":"2023-10-17T06:07:14.876863+0000","last_peered":"2023-10-17T06:07:14.876863+0000","last_clean":"2023-10-17T06:07:14.876863+0000","last_became_active":"2023-10-17T06:07:08.589511+0000","last_became_peered":"2023-10-17T06:07:08.589511+0000","last_unstale":"2023-10-17T06:07:14.876863+0000","last_undegraded":"2023-10-17T06:07:14.876863+0000","last_fullsized":"2023-10-17T06:07:14.876863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:16:05.759169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292842+0000","last_change":"2023-10-17T06:07:09.818359+0000","last_active":"2023-10-17T06:07:15.292842+0000","last_peered":"2023-10-17T06:07:15.292842+0000","last_clean":"2023-10-17T06:07:15.292842+0000","last_became_active":"2023-10-17T06:07:09.818092+0000","last_became_peered":"2023-10-17T06:07:09.818092+0000","last_unstale":"2023-10-17T06:07:15.292842+0000","last_undegraded":"2023-10-17T06:07:15.292842+0000","last_fullsized":"2023-10-17T06:07:15.292842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:59:42.620914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291756+0000","last_change":"2023-10-17T06:07:08.585166+0000","last_active":"2023-10-17T06:07:15.291756+0000","last_peered":"2023-10-17T06:07:15.291756+0000","last_clean":"2023-10-17T06:07:15.291756+0000","last_became_active":"2023-10-17T06:07:08.583972+0000","last_became_peered":"2023-10-17T06:07:08.583972+0000","last_unstale":"2023-10-17T06:07:15.291756+0000","last_undegraded":"2023-10-17T06:07:15.291756+0000","last_fullsized":"2023-10-17T06:07:15.291756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:02:40.893599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883659+0000","last_change":"2023-10-17T06:07:09.816356+0000","last_active":"2023-10-17T06:07:14.883659+0000","last_peered":"2023-10-17T06:07:14.883659+0000","last_clean":"2023-10-17T06:07:14.883659+0000","last_became_active":"2023-10-17T06:07:09.816066+0000","last_became_peered":"2023-10-17T06:07:09.816066+0000","last_unstale":"2023-10-17T06:07:14.883659+0000","last_undegraded":"2023-10-17T06:07:14.883659+0000","last_fullsized":"2023-10-17T06:07:14.883659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:40:06.008865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290633+0000","last_change":"2023-10-17T06:07:13.885847+0000","last_active":"2023-10-17T06:07:15.290633+0000","last_peered":"2023-10-17T06:07:15.290633+0000","last_clean":"2023-10-17T06:07:15.290633+0000","last_became_active":"2023-10-17T06:07:13.883713+0000","last_became_peered":"2023-10-17T06:07:13.883713+0000","last_unstale":"2023-10-17T06:07:15.290633+0000","last_undegraded":"2023-10-17T06:07:15.290633+0000","last_fullsized":"2023-10-17T06:07:15.290633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:40:10.287699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876962+0000","last_change":"2023-10-17T06:07:08.590802+0000","last_active":"2023-10-17T06:07:14.876962+0000","last_peered":"2023-10-17T06:07:14.876962+0000","last_clean":"2023-10-17T06:07:14.876962+0000","last_became_active":"2023-10-17T06:07:08.590520+0000","last_became_peered":"2023-10-17T06:07:08.590520+0000","last_unstale":"2023-10-17T06:07:14.876962+0000","last_undegraded":"2023-10-17T06:07:14.876962+0000","last_fullsized":"2023-10-17T06:07:14.876962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:20.494951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290839+0000","last_change":"2023-10-17T06:07:09.819059+0000","last_active":"2023-10-17T06:07:15.290839+0000","last_peered":"2023-10-17T06:07:15.290839+0000","last_clean":"2023-10-17T06:07:15.290839+0000","last_became_active":"2023-10-17T06:07:09.818796+0000","last_became_peered":"2023-10-17T06:07:09.818796+0000","last_unstale":"2023-10-17T06:07:15.290839+0000","last_undegraded":"2023-10-17T06:07:15.290839+0000","last_fullsized":"2023-10-17T06:07:15.290839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:40:16.847674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883411+0000","last_change":"2023-10-17T06:07:13.891595+0000","last_active":"2023-10-17T06:07:14.883411+0000","last_peered":"2023-10-17T06:07:14.883411+0000","last_clean":"2023-10-17T06:07:14.883411+0000","last_became_active":"2023-10-17T06:07:13.891300+0000","last_became_peered":"2023-10-17T06:07:13.891300+0000","last_unstale":"2023-10-17T06:07:14.883411+0000","last_undegraded":"2023-10-17T06:07:14.883411+0000","last_fullsized":"2023-10-17T06:07:14.883411+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:39:43.311635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289114+0000","last_change":"2023-10-17T06:07:09.830559+0000","last_active":"2023-10-17T06:07:15.289114+0000","last_peered":"2023-10-17T06:07:15.289114+0000","last_clean":"2023-10-17T06:07:15.289114+0000","last_became_active":"2023-10-17T06:07:09.830247+0000","last_became_peered":"2023-10-17T06:07:09.830247+0000","last_unstale":"2023-10-17T06:07:15.289114+0000","last_undegraded":"2023-10-17T06:07:15.289114+0000","last_fullsized":"2023-10-17T06:07:15.289114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:16:06.924811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.288720+0000","last_change":"2023-10-17T06:07:09.817481+0000","last_active":"2023-10-17T06:07:15.288720+0000","last_peered":"2023-10-17T06:07:15.288720+0000","last_clean":"2023-10-17T06:07:15.288720+0000","last_became_active":"2023-10-17T06:07:09.814576+0000","last_became_peered":"2023-10-17T06:07:09.814576+0000","last_unstale":"2023-10-17T06:07:15.288720+0000","last_undegraded":"2023-10-17T06:07:15.288720+0000","last_fullsized":"2023-10-17T06:07:15.288720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:17:19.424257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878534+0000","last_change":"2023-10-17T06:07:09.820385+0000","last_active":"2023-10-17T06:07:14.878534+0000","last_peered":"2023-10-17T06:07:14.878534+0000","last_clean":"2023-10-17T06:07:14.878534+0000","last_became_active":"2023-10-17T06:07:09.820110+0000","last_became_peered":"2023-10-17T06:07:09.820110+0000","last_unstale":"2023-10-17T06:07:14.878534+0000","last_undegraded":"2023-10-17T06:07:14.878534+0000","last_fullsized":"2023-10-17T06:07:14.878534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:11:35.023099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289802+0000","last_change":"2023-10-17T06:07:09.822056+0000","last_active":"2023-10-17T06:07:15.289802+0000","last_peered":"2023-10-17T06:07:15.289802+0000","last_clean":"2023-10-17T06:07:15.289802+0000","last_became_active":"2023-10-17T06:07:09.821742+0000","last_became_peered":"2023-10-17T06:07:09.821742+0000","last_unstale":"2023-10-17T06:07:15.289802+0000","last_undegraded":"2023-10-17T06:07:15.289802+0000","last_fullsized":"2023-10-17T06:07:15.289802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:31.461649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292457+0000","last_change":"2023-10-17T06:07:09.837676+0000","last_active":"2023-10-17T06:07:15.292457+0000","last_peered":"2023-10-17T06:07:15.292457+0000","last_clean":"2023-10-17T06:07:15.292457+0000","last_became_active":"2023-10-17T06:07:09.837404+0000","last_became_peered":"2023-10-17T06:07:09.837404+0000","last_unstale":"2023-10-17T06:07:15.292457+0000","last_undegraded":"2023-10-17T06:07:15.292457+0000","last_fullsized":"2023-10-17T06:07:15.292457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:16:45.547751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883628+0000","last_change":"2023-10-17T06:07:09.815486+0000","last_active":"2023-10-17T06:07:14.883628+0000","last_peered":"2023-10-17T06:07:14.883628+0000","last_clean":"2023-10-17T06:07:14.883628+0000","last_became_active":"2023-10-17T06:07:09.815216+0000","last_became_peered":"2023-10-17T06:07:09.815216+0000","last_unstale":"2023-10-17T06:07:14.883628+0000","last_undegraded":"2023-10-17T06:07:14.883628+0000","last_fullsized":"2023-10-17T06:07:14.883628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:47:27.513466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292809+0000","last_change":"2023-10-17T06:07:09.832482+0000","last_active":"2023-10-17T06:07:15.292809+0000","last_peered":"2023-10-17T06:07:15.292809+0000","last_clean":"2023-10-17T06:07:15.292809+0000","last_became_active":"2023-10-17T06:07:09.829842+0000","last_became_peered":"2023-10-17T06:07:09.829842+0000","last_unstale":"2023-10-17T06:07:15.292809+0000","last_undegraded":"2023-10-17T06:07:15.292809+0000","last_fullsized":"2023-10-17T06:07:15.292809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:17:19.424257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292847+0000","last_change":"2023-10-17T06:07:09.825942+0000","last_active":"2023-10-17T06:07:15.292847+0000","last_peered":"2023-10-17T06:07:15.292847+0000","last_clean":"2023-10-17T06:07:15.292847+0000","last_became_active":"2023-10-17T06:07:09.825679+0000","last_became_peered":"2023-10-17T06:07:09.825679+0000","last_unstale":"2023-10-17T06:07:15.292847+0000","last_undegraded":"2023-10-17T06:07:15.292847+0000","last_fullsized":"2023-10-17T06:07:15.292847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:11:05.795490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876229+0000","last_change":"2023-10-17T06:07:09.823556+0000","last_active":"2023-10-17T06:07:14.876229+0000","last_peered":"2023-10-17T06:07:14.876229+0000","last_clean":"2023-10-17T06:07:14.876229+0000","last_became_active":"2023-10-17T06:07:09.823156+0000","last_became_peered":"2023-10-17T06:07:09.823156+0000","last_unstale":"2023-10-17T06:07:14.876229+0000","last_undegraded":"2023-10-17T06:07:14.876229+0000","last_fullsized":"2023-10-17T06:07:14.876229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:13:26.091146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.288516+0000","last_change":"2023-10-17T06:07:09.839598+0000","last_active":"2023-10-17T06:07:15.288516+0000","last_peered":"2023-10-17T06:07:15.288516+0000","last_clean":"2023-10-17T06:07:15.288516+0000","last_became_active":"2023-10-17T06:07:09.839335+0000","last_became_peered":"2023-10-17T06:07:09.839335+0000","last_unstale":"2023-10-17T06:07:15.288516+0000","last_undegraded":"2023-10-17T06:07:15.288516+0000","last_fullsized":"2023-10-17T06:07:15.288516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:50:22.863407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291642+0000","last_change":"2023-10-17T06:07:09.833987+0000","last_active":"2023-10-17T06:07:15.291642+0000","last_peered":"2023-10-17T06:07:15.291642+0000","last_clean":"2023-10-17T06:07:15.291642+0000","last_became_active":"2023-10-17T06:07:09.829996+0000","last_became_peered":"2023-10-17T06:07:09.829996+0000","last_unstale":"2023-10-17T06:07:15.291642+0000","last_undegraded":"2023-10-17T06:07:15.291642+0000","last_fullsized":"2023-10-17T06:07:15.291642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:02:25.494146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877356+0000","last_change":"2023-10-17T06:07:09.823715+0000","last_active":"2023-10-17T06:07:14.877356+0000","last_peered":"2023-10-17T06:07:14.877356+0000","last_clean":"2023-10-17T06:07:14.877356+0000","last_became_active":"2023-10-17T06:07:09.823129+0000","last_became_peered":"2023-10-17T06:07:09.823129+0000","last_unstale":"2023-10-17T06:07:14.877356+0000","last_undegraded":"2023-10-17T06:07:14.877356+0000","last_fullsized":"2023-10-17T06:07:14.877356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:36:11.487607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878693+0000","last_change":"2023-10-17T06:07:09.820940+0000","last_active":"2023-10-17T06:07:14.878693+0000","last_peered":"2023-10-17T06:07:14.878693+0000","last_clean":"2023-10-17T06:07:14.878693+0000","last_became_active":"2023-10-17T06:07:09.820736+0000","last_became_peered":"2023-10-17T06:07:09.820736+0000","last_unstale":"2023-10-17T06:07:14.878693+0000","last_undegraded":"2023-10-17T06:07:14.878693+0000","last_fullsized":"2023-10-17T06:07:14.878693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:23:39.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877433+0000","last_change":"2023-10-17T06:07:09.830379+0000","last_active":"2023-10-17T06:07:14.877433+0000","last_peered":"2023-10-17T06:07:14.877433+0000","last_clean":"2023-10-17T06:07:14.877433+0000","last_became_active":"2023-10-17T06:07:09.830134+0000","last_became_peered":"2023-10-17T06:07:09.830134+0000","last_unstale":"2023-10-17T06:07:14.877433+0000","last_undegraded":"2023-10-17T06:07:14.877433+0000","last_fullsized":"2023-10-17T06:07:14.877433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:37:37.680937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877600+0000","last_change":"2023-10-17T06:07:09.819191+0000","last_active":"2023-10-17T06:07:14.877600+0000","last_peered":"2023-10-17T06:07:14.877600+0000","last_clean":"2023-10-17T06:07:14.877600+0000","last_became_active":"2023-10-17T06:07:09.818894+0000","last_became_peered":"2023-10-17T06:07:09.818894+0000","last_unstale":"2023-10-17T06:07:14.877600+0000","last_undegraded":"2023-10-17T06:07:14.877600+0000","last_fullsized":"2023-10-17T06:07:14.877600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:40:29.612977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292543+0000","last_change":"2023-10-17T06:07:09.825371+0000","last_active":"2023-10-17T06:07:15.292543+0000","last_peered":"2023-10-17T06:07:15.292543+0000","last_clean":"2023-10-17T06:07:15.292543+0000","last_became_active":"2023-10-17T06:07:09.825096+0000","last_became_peered":"2023-10-17T06:07:09.825096+0000","last_unstale":"2023-10-17T06:07:15.292543+0000","last_undegraded":"2023-10-17T06:07:15.292543+0000","last_fullsized":"2023-10-17T06:07:15.292543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:30:13.596885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878194+0000","last_change":"2023-10-17T06:07:09.834663+0000","last_active":"2023-10-17T06:07:14.878194+0000","last_peered":"2023-10-17T06:07:14.878194+0000","last_clean":"2023-10-17T06:07:14.878194+0000","last_became_active":"2023-10-17T06:07:09.834468+0000","last_became_peered":"2023-10-17T06:07:09.834468+0000","last_unstale":"2023-10-17T06:07:14.878194+0000","last_undegraded":"2023-10-17T06:07:14.878194+0000","last_fullsized":"2023-10-17T06:07:14.878194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:36:13.053365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876830+0000","last_change":"2023-10-17T06:07:09.832756+0000","last_active":"2023-10-17T06:07:14.876830+0000","last_peered":"2023-10-17T06:07:14.876830+0000","last_clean":"2023-10-17T06:07:14.876830+0000","last_became_active":"2023-10-17T06:07:09.832258+0000","last_became_peered":"2023-10-17T06:07:09.832258+0000","last_unstale":"2023-10-17T06:07:14.876830+0000","last_undegraded":"2023-10-17T06:07:14.876830+0000","last_fullsized":"2023-10-17T06:07:14.876830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:19:22.830429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883010+0000","last_change":"2023-10-17T06:07:09.820030+0000","last_active":"2023-10-17T06:07:14.883010+0000","last_peered":"2023-10-17T06:07:14.883010+0000","last_clean":"2023-10-17T06:07:14.883010+0000","last_became_active":"2023-10-17T06:07:09.819756+0000","last_became_peered":"2023-10-17T06:07:09.819756+0000","last_unstale":"2023-10-17T06:07:14.883010+0000","last_undegraded":"2023-10-17T06:07:14.883010+0000","last_fullsized":"2023-10-17T06:07:14.883010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:50:22.863407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877122+0000","last_change":"2023-10-17T06:07:09.826587+0000","last_active":"2023-10-17T06:07:14.877122+0000","last_peered":"2023-10-17T06:07:14.877122+0000","last_clean":"2023-10-17T06:07:14.877122+0000","last_became_active":"2023-10-17T06:07:09.825860+0000","last_became_peered":"2023-10-17T06:07:09.825860+0000","last_unstale":"2023-10-17T06:07:14.877122+0000","last_undegraded":"2023-10-17T06:07:14.877122+0000","last_fullsized":"2023-10-17T06:07:14.877122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:59:29.208159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877138+0000","last_change":"2023-10-17T06:07:09.810586+0000","last_active":"2023-10-17T06:07:14.877138+0000","last_peered":"2023-10-17T06:07:14.877138+0000","last_clean":"2023-10-17T06:07:14.877138+0000","last_became_active":"2023-10-17T06:07:09.809875+0000","last_became_peered":"2023-10-17T06:07:09.809875+0000","last_unstale":"2023-10-17T06:07:14.877138+0000","last_undegraded":"2023-10-17T06:07:14.877138+0000","last_fullsized":"2023-10-17T06:07:14.877138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:20:16.424591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879359+0000","last_change":"2023-10-17T06:07:09.820690+0000","last_active":"2023-10-17T06:07:14.879359+0000","last_peered":"2023-10-17T06:07:14.879359+0000","last_clean":"2023-10-17T06:07:14.879359+0000","last_became_active":"2023-10-17T06:07:09.820404+0000","last_became_peered":"2023-10-17T06:07:09.820404+0000","last_unstale":"2023-10-17T06:07:14.879359+0000","last_undegraded":"2023-10-17T06:07:14.879359+0000","last_fullsized":"2023-10-17T06:07:14.879359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:51:00.656359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883627+0000","last_change":"2023-10-17T06:07:09.840730+0000","last_active":"2023-10-17T06:07:14.883627+0000","last_peered":"2023-10-17T06:07:14.883627+0000","last_clean":"2023-10-17T06:07:14.883627+0000","last_became_active":"2023-10-17T06:07:09.839503+0000","last_became_peered":"2023-10-17T06:07:09.839503+0000","last_unstale":"2023-10-17T06:07:14.883627+0000","last_undegraded":"2023-10-17T06:07:14.883627+0000","last_fullsized":"2023-10-17T06:07:14.883627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:53:37.426543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292422+0000","last_change":"2023-10-17T06:07:09.833449+0000","last_active":"2023-10-17T06:07:15.292422+0000","last_peered":"2023-10-17T06:07:15.292422+0000","last_clean":"2023-10-17T06:07:15.292422+0000","last_became_active":"2023-10-17T06:07:09.833054+0000","last_became_peered":"2023-10-17T06:07:09.833054+0000","last_unstale":"2023-10-17T06:07:15.292422+0000","last_undegraded":"2023-10-17T06:07:15.292422+0000","last_fullsized":"2023-10-17T06:07:15.292422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:30:04.900751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.882634+0000","last_change":"2023-10-17T06:07:09.809269+0000","last_active":"2023-10-17T06:07:14.882634+0000","last_peered":"2023-10-17T06:07:14.882634+0000","last_clean":"2023-10-17T06:07:14.882634+0000","last_became_active":"2023-10-17T06:07:09.808823+0000","last_became_peered":"2023-10-17T06:07:09.808823+0000","last_unstale":"2023-10-17T06:07:14.882634+0000","last_undegraded":"2023-10-17T06:07:14.882634+0000","last_fullsized":"2023-10-17T06:07:14.882634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:00:19.054030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876659+0000","last_change":"2023-10-17T06:07:09.837236+0000","last_active":"2023-10-17T06:07:14.876659+0000","last_peered":"2023-10-17T06:07:14.876659+0000","last_clean":"2023-10-17T06:07:14.876659+0000","last_became_active":"2023-10-17T06:07:09.831813+0000","last_became_peered":"2023-10-17T06:07:09.831813+0000","last_unstale":"2023-10-17T06:07:14.876659+0000","last_undegraded":"2023-10-17T06:07:14.876659+0000","last_fullsized":"2023-10-17T06:07:14.876659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:30:04.900751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877874+0000","last_change":"2023-10-17T06:07:09.818210+0000","last_active":"2023-10-17T06:07:14.877874+0000","last_peered":"2023-10-17T06:07:14.877874+0000","last_clean":"2023-10-17T06:07:14.877874+0000","last_became_active":"2023-10-17T06:07:09.817925+0000","last_became_peered":"2023-10-17T06:07:09.817925+0000","last_unstale":"2023-10-17T06:07:14.877874+0000","last_undegraded":"2023-10-17T06:07:14.877874+0000","last_fullsized":"2023-10-17T06:07:14.877874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:49:52.757385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292096+0000","last_change":"2023-10-17T06:07:09.825092+0000","last_active":"2023-10-17T06:07:15.292096+0000","last_peered":"2023-10-17T06:07:15.292096+0000","last_clean":"2023-10-17T06:07:15.292096+0000","last_became_active":"2023-10-17T06:07:09.824830+0000","last_became_peered":"2023-10-17T06:07:09.824830+0000","last_unstale":"2023-10-17T06:07:15.292096+0000","last_undegraded":"2023-10-17T06:07:15.292096+0000","last_fullsized":"2023-10-17T06:07:15.292096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:13:26.091146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289991+0000","last_change":"2023-10-17T06:07:09.839421+0000","last_active":"2023-10-17T06:07:15.289991+0000","last_peered":"2023-10-17T06:07:15.289991+0000","last_clean":"2023-10-17T06:07:15.289991+0000","last_became_active":"2023-10-17T06:07:09.839171+0000","last_became_peered":"2023-10-17T06:07:09.839171+0000","last_unstale":"2023-10-17T06:07:15.289991+0000","last_undegraded":"2023-10-17T06:07:15.289991+0000","last_fullsized":"2023-10-17T06:07:15.289991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:47:47.791448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879222+0000","last_change":"2023-10-17T06:07:09.834207+0000","last_active":"2023-10-17T06:07:14.879222+0000","last_peered":"2023-10-17T06:07:14.879222+0000","last_clean":"2023-10-17T06:07:14.879222+0000","last_became_active":"2023-10-17T06:07:09.833966+0000","last_became_peered":"2023-10-17T06:07:09.833966+0000","last_unstale":"2023-10-17T06:07:14.879222+0000","last_undegraded":"2023-10-17T06:07:14.879222+0000","last_fullsized":"2023-10-17T06:07:14.879222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:54:25.125826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883402+0000","last_change":"2023-10-17T06:07:09.823776+0000","last_active":"2023-10-17T06:07:14.883402+0000","last_peered":"2023-10-17T06:07:14.883402+0000","last_clean":"2023-10-17T06:07:14.883402+0000","last_became_active":"2023-10-17T06:07:09.823394+0000","last_became_peered":"2023-10-17T06:07:09.823394+0000","last_unstale":"2023-10-17T06:07:14.883402+0000","last_undegraded":"2023-10-17T06:07:14.883402+0000","last_fullsized":"2023-10-17T06:07:14.883402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:45:39.252622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877489+0000","last_change":"2023-10-17T06:07:09.818284+0000","last_active":"2023-10-17T06:07:14.877489+0000","last_peered":"2023-10-17T06:07:14.877489+0000","last_clean":"2023-10-17T06:07:14.877489+0000","last_became_active":"2023-10-17T06:07:09.817980+0000","last_became_peered":"2023-10-17T06:07:09.817980+0000","last_unstale":"2023-10-17T06:07:14.877489+0000","last_undegraded":"2023-10-17T06:07:14.877489+0000","last_fullsized":"2023-10-17T06:07:14.877489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:42:16.038333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":122060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]}]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":122712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]}]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":125957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]}]},{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":917504,"data_stored":716485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.613}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.659}]}]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":122150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]}]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":122060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.798}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6439999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.859}]}]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":122060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6439999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":711019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-17T06:07:41.985 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-17T06:07:42.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.191+0000 7f77eeb84700 1 Processor -- start 2023-10-17T06:07:42.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.191+0000 7f77eeb84700 1 -- start start 2023-10-17T06:07:42.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.195+0000 7f77eeb84700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77e80b4310 0x7f77e80ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:42.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.195+0000 7f77eeb84700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e815e000 con 0x7f77e80cc190 2023-10-17T06:07:42.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.195+0000 7f77eeb84700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e80ce170 con 0x7f77e80cdd90 2023-10-17T06:07:42.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.195+0000 7f77eeb84700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e815d3f0 con 0x7f77e80b4310 2023-10-17T06:07:42.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.195+0000 7f77ed381700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f77e80cc190 0x7f77e80b3c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:54088/0 (socket says 172.21.15.125:54088) 2023-10-17T06:07:42.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.195+0000 7f77ed381700 1 -- 172.21.15.125:0/1646636173 learned_addr learned my addr 172.21.15.125:0/1646636173 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:42.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ee383700 1 --2- 172.21.15.125:0/1646636173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77e80b4310 0x7f77e80ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:42.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ecb80700 1 -- 172.21.15.125:0/1646636173 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803285208 0 0) 0x7f77e815e000 con 0x7f77e80cc190 2023-10-17T06:07:42.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ecb80700 1 -- 172.21.15.125:0/1646636173 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77d40035d0 con 0x7f77e80cc190 2023-10-17T06:07:42.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ecb80700 1 -- 172.21.15.125:0/1646636173 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183719209 0 0) 0x7f77e80ce170 con 0x7f77e80cdd90 2023-10-17T06:07:42.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ecb80700 1 -- 172.21.15.125:0/1646636173 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77e815e000 con 0x7f77e80cdd90 2023-10-17T06:07:42.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ecb80700 1 -- 172.21.15.125:0/1646636173 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1889488580 0 0) 0x7f77d40035d0 con 0x7f77e80cc190 2023-10-17T06:07:42.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ecb80700 1 -- 172.21.15.125:0/1646636173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77e80b4310 msgr2=0x7f77e80ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:42.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ecb80700 1 --2- 172.21.15.125:0/1646636173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77e80b4310 0x7f77e80ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:42.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ecb80700 1 -- 172.21.15.125:0/1646636173 >> v1:172.21.15.184:6789/0 conn(0x7f77e80cdd90 legacy=0x7f77e806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:42.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ecb80700 1 -- 172.21.15.125:0/1646636173 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e815d6d0 con 0x7f77e80cc190 2023-10-17T06:07:42.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ecb80700 1 -- 172.21.15.125:0/1646636173 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7f77d8001670 con 0x7f77e80cc190 2023-10-17T06:07:42.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ecb80700 1 -- 172.21.15.125:0/1646636173 >> v1:172.21.15.125:6789/0 conn(0x7f77e80cc190 legacy=0x7f77e80b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:42.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ecb80700 1 --2- 172.21.15.125:0/1646636173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77d4003be0 0x7f77d4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:42.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ecb80700 1 --2- 172.21.15.125:0/1646636173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77d4004870 0x7f77d4004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:42.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ecb80700 1 --2- 172.21.15.125:0/1646636173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77e80b4310 0x7f77d4005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:42.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ecb80700 1 -- 172.21.15.125:0/1646636173 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e815d3f0 con 0x7f77d4003be0 2023-10-17T06:07:42.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ecb80700 1 -- 172.21.15.125:0/1646636173 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d400bb10 con 0x7f77d4004870 2023-10-17T06:07:42.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ecb80700 1 -- 172.21.15.125:0/1646636173 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d400bcd0 con 0x7f77e80b4310 2023-10-17T06:07:42.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77edb82700 1 --2- 172.21.15.125:0/1646636173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77d4003be0 0x7f77d4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:42.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ee383700 1 --2- 172.21.15.125:0/1646636173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77e80b4310 0x7f77d4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:42.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ed381700 1 --2- 172.21.15.125:0/1646636173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77d4004870 0x7f77d4004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:42.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77edb82700 1 -- 172.21.15.125:0/1646636173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77e80b4310 msgr2=0x7f77d4005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:42.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77edb82700 1 --2- 172.21.15.125:0/1646636173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77e80b4310 0x7f77d4005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:42.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77edb82700 1 -- 172.21.15.125:0/1646636173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77d4004870 msgr2=0x7f77d4004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:42.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77edb82700 1 --2- 172.21.15.125:0/1646636173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77d4004870 0x7f77d4004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:42.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77edb82700 1 -- 172.21.15.125:0/1646636173 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d40035d0 con 0x7f77d4003be0 2023-10-17T06:07:42.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ed381700 1 --2- 172.21.15.125:0/1646636173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77d4004870 0x7f77d4004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:42.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77edb82700 1 --2- 172.21.15.125:0/1646636173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77d4003be0 0x7f77d4003fe0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f77e4002230 tx=0x7f77d40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e8ce9295016b85 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:42.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ecb80700 1 -- 172.21.15.125:0/1646636173 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4001f30 con 0x7f77d4003be0 2023-10-17T06:07:42.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ecb80700 1 -- 172.21.15.125:0/1646636173 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e400ce60 con 0x7f77d4003be0 2023-10-17T06:07:42.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.199+0000 7f77ecb80700 1 -- 172.21.15.125:0/1646636173 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e4003c60 con 0x7f77d4003be0 2023-10-17T06:07:42.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.203+0000 7f77eeb84700 1 -- 172.21.15.125:0/1646636173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77d4003be0 msgr2=0x7f77d4003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:42.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.203+0000 7f77eeb84700 1 --2- 172.21.15.125:0/1646636173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77d4003be0 0x7f77d4003fe0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f77e4002230 tx=0x7f77d40058a0 comp rx=0 tx=0).stop 2023-10-17T06:07:42.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.203+0000 7f77ee383700 1 -- 172.21.15.125:0/1646636173 reap_dead start 2023-10-17T06:07:42.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.203+0000 7f77eeb84700 1 -- 172.21.15.125:0/1646636173 shutdown_connections 2023-10-17T06:07:42.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.203+0000 7f77eeb84700 1 -- 172.21.15.125:0/1646636173 >> 172.21.15.125:0/1646636173 conn(0x7f77e80ce5c0 msgr2=0x7f77e80ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:42.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.203+0000 7f77eeb84700 1 -- 172.21.15.125:0/1646636173 shutdown_connections 2023-10-17T06:07:42.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.203+0000 7f77eeb84700 1 -- 172.21.15.125:0/1646636173 wait complete. 2023-10-17T06:07:42.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.203+0000 7f77eeb84700 1 Processor -- start 2023-10-17T06:07:42.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.203+0000 7f77eeb84700 1 -- start start 2023-10-17T06:07:42.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77eeb84700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77d4003be0 0x7f77e8156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:42.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77eeb84700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77e80c7450 0x7f77e806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:42.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77eeb84700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77e806d260 0x7f77e80b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:42.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77eeb84700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e8156780 con 0x7f77e806d260 2023-10-17T06:07:42.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77eeb84700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e80c6fc0 con 0x7f77e80c7450 2023-10-17T06:07:42.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77eeb84700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e806d6e0 con 0x7f77d4003be0 2023-10-17T06:07:42.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77ee383700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77e806d260 0x7f77e80b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:42.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77ee383700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77e806d260 0x7f77e80b2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48986/0 (socket says 172.21.15.125:48986) 2023-10-17T06:07:42.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77ee383700 1 -- 172.21.15.125:0/4124560578 learned_addr learned my addr 172.21.15.125:0/4124560578 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:42.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77ed381700 1 --2- 172.21.15.125:0/4124560578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77e80c7450 0x7f77e806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:42.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77edb82700 1 --2- 172.21.15.125:0/4124560578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77d4003be0 0x7f77e8156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:42.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77ee383700 1 -- 172.21.15.125:0/4124560578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77d4003be0 msgr2=0x7f77e8156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:42.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77ee383700 1 --2- 172.21.15.125:0/4124560578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77d4003be0 0x7f77e8156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:42.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77ee383700 1 -- 172.21.15.125:0/4124560578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77e80c7450 msgr2=0x7f77e806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:42.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77ee383700 1 --2- 172.21.15.125:0/4124560578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77e80c7450 0x7f77e806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:42.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77ee383700 1 -- 172.21.15.125:0/4124560578 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e80c6110 con 0x7f77e806d260 2023-10-17T06:07:42.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77ed381700 1 --2- 172.21.15.125:0/4124560578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77e80c7450 0x7f77e806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:42.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77ee383700 1 --2- 172.21.15.125:0/4124560578 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77e806d260 0x7f77e80b2350 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f77e80cf5f0 tx=0x7f77e0011b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:42.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77de7fc700 1 -- 172.21.15.125:0/4124560578 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e0004300 con 0x7f77e806d260 2023-10-17T06:07:42.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77de7fc700 1 -- 172.21.15.125:0/4124560578 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e0004460 con 0x7f77e806d260 2023-10-17T06:07:42.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77eeb84700 1 -- 172.21.15.125:0/4124560578 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e80c63b0 con 0x7f77e806d260 2023-10-17T06:07:42.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77de7fc700 1 -- 172.21.15.125:0/4124560578 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e0003900 con 0x7f77e806d260 2023-10-17T06:07:42.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.207+0000 7f77eeb84700 1 -- 172.21.15.125:0/4124560578 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e80c6970 con 0x7f77e806d260 2023-10-17T06:07:42.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.211+0000 7f77eeb84700 1 -- 172.21.15.125:0/4124560578 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e8072e60 con 0x7f77e806d260 2023-10-17T06:07:42.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.211+0000 7f77de7fc700 1 -- 172.21.15.125:0/4124560578 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f77e0003a60 con 0x7f77e806d260 2023-10-17T06:07:42.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.211+0000 7f77de7fc700 1 --2- 172.21.15.125:0/4124560578 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f77cc0656f0 0x7f77cc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:42.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.211+0000 7f77de7fc700 1 -- 172.21.15.125:0/4124560578 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f77e00832a0 con 0x7f77e806d260 2023-10-17T06:07:42.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.211+0000 7f77edb82700 1 --2- 172.21.15.125:0/4124560578 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f77cc0656f0 0x7f77cc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:42.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.215+0000 7f77edb82700 1 --2- 172.21.15.125:0/4124560578 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f77cc0656f0 0x7f77cc067bb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f77e400d010 tx=0x7f77e400a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:42.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.219+0000 7f77de7fc700 1 -- 172.21.15.125:0/4124560578 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f77e00509d0 con 0x7f77e806d260 2023-10-17T06:07:42.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.375+0000 7f77eeb84700 1 -- 172.21.15.125:0/4124560578 --> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f77e815d9b0 con 0x7f77cc0656f0 2023-10-17T06:07:42.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.391+0000 7f77de7fc700 1 -- 172.21.15.125:0/4124560578 <== mgr.4107 v2:172.21.15.125:6832/2516570548 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367149 (secure 0 0 0) 0x7f77e4022070 con 0x7f77cc0656f0 2023-10-17T06:07:42.402 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:42.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.399+0000 7f77eeb84700 1 -- 172.21.15.125:0/4124560578 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f77cc0656f0 msgr2=0x7f77cc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:42.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.399+0000 7f77eeb84700 1 --2- 172.21.15.125:0/4124560578 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f77cc0656f0 0x7f77cc067bb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f77e400d010 tx=0x7f77e400a000 comp rx=0 tx=0).stop 2023-10-17T06:07:42.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.399+0000 7f77eeb84700 1 -- 172.21.15.125:0/4124560578 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77e806d260 msgr2=0x7f77e80b2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:42.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.399+0000 7f77eeb84700 1 --2- 172.21.15.125:0/4124560578 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77e806d260 0x7f77e80b2350 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f77e80cf5f0 tx=0x7f77e0011b80 comp rx=0 tx=0).stop 2023-10-17T06:07:42.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.399+0000 7f77eeb84700 1 -- 172.21.15.125:0/4124560578 shutdown_connections 2023-10-17T06:07:42.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.399+0000 7f77eeb84700 1 --2- 172.21.15.125:0/4124560578 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f77cc0656f0 0x7f77cc067bb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:42.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.399+0000 7f77eeb84700 1 --2- 172.21.15.125:0/4124560578 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77e806d260 0x7f77e80b2350 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:42.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.399+0000 7f77eeb84700 1 --2- 172.21.15.125:0/4124560578 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77e80c7450 0x7f77e806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:42.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.399+0000 7f77eeb84700 1 --2- 172.21.15.125:0/4124560578 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f77d4003be0 0x7f77e8156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:42.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.399+0000 7f77eeb84700 1 -- 172.21.15.125:0/4124560578 >> 172.21.15.125:0/4124560578 conn(0x7f77e80ce5c0 msgr2=0x7f77e80b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:42.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.399+0000 7f77eeb84700 1 -- 172.21.15.125:0/4124560578 shutdown_connections 2023-10-17T06:07:42.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.403+0000 7f77eeb84700 1 -- 172.21.15.125:0/4124560578 wait complete. 2023-10-17T06:07:42.407 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-17T06:07:42.423 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2023-10-17T06:07:41.955601+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219680,"kb_used_data":3524,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755040,"statfs":{"total":773094113280,"available":772869160960,"internally_reserved":0,"allocated":3608576,"data_stored":2164503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005509"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290252+0000","last_change":"2023-10-17T06:07:13.901434+0000","last_active":"2023-10-17T06:07:15.290252+0000","last_peered":"2023-10-17T06:07:15.290252+0000","last_clean":"2023-10-17T06:07:15.290252+0000","last_became_active":"2023-10-17T06:07:13.901040+0000","last_became_peered":"2023-10-17T06:07:13.901040+0000","last_unstale":"2023-10-17T06:07:15.290252+0000","last_undegraded":"2023-10-17T06:07:15.290252+0000","last_fullsized":"2023-10-17T06:07:15.290252+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:36:26.363513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292800+0000","last_change":"2023-10-17T06:07:08.591346+0000","last_active":"2023-10-17T06:07:15.292800+0000","last_peered":"2023-10-17T06:07:15.292800+0000","last_clean":"2023-10-17T06:07:15.292800+0000","last_became_active":"2023-10-17T06:07:08.591043+0000","last_became_peered":"2023-10-17T06:07:08.591043+0000","last_unstale":"2023-10-17T06:07:15.292800+0000","last_undegraded":"2023-10-17T06:07:15.292800+0000","last_fullsized":"2023-10-17T06:07:15.292800+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:20.494951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879068+0000","last_change":"2023-10-17T06:07:09.836025+0000","last_active":"2023-10-17T06:07:14.879068+0000","last_peered":"2023-10-17T06:07:14.879068+0000","last_clean":"2023-10-17T06:07:14.879068+0000","last_became_active":"2023-10-17T06:07:09.835767+0000","last_became_peered":"2023-10-17T06:07:09.835767+0000","last_unstale":"2023-10-17T06:07:14.879068+0000","last_undegraded":"2023-10-17T06:07:14.879068+0000","last_fullsized":"2023-10-17T06:07:14.879068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:42:27.021964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878105+0000","last_change":"2023-10-17T06:07:13.895224+0000","last_active":"2023-10-17T06:07:14.878105+0000","last_peered":"2023-10-17T06:07:14.878105+0000","last_clean":"2023-10-17T06:07:14.878105+0000","last_became_active":"2023-10-17T06:07:13.894817+0000","last_became_peered":"2023-10-17T06:07:13.894817+0000","last_unstale":"2023-10-17T06:07:14.878105+0000","last_undegraded":"2023-10-17T06:07:14.878105+0000","last_fullsized":"2023-10-17T06:07:14.878105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:48:43.184952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290660+0000","last_change":"2023-10-17T06:07:08.593335+0000","last_active":"2023-10-17T06:07:15.290660+0000","last_peered":"2023-10-17T06:07:15.290660+0000","last_clean":"2023-10-17T06:07:15.290660+0000","last_became_active":"2023-10-17T06:07:08.592714+0000","last_became_peered":"2023-10-17T06:07:08.592714+0000","last_unstale":"2023-10-17T06:07:15.290660+0000","last_undegraded":"2023-10-17T06:07:15.290660+0000","last_fullsized":"2023-10-17T06:07:15.290660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:19:27.180864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289199+0000","last_change":"2023-10-17T06:07:09.826416+0000","last_active":"2023-10-17T06:07:15.289199+0000","last_peered":"2023-10-17T06:07:15.289199+0000","last_clean":"2023-10-17T06:07:15.289199+0000","last_became_active":"2023-10-17T06:07:09.826166+0000","last_became_peered":"2023-10-17T06:07:09.826166+0000","last_unstale":"2023-10-17T06:07:15.289199+0000","last_undegraded":"2023-10-17T06:07:15.289199+0000","last_fullsized":"2023-10-17T06:07:15.289199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:40:00.062457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883131+0000","last_change":"2023-10-17T06:07:13.882442+0000","last_active":"2023-10-17T06:07:14.883131+0000","last_peered":"2023-10-17T06:07:14.883131+0000","last_clean":"2023-10-17T06:07:14.883131+0000","last_became_active":"2023-10-17T06:07:13.882071+0000","last_became_peered":"2023-10-17T06:07:13.882071+0000","last_unstale":"2023-10-17T06:07:14.883131+0000","last_undegraded":"2023-10-17T06:07:14.883131+0000","last_fullsized":"2023-10-17T06:07:14.883131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:17:23.703090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883798+0000","last_change":"2023-10-17T06:07:08.596020+0000","last_active":"2023-10-17T06:07:14.883798+0000","last_peered":"2023-10-17T06:07:14.883798+0000","last_clean":"2023-10-17T06:07:14.883798+0000","last_became_active":"2023-10-17T06:07:08.595675+0000","last_became_peered":"2023-10-17T06:07:08.595675+0000","last_unstale":"2023-10-17T06:07:14.883798+0000","last_undegraded":"2023-10-17T06:07:14.883798+0000","last_fullsized":"2023-10-17T06:07:14.883798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:49:51.752101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878221+0000","last_change":"2023-10-17T06:07:09.810995+0000","last_active":"2023-10-17T06:07:14.878221+0000","last_peered":"2023-10-17T06:07:14.878221+0000","last_clean":"2023-10-17T06:07:14.878221+0000","last_became_active":"2023-10-17T06:07:09.810703+0000","last_became_peered":"2023-10-17T06:07:09.810703+0000","last_unstale":"2023-10-17T06:07:14.878221+0000","last_undegraded":"2023-10-17T06:07:14.878221+0000","last_fullsized":"2023-10-17T06:07:14.878221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:47:31.281761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876631+0000","last_change":"2023-10-17T06:07:13.895957+0000","last_active":"2023-10-17T06:07:14.876631+0000","last_peered":"2023-10-17T06:07:14.876631+0000","last_clean":"2023-10-17T06:07:14.876631+0000","last_became_active":"2023-10-17T06:07:13.895553+0000","last_became_peered":"2023-10-17T06:07:13.895553+0000","last_unstale":"2023-10-17T06:07:14.876631+0000","last_undegraded":"2023-10-17T06:07:14.876631+0000","last_fullsized":"2023-10-17T06:07:14.876631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:26.493795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883297+0000","last_change":"2023-10-17T06:07:08.596194+0000","last_active":"2023-10-17T06:07:14.883297+0000","last_peered":"2023-10-17T06:07:14.883297+0000","last_clean":"2023-10-17T06:07:14.883297+0000","last_became_active":"2023-10-17T06:07:08.595660+0000","last_became_peered":"2023-10-17T06:07:08.595660+0000","last_unstale":"2023-10-17T06:07:14.883297+0000","last_undegraded":"2023-10-17T06:07:14.883297+0000","last_fullsized":"2023-10-17T06:07:14.883297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:39:59.057172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880325+0000","last_change":"2023-10-17T06:07:09.807993+0000","last_active":"2023-10-17T06:07:14.880325+0000","last_peered":"2023-10-17T06:07:14.880325+0000","last_clean":"2023-10-17T06:07:14.880325+0000","last_became_active":"2023-10-17T06:07:09.807693+0000","last_became_peered":"2023-10-17T06:07:09.807693+0000","last_unstale":"2023-10-17T06:07:14.880325+0000","last_undegraded":"2023-10-17T06:07:14.880325+0000","last_fullsized":"2023-10-17T06:07:14.880325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:35:18.327855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292566+0000","last_change":"2023-10-17T06:07:13.889302+0000","last_active":"2023-10-17T06:07:15.292566+0000","last_peered":"2023-10-17T06:07:15.292566+0000","last_clean":"2023-10-17T06:07:15.292566+0000","last_became_active":"2023-10-17T06:07:13.888782+0000","last_became_peered":"2023-10-17T06:07:13.888782+0000","last_unstale":"2023-10-17T06:07:15.292566+0000","last_undegraded":"2023-10-17T06:07:15.292566+0000","last_fullsized":"2023-10-17T06:07:15.292566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:00:23.332863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292161+0000","last_change":"2023-10-17T06:07:08.594447+0000","last_active":"2023-10-17T06:07:15.292161+0000","last_peered":"2023-10-17T06:07:15.292161+0000","last_clean":"2023-10-17T06:07:15.292161+0000","last_became_active":"2023-10-17T06:07:08.594176+0000","last_became_peered":"2023-10-17T06:07:08.594176+0000","last_unstale":"2023-10-17T06:07:15.292161+0000","last_undegraded":"2023-10-17T06:07:15.292161+0000","last_fullsized":"2023-10-17T06:07:15.292161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:15:03.640415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877356+0000","last_change":"2023-10-17T06:07:09.819893+0000","last_active":"2023-10-17T06:07:14.877356+0000","last_peered":"2023-10-17T06:07:14.877356+0000","last_clean":"2023-10-17T06:07:14.877356+0000","last_became_active":"2023-10-17T06:07:09.819607+0000","last_became_peered":"2023-10-17T06:07:09.819607+0000","last_unstale":"2023-10-17T06:07:14.877356+0000","last_undegraded":"2023-10-17T06:07:14.877356+0000","last_fullsized":"2023-10-17T06:07:14.877356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:21:39.864171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878555+0000","last_change":"2023-10-17T06:07:13.880508+0000","last_active":"2023-10-17T06:07:14.878555+0000","last_peered":"2023-10-17T06:07:14.878555+0000","last_clean":"2023-10-17T06:07:14.878555+0000","last_became_active":"2023-10-17T06:07:13.879917+0000","last_became_peered":"2023-10-17T06:07:13.879917+0000","last_unstale":"2023-10-17T06:07:14.878555+0000","last_undegraded":"2023-10-17T06:07:14.878555+0000","last_fullsized":"2023-10-17T06:07:14.878555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:40:59.144753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878410+0000","last_change":"2023-10-17T06:07:08.588962+0000","last_active":"2023-10-17T06:07:14.878410+0000","last_peered":"2023-10-17T06:07:14.878410+0000","last_clean":"2023-10-17T06:07:14.878410+0000","last_became_active":"2023-10-17T06:07:08.588620+0000","last_became_peered":"2023-10-17T06:07:08.588620+0000","last_unstale":"2023-10-17T06:07:14.878410+0000","last_undegraded":"2023-10-17T06:07:14.878410+0000","last_fullsized":"2023-10-17T06:07:14.878410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:54:25.029489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291108+0000","last_change":"2023-10-17T06:07:09.828789+0000","last_active":"2023-10-17T06:07:15.291108+0000","last_peered":"2023-10-17T06:07:15.291108+0000","last_clean":"2023-10-17T06:07:15.291108+0000","last_became_active":"2023-10-17T06:07:09.828222+0000","last_became_peered":"2023-10-17T06:07:09.828222+0000","last_unstale":"2023-10-17T06:07:15.291108+0000","last_undegraded":"2023-10-17T06:07:15.291108+0000","last_fullsized":"2023-10-17T06:07:15.291108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:40:29.612977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290241+0000","last_change":"2023-10-17T06:07:13.884632+0000","last_active":"2023-10-17T06:07:15.290241+0000","last_peered":"2023-10-17T06:07:15.290241+0000","last_clean":"2023-10-17T06:07:15.290241+0000","last_became_active":"2023-10-17T06:07:13.883506+0000","last_became_peered":"2023-10-17T06:07:13.883506+0000","last_unstale":"2023-10-17T06:07:15.290241+0000","last_undegraded":"2023-10-17T06:07:15.290241+0000","last_fullsized":"2023-10-17T06:07:15.290241+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:58:02.371449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291061+0000","last_change":"2023-10-17T06:07:08.596112+0000","last_active":"2023-10-17T06:07:15.291061+0000","last_peered":"2023-10-17T06:07:15.291061+0000","last_clean":"2023-10-17T06:07:15.291061+0000","last_became_active":"2023-10-17T06:07:08.595385+0000","last_became_peered":"2023-10-17T06:07:08.595385+0000","last_unstale":"2023-10-17T06:07:15.291061+0000","last_undegraded":"2023-10-17T06:07:15.291061+0000","last_fullsized":"2023-10-17T06:07:15.291061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:25:55.002475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292431+0000","last_change":"2023-10-17T06:07:09.839412+0000","last_active":"2023-10-17T06:07:15.292431+0000","last_peered":"2023-10-17T06:07:15.292431+0000","last_clean":"2023-10-17T06:07:15.292431+0000","last_became_active":"2023-10-17T06:07:09.838904+0000","last_became_peered":"2023-10-17T06:07:09.838904+0000","last_unstale":"2023-10-17T06:07:15.292431+0000","last_undegraded":"2023-10-17T06:07:15.292431+0000","last_fullsized":"2023-10-17T06:07:15.292431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:19:22.830429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292307+0000","last_change":"2023-10-17T06:07:13.888543+0000","last_active":"2023-10-17T06:07:15.292307+0000","last_peered":"2023-10-17T06:07:15.292307+0000","last_clean":"2023-10-17T06:07:15.292307+0000","last_became_active":"2023-10-17T06:07:13.888176+0000","last_became_peered":"2023-10-17T06:07:13.888176+0000","last_unstale":"2023-10-17T06:07:15.292307+0000","last_undegraded":"2023-10-17T06:07:15.292307+0000","last_fullsized":"2023-10-17T06:07:15.292307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:26.493795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289600+0000","last_change":"2023-10-17T06:07:08.589779+0000","last_active":"2023-10-17T06:07:15.289600+0000","last_peered":"2023-10-17T06:07:15.289600+0000","last_clean":"2023-10-17T06:07:15.289600+0000","last_became_active":"2023-10-17T06:07:08.587389+0000","last_became_peered":"2023-10-17T06:07:08.587389+0000","last_unstale":"2023-10-17T06:07:15.289600+0000","last_undegraded":"2023-10-17T06:07:15.289600+0000","last_fullsized":"2023-10-17T06:07:15.289600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:45:38.247338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290377+0000","last_change":"2023-10-17T06:07:09.824706+0000","last_active":"2023-10-17T06:07:15.290377+0000","last_peered":"2023-10-17T06:07:15.290377+0000","last_clean":"2023-10-17T06:07:15.290377+0000","last_became_active":"2023-10-17T06:07:09.824384+0000","last_became_peered":"2023-10-17T06:07:09.824384+0000","last_unstale":"2023-10-17T06:07:15.290377+0000","last_undegraded":"2023-10-17T06:07:15.290377+0000","last_fullsized":"2023-10-17T06:07:15.290377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:33:14.304674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291416+0000","last_change":"2023-10-17T06:07:09.814976+0000","last_active":"2023-10-17T06:07:15.291416+0000","last_peered":"2023-10-17T06:07:15.291416+0000","last_clean":"2023-10-17T06:07:15.291416+0000","last_became_active":"2023-10-17T06:07:09.814529+0000","last_became_peered":"2023-10-17T06:07:09.814529+0000","last_unstale":"2023-10-17T06:07:15.291416+0000","last_undegraded":"2023-10-17T06:07:15.291416+0000","last_fullsized":"2023-10-17T06:07:15.291416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:48:38.906119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292919+0000","last_change":"2023-10-17T06:07:08.596874+0000","last_active":"2023-10-17T06:07:15.292919+0000","last_peered":"2023-10-17T06:07:15.292919+0000","last_clean":"2023-10-17T06:07:15.292919+0000","last_became_active":"2023-10-17T06:07:08.596349+0000","last_became_peered":"2023-10-17T06:07:08.596349+0000","last_unstale":"2023-10-17T06:07:15.292919+0000","last_undegraded":"2023-10-17T06:07:15.292919+0000","last_fullsized":"2023-10-17T06:07:15.292919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:37:33.810500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289117+0000","last_change":"2023-10-17T06:07:13.888460+0000","last_active":"2023-10-17T06:07:15.289117+0000","last_peered":"2023-10-17T06:07:15.289117+0000","last_clean":"2023-10-17T06:07:15.289117+0000","last_became_active":"2023-10-17T06:07:13.887943+0000","last_became_peered":"2023-10-17T06:07:13.887943+0000","last_unstale":"2023-10-17T06:07:15.289117+0000","last_undegraded":"2023-10-17T06:07:15.289117+0000","last_fullsized":"2023-10-17T06:07:15.289117+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:33:38.048460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.288908+0000","last_change":"2023-10-17T06:07:09.823031+0000","last_active":"2023-10-17T06:07:15.288908+0000","last_peered":"2023-10-17T06:07:15.288908+0000","last_clean":"2023-10-17T06:07:15.288908+0000","last_became_active":"2023-10-17T06:07:09.821733+0000","last_became_peered":"2023-10-17T06:07:09.821733+0000","last_unstale":"2023-10-17T06:07:15.288908+0000","last_undegraded":"2023-10-17T06:07:15.288908+0000","last_fullsized":"2023-10-17T06:07:15.288908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:38.659545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883705+0000","last_change":"2023-10-17T06:07:08.588590+0000","last_active":"2023-10-17T06:07:14.883705+0000","last_peered":"2023-10-17T06:07:14.883705+0000","last_clean":"2023-10-17T06:07:14.883705+0000","last_became_active":"2023-10-17T06:07:08.587376+0000","last_became_peered":"2023-10-17T06:07:08.587376+0000","last_unstale":"2023-10-17T06:07:14.883705+0000","last_undegraded":"2023-10-17T06:07:14.883705+0000","last_fullsized":"2023-10-17T06:07:14.883705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:19:27.180864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876041+0000","last_change":"2023-10-17T06:07:13.890283+0000","last_active":"2023-10-17T06:07:14.876041+0000","last_peered":"2023-10-17T06:07:14.876041+0000","last_clean":"2023-10-17T06:07:14.876041+0000","last_became_active":"2023-10-17T06:07:13.889919+0000","last_became_peered":"2023-10-17T06:07:13.889919+0000","last_unstale":"2023-10-17T06:07:14.876041+0000","last_undegraded":"2023-10-17T06:07:14.876041+0000","last_fullsized":"2023-10-17T06:07:14.876041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:37:49.339156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877482+0000","last_change":"2023-10-17T06:07:08.600096+0000","last_active":"2023-10-17T06:07:14.877482+0000","last_peered":"2023-10-17T06:07:14.877482+0000","last_clean":"2023-10-17T06:07:14.877482+0000","last_became_active":"2023-10-17T06:07:08.599786+0000","last_became_peered":"2023-10-17T06:07:08.599786+0000","last_unstale":"2023-10-17T06:07:14.877482+0000","last_undegraded":"2023-10-17T06:07:14.877482+0000","last_fullsized":"2023-10-17T06:07:14.877482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:37:33.810500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290765+0000","last_change":"2023-10-17T06:07:09.827852+0000","last_active":"2023-10-17T06:07:15.290765+0000","last_peered":"2023-10-17T06:07:15.290765+0000","last_clean":"2023-10-17T06:07:15.290765+0000","last_became_active":"2023-10-17T06:07:09.827571+0000","last_became_peered":"2023-10-17T06:07:09.827571+0000","last_unstale":"2023-10-17T06:07:15.290765+0000","last_undegraded":"2023-10-17T06:07:15.290765+0000","last_fullsized":"2023-10-17T06:07:15.290765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:53:34.063175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289369+0000","last_change":"2023-10-17T06:07:13.888236+0000","last_active":"2023-10-17T06:07:15.289369+0000","last_peered":"2023-10-17T06:07:15.289369+0000","last_clean":"2023-10-17T06:07:15.289369+0000","last_became_active":"2023-10-17T06:07:13.887862+0000","last_became_peered":"2023-10-17T06:07:13.887862+0000","last_unstale":"2023-10-17T06:07:15.289369+0000","last_undegraded":"2023-10-17T06:07:15.289369+0000","last_fullsized":"2023-10-17T06:07:15.289369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:39:43.311635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:26.389600+0000","last_change":"2023-10-17T06:07:08.585396+0000","last_active":"2023-10-17T06:07:26.389600+0000","last_peered":"2023-10-17T06:07:26.389600+0000","last_clean":"2023-10-17T06:07:26.389600+0000","last_became_active":"2023-10-17T06:07:08.585072+0000","last_became_peered":"2023-10-17T06:07:08.585072+0000","last_unstale":"2023-10-17T06:07:26.389600+0000","last_undegraded":"2023-10-17T06:07:26.389600+0000","last_fullsized":"2023-10-17T06:07:26.389600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:45:24.700330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880432+0000","last_change":"2023-10-17T06:07:09.821236+0000","last_active":"2023-10-17T06:07:14.880432+0000","last_peered":"2023-10-17T06:07:14.880432+0000","last_clean":"2023-10-17T06:07:14.880432+0000","last_became_active":"2023-10-17T06:07:09.820316+0000","last_became_peered":"2023-10-17T06:07:09.820316+0000","last_unstale":"2023-10-17T06:07:14.880432+0000","last_undegraded":"2023-10-17T06:07:14.880432+0000","last_fullsized":"2023-10-17T06:07:14.880432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:57:46.498866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290002+0000","last_change":"2023-10-17T06:07:13.889504+0000","last_active":"2023-10-17T06:07:15.290002+0000","last_peered":"2023-10-17T06:07:15.290002+0000","last_clean":"2023-10-17T06:07:15.290002+0000","last_became_active":"2023-10-17T06:07:13.889086+0000","last_became_peered":"2023-10-17T06:07:13.889086+0000","last_unstale":"2023-10-17T06:07:15.290002+0000","last_undegraded":"2023-10-17T06:07:15.290002+0000","last_fullsized":"2023-10-17T06:07:15.290002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:11:54.644012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880973+0000","last_change":"2023-10-17T06:07:09.808679+0000","last_active":"2023-10-17T06:07:14.880973+0000","last_peered":"2023-10-17T06:07:14.880973+0000","last_clean":"2023-10-17T06:07:14.880973+0000","last_became_active":"2023-10-17T06:07:09.808378+0000","last_became_peered":"2023-10-17T06:07:09.808378+0000","last_unstale":"2023-10-17T06:07:14.880973+0000","last_undegraded":"2023-10-17T06:07:14.880973+0000","last_fullsized":"2023-10-17T06:07:14.880973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:25:25.772710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290420+0000","last_change":"2023-10-17T06:07:02.749481+0000","last_active":"2023-10-17T06:07:15.290420+0000","last_peered":"2023-10-17T06:07:15.290420+0000","last_clean":"2023-10-17T06:07:15.290420+0000","last_became_active":"2023-10-17T06:07:02.748983+0000","last_became_peered":"2023-10-17T06:07:02.748983+0000","last_unstale":"2023-10-17T06:07:15.290420+0000","last_undegraded":"2023-10-17T06:07:15.290420+0000","last_fullsized":"2023-10-17T06:07:15.290420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:04:52.302673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292851+0000","last_change":"2023-10-17T06:07:08.590018+0000","last_active":"2023-10-17T06:07:15.292851+0000","last_peered":"2023-10-17T06:07:15.292851+0000","last_clean":"2023-10-17T06:07:15.292851+0000","last_became_active":"2023-10-17T06:07:08.589795+0000","last_became_peered":"2023-10-17T06:07:08.589795+0000","last_unstale":"2023-10-17T06:07:15.292851+0000","last_undegraded":"2023-10-17T06:07:15.292851+0000","last_fullsized":"2023-10-17T06:07:15.292851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:36:10.482323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.288777+0000","last_change":"2023-10-17T06:07:13.896667+0000","last_active":"2023-10-17T06:07:15.288777+0000","last_peered":"2023-10-17T06:07:15.288777+0000","last_clean":"2023-10-17T06:07:15.288777+0000","last_became_active":"2023-10-17T06:07:13.896149+0000","last_became_peered":"2023-10-17T06:07:13.896149+0000","last_unstale":"2023-10-17T06:07:15.288777+0000","last_undegraded":"2023-10-17T06:07:15.288777+0000","last_fullsized":"2023-10-17T06:07:15.288777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:11:10.074323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289308+0000","last_change":"2023-10-17T06:07:09.822567+0000","last_active":"2023-10-17T06:07:15.289308+0000","last_peered":"2023-10-17T06:07:15.289308+0000","last_clean":"2023-10-17T06:07:15.289308+0000","last_became_active":"2023-10-17T06:07:09.822127+0000","last_became_peered":"2023-10-17T06:07:09.822127+0000","last_unstale":"2023-10-17T06:07:15.289308+0000","last_undegraded":"2023-10-17T06:07:15.289308+0000","last_fullsized":"2023-10-17T06:07:15.289308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:34:10.878608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292896+0000","last_change":"2023-10-17T06:07:02.746809+0000","last_active":"2023-10-17T06:07:15.292896+0000","last_peered":"2023-10-17T06:07:15.292896+0000","last_clean":"2023-10-17T06:07:15.292896+0000","last_became_active":"2023-10-17T06:07:02.746404+0000","last_became_peered":"2023-10-17T06:07:02.746404+0000","last_unstale":"2023-10-17T06:07:15.292896+0000","last_undegraded":"2023-10-17T06:07:15.292896+0000","last_fullsized":"2023-10-17T06:07:15.292896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:31.812798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291815+0000","last_change":"2023-10-17T06:07:08.592911+0000","last_active":"2023-10-17T06:07:15.291815+0000","last_peered":"2023-10-17T06:07:15.291815+0000","last_clean":"2023-10-17T06:07:15.291815+0000","last_became_active":"2023-10-17T06:07:08.592015+0000","last_became_peered":"2023-10-17T06:07:08.592015+0000","last_unstale":"2023-10-17T06:07:15.291815+0000","last_undegraded":"2023-10-17T06:07:15.291815+0000","last_fullsized":"2023-10-17T06:07:15.291815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:47:30.276476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880688+0000","last_change":"2023-10-17T06:07:13.886563+0000","last_active":"2023-10-17T06:07:14.880688+0000","last_peered":"2023-10-17T06:07:14.880688+0000","last_clean":"2023-10-17T06:07:14.880688+0000","last_became_active":"2023-10-17T06:07:13.885937+0000","last_became_peered":"2023-10-17T06:07:13.885937+0000","last_unstale":"2023-10-17T06:07:14.880688+0000","last_undegraded":"2023-10-17T06:07:14.880688+0000","last_fullsized":"2023-10-17T06:07:14.880688+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:16:52.713610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292036+0000","last_change":"2023-10-17T06:07:09.828851+0000","last_active":"2023-10-17T06:07:15.292036+0000","last_peered":"2023-10-17T06:07:15.292036+0000","last_clean":"2023-10-17T06:07:15.292036+0000","last_became_active":"2023-10-17T06:07:09.828580+0000","last_became_peered":"2023-10-17T06:07:09.828580+0000","last_unstale":"2023-10-17T06:07:15.292036+0000","last_undegraded":"2023-10-17T06:07:15.292036+0000","last_fullsized":"2023-10-17T06:07:15.292036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:37:45.060322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878005+0000","last_change":"2023-10-17T06:07:02.943274+0000","last_active":"2023-10-17T06:07:14.878005+0000","last_peered":"2023-10-17T06:07:14.878005+0000","last_clean":"2023-10-17T06:07:14.878005+0000","last_became_active":"2023-10-17T06:07:02.942674+0000","last_became_peered":"2023-10-17T06:07:02.942674+0000","last_unstale":"2023-10-17T06:07:14.878005+0000","last_undegraded":"2023-10-17T06:07:14.878005+0000","last_fullsized":"2023-10-17T06:07:14.878005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:15:10.401039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291849+0000","last_change":"2023-10-17T06:07:08.589251+0000","last_active":"2023-10-17T06:07:15.291849+0000","last_peered":"2023-10-17T06:07:15.291849+0000","last_clean":"2023-10-17T06:07:15.291849+0000","last_became_active":"2023-10-17T06:07:08.588935+0000","last_became_peered":"2023-10-17T06:07:08.588935+0000","last_unstale":"2023-10-17T06:07:15.291849+0000","last_undegraded":"2023-10-17T06:07:15.291849+0000","last_fullsized":"2023-10-17T06:07:15.291849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:12:42.498064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289409+0000","last_change":"2023-10-17T06:07:13.878939+0000","last_active":"2023-10-17T06:07:15.289409+0000","last_peered":"2023-10-17T06:07:15.289409+0000","last_clean":"2023-10-17T06:07:15.289409+0000","last_became_active":"2023-10-17T06:07:13.878486+0000","last_became_peered":"2023-10-17T06:07:13.878486+0000","last_unstale":"2023-10-17T06:07:15.289409+0000","last_undegraded":"2023-10-17T06:07:15.289409+0000","last_fullsized":"2023-10-17T06:07:15.289409+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:56.529454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291030+0000","last_change":"2023-10-17T06:07:09.811823+0000","last_active":"2023-10-17T06:07:15.291030+0000","last_peered":"2023-10-17T06:07:15.291030+0000","last_clean":"2023-10-17T06:07:15.291030+0000","last_became_active":"2023-10-17T06:07:09.811377+0000","last_became_peered":"2023-10-17T06:07:09.811377+0000","last_unstale":"2023-10-17T06:07:15.291030+0000","last_undegraded":"2023-10-17T06:07:15.291030+0000","last_fullsized":"2023-10-17T06:07:15.291030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:40:59.235159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292614+0000","last_change":"2023-10-17T06:07:02.943009+0000","last_active":"2023-10-17T06:07:15.292614+0000","last_peered":"2023-10-17T06:07:15.292614+0000","last_clean":"2023-10-17T06:07:15.292614+0000","last_became_active":"2023-10-17T06:07:02.942298+0000","last_became_peered":"2023-10-17T06:07:02.942298+0000","last_unstale":"2023-10-17T06:07:15.292614+0000","last_undegraded":"2023-10-17T06:07:15.292614+0000","last_fullsized":"2023-10-17T06:07:15.292614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:50:16.016660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883796+0000","last_change":"2023-10-17T06:07:08.593524+0000","last_active":"2023-10-17T06:07:14.883796+0000","last_peered":"2023-10-17T06:07:14.883796+0000","last_clean":"2023-10-17T06:07:14.883796+0000","last_became_active":"2023-10-17T06:07:08.593028+0000","last_became_peered":"2023-10-17T06:07:08.593028+0000","last_unstale":"2023-10-17T06:07:14.883796+0000","last_undegraded":"2023-10-17T06:07:14.883796+0000","last_fullsized":"2023-10-17T06:07:14.883796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:40:28.607693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291886+0000","last_change":"2023-10-17T06:07:13.894885+0000","last_active":"2023-10-17T06:07:15.291886+0000","last_peered":"2023-10-17T06:07:15.291886+0000","last_clean":"2023-10-17T06:07:15.291886+0000","last_became_active":"2023-10-17T06:07:13.894293+0000","last_became_peered":"2023-10-17T06:07:13.894293+0000","last_unstale":"2023-10-17T06:07:15.291886+0000","last_undegraded":"2023-10-17T06:07:15.291886+0000","last_fullsized":"2023-10-17T06:07:15.291886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:42:35.048426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291587+0000","last_change":"2023-10-17T06:07:09.821864+0000","last_active":"2023-10-17T06:07:15.291587+0000","last_peered":"2023-10-17T06:07:15.291587+0000","last_clean":"2023-10-17T06:07:15.291587+0000","last_became_active":"2023-10-17T06:07:09.821343+0000","last_became_peered":"2023-10-17T06:07:09.821343+0000","last_unstale":"2023-10-17T06:07:15.291587+0000","last_undegraded":"2023-10-17T06:07:15.291587+0000","last_fullsized":"2023-10-17T06:07:15.291587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:34:13.301999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880514+0000","last_change":"2023-10-17T06:07:08.599322+0000","last_active":"2023-10-17T06:07:14.880514+0000","last_peered":"2023-10-17T06:07:14.880514+0000","last_clean":"2023-10-17T06:07:14.880514+0000","last_became_active":"2023-10-17T06:07:08.598993+0000","last_became_peered":"2023-10-17T06:07:08.598993+0000","last_unstale":"2023-10-17T06:07:14.880514+0000","last_undegraded":"2023-10-17T06:07:14.880514+0000","last_fullsized":"2023-10-17T06:07:14.880514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:58:22.441442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883204+0000","last_change":"2023-10-17T06:07:02.747287+0000","last_active":"2023-10-17T06:07:14.883204+0000","last_peered":"2023-10-17T06:07:14.883204+0000","last_clean":"2023-10-17T06:07:14.883204+0000","last_became_active":"2023-10-17T06:07:02.746659+0000","last_became_peered":"2023-10-17T06:07:02.746659+0000","last_unstale":"2023-10-17T06:07:14.883204+0000","last_undegraded":"2023-10-17T06:07:14.883204+0000","last_fullsized":"2023-10-17T06:07:14.883204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:10:58.948743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292088+0000","last_change":"2023-10-17T06:07:13.889327+0000","last_active":"2023-10-17T06:07:15.292088+0000","last_peered":"2023-10-17T06:07:15.292088+0000","last_clean":"2023-10-17T06:07:15.292088+0000","last_became_active":"2023-10-17T06:07:13.888985+0000","last_became_peered":"2023-10-17T06:07:13.888985+0000","last_unstale":"2023-10-17T06:07:15.292088+0000","last_undegraded":"2023-10-17T06:07:15.292088+0000","last_fullsized":"2023-10-17T06:07:15.292088+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:37.345075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292956+0000","last_change":"2023-10-17T06:07:09.831976+0000","last_active":"2023-10-17T06:07:15.292956+0000","last_peered":"2023-10-17T06:07:15.292956+0000","last_clean":"2023-10-17T06:07:15.292956+0000","last_became_active":"2023-10-17T06:07:09.831699+0000","last_became_peered":"2023-10-17T06:07:09.831699+0000","last_unstale":"2023-10-17T06:07:15.292956+0000","last_undegraded":"2023-10-17T06:07:15.292956+0000","last_fullsized":"2023-10-17T06:07:15.292956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:34:10.878608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290153+0000","last_change":"2023-10-17T06:07:08.590078+0000","last_active":"2023-10-17T06:07:15.290153+0000","last_peered":"2023-10-17T06:07:15.290153+0000","last_clean":"2023-10-17T06:07:15.290153+0000","last_became_active":"2023-10-17T06:07:08.589804+0000","last_became_peered":"2023-10-17T06:07:08.589804+0000","last_unstale":"2023-10-17T06:07:15.290153+0000","last_undegraded":"2023-10-17T06:07:15.290153+0000","last_fullsized":"2023-10-17T06:07:15.290153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:31:11.288698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876702+0000","last_change":"2023-10-17T06:07:02.746785+0000","last_active":"2023-10-17T06:07:14.876702+0000","last_peered":"2023-10-17T06:07:14.876702+0000","last_clean":"2023-10-17T06:07:14.876702+0000","last_became_active":"2023-10-17T06:07:02.746431+0000","last_became_peered":"2023-10-17T06:07:02.746431+0000","last_unstale":"2023-10-17T06:07:14.876702+0000","last_undegraded":"2023-10-17T06:07:14.876702+0000","last_fullsized":"2023-10-17T06:07:14.876702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:47:53.439829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877694+0000","last_change":"2023-10-17T06:07:13.894877+0000","last_active":"2023-10-17T06:07:14.877694+0000","last_peered":"2023-10-17T06:07:14.877694+0000","last_clean":"2023-10-17T06:07:14.877694+0000","last_became_active":"2023-10-17T06:07:13.894391+0000","last_became_peered":"2023-10-17T06:07:13.894391+0000","last_unstale":"2023-10-17T06:07:14.877694+0000","last_undegraded":"2023-10-17T06:07:14.877694+0000","last_fullsized":"2023-10-17T06:07:14.877694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:38:55.951805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292434+0000","last_change":"2023-10-17T06:07:09.833782+0000","last_active":"2023-10-17T06:07:15.292434+0000","last_peered":"2023-10-17T06:07:15.292434+0000","last_clean":"2023-10-17T06:07:15.292434+0000","last_became_active":"2023-10-17T06:07:09.833566+0000","last_became_peered":"2023-10-17T06:07:09.833566+0000","last_unstale":"2023-10-17T06:07:15.292434+0000","last_undegraded":"2023-10-17T06:07:15.292434+0000","last_fullsized":"2023-10-17T06:07:15.292434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:16:06.764453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290341+0000","last_change":"2023-10-17T06:07:08.594763+0000","last_active":"2023-10-17T06:07:15.290341+0000","last_peered":"2023-10-17T06:07:15.290341+0000","last_clean":"2023-10-17T06:07:15.290341+0000","last_became_active":"2023-10-17T06:07:08.594251+0000","last_became_peered":"2023-10-17T06:07:08.594251+0000","last_unstale":"2023-10-17T06:07:15.290341+0000","last_undegraded":"2023-10-17T06:07:15.290341+0000","last_fullsized":"2023-10-17T06:07:15.290341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:27:17.766731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876827+0000","last_change":"2023-10-17T06:07:02.746953+0000","last_active":"2023-10-17T06:07:14.876827+0000","last_peered":"2023-10-17T06:07:14.876827+0000","last_clean":"2023-10-17T06:07:14.876827+0000","last_became_active":"2023-10-17T06:07:02.746344+0000","last_became_peered":"2023-10-17T06:07:02.746344+0000","last_unstale":"2023-10-17T06:07:14.876827+0000","last_undegraded":"2023-10-17T06:07:14.876827+0000","last_fullsized":"2023-10-17T06:07:14.876827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:30:18.210606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883947+0000","last_change":"2023-10-17T06:07:13.893870+0000","last_active":"2023-10-17T06:07:14.883947+0000","last_peered":"2023-10-17T06:07:14.883947+0000","last_clean":"2023-10-17T06:07:14.883947+0000","last_became_active":"2023-10-17T06:07:13.893268+0000","last_became_peered":"2023-10-17T06:07:13.893268+0000","last_unstale":"2023-10-17T06:07:14.883947+0000","last_undegraded":"2023-10-17T06:07:14.883947+0000","last_fullsized":"2023-10-17T06:07:14.883947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:48:43.184952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289977+0000","last_change":"2023-10-17T06:07:09.822737+0000","last_active":"2023-10-17T06:07:15.289977+0000","last_peered":"2023-10-17T06:07:15.289977+0000","last_clean":"2023-10-17T06:07:15.289977+0000","last_became_active":"2023-10-17T06:07:09.822425+0000","last_became_peered":"2023-10-17T06:07:09.822425+0000","last_unstale":"2023-10-17T06:07:15.289977+0000","last_undegraded":"2023-10-17T06:07:15.289977+0000","last_fullsized":"2023-10-17T06:07:15.289977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:56:42.475703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291869+0000","last_change":"2023-10-17T06:07:08.593933+0000","last_active":"2023-10-17T06:07:15.291869+0000","last_peered":"2023-10-17T06:07:15.291869+0000","last_clean":"2023-10-17T06:07:15.291869+0000","last_became_active":"2023-10-17T06:07:08.593639+0000","last_became_peered":"2023-10-17T06:07:08.593639+0000","last_unstale":"2023-10-17T06:07:15.291869+0000","last_undegraded":"2023-10-17T06:07:15.291869+0000","last_fullsized":"2023-10-17T06:07:15.291869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:54:25.029489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883311+0000","last_change":"2023-10-17T06:07:02.747957+0000","last_active":"2023-10-17T06:07:14.883311+0000","last_peered":"2023-10-17T06:07:14.883311+0000","last_clean":"2023-10-17T06:07:14.883311+0000","last_became_active":"2023-10-17T06:07:02.747569+0000","last_became_peered":"2023-10-17T06:07:02.747569+0000","last_unstale":"2023-10-17T06:07:14.883311+0000","last_undegraded":"2023-10-17T06:07:14.883311+0000","last_fullsized":"2023-10-17T06:07:14.883311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:34:04.031861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876594+0000","last_change":"2023-10-17T06:06:55.916050+0000","last_active":"2023-10-17T06:07:14.876594+0000","last_peered":"2023-10-17T06:07:14.876594+0000","last_clean":"2023-10-17T06:07:14.876594+0000","last_became_active":"2023-10-17T06:06:55.914009+0000","last_became_peered":"2023-10-17T06:06:55.914009+0000","last_unstale":"2023-10-17T06:07:14.876594+0000","last_undegraded":"2023-10-17T06:07:14.876594+0000","last_fullsized":"2023-10-17T06:07:14.876594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:06:54.658926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:06:54.658926+0000","last_clean_scrub_stamp":"2023-10-17T06:06:54.658926+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:14:50.752002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877158+0000","last_change":"2023-10-17T06:07:13.894679+0000","last_active":"2023-10-17T06:07:14.877158+0000","last_peered":"2023-10-17T06:07:14.877158+0000","last_clean":"2023-10-17T06:07:14.877158+0000","last_became_active":"2023-10-17T06:07:13.894264+0000","last_became_peered":"2023-10-17T06:07:13.894264+0000","last_unstale":"2023-10-17T06:07:14.877158+0000","last_undegraded":"2023-10-17T06:07:14.877158+0000","last_fullsized":"2023-10-17T06:07:14.877158+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:59:46.899748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292942+0000","last_change":"2023-10-17T06:07:09.820803+0000","last_active":"2023-10-17T06:07:15.292942+0000","last_peered":"2023-10-17T06:07:15.292942+0000","last_clean":"2023-10-17T06:07:15.292942+0000","last_became_active":"2023-10-17T06:07:09.820566+0000","last_became_peered":"2023-10-17T06:07:09.820566+0000","last_unstale":"2023-10-17T06:07:15.292942+0000","last_undegraded":"2023-10-17T06:07:15.292942+0000","last_fullsized":"2023-10-17T06:07:15.292942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:40:00.062457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289860+0000","last_change":"2023-10-17T06:07:08.589080+0000","last_active":"2023-10-17T06:07:15.289860+0000","last_peered":"2023-10-17T06:07:15.289860+0000","last_clean":"2023-10-17T06:07:15.289860+0000","last_became_active":"2023-10-17T06:07:08.588709+0000","last_became_peered":"2023-10-17T06:07:08.588709+0000","last_unstale":"2023-10-17T06:07:15.289860+0000","last_undegraded":"2023-10-17T06:07:15.289860+0000","last_fullsized":"2023-10-17T06:07:15.289860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:53:36.421259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879485+0000","last_change":"2023-10-17T06:07:13.886705+0000","last_active":"2023-10-17T06:07:14.879485+0000","last_peered":"2023-10-17T06:07:14.879485+0000","last_clean":"2023-10-17T06:07:14.879485+0000","last_became_active":"2023-10-17T06:07:13.883384+0000","last_became_peered":"2023-10-17T06:07:13.883384+0000","last_unstale":"2023-10-17T06:07:14.879485+0000","last_undegraded":"2023-10-17T06:07:14.879485+0000","last_fullsized":"2023-10-17T06:07:14.879485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:52:08.295905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879605+0000","last_change":"2023-10-17T06:07:09.829835+0000","last_active":"2023-10-17T06:07:14.879605+0000","last_peered":"2023-10-17T06:07:14.879605+0000","last_clean":"2023-10-17T06:07:14.879605+0000","last_became_active":"2023-10-17T06:07:09.829477+0000","last_became_peered":"2023-10-17T06:07:09.829477+0000","last_unstale":"2023-10-17T06:07:14.879605+0000","last_undegraded":"2023-10-17T06:07:14.879605+0000","last_fullsized":"2023-10-17T06:07:14.879605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:54:26.203860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880973+0000","last_change":"2023-10-17T06:07:08.598286+0000","last_active":"2023-10-17T06:07:14.880973+0000","last_peered":"2023-10-17T06:07:14.880973+0000","last_clean":"2023-10-17T06:07:14.880973+0000","last_became_active":"2023-10-17T06:07:08.596247+0000","last_became_peered":"2023-10-17T06:07:08.596247+0000","last_unstale":"2023-10-17T06:07:14.880973+0000","last_undegraded":"2023-10-17T06:07:14.880973+0000","last_fullsized":"2023-10-17T06:07:14.880973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:17.909670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883786+0000","last_change":"2023-10-17T06:07:13.881124+0000","last_active":"2023-10-17T06:07:14.883786+0000","last_peered":"2023-10-17T06:07:14.883786+0000","last_clean":"2023-10-17T06:07:14.883786+0000","last_became_active":"2023-10-17T06:07:13.880566+0000","last_became_peered":"2023-10-17T06:07:13.880566+0000","last_unstale":"2023-10-17T06:07:14.883786+0000","last_undegraded":"2023-10-17T06:07:14.883786+0000","last_fullsized":"2023-10-17T06:07:14.883786+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:40:21.126507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879496+0000","last_change":"2023-10-17T06:07:09.813992+0000","last_active":"2023-10-17T06:07:14.879496+0000","last_peered":"2023-10-17T06:07:14.879496+0000","last_clean":"2023-10-17T06:07:14.879496+0000","last_became_active":"2023-10-17T06:07:09.813694+0000","last_became_peered":"2023-10-17T06:07:09.813694+0000","last_unstale":"2023-10-17T06:07:14.879496+0000","last_undegraded":"2023-10-17T06:07:14.879496+0000","last_fullsized":"2023-10-17T06:07:14.879496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:47:35.627253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290037+0000","last_change":"2023-10-17T06:07:08.596976+0000","last_active":"2023-10-17T06:07:15.290037+0000","last_peered":"2023-10-17T06:07:15.290037+0000","last_clean":"2023-10-17T06:07:15.290037+0000","last_became_active":"2023-10-17T06:07:08.596039+0000","last_became_peered":"2023-10-17T06:07:08.596039+0000","last_unstale":"2023-10-17T06:07:15.290037+0000","last_undegraded":"2023-10-17T06:07:15.290037+0000","last_fullsized":"2023-10-17T06:07:15.290037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:38:51.815549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292604+0000","last_change":"2023-10-17T06:07:13.903277+0000","last_active":"2023-10-17T06:07:15.292604+0000","last_peered":"2023-10-17T06:07:15.292604+0000","last_clean":"2023-10-17T06:07:15.292604+0000","last_became_active":"2023-10-17T06:07:13.902862+0000","last_became_peered":"2023-10-17T06:07:13.902862+0000","last_unstale":"2023-10-17T06:07:15.292604+0000","last_undegraded":"2023-10-17T06:07:15.292604+0000","last_fullsized":"2023-10-17T06:07:15.292604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:10:38.378978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878801+0000","last_change":"2023-10-17T06:07:09.810979+0000","last_active":"2023-10-17T06:07:14.878801+0000","last_peered":"2023-10-17T06:07:14.878801+0000","last_clean":"2023-10-17T06:07:14.878801+0000","last_became_active":"2023-10-17T06:07:09.810707+0000","last_became_peered":"2023-10-17T06:07:09.810707+0000","last_unstale":"2023-10-17T06:07:14.878801+0000","last_undegraded":"2023-10-17T06:07:14.878801+0000","last_fullsized":"2023-10-17T06:07:14.878801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:27:20.376471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290069+0000","last_change":"2023-10-17T06:07:08.597403+0000","last_active":"2023-10-17T06:07:15.290069+0000","last_peered":"2023-10-17T06:07:15.290069+0000","last_clean":"2023-10-17T06:07:15.290069+0000","last_became_active":"2023-10-17T06:07:08.597116+0000","last_became_peered":"2023-10-17T06:07:08.597116+0000","last_unstale":"2023-10-17T06:07:15.290069+0000","last_undegraded":"2023-10-17T06:07:15.290069+0000","last_fullsized":"2023-10-17T06:07:15.290069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:47:26.508182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877174+0000","last_change":"2023-10-17T06:07:13.886903+0000","last_active":"2023-10-17T06:07:14.877174+0000","last_peered":"2023-10-17T06:07:14.877174+0000","last_clean":"2023-10-17T06:07:14.877174+0000","last_became_active":"2023-10-17T06:07:13.886501+0000","last_became_peered":"2023-10-17T06:07:13.886501+0000","last_unstale":"2023-10-17T06:07:14.877174+0000","last_undegraded":"2023-10-17T06:07:14.877174+0000","last_fullsized":"2023-10-17T06:07:14.877174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:31:21.259203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291890+0000","last_change":"2023-10-17T06:07:09.832883+0000","last_active":"2023-10-17T06:07:15.291890+0000","last_peered":"2023-10-17T06:07:15.291890+0000","last_clean":"2023-10-17T06:07:15.291890+0000","last_became_active":"2023-10-17T06:07:09.832553+0000","last_became_peered":"2023-10-17T06:07:09.832553+0000","last_unstale":"2023-10-17T06:07:15.291890+0000","last_undegraded":"2023-10-17T06:07:15.291890+0000","last_fullsized":"2023-10-17T06:07:15.291890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:55:00.304360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883483+0000","last_change":"2023-10-17T06:07:08.593403+0000","last_active":"2023-10-17T06:07:14.883483+0000","last_peered":"2023-10-17T06:07:14.883483+0000","last_clean":"2023-10-17T06:07:14.883483+0000","last_became_active":"2023-10-17T06:07:08.593066+0000","last_became_peered":"2023-10-17T06:07:08.593066+0000","last_unstale":"2023-10-17T06:07:14.883483+0000","last_undegraded":"2023-10-17T06:07:14.883483+0000","last_fullsized":"2023-10-17T06:07:14.883483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:30.456365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877086+0000","last_change":"2023-10-17T06:07:13.884346+0000","last_active":"2023-10-17T06:07:14.877086+0000","last_peered":"2023-10-17T06:07:14.877086+0000","last_clean":"2023-10-17T06:07:14.877086+0000","last_became_active":"2023-10-17T06:07:13.883456+0000","last_became_peered":"2023-10-17T06:07:13.883456+0000","last_unstale":"2023-10-17T06:07:14.877086+0000","last_undegraded":"2023-10-17T06:07:14.877086+0000","last_fullsized":"2023-10-17T06:07:14.877086+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:21:45.506386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289623+0000","last_change":"2023-10-17T06:07:09.830493+0000","last_active":"2023-10-17T06:07:15.289623+0000","last_peered":"2023-10-17T06:07:15.289623+0000","last_clean":"2023-10-17T06:07:15.289623+0000","last_became_active":"2023-10-17T06:07:09.830215+0000","last_became_peered":"2023-10-17T06:07:09.830215+0000","last_unstale":"2023-10-17T06:07:15.289623+0000","last_undegraded":"2023-10-17T06:07:15.289623+0000","last_fullsized":"2023-10-17T06:07:15.289623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:16:55.493821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877695+0000","last_change":"2023-10-17T06:07:08.591482+0000","last_active":"2023-10-17T06:07:14.877695+0000","last_peered":"2023-10-17T06:07:14.877695+0000","last_clean":"2023-10-17T06:07:14.877695+0000","last_became_active":"2023-10-17T06:07:08.591091+0000","last_became_peered":"2023-10-17T06:07:08.591091+0000","last_unstale":"2023-10-17T06:07:14.877695+0000","last_undegraded":"2023-10-17T06:07:14.877695+0000","last_fullsized":"2023-10-17T06:07:14.877695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:37:06.939408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876853+0000","last_change":"2023-10-17T06:07:13.888286+0000","last_active":"2023-10-17T06:07:14.876853+0000","last_peered":"2023-10-17T06:07:14.876853+0000","last_clean":"2023-10-17T06:07:14.876853+0000","last_became_active":"2023-10-17T06:07:13.887859+0000","last_became_peered":"2023-10-17T06:07:13.887859+0000","last_unstale":"2023-10-17T06:07:14.876853+0000","last_undegraded":"2023-10-17T06:07:14.876853+0000","last_fullsized":"2023-10-17T06:07:14.876853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:16:48.285650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.880831+0000","last_change":"2023-10-17T06:07:09.817272+0000","last_active":"2023-10-17T06:07:14.880831+0000","last_peered":"2023-10-17T06:07:14.880831+0000","last_clean":"2023-10-17T06:07:14.880831+0000","last_became_active":"2023-10-17T06:07:09.817017+0000","last_became_peered":"2023-10-17T06:07:09.817017+0000","last_unstale":"2023-10-17T06:07:14.880831+0000","last_undegraded":"2023-10-17T06:07:14.880831+0000","last_fullsized":"2023-10-17T06:07:14.880831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:30:38.008679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877583+0000","last_change":"2023-10-17T06:07:08.595069+0000","last_active":"2023-10-17T06:07:14.877583+0000","last_peered":"2023-10-17T06:07:14.877583+0000","last_clean":"2023-10-17T06:07:14.877583+0000","last_became_active":"2023-10-17T06:07:08.594724+0000","last_became_peered":"2023-10-17T06:07:08.594724+0000","last_unstale":"2023-10-17T06:07:14.877583+0000","last_undegraded":"2023-10-17T06:07:14.877583+0000","last_fullsized":"2023-10-17T06:07:14.877583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:30:12.591601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876486+0000","last_change":"2023-10-17T06:07:13.900939+0000","last_active":"2023-10-17T06:07:14.876486+0000","last_peered":"2023-10-17T06:07:14.876486+0000","last_clean":"2023-10-17T06:07:14.876486+0000","last_became_active":"2023-10-17T06:07:13.900504+0000","last_became_peered":"2023-10-17T06:07:13.900504+0000","last_unstale":"2023-10-17T06:07:14.876486+0000","last_undegraded":"2023-10-17T06:07:14.876486+0000","last_fullsized":"2023-10-17T06:07:14.876486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:57:24.016963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.882704+0000","last_change":"2023-10-17T06:07:09.811667+0000","last_active":"2023-10-17T06:07:14.882704+0000","last_peered":"2023-10-17T06:07:14.882704+0000","last_clean":"2023-10-17T06:07:14.882704+0000","last_became_active":"2023-10-17T06:07:09.811321+0000","last_became_peered":"2023-10-17T06:07:09.811321+0000","last_unstale":"2023-10-17T06:07:14.882704+0000","last_undegraded":"2023-10-17T06:07:14.882704+0000","last_fullsized":"2023-10-17T06:07:14.882704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:10:34.100144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877826+0000","last_change":"2023-10-17T06:07:08.591244+0000","last_active":"2023-10-17T06:07:14.877826+0000","last_peered":"2023-10-17T06:07:14.877826+0000","last_clean":"2023-10-17T06:07:14.877826+0000","last_became_active":"2023-10-17T06:07:08.591000+0000","last_became_peered":"2023-10-17T06:07:08.591000+0000","last_unstale":"2023-10-17T06:07:14.877826+0000","last_undegraded":"2023-10-17T06:07:14.877826+0000","last_fullsized":"2023-10-17T06:07:14.877826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:35:22.580242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876460+0000","last_change":"2023-10-17T06:07:13.885860+0000","last_active":"2023-10-17T06:07:14.876460+0000","last_peered":"2023-10-17T06:07:14.876460+0000","last_clean":"2023-10-17T06:07:14.876460+0000","last_became_active":"2023-10-17T06:07:13.885432+0000","last_became_peered":"2023-10-17T06:07:13.885432+0000","last_unstale":"2023-10-17T06:07:14.876460+0000","last_undegraded":"2023-10-17T06:07:14.876460+0000","last_fullsized":"2023-10-17T06:07:14.876460+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:46:37.345075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883253+0000","last_change":"2023-10-17T06:07:13.890018+0000","last_active":"2023-10-17T06:07:14.883253+0000","last_peered":"2023-10-17T06:07:14.883253+0000","last_clean":"2023-10-17T06:07:14.883253+0000","last_became_active":"2023-10-17T06:07:13.889612+0000","last_became_peered":"2023-10-17T06:07:13.889612+0000","last_unstale":"2023-10-17T06:07:14.883253+0000","last_undegraded":"2023-10-17T06:07:14.883253+0000","last_fullsized":"2023-10-17T06:07:14.883253+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:42.938379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289398+0000","last_change":"2023-10-17T06:07:08.591493+0000","last_active":"2023-10-17T06:07:15.289398+0000","last_peered":"2023-10-17T06:07:15.289398+0000","last_clean":"2023-10-17T06:07:15.289398+0000","last_became_active":"2023-10-17T06:07:08.591098+0000","last_became_peered":"2023-10-17T06:07:08.591098+0000","last_unstale":"2023-10-17T06:07:15.289398+0000","last_undegraded":"2023-10-17T06:07:15.289398+0000","last_fullsized":"2023-10-17T06:07:15.289398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:30:33.950741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291656+0000","last_change":"2023-10-17T06:07:09.822777+0000","last_active":"2023-10-17T06:07:15.291656+0000","last_peered":"2023-10-17T06:07:15.291656+0000","last_clean":"2023-10-17T06:07:15.291656+0000","last_became_active":"2023-10-17T06:07:09.822160+0000","last_became_peered":"2023-10-17T06:07:09.822160+0000","last_unstale":"2023-10-17T06:07:15.291656+0000","last_undegraded":"2023-10-17T06:07:15.291656+0000","last_fullsized":"2023-10-17T06:07:15.291656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:36:13.053365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291408+0000","last_change":"2023-10-17T06:07:13.895666+0000","last_active":"2023-10-17T06:07:15.291408+0000","last_peered":"2023-10-17T06:07:15.291408+0000","last_clean":"2023-10-17T06:07:15.291408+0000","last_became_active":"2023-10-17T06:07:13.895322+0000","last_became_peered":"2023-10-17T06:07:13.895322+0000","last_unstale":"2023-10-17T06:07:15.291408+0000","last_undegraded":"2023-10-17T06:07:15.291408+0000","last_fullsized":"2023-10-17T06:07:15.291408+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:49:57.036218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876863+0000","last_change":"2023-10-17T06:07:08.589887+0000","last_active":"2023-10-17T06:07:14.876863+0000","last_peered":"2023-10-17T06:07:14.876863+0000","last_clean":"2023-10-17T06:07:14.876863+0000","last_became_active":"2023-10-17T06:07:08.589511+0000","last_became_peered":"2023-10-17T06:07:08.589511+0000","last_unstale":"2023-10-17T06:07:14.876863+0000","last_undegraded":"2023-10-17T06:07:14.876863+0000","last_fullsized":"2023-10-17T06:07:14.876863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:16:05.759169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292842+0000","last_change":"2023-10-17T06:07:09.818359+0000","last_active":"2023-10-17T06:07:15.292842+0000","last_peered":"2023-10-17T06:07:15.292842+0000","last_clean":"2023-10-17T06:07:15.292842+0000","last_became_active":"2023-10-17T06:07:09.818092+0000","last_became_peered":"2023-10-17T06:07:09.818092+0000","last_unstale":"2023-10-17T06:07:15.292842+0000","last_undegraded":"2023-10-17T06:07:15.292842+0000","last_fullsized":"2023-10-17T06:07:15.292842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:59:42.620914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291756+0000","last_change":"2023-10-17T06:07:08.585166+0000","last_active":"2023-10-17T06:07:15.291756+0000","last_peered":"2023-10-17T06:07:15.291756+0000","last_clean":"2023-10-17T06:07:15.291756+0000","last_became_active":"2023-10-17T06:07:08.583972+0000","last_became_peered":"2023-10-17T06:07:08.583972+0000","last_unstale":"2023-10-17T06:07:15.291756+0000","last_undegraded":"2023-10-17T06:07:15.291756+0000","last_fullsized":"2023-10-17T06:07:15.291756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:02:40.893599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883659+0000","last_change":"2023-10-17T06:07:09.816356+0000","last_active":"2023-10-17T06:07:14.883659+0000","last_peered":"2023-10-17T06:07:14.883659+0000","last_clean":"2023-10-17T06:07:14.883659+0000","last_became_active":"2023-10-17T06:07:09.816066+0000","last_became_peered":"2023-10-17T06:07:09.816066+0000","last_unstale":"2023-10-17T06:07:14.883659+0000","last_undegraded":"2023-10-17T06:07:14.883659+0000","last_fullsized":"2023-10-17T06:07:14.883659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:40:06.008865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290633+0000","last_change":"2023-10-17T06:07:13.885847+0000","last_active":"2023-10-17T06:07:15.290633+0000","last_peered":"2023-10-17T06:07:15.290633+0000","last_clean":"2023-10-17T06:07:15.290633+0000","last_became_active":"2023-10-17T06:07:13.883713+0000","last_became_peered":"2023-10-17T06:07:13.883713+0000","last_unstale":"2023-10-17T06:07:15.290633+0000","last_undegraded":"2023-10-17T06:07:15.290633+0000","last_fullsized":"2023-10-17T06:07:15.290633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:40:10.287699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876962+0000","last_change":"2023-10-17T06:07:08.590802+0000","last_active":"2023-10-17T06:07:14.876962+0000","last_peered":"2023-10-17T06:07:14.876962+0000","last_clean":"2023-10-17T06:07:14.876962+0000","last_became_active":"2023-10-17T06:07:08.590520+0000","last_became_peered":"2023-10-17T06:07:08.590520+0000","last_unstale":"2023-10-17T06:07:14.876962+0000","last_undegraded":"2023-10-17T06:07:14.876962+0000","last_fullsized":"2023-10-17T06:07:14.876962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:07.547339+0000","last_clean_scrub_stamp":"2023-10-17T06:07:07.547339+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:20.494951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.290839+0000","last_change":"2023-10-17T06:07:09.819059+0000","last_active":"2023-10-17T06:07:15.290839+0000","last_peered":"2023-10-17T06:07:15.290839+0000","last_clean":"2023-10-17T06:07:15.290839+0000","last_became_active":"2023-10-17T06:07:09.818796+0000","last_became_peered":"2023-10-17T06:07:09.818796+0000","last_unstale":"2023-10-17T06:07:15.290839+0000","last_undegraded":"2023-10-17T06:07:15.290839+0000","last_fullsized":"2023-10-17T06:07:15.290839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:40:16.847674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883411+0000","last_change":"2023-10-17T06:07:13.891595+0000","last_active":"2023-10-17T06:07:14.883411+0000","last_peered":"2023-10-17T06:07:14.883411+0000","last_clean":"2023-10-17T06:07:14.883411+0000","last_became_active":"2023-10-17T06:07:13.891300+0000","last_became_peered":"2023-10-17T06:07:13.891300+0000","last_unstale":"2023-10-17T06:07:14.883411+0000","last_undegraded":"2023-10-17T06:07:14.883411+0000","last_fullsized":"2023-10-17T06:07:14.883411+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:12.831457+0000","last_clean_scrub_stamp":"2023-10-17T06:07:12.831457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:39:43.311635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289114+0000","last_change":"2023-10-17T06:07:09.830559+0000","last_active":"2023-10-17T06:07:15.289114+0000","last_peered":"2023-10-17T06:07:15.289114+0000","last_clean":"2023-10-17T06:07:15.289114+0000","last_became_active":"2023-10-17T06:07:09.830247+0000","last_became_peered":"2023-10-17T06:07:09.830247+0000","last_unstale":"2023-10-17T06:07:15.289114+0000","last_undegraded":"2023-10-17T06:07:15.289114+0000","last_fullsized":"2023-10-17T06:07:15.289114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:16:06.924811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.288720+0000","last_change":"2023-10-17T06:07:09.817481+0000","last_active":"2023-10-17T06:07:15.288720+0000","last_peered":"2023-10-17T06:07:15.288720+0000","last_clean":"2023-10-17T06:07:15.288720+0000","last_became_active":"2023-10-17T06:07:09.814576+0000","last_became_peered":"2023-10-17T06:07:09.814576+0000","last_unstale":"2023-10-17T06:07:15.288720+0000","last_undegraded":"2023-10-17T06:07:15.288720+0000","last_fullsized":"2023-10-17T06:07:15.288720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:17:19.424257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878534+0000","last_change":"2023-10-17T06:07:09.820385+0000","last_active":"2023-10-17T06:07:14.878534+0000","last_peered":"2023-10-17T06:07:14.878534+0000","last_clean":"2023-10-17T06:07:14.878534+0000","last_became_active":"2023-10-17T06:07:09.820110+0000","last_became_peered":"2023-10-17T06:07:09.820110+0000","last_unstale":"2023-10-17T06:07:14.878534+0000","last_undegraded":"2023-10-17T06:07:14.878534+0000","last_fullsized":"2023-10-17T06:07:14.878534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:11:35.023099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289802+0000","last_change":"2023-10-17T06:07:09.822056+0000","last_active":"2023-10-17T06:07:15.289802+0000","last_peered":"2023-10-17T06:07:15.289802+0000","last_clean":"2023-10-17T06:07:15.289802+0000","last_became_active":"2023-10-17T06:07:09.821742+0000","last_became_peered":"2023-10-17T06:07:09.821742+0000","last_unstale":"2023-10-17T06:07:15.289802+0000","last_undegraded":"2023-10-17T06:07:15.289802+0000","last_fullsized":"2023-10-17T06:07:15.289802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:08:31.461649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292457+0000","last_change":"2023-10-17T06:07:09.837676+0000","last_active":"2023-10-17T06:07:15.292457+0000","last_peered":"2023-10-17T06:07:15.292457+0000","last_clean":"2023-10-17T06:07:15.292457+0000","last_became_active":"2023-10-17T06:07:09.837404+0000","last_became_peered":"2023-10-17T06:07:09.837404+0000","last_unstale":"2023-10-17T06:07:15.292457+0000","last_undegraded":"2023-10-17T06:07:15.292457+0000","last_fullsized":"2023-10-17T06:07:15.292457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:16:45.547751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883628+0000","last_change":"2023-10-17T06:07:09.815486+0000","last_active":"2023-10-17T06:07:14.883628+0000","last_peered":"2023-10-17T06:07:14.883628+0000","last_clean":"2023-10-17T06:07:14.883628+0000","last_became_active":"2023-10-17T06:07:09.815216+0000","last_became_peered":"2023-10-17T06:07:09.815216+0000","last_unstale":"2023-10-17T06:07:14.883628+0000","last_undegraded":"2023-10-17T06:07:14.883628+0000","last_fullsized":"2023-10-17T06:07:14.883628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:47:27.513466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292809+0000","last_change":"2023-10-17T06:07:09.832482+0000","last_active":"2023-10-17T06:07:15.292809+0000","last_peered":"2023-10-17T06:07:15.292809+0000","last_clean":"2023-10-17T06:07:15.292809+0000","last_became_active":"2023-10-17T06:07:09.829842+0000","last_became_peered":"2023-10-17T06:07:09.829842+0000","last_unstale":"2023-10-17T06:07:15.292809+0000","last_undegraded":"2023-10-17T06:07:15.292809+0000","last_fullsized":"2023-10-17T06:07:15.292809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:17:19.424257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292847+0000","last_change":"2023-10-17T06:07:09.825942+0000","last_active":"2023-10-17T06:07:15.292847+0000","last_peered":"2023-10-17T06:07:15.292847+0000","last_clean":"2023-10-17T06:07:15.292847+0000","last_became_active":"2023-10-17T06:07:09.825679+0000","last_became_peered":"2023-10-17T06:07:09.825679+0000","last_unstale":"2023-10-17T06:07:15.292847+0000","last_undegraded":"2023-10-17T06:07:15.292847+0000","last_fullsized":"2023-10-17T06:07:15.292847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:11:05.795490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876229+0000","last_change":"2023-10-17T06:07:09.823556+0000","last_active":"2023-10-17T06:07:14.876229+0000","last_peered":"2023-10-17T06:07:14.876229+0000","last_clean":"2023-10-17T06:07:14.876229+0000","last_became_active":"2023-10-17T06:07:09.823156+0000","last_became_peered":"2023-10-17T06:07:09.823156+0000","last_unstale":"2023-10-17T06:07:14.876229+0000","last_undegraded":"2023-10-17T06:07:14.876229+0000","last_fullsized":"2023-10-17T06:07:14.876229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:13:26.091146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.288516+0000","last_change":"2023-10-17T06:07:09.839598+0000","last_active":"2023-10-17T06:07:15.288516+0000","last_peered":"2023-10-17T06:07:15.288516+0000","last_clean":"2023-10-17T06:07:15.288516+0000","last_became_active":"2023-10-17T06:07:09.839335+0000","last_became_peered":"2023-10-17T06:07:09.839335+0000","last_unstale":"2023-10-17T06:07:15.288516+0000","last_undegraded":"2023-10-17T06:07:15.288516+0000","last_fullsized":"2023-10-17T06:07:15.288516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:50:22.863407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.291642+0000","last_change":"2023-10-17T06:07:09.833987+0000","last_active":"2023-10-17T06:07:15.291642+0000","last_peered":"2023-10-17T06:07:15.291642+0000","last_clean":"2023-10-17T06:07:15.291642+0000","last_became_active":"2023-10-17T06:07:09.829996+0000","last_became_peered":"2023-10-17T06:07:09.829996+0000","last_unstale":"2023-10-17T06:07:15.291642+0000","last_undegraded":"2023-10-17T06:07:15.291642+0000","last_fullsized":"2023-10-17T06:07:15.291642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:02:25.494146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877356+0000","last_change":"2023-10-17T06:07:09.823715+0000","last_active":"2023-10-17T06:07:14.877356+0000","last_peered":"2023-10-17T06:07:14.877356+0000","last_clean":"2023-10-17T06:07:14.877356+0000","last_became_active":"2023-10-17T06:07:09.823129+0000","last_became_peered":"2023-10-17T06:07:09.823129+0000","last_unstale":"2023-10-17T06:07:14.877356+0000","last_undegraded":"2023-10-17T06:07:14.877356+0000","last_fullsized":"2023-10-17T06:07:14.877356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:36:11.487607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878693+0000","last_change":"2023-10-17T06:07:09.820940+0000","last_active":"2023-10-17T06:07:14.878693+0000","last_peered":"2023-10-17T06:07:14.878693+0000","last_clean":"2023-10-17T06:07:14.878693+0000","last_became_active":"2023-10-17T06:07:09.820736+0000","last_became_peered":"2023-10-17T06:07:09.820736+0000","last_unstale":"2023-10-17T06:07:14.878693+0000","last_undegraded":"2023-10-17T06:07:14.878693+0000","last_fullsized":"2023-10-17T06:07:14.878693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:23:39.566829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877433+0000","last_change":"2023-10-17T06:07:09.830379+0000","last_active":"2023-10-17T06:07:14.877433+0000","last_peered":"2023-10-17T06:07:14.877433+0000","last_clean":"2023-10-17T06:07:14.877433+0000","last_became_active":"2023-10-17T06:07:09.830134+0000","last_became_peered":"2023-10-17T06:07:09.830134+0000","last_unstale":"2023-10-17T06:07:14.877433+0000","last_undegraded":"2023-10-17T06:07:14.877433+0000","last_fullsized":"2023-10-17T06:07:14.877433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:37:37.680937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877600+0000","last_change":"2023-10-17T06:07:09.819191+0000","last_active":"2023-10-17T06:07:14.877600+0000","last_peered":"2023-10-17T06:07:14.877600+0000","last_clean":"2023-10-17T06:07:14.877600+0000","last_became_active":"2023-10-17T06:07:09.818894+0000","last_became_peered":"2023-10-17T06:07:09.818894+0000","last_unstale":"2023-10-17T06:07:14.877600+0000","last_undegraded":"2023-10-17T06:07:14.877600+0000","last_fullsized":"2023-10-17T06:07:14.877600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:40:29.612977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292543+0000","last_change":"2023-10-17T06:07:09.825371+0000","last_active":"2023-10-17T06:07:15.292543+0000","last_peered":"2023-10-17T06:07:15.292543+0000","last_clean":"2023-10-17T06:07:15.292543+0000","last_became_active":"2023-10-17T06:07:09.825096+0000","last_became_peered":"2023-10-17T06:07:09.825096+0000","last_unstale":"2023-10-17T06:07:15.292543+0000","last_undegraded":"2023-10-17T06:07:15.292543+0000","last_fullsized":"2023-10-17T06:07:15.292543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:30:13.596885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.878194+0000","last_change":"2023-10-17T06:07:09.834663+0000","last_active":"2023-10-17T06:07:14.878194+0000","last_peered":"2023-10-17T06:07:14.878194+0000","last_clean":"2023-10-17T06:07:14.878194+0000","last_became_active":"2023-10-17T06:07:09.834468+0000","last_became_peered":"2023-10-17T06:07:09.834468+0000","last_unstale":"2023-10-17T06:07:14.878194+0000","last_undegraded":"2023-10-17T06:07:14.878194+0000","last_fullsized":"2023-10-17T06:07:14.878194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:36:13.053365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876830+0000","last_change":"2023-10-17T06:07:09.832756+0000","last_active":"2023-10-17T06:07:14.876830+0000","last_peered":"2023-10-17T06:07:14.876830+0000","last_clean":"2023-10-17T06:07:14.876830+0000","last_became_active":"2023-10-17T06:07:09.832258+0000","last_became_peered":"2023-10-17T06:07:09.832258+0000","last_unstale":"2023-10-17T06:07:14.876830+0000","last_undegraded":"2023-10-17T06:07:14.876830+0000","last_fullsized":"2023-10-17T06:07:14.876830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:19:22.830429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883010+0000","last_change":"2023-10-17T06:07:09.820030+0000","last_active":"2023-10-17T06:07:14.883010+0000","last_peered":"2023-10-17T06:07:14.883010+0000","last_clean":"2023-10-17T06:07:14.883010+0000","last_became_active":"2023-10-17T06:07:09.819756+0000","last_became_peered":"2023-10-17T06:07:09.819756+0000","last_unstale":"2023-10-17T06:07:14.883010+0000","last_undegraded":"2023-10-17T06:07:14.883010+0000","last_fullsized":"2023-10-17T06:07:14.883010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:50:22.863407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877122+0000","last_change":"2023-10-17T06:07:09.826587+0000","last_active":"2023-10-17T06:07:14.877122+0000","last_peered":"2023-10-17T06:07:14.877122+0000","last_clean":"2023-10-17T06:07:14.877122+0000","last_became_active":"2023-10-17T06:07:09.825860+0000","last_became_peered":"2023-10-17T06:07:09.825860+0000","last_unstale":"2023-10-17T06:07:14.877122+0000","last_undegraded":"2023-10-17T06:07:14.877122+0000","last_fullsized":"2023-10-17T06:07:14.877122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:59:29.208159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877138+0000","last_change":"2023-10-17T06:07:09.810586+0000","last_active":"2023-10-17T06:07:14.877138+0000","last_peered":"2023-10-17T06:07:14.877138+0000","last_clean":"2023-10-17T06:07:14.877138+0000","last_became_active":"2023-10-17T06:07:09.809875+0000","last_became_peered":"2023-10-17T06:07:09.809875+0000","last_unstale":"2023-10-17T06:07:14.877138+0000","last_undegraded":"2023-10-17T06:07:14.877138+0000","last_fullsized":"2023-10-17T06:07:14.877138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:20:16.424591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879359+0000","last_change":"2023-10-17T06:07:09.820690+0000","last_active":"2023-10-17T06:07:14.879359+0000","last_peered":"2023-10-17T06:07:14.879359+0000","last_clean":"2023-10-17T06:07:14.879359+0000","last_became_active":"2023-10-17T06:07:09.820404+0000","last_became_peered":"2023-10-17T06:07:09.820404+0000","last_unstale":"2023-10-17T06:07:14.879359+0000","last_undegraded":"2023-10-17T06:07:14.879359+0000","last_fullsized":"2023-10-17T06:07:14.879359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:51:00.656359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883627+0000","last_change":"2023-10-17T06:07:09.840730+0000","last_active":"2023-10-17T06:07:14.883627+0000","last_peered":"2023-10-17T06:07:14.883627+0000","last_clean":"2023-10-17T06:07:14.883627+0000","last_became_active":"2023-10-17T06:07:09.839503+0000","last_became_peered":"2023-10-17T06:07:09.839503+0000","last_unstale":"2023-10-17T06:07:14.883627+0000","last_undegraded":"2023-10-17T06:07:14.883627+0000","last_fullsized":"2023-10-17T06:07:14.883627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:53:37.426543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292422+0000","last_change":"2023-10-17T06:07:09.833449+0000","last_active":"2023-10-17T06:07:15.292422+0000","last_peered":"2023-10-17T06:07:15.292422+0000","last_clean":"2023-10-17T06:07:15.292422+0000","last_became_active":"2023-10-17T06:07:09.833054+0000","last_became_peered":"2023-10-17T06:07:09.833054+0000","last_unstale":"2023-10-17T06:07:15.292422+0000","last_undegraded":"2023-10-17T06:07:15.292422+0000","last_fullsized":"2023-10-17T06:07:15.292422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:30:04.900751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.882634+0000","last_change":"2023-10-17T06:07:09.809269+0000","last_active":"2023-10-17T06:07:14.882634+0000","last_peered":"2023-10-17T06:07:14.882634+0000","last_clean":"2023-10-17T06:07:14.882634+0000","last_became_active":"2023-10-17T06:07:09.808823+0000","last_became_peered":"2023-10-17T06:07:09.808823+0000","last_unstale":"2023-10-17T06:07:14.882634+0000","last_undegraded":"2023-10-17T06:07:14.882634+0000","last_fullsized":"2023-10-17T06:07:14.882634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:00:19.054030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.876659+0000","last_change":"2023-10-17T06:07:09.837236+0000","last_active":"2023-10-17T06:07:14.876659+0000","last_peered":"2023-10-17T06:07:14.876659+0000","last_clean":"2023-10-17T06:07:14.876659+0000","last_became_active":"2023-10-17T06:07:09.831813+0000","last_became_peered":"2023-10-17T06:07:09.831813+0000","last_unstale":"2023-10-17T06:07:14.876659+0000","last_undegraded":"2023-10-17T06:07:14.876659+0000","last_fullsized":"2023-10-17T06:07:14.876659+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:30:04.900751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877874+0000","last_change":"2023-10-17T06:07:09.818210+0000","last_active":"2023-10-17T06:07:14.877874+0000","last_peered":"2023-10-17T06:07:14.877874+0000","last_clean":"2023-10-17T06:07:14.877874+0000","last_became_active":"2023-10-17T06:07:09.817925+0000","last_became_peered":"2023-10-17T06:07:09.817925+0000","last_unstale":"2023-10-17T06:07:14.877874+0000","last_undegraded":"2023-10-17T06:07:14.877874+0000","last_fullsized":"2023-10-17T06:07:14.877874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:49:52.757385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.292096+0000","last_change":"2023-10-17T06:07:09.825092+0000","last_active":"2023-10-17T06:07:15.292096+0000","last_peered":"2023-10-17T06:07:15.292096+0000","last_clean":"2023-10-17T06:07:15.292096+0000","last_became_active":"2023-10-17T06:07:09.824830+0000","last_became_peered":"2023-10-17T06:07:09.824830+0000","last_unstale":"2023-10-17T06:07:15.292096+0000","last_undegraded":"2023-10-17T06:07:15.292096+0000","last_fullsized":"2023-10-17T06:07:15.292096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:13:26.091146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:15.289991+0000","last_change":"2023-10-17T06:07:09.839421+0000","last_active":"2023-10-17T06:07:15.289991+0000","last_peered":"2023-10-17T06:07:15.289991+0000","last_clean":"2023-10-17T06:07:15.289991+0000","last_became_active":"2023-10-17T06:07:09.839171+0000","last_became_peered":"2023-10-17T06:07:09.839171+0000","last_unstale":"2023-10-17T06:07:15.289991+0000","last_undegraded":"2023-10-17T06:07:15.289991+0000","last_fullsized":"2023-10-17T06:07:15.289991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:47:47.791448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.879222+0000","last_change":"2023-10-17T06:07:09.834207+0000","last_active":"2023-10-17T06:07:14.879222+0000","last_peered":"2023-10-17T06:07:14.879222+0000","last_clean":"2023-10-17T06:07:14.879222+0000","last_became_active":"2023-10-17T06:07:09.833966+0000","last_became_peered":"2023-10-17T06:07:09.833966+0000","last_unstale":"2023-10-17T06:07:14.879222+0000","last_undegraded":"2023-10-17T06:07:14.879222+0000","last_fullsized":"2023-10-17T06:07:14.879222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:54:25.125826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.883402+0000","last_change":"2023-10-17T06:07:09.823776+0000","last_active":"2023-10-17T06:07:14.883402+0000","last_peered":"2023-10-17T06:07:14.883402+0000","last_clean":"2023-10-17T06:07:14.883402+0000","last_became_active":"2023-10-17T06:07:09.823394+0000","last_became_peered":"2023-10-17T06:07:09.823394+0000","last_unstale":"2023-10-17T06:07:14.883402+0000","last_undegraded":"2023-10-17T06:07:14.883402+0000","last_fullsized":"2023-10-17T06:07:14.883402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:45:39.252622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-17T06:07:14.877489+0000","last_change":"2023-10-17T06:07:09.818284+0000","last_active":"2023-10-17T06:07:14.877489+0000","last_peered":"2023-10-17T06:07:14.877489+0000","last_clean":"2023-10-17T06:07:14.877489+0000","last_became_active":"2023-10-17T06:07:09.817980+0000","last_became_peered":"2023-10-17T06:07:09.817980+0000","last_unstale":"2023-10-17T06:07:14.877489+0000","last_undegraded":"2023-10-17T06:07:14.877489+0000","last_fullsized":"2023-10-17T06:07:14.877489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:08.552624+0000","last_clean_scrub_stamp":"2023-10-17T06:07:08.552624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:42:16.038333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":122060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]}]},{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":122712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.3700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]}]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":125957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]}]},{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":917504,"data_stored":716485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.613}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.659}]}]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":122150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]}]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":122060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.798}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6439999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.859}]}]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":122060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6439999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":711019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-17T06:07:42.430 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-17T06:07:42.431 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-17T06:07:42.431 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-17T06:07:42.431 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-17T06:07:42.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.631+0000 7f967247d700 1 Processor -- start 2023-10-17T06:07:42.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.631+0000 7f967247d700 1 -- start start 2023-10-17T06:07:42.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.631+0000 7f967247d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f966c0b3d40 0x7f966c0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:42.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.631+0000 7f967247d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f966c164a20 0x7f966c0c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:42.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.631+0000 7f967247d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f966c06ce20 0x7f966c06d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:42.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.631+0000 7f967247d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966c06e2d0 con 0x7f966c164a20 2023-10-17T06:07:42.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.631+0000 7f967247d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966c06d7d0 con 0x7f966c06ce20 2023-10-17T06:07:42.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.631+0000 7f967247d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0ca200 con 0x7f966c0b3d40 2023-10-17T06:07:42.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f9670c7a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f966c164a20 0x7f966c0c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:42.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f9670c7a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f966c164a20 0x7f966c0c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48992/0 (socket says 172.21.15.125:48992) 2023-10-17T06:07:42.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f9670c7a700 1 -- 172.21.15.125:0/2363524181 learned_addr learned my addr 172.21.15.125:0/2363524181 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:42.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f967147b700 1 --2- 172.21.15.125:0/2363524181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f966c0b3d40 0x7f966c0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:42.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f9671c7c700 1 --2- 172.21.15.125:0/2363524181 >> v2:172.21.15.184:3300/0 conn(0x7f966c06ce20 0x7f966c06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:42.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f9670c7a700 1 -- 172.21.15.125:0/2363524181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f966c0b3d40 msgr2=0x7f966c0cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:42.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f9670c7a700 1 --2- 172.21.15.125:0/2363524181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f966c0b3d40 0x7f966c0cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:42.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f9670c7a700 1 -- 172.21.15.125:0/2363524181 >> v2:172.21.15.184:3300/0 conn(0x7f966c06ce20 msgr2=0x7f966c06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:42.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f9670c7a700 1 --2- 172.21.15.125:0/2363524181 >> v2:172.21.15.184:3300/0 conn(0x7f966c06ce20 0x7f966c06d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:42.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f9670c7a700 1 -- 172.21.15.125:0/2363524181 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c0ca4c0 con 0x7f966c164a20 2023-10-17T06:07:42.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f9670c7a700 1 --2- 172.21.15.125:0/2363524181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f966c164a20 0x7f966c0c9cc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f966c164eb0 tx=0x7f965c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f1db65052ec571 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f9663fff700 1 -- 172.21.15.125:0/2363524181 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c00b8a0 con 0x7f966c164a20 2023-10-17T06:07:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f9663fff700 1 -- 172.21.15.125:0/2363524181 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965c00ba00 con 0x7f966c164a20 2023-10-17T06:07:42.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f9663fff700 1 -- 172.21.15.125:0/2363524181 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c00bd90 con 0x7f966c164a20 2023-10-17T06:07:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f967247d700 1 -- 172.21.15.125:0/2363524181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f966c164a20 msgr2=0x7f966c0c9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f967247d700 1 --2- 172.21.15.125:0/2363524181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f966c164a20 0x7f966c0c9cc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f966c164eb0 tx=0x7f965c009bf0 comp rx=0 tx=0).stop 2023-10-17T06:07:42.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f967247d700 1 -- 172.21.15.125:0/2363524181 shutdown_connections 2023-10-17T06:07:42.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f967247d700 1 --2- 172.21.15.125:0/2363524181 >> v2:172.21.15.184:3300/0 conn(0x7f966c06ce20 0x7f966c06d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:42.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f967247d700 1 --2- 172.21.15.125:0/2363524181 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f966c164a20 0x7f966c0c9cc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:42.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f967247d700 1 --2- 172.21.15.125:0/2363524181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f966c0b3d40 0x7f966c0cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:42.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f967247d700 1 -- 172.21.15.125:0/2363524181 >> 172.21.15.125:0/2363524181 conn(0x7f966c0ce5c0 msgr2=0x7f966c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:42.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f967247d700 1 -- 172.21.15.125:0/2363524181 shutdown_connections 2023-10-17T06:07:42.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.635+0000 7f967247d700 1 -- 172.21.15.125:0/2363524181 wait complete. 2023-10-17T06:07:42.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.639+0000 7f967247d700 1 Processor -- start 2023-10-17T06:07:42.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.639+0000 7f967247d700 1 -- start start 2023-10-17T06:07:42.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f967247d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f966c06ce20 0x7f966c0c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:42.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f967247d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f966c0b3d40 0x7f966c1587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:42.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f967247d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f966c164a20 0x7f966c0c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:42.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f967247d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0c5b60 con 0x7f966c164a20 2023-10-17T06:07:42.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f967247d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0c7780 con 0x7f966c06ce20 2023-10-17T06:07:42.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f967247d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0c5db0 con 0x7f966c0b3d40 2023-10-17T06:07:42.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f9671c7c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f966c164a20 0x7f966c0c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:42.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f9671c7c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f966c164a20 0x7f966c0c7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48996/0 (socket says 172.21.15.125:48996) 2023-10-17T06:07:42.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f9671c7c700 1 -- 172.21.15.125:0/3745649160 learned_addr learned my addr 172.21.15.125:0/3745649160 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:42.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f9670c7a700 1 --2- 172.21.15.125:0/3745649160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f966c0b3d40 0x7f966c1587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:42.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f967147b700 1 --2- 172.21.15.125:0/3745649160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f966c06ce20 0x7f966c0c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:42.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f9671c7c700 1 -- 172.21.15.125:0/3745649160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f966c0b3d40 msgr2=0x7f966c1587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:42.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f9671c7c700 1 --2- 172.21.15.125:0/3745649160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f966c0b3d40 0x7f966c1587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:42.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f9671c7c700 1 -- 172.21.15.125:0/3745649160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f966c06ce20 msgr2=0x7f966c0c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:42.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f9671c7c700 1 --2- 172.21.15.125:0/3745649160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f966c06ce20 0x7f966c0c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:42.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f9671c7c700 1 -- 172.21.15.125:0/3745649160 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965c009570 con 0x7f966c164a20 2023-10-17T06:07:42.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f967147b700 1 --2- 172.21.15.125:0/3745649160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f966c06ce20 0x7f966c0c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:42.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f9670c7a700 1 --2- 172.21.15.125:0/3745649160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f966c0b3d40 0x7f966c1587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:42.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f9671c7c700 1 --2- 172.21.15.125:0/3745649160 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f966c164a20 0x7f966c0c7a60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f966400e810 tx=0x7f966400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:42.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f9661ffb700 1 -- 172.21.15.125:0/3745649160 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9664013610 con 0x7f966c164a20 2023-10-17T06:07:42.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f9661ffb700 1 -- 172.21.15.125:0/3745649160 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9664013790 con 0x7f966c164a20 2023-10-17T06:07:42.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f9661ffb700 1 -- 172.21.15.125:0/3745649160 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9664013b40 con 0x7f966c164a20 2023-10-17T06:07:42.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f967247d700 1 -- 172.21.15.125:0/3745649160 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f966c0c6090 con 0x7f966c164a20 2023-10-17T06:07:42.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.643+0000 7f967247d700 1 -- 172.21.15.125:0/3745649160 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966c15dcd0 con 0x7f966c164a20 2023-10-17T06:07:42.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.647+0000 7f967247d700 1 -- 172.21.15.125:0/3745649160 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966c0c65b0 con 0x7f966c164a20 2023-10-17T06:07:42.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.647+0000 7f9661ffb700 1 -- 172.21.15.125:0/3745649160 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9664013ca0 con 0x7f966c164a20 2023-10-17T06:07:42.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.647+0000 7f9661ffb700 1 --2- 172.21.15.125:0/3745649160 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f96500656f0 0x7f9650067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:42.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.647+0000 7f9661ffb700 1 -- 172.21.15.125:0/3745649160 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9664082c70 con 0x7f966c164a20 2023-10-17T06:07:42.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.647+0000 7f967147b700 1 --2- 172.21.15.125:0/3745649160 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f96500656f0 0x7f9650067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:42.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.651+0000 7f967147b700 1 --2- 172.21.15.125:0/3745649160 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f96500656f0 0x7f9650067bb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9668009be0 tx=0x7f9668003a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:42.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:42.655+0000 7f9661ffb700 1 -- 172.21.15.125:0/3745649160 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f966c0c65b0 con 0x7f966c164a20 2023-10-17T06:07:43.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.047+0000 7f967247d700 1 -- 172.21.15.125:0/3745649160 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f966c0c65b0 con 0x7f966c164a20 2023-10-17T06:07:43.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.047+0000 7f9661ffb700 1 -- 172.21.15.125:0/3745649160 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f9664021040 con 0x7f966c164a20 2023-10-17T06:07:43.051 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:43.051 INFO:teuthology.orchestra.run.smithi125.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-17T06:07:43.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.051+0000 7f967247d700 1 -- 172.21.15.125:0/3745649160 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f96500656f0 msgr2=0x7f9650067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:43.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.051+0000 7f967247d700 1 --2- 172.21.15.125:0/3745649160 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f96500656f0 0x7f9650067bb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9668009be0 tx=0x7f9668003a80 comp rx=0 tx=0).stop 2023-10-17T06:07:43.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.051+0000 7f967247d700 1 -- 172.21.15.125:0/3745649160 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f966c164a20 msgr2=0x7f966c0c7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:43.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.051+0000 7f967247d700 1 --2- 172.21.15.125:0/3745649160 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f966c164a20 0x7f966c0c7a60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f966400e810 tx=0x7f966400ebd0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.051+0000 7f967247d700 1 -- 172.21.15.125:0/3745649160 shutdown_connections 2023-10-17T06:07:43.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.051+0000 7f967247d700 1 --2- 172.21.15.125:0/3745649160 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f96500656f0 0x7f9650067bb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.051+0000 7f967247d700 1 --2- 172.21.15.125:0/3745649160 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f966c164a20 0x7f966c0c7a60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.051+0000 7f967247d700 1 --2- 172.21.15.125:0/3745649160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f966c0b3d40 0x7f966c1587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.051+0000 7f967247d700 1 --2- 172.21.15.125:0/3745649160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f966c06ce20 0x7f966c0c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.051+0000 7f967247d700 1 -- 172.21.15.125:0/3745649160 >> 172.21.15.125:0/3745649160 conn(0x7f966c0ce5c0 msgr2=0x7f966c1e9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:43.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.051+0000 7f967247d700 1 -- 172.21.15.125:0/3745649160 shutdown_connections 2023-10-17T06:07:43.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.051+0000 7f967247d700 1 -- 172.21.15.125:0/3745649160 wait complete. 2023-10-17T06:07:43.073 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-17T06:07:43.074 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:07:43.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.239+0000 7f2170948700 1 Processor -- start 2023-10-17T06:07:43.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.243+0000 7f2170948700 1 -- start start 2023-10-17T06:07:43.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.243+0000 7f2170948700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216c0d2e00 0x7f216c0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:43.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.243+0000 7f2170948700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f216c160710 0x7f216c0d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:43.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.243+0000 7f2170948700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f216c0b5ae0 0x7f216c06db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:43.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.243+0000 7f2170948700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216c15df90 con 0x7f216c160710 2023-10-17T06:07:43.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.243+0000 7f2170948700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216c15d0d0 con 0x7f216c0b5ae0 2023-10-17T06:07:43.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.243+0000 7f2170948700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c06f0f0 con 0x7f216c0d2e00 2023-10-17T06:07:43.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.243+0000 7f216affd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f216c160710 0x7f216c0d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:43.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.243+0000 7f216affd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f216c160710 0x7f216c0d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49008/0 (socket says 172.21.15.125:49008) 2023-10-17T06:07:43.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.243+0000 7f216affd700 1 -- 172.21.15.125:0/932924814 learned_addr learned my addr 172.21.15.125:0/932924814 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:43.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.243+0000 7f216b7fe700 1 --2- 172.21.15.125:0/932924814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216c0d2e00 0x7f216c0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:43.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.243+0000 7f216bfff700 1 --2- 172.21.15.125:0/932924814 >> v2:172.21.15.184:3300/0 conn(0x7f216c0b5ae0 0x7f216c06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:43.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.243+0000 7f216affd700 1 -- 172.21.15.125:0/932924814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216c0d2e00 msgr2=0x7f216c0b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:43.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.243+0000 7f216affd700 1 --2- 172.21.15.125:0/932924814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216c0d2e00 0x7f216c0b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.243+0000 7f216affd700 1 -- 172.21.15.125:0/932924814 >> v2:172.21.15.184:3300/0 conn(0x7f216c0b5ae0 msgr2=0x7f216c06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:43.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.243+0000 7f216affd700 1 --2- 172.21.15.125:0/932924814 >> v2:172.21.15.184:3300/0 conn(0x7f216c0b5ae0 0x7f216c06db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.243+0000 7f216affd700 1 -- 172.21.15.125:0/932924814 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c0d3720 con 0x7f216c160710 2023-10-17T06:07:43.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.243+0000 7f216affd700 1 --2- 172.21.15.125:0/932924814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f216c160710 0x7f216c0d31e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2160009910 tx=0x7f2160009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6002ee41c0c60e29 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:43.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.247+0000 7f216a7fc700 1 -- 172.21.15.125:0/932924814 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2160011830 con 0x7f216c160710 2023-10-17T06:07:43.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.247+0000 7f216a7fc700 1 -- 172.21.15.125:0/932924814 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2160011990 con 0x7f216c160710 2023-10-17T06:07:43.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.247+0000 7f216a7fc700 1 -- 172.21.15.125:0/932924814 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2160011d40 con 0x7f216c160710 2023-10-17T06:07:43.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.247+0000 7f2170948700 1 -- 172.21.15.125:0/932924814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f216c160710 msgr2=0x7f216c0d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:43.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.247+0000 7f2170948700 1 --2- 172.21.15.125:0/932924814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f216c160710 0x7f216c0d31e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2160009910 tx=0x7f2160009c20 comp rx=0 tx=0).stop 2023-10-17T06:07:43.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.247+0000 7f2170948700 1 -- 172.21.15.125:0/932924814 shutdown_connections 2023-10-17T06:07:43.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.247+0000 7f2170948700 1 --2- 172.21.15.125:0/932924814 >> v2:172.21.15.184:3300/0 conn(0x7f216c0b5ae0 0x7f216c06db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.247+0000 7f2170948700 1 --2- 172.21.15.125:0/932924814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f216c160710 0x7f216c0d31e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.247+0000 7f2170948700 1 --2- 172.21.15.125:0/932924814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216c0d2e00 0x7f216c0b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.247+0000 7f2170948700 1 -- 172.21.15.125:0/932924814 >> 172.21.15.125:0/932924814 conn(0x7f216c069f20 msgr2=0x7f216c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:43.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.247+0000 7f2170948700 1 -- 172.21.15.125:0/932924814 shutdown_connections 2023-10-17T06:07:43.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.247+0000 7f2170948700 1 -- 172.21.15.125:0/932924814 wait complete. 2023-10-17T06:07:43.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f2170948700 1 Processor -- start 2023-10-17T06:07:43.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f2170948700 1 -- start start 2023-10-17T06:07:43.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f2170948700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f216c0b5ae0 0x7f216c0b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:43.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f2170948700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216c0d2e00 0x7f216c14f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:43.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f2170948700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f216c160710 0x7f216c15f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:43.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f2170948700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0b1740 con 0x7f216c160710 2023-10-17T06:07:43.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f2170948700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c14f8e0 con 0x7f216c0b5ae0 2023-10-17T06:07:43.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f2170948700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0b0ea0 con 0x7f216c0d2e00 2023-10-17T06:07:43.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f216bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f216c160710 0x7f216c15f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:43.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f216bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f216c160710 0x7f216c15f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49010/0 (socket says 172.21.15.125:49010) 2023-10-17T06:07:43.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f216bfff700 1 -- 172.21.15.125:0/1859213058 learned_addr learned my addr 172.21.15.125:0/1859213058 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:43.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f216affd700 1 --2- 172.21.15.125:0/1859213058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216c0d2e00 0x7f216c14f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:43.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f216b7fe700 1 --2- 172.21.15.125:0/1859213058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f216c0b5ae0 0x7f216c0b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:43.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f216bfff700 1 -- 172.21.15.125:0/1859213058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216c0d2e00 msgr2=0x7f216c14f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:43.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f216bfff700 1 --2- 172.21.15.125:0/1859213058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216c0d2e00 0x7f216c14f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f216bfff700 1 -- 172.21.15.125:0/1859213058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f216c0b5ae0 msgr2=0x7f216c0b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:43.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f216bfff700 1 --2- 172.21.15.125:0/1859213058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f216c0b5ae0 0x7f216c0b0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f216bfff700 1 -- 172.21.15.125:0/1859213058 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2160009570 con 0x7f216c160710 2023-10-17T06:07:43.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f216affd700 1 --2- 172.21.15.125:0/1859213058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216c0d2e00 0x7f216c14f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:43.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f216bfff700 1 --2- 172.21.15.125:0/1859213058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f216c160710 0x7f216c15f6b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f216400eed0 tx=0x7f216400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:43.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f2153fff700 1 -- 172.21.15.125:0/1859213058 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164010040 con 0x7f216c160710 2023-10-17T06:07:43.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f2153fff700 1 -- 172.21.15.125:0/1859213058 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216400baa0 con 0x7f216c160710 2023-10-17T06:07:43.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f2153fff700 1 -- 172.21.15.125:0/1859213058 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216400be50 con 0x7f216c160710 2023-10-17T06:07:43.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f2170948700 1 -- 172.21.15.125:0/1859213058 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216c0b1180 con 0x7f216c160710 2023-10-17T06:07:43.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.251+0000 7f2170948700 1 -- 172.21.15.125:0/1859213058 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c0aba10 con 0x7f216c160710 2023-10-17T06:07:43.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.255+0000 7f2170948700 1 -- 172.21.15.125:0/1859213058 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c072e60 con 0x7f216c160710 2023-10-17T06:07:43.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.255+0000 7f2153fff700 1 -- 172.21.15.125:0/1859213058 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2164014400 con 0x7f216c160710 2023-10-17T06:07:43.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.259+0000 7f2153fff700 1 --2- 172.21.15.125:0/1859213058 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f21580656f0 0x7f2158067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:43.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.259+0000 7f2153fff700 1 -- 172.21.15.125:0/1859213058 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2164006e40 con 0x7f216c160710 2023-10-17T06:07:43.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.259+0000 7f216b7fe700 1 --2- 172.21.15.125:0/1859213058 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f21580656f0 0x7f2158067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:43.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.259+0000 7f216b7fe700 1 --2- 172.21.15.125:0/1859213058 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f21580656f0 0x7f2158067bb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f215c009b50 tx=0x7f215c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:43.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.263+0000 7f2153fff700 1 -- 172.21.15.125:0/1859213058 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2164050d40 con 0x7f216c160710 2023-10-17T06:07:43.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.447+0000 7f2170948700 1 -- 172.21.15.125:0/1859213058 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f216c15dba0 con 0x7f216c160710 2023-10-17T06:07:43.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.447+0000 7f2153fff700 1 -- 172.21.15.125:0/1859213058 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f2164054360 con 0x7f216c160710 2023-10-17T06:07:43.452 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:43.452 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":28,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:14.576796+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:07:43.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.451+0000 7f2170948700 1 -- 172.21.15.125:0/1859213058 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f21580656f0 msgr2=0x7f2158067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:43.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.451+0000 7f2170948700 1 --2- 172.21.15.125:0/1859213058 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f21580656f0 0x7f2158067bb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f215c009b50 tx=0x7f215c009240 comp rx=0 tx=0).stop 2023-10-17T06:07:43.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.451+0000 7f2170948700 1 -- 172.21.15.125:0/1859213058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f216c160710 msgr2=0x7f216c15f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:43.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.451+0000 7f2170948700 1 --2- 172.21.15.125:0/1859213058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f216c160710 0x7f216c15f6b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f216400eed0 tx=0x7f216400ef00 comp rx=0 tx=0).stop 2023-10-17T06:07:43.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.451+0000 7f2170948700 1 -- 172.21.15.125:0/1859213058 shutdown_connections 2023-10-17T06:07:43.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.451+0000 7f2170948700 1 --2- 172.21.15.125:0/1859213058 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f21580656f0 0x7f2158067bb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.451+0000 7f2170948700 1 --2- 172.21.15.125:0/1859213058 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f216c160710 0x7f216c15f6b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.451+0000 7f2170948700 1 --2- 172.21.15.125:0/1859213058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216c0d2e00 0x7f216c14f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.451+0000 7f2170948700 1 --2- 172.21.15.125:0/1859213058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f216c0b5ae0 0x7f216c0b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.451+0000 7f2170948700 1 -- 172.21.15.125:0/1859213058 >> 172.21.15.125:0/1859213058 conn(0x7f216c069f20 msgr2=0x7f216c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:43.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.451+0000 7f2170948700 1 -- 172.21.15.125:0/1859213058 shutdown_connections 2023-10-17T06:07:43.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.451+0000 7f2170948700 1 -- 172.21.15.125:0/1859213058 wait complete. 2023-10-17T06:07:43.477 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-17T06:07:06.629169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-17T06:07:08.148117+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-17T06:07:11.895112+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-17T06:07:43.477 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:07:43.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.659+0000 7f78347d2700 1 Processor -- start 2023-10-17T06:07:43.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.659+0000 7f78347d2700 1 -- start start 2023-10-17T06:07:43.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.659+0000 7f78347d2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f782c0caa10 0x7f782c167da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:43.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.659+0000 7f78347d2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782c0ca840 con 0x7f782c06f450 2023-10-17T06:07:43.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.659+0000 7f78347d2700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782c0ca560 con 0x7f782c15ce30 2023-10-17T06:07:43.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.659+0000 7f78347d2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782c0ccf30 con 0x7f782c0caa10 2023-10-17T06:07:43.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.659+0000 7f7831d6d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f782c06f450 0x7f782c161120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59526/0 (socket says 172.21.15.125:59526) 2023-10-17T06:07:43.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.659+0000 7f7831d6d700 1 -- 172.21.15.125:0/1929129870 learned_addr learned my addr 172.21.15.125:0/1929129870 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:43.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.659+0000 7f7832d6f700 1 --2- 172.21.15.125:0/1929129870 >> v2:172.21.15.125:3300/0 conn(0x7f782c0caa10 0x7f782c167da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:43.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.659+0000 7f783156c700 1 -- 172.21.15.125:0/1929129870 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146457282 0 0) 0x7f782c0ca840 con 0x7f782c06f450 2023-10-17T06:07:43.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.659+0000 7f783156c700 1 -- 172.21.15.125:0/1929129870 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78140035d0 con 0x7f782c06f450 2023-10-17T06:07:43.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.659+0000 7f7832d6f700 1 -- 172.21.15.125:0/1929129870 >> v1:172.21.15.184:6789/0 conn(0x7f782c15ce30 legacy=0x7f782c160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:43.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.659+0000 7f7832d6f700 1 -- 172.21.15.125:0/1929129870 >> v1:172.21.15.125:6789/0 conn(0x7f782c06f450 legacy=0x7f782c161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:43.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.663+0000 7f7832d6f700 1 -- 172.21.15.125:0/1929129870 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c0cd210 con 0x7f782c0caa10 2023-10-17T06:07:43.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.663+0000 7f7832d6f700 1 --2- 172.21.15.125:0/1929129870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f782c0caa10 0x7f782c167da0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7824009d90 tx=0x7f782400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d94163f5468b0f server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:43.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.663+0000 7f783156c700 1 -- 172.21.15.125:0/1929129870 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782400e070 con 0x7f782c0caa10 2023-10-17T06:07:43.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.663+0000 7f783156c700 1 -- 172.21.15.125:0/1929129870 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782400bb20 con 0x7f782c0caa10 2023-10-17T06:07:43.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.663+0000 7f783156c700 1 -- 172.21.15.125:0/1929129870 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7824012430 con 0x7f782c0caa10 2023-10-17T06:07:43.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.663+0000 7f78347d2700 1 -- 172.21.15.125:0/1929129870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f782c0caa10 msgr2=0x7f782c167da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:43.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.663+0000 7f78347d2700 1 --2- 172.21.15.125:0/1929129870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f782c0caa10 0x7f782c167da0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7824009d90 tx=0x7f782400b330 comp rx=0 tx=0).stop 2023-10-17T06:07:43.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.667+0000 7f78347d2700 1 -- 172.21.15.125:0/1929129870 shutdown_connections 2023-10-17T06:07:43.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.667+0000 7f78347d2700 1 --2- 172.21.15.125:0/1929129870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f782c0caa10 0x7f782c167da0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.667+0000 7f78347d2700 1 -- 172.21.15.125:0/1929129870 >> 172.21.15.125:0/1929129870 conn(0x7f782c0ce820 msgr2=0x7f782c0cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.667+0000 7f78347d2700 1 -- 172.21.15.125:0/1929129870 shutdown_connections 2023-10-17T06:07:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.667+0000 7f78347d2700 1 -- 172.21.15.125:0/1929129870 wait complete. 2023-10-17T06:07:43.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.667+0000 7f78347d2700 1 Processor -- start 2023-10-17T06:07:43.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.667+0000 7f78347d2700 1 -- start start 2023-10-17T06:07:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.667+0000 7f78347d2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f782c06f450 0x7f782c15e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:43.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.667+0000 7f78347d2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f782c0caa10 0x7f782c1f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:43.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f7831d6d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f782c0caa10 0x7f782c1f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:43.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f7831d6d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f782c0caa10 0x7f782c1f29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:60210/0 (socket says 172.21.15.125:60210) 2023-10-17T06:07:43.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f78347d2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f782c15ce30 0x7f782c1f6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:43.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f783256e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f782c06f450 0x7f782c15e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:43.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f78347d2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c1f6ed0 con 0x7f782c15ce30 2023-10-17T06:07:43.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f78347d2700 1 -- 172.21.15.125:0/2527512372 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c15eba0 con 0x7f782c0caa10 2023-10-17T06:07:43.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f7831d6d700 1 -- 172.21.15.125:0/2527512372 learned_addr learned my addr 172.21.15.125:0/2527512372 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:43.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f78347d2700 1 -- 172.21.15.125:0/2527512372 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c15ee80 con 0x7f782c06f450 2023-10-17T06:07:43.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f7832d6f700 1 --2- 172.21.15.125:0/2527512372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f782c15ce30 0x7f782c1f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:43.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f7831d6d700 1 -- 172.21.15.125:0/2527512372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f782c06f450 msgr2=0x7f782c15e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:43.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f7831d6d700 1 --2- 172.21.15.125:0/2527512372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f782c06f450 0x7f782c15e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f7831d6d700 1 -- 172.21.15.125:0/2527512372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f782c15ce30 msgr2=0x7f782c1f6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:43.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f7831d6d700 1 --2- 172.21.15.125:0/2527512372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f782c15ce30 0x7f782c1f6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f7831d6d700 1 -- 172.21.15.125:0/2527512372 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7824009a70 con 0x7f782c0caa10 2023-10-17T06:07:43.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f7832d6f700 1 --2- 172.21.15.125:0/2527512372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f782c15ce30 0x7f782c1f6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:43.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f7831d6d700 1 --2- 172.21.15.125:0/2527512372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f782c0caa10 0x7f782c1f29f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f782000c4d0 tx=0x7f782000c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:43.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f782affd700 1 -- 172.21.15.125:0/2527512372 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7820005d90 con 0x7f782c0caa10 2023-10-17T06:07:43.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f782affd700 1 -- 172.21.15.125:0/2527512372 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78200070d0 con 0x7f782c0caa10 2023-10-17T06:07:43.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f78347d2700 1 -- 172.21.15.125:0/2527512372 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c15f160 con 0x7f782c0caa10 2023-10-17T06:07:43.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f782affd700 1 -- 172.21.15.125:0/2527512372 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7820007480 con 0x7f782c0caa10 2023-10-17T06:07:43.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f78347d2700 1 -- 172.21.15.125:0/2527512372 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c0c58f0 con 0x7f782c0caa10 2023-10-17T06:07:43.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.671+0000 7f78347d2700 1 -- 172.21.15.125:0/2527512372 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782c072e60 con 0x7f782c0caa10 2023-10-17T06:07:43.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.675+0000 7f782affd700 1 -- 172.21.15.125:0/2527512372 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f78200075e0 con 0x7f782c0caa10 2023-10-17T06:07:43.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.675+0000 7f782affd700 1 --2- 172.21.15.125:0/2527512372 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f78180656f0 0x7f7818067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:43.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.675+0000 7f782affd700 1 -- 172.21.15.125:0/2527512372 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7820082630 con 0x7f782c0caa10 2023-10-17T06:07:43.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.675+0000 7f783256e700 1 --2- 172.21.15.125:0/2527512372 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f78180656f0 0x7f7818067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:43.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.675+0000 7f783256e700 1 --2- 172.21.15.125:0/2527512372 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f78180656f0 0x7f7818067bb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f781c000f60 tx=0x7f781c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:43.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.679+0000 7f782affd700 1 -- 172.21.15.125:0/2527512372 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f782004fd60 con 0x7f782c0caa10 2023-10-17T06:07:43.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.859+0000 7f78347d2700 1 -- 172.21.15.125:0/2527512372 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f782c06d0f0 con 0x7f782c0caa10 2023-10-17T06:07:43.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.859+0000 7f782affd700 1 -- 172.21.15.125:0/2527512372 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7820053380 con 0x7f782c0caa10 2023-10-17T06:07:43.864 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:07:43.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.863+0000 7f78347d2700 1 -- 172.21.15.125:0/2527512372 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f78180656f0 msgr2=0x7f7818067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:43.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.863+0000 7f78347d2700 1 --2- 172.21.15.125:0/2527512372 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f78180656f0 0x7f7818067bb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f781c000f60 tx=0x7f781c009040 comp rx=0 tx=0).stop 2023-10-17T06:07:43.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.863+0000 7f78347d2700 1 -- 172.21.15.125:0/2527512372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f782c0caa10 msgr2=0x7f782c1f29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:43.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.863+0000 7f78347d2700 1 --2- 172.21.15.125:0/2527512372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f782c0caa10 0x7f782c1f29f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f782000c4d0 tx=0x7f782000c7e0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.863+0000 7f78347d2700 1 -- 172.21.15.125:0/2527512372 shutdown_connections 2023-10-17T06:07:43.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.863+0000 7f78347d2700 1 --2- 172.21.15.125:0/2527512372 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f78180656f0 0x7f7818067bb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.863+0000 7f78347d2700 1 --2- 172.21.15.125:0/2527512372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f782c15ce30 0x7f782c1f6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.863+0000 7f78347d2700 1 --2- 172.21.15.125:0/2527512372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f782c0caa10 0x7f782c1f29f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.863+0000 7f78347d2700 1 --2- 172.21.15.125:0/2527512372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f782c06f450 0x7f782c15e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:43.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.867+0000 7f78347d2700 1 -- 172.21.15.125:0/2527512372 >> 172.21.15.125:0/2527512372 conn(0x7f782c0ce820 msgr2=0x7f782c15b320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:43.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.867+0000 7f78347d2700 1 -- 172.21.15.125:0/2527512372 shutdown_connections 2023-10-17T06:07:43.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:43.867+0000 7f78347d2700 1 -- 172.21.15.125:0/2527512372 wait complete. 2023-10-17T06:07:43.891 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:07:44.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.075+0000 7fe256cdf700 1 Processor -- start 2023-10-17T06:07:44.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.075+0000 7fe256cdf700 1 -- start start 2023-10-17T06:07:44.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.079+0000 7fe256cdf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe2500c1e30 0x7fe25006f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:44.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.079+0000 7fe256cdf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe25006ec20 0x7fe2500c9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:44.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.079+0000 7fe256cdf700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2500cc3f0 con 0x7fe2500cad50 2023-10-17T06:07:44.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.079+0000 7fe256cdf700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2500c2210 con 0x7fe2500c1e30 2023-10-17T06:07:44.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.079+0000 7fe256cdf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25006d820 con 0x7fe25006ec20 2023-10-17T06:07:44.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.079+0000 7fe254a7b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe2500c1e30 0x7fe25006f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:44.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.079+0000 7fe254a7b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe2500c1e30 0x7fe25006f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47172/0 (socket says 172.21.15.125:47172) 2023-10-17T06:07:44.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.079+0000 7fe254a7b700 1 -- 172.21.15.125:0/1676703992 learned_addr learned my addr 172.21.15.125:0/1676703992 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:44.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.079+0000 7fe25527c700 1 --2- 172.21.15.125:0/1676703992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe25006ec20 0x7fe2500c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:44.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.079+0000 7fe254a7b700 1 -- 172.21.15.125:0/1676703992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe25006ec20 msgr2=0x7fe2500c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:44.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.079+0000 7fe254a7b700 1 --2- 172.21.15.125:0/1676703992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe25006ec20 0x7fe2500c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.079+0000 7fe254a7b700 1 -- 172.21.15.125:0/1676703992 >> v1:172.21.15.184:6789/0 conn(0x7fe2500cad50 legacy=0x7fe25006e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:44.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.079+0000 7fe254a7b700 1 -- 172.21.15.125:0/1676703992 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25006e080 con 0x7fe2500c1e30 2023-10-17T06:07:44.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.079+0000 7fe25527c700 1 --2- 172.21.15.125:0/1676703992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe25006ec20 0x7fe2500c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:44.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.079+0000 7fe254a7b700 1 --2- 172.21.15.125:0/1676703992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2500c1e30 0x7fe25006f450 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe244009910 tx=0x7fe244009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e2de6a4b65d6ec server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:44.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.079+0000 7fe24f7fe700 1 -- 172.21.15.125:0/1676703992 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244004230 con 0x7fe2500c1e30 2023-10-17T06:07:44.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.079+0000 7fe24f7fe700 1 -- 172.21.15.125:0/1676703992 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe244004390 con 0x7fe2500c1e30 2023-10-17T06:07:44.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.079+0000 7fe24f7fe700 1 -- 172.21.15.125:0/1676703992 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244009e60 con 0x7fe2500c1e30 2023-10-17T06:07:44.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.079+0000 7fe256cdf700 1 -- 172.21.15.125:0/1676703992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2500c1e30 msgr2=0x7fe25006f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:44.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.079+0000 7fe256cdf700 1 --2- 172.21.15.125:0/1676703992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2500c1e30 0x7fe25006f450 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe244009910 tx=0x7fe244009c20 comp rx=0 tx=0).stop 2023-10-17T06:07:44.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.083+0000 7fe256cdf700 1 -- 172.21.15.125:0/1676703992 shutdown_connections 2023-10-17T06:07:44.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.083+0000 7fe256cdf700 1 --2- 172.21.15.125:0/1676703992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe25006ec20 0x7fe2500c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.083+0000 7fe256cdf700 1 --2- 172.21.15.125:0/1676703992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2500c1e30 0x7fe25006f450 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.083+0000 7fe256cdf700 1 -- 172.21.15.125:0/1676703992 >> 172.21.15.125:0/1676703992 conn(0x7fe2500ce820 msgr2=0x7fe2500cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:44.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.083+0000 7fe256cdf700 1 -- 172.21.15.125:0/1676703992 shutdown_connections 2023-10-17T06:07:44.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.083+0000 7fe256cdf700 1 -- 172.21.15.125:0/1676703992 wait complete. 2023-10-17T06:07:44.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.083+0000 7fe256cdf700 1 Processor -- start 2023-10-17T06:07:44.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.083+0000 7fe256cdf700 1 -- start start 2023-10-17T06:07:44.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe256cdf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe25006ec20 0x7fe25015b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:44.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe256cdf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2500c1e30 0x7fe2500c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:44.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe256cdf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2500cad50 0x7fe2500cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:44.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe256cdf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25015c670 con 0x7fe25006ec20 2023-10-17T06:07:44.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe256cdf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25015c950 con 0x7fe2500cad50 2023-10-17T06:07:44.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe256cdf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25015cc30 con 0x7fe2500c1e30 2023-10-17T06:07:44.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe254a7b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe25006ec20 0x7fe25015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:44.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe254a7b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe25006ec20 0x7fe25015b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47182/0 (socket says 172.21.15.125:47182) 2023-10-17T06:07:44.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe254a7b700 1 -- 172.21.15.125:0/1169960249 learned_addr learned my addr 172.21.15.125:0/1169960249 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:44.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe25527c700 1 --2- 172.21.15.125:0/1169960249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2500cad50 0x7fe2500cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:44.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe24ffff700 1 --2- 172.21.15.125:0/1169960249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2500c1e30 0x7fe2500c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:44.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe254a7b700 1 -- 172.21.15.125:0/1169960249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2500c1e30 msgr2=0x7fe2500c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:44.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe254a7b700 1 --2- 172.21.15.125:0/1169960249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2500c1e30 0x7fe2500c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe254a7b700 1 -- 172.21.15.125:0/1169960249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2500cad50 msgr2=0x7fe2500cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:44.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe254a7b700 1 --2- 172.21.15.125:0/1169960249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2500cad50 0x7fe2500cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe254a7b700 1 -- 172.21.15.125:0/1169960249 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe244009570 con 0x7fe25006ec20 2023-10-17T06:07:44.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe24ffff700 1 --2- 172.21.15.125:0/1169960249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2500c1e30 0x7fe2500c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:44.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe254a7b700 1 --2- 172.21.15.125:0/1169960249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe25006ec20 0x7fe25015b260 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe244004000 tx=0x7fe244004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:44.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe24d7fa700 1 -- 172.21.15.125:0/1169960249 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24400bd30 con 0x7fe25006ec20 2023-10-17T06:07:44.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe24d7fa700 1 -- 172.21.15.125:0/1169960249 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24401f070 con 0x7fe25006ec20 2023-10-17T06:07:44.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe24d7fa700 1 -- 172.21.15.125:0/1169960249 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2440038e0 con 0x7fe25006ec20 2023-10-17T06:07:44.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe256cdf700 1 -- 172.21.15.125:0/1169960249 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25015cf10 con 0x7fe25006ec20 2023-10-17T06:07:44.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.087+0000 7fe256cdf700 1 -- 172.21.15.125:0/1169960249 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25015d710 con 0x7fe25006ec20 2023-10-17T06:07:44.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.091+0000 7fe256cdf700 1 -- 172.21.15.125:0/1169960249 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25015d430 con 0x7fe25006ec20 2023-10-17T06:07:44.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.091+0000 7fe24d7fa700 1 -- 172.21.15.125:0/1169960249 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe244021030 con 0x7fe25006ec20 2023-10-17T06:07:44.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.091+0000 7fe24d7fa700 1 --2- 172.21.15.125:0/1169960249 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe2340656f0 0x7fe234067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:44.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.091+0000 7fe24d7fa700 1 -- 172.21.15.125:0/1169960249 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe244084740 con 0x7fe25006ec20 2023-10-17T06:07:44.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.095+0000 7fe24ffff700 1 --2- 172.21.15.125:0/1169960249 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe2340656f0 0x7fe234067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:44.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.095+0000 7fe24ffff700 1 --2- 172.21.15.125:0/1169960249 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe2340656f0 0x7fe234067bb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe2500c7450 tx=0x7fe23c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:44.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.099+0000 7fe24d7fa700 1 -- 172.21.15.125:0/1169960249 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe25015d430 con 0x7fe25006ec20 2023-10-17T06:07:44.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.275+0000 7fe256cdf700 1 -- 172.21.15.125:0/1169960249 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe25015d430 con 0x7fe25006ec20 2023-10-17T06:07:44.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.275+0000 7fe24d7fa700 1 -- 172.21.15.125:0/1169960249 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe25015d430 con 0x7fe25006ec20 2023-10-17T06:07:44.279 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:07:44.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.279+0000 7fe256cdf700 1 -- 172.21.15.125:0/1169960249 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe2340656f0 msgr2=0x7fe234067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:44.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.279+0000 7fe256cdf700 1 --2- 172.21.15.125:0/1169960249 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe2340656f0 0x7fe234067bb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe2500c7450 tx=0x7fe23c008040 comp rx=0 tx=0).stop 2023-10-17T06:07:44.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.279+0000 7fe256cdf700 1 -- 172.21.15.125:0/1169960249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe25006ec20 msgr2=0x7fe25015b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:44.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.279+0000 7fe256cdf700 1 --2- 172.21.15.125:0/1169960249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe25006ec20 0x7fe25015b260 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe244004000 tx=0x7fe244004770 comp rx=0 tx=0).stop 2023-10-17T06:07:44.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.279+0000 7fe256cdf700 1 -- 172.21.15.125:0/1169960249 shutdown_connections 2023-10-17T06:07:44.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.279+0000 7fe256cdf700 1 --2- 172.21.15.125:0/1169960249 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe2340656f0 0x7fe234067bb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.279+0000 7fe256cdf700 1 --2- 172.21.15.125:0/1169960249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2500cad50 0x7fe2500cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.279+0000 7fe256cdf700 1 --2- 172.21.15.125:0/1169960249 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2500c1e30 0x7fe2500c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.279+0000 7fe256cdf700 1 --2- 172.21.15.125:0/1169960249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe25006ec20 0x7fe25015b260 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.279+0000 7fe256cdf700 1 -- 172.21.15.125:0/1169960249 >> 172.21.15.125:0/1169960249 conn(0x7fe2500ce820 msgr2=0x7fe2500c4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:44.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.279+0000 7fe256cdf700 1 -- 172.21.15.125:0/1169960249 shutdown_connections 2023-10-17T06:07:44.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.279+0000 7fe256cdf700 1 -- 172.21.15.125:0/1169960249 wait complete. 2023-10-17T06:07:44.305 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-17T06:07:44.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.479+0000 7f6924953700 1 Processor -- start 2023-10-17T06:07:44.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.479+0000 7f6924953700 1 -- start start 2023-10-17T06:07:44.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.479+0000 7f6924953700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69200d2e00 0x7f69200b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:44.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.483+0000 7f6924953700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f69200b5ae0 0x7f692006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:44.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.483+0000 7f6924953700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692015d0d0 con 0x7f6920160710 2023-10-17T06:07:44.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.483+0000 7f6924953700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f692015df90 con 0x7f69200b5ae0 2023-10-17T06:07:44.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.483+0000 7f6924953700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692006f0f0 con 0x7f69200d2e00 2023-10-17T06:07:44.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.483+0000 7f691e59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6920160710 0x7f69200d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59528/0 (socket says 172.21.15.125:59528) 2023-10-17T06:07:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.483+0000 7f691e59c700 1 -- 172.21.15.125:0/234393683 learned_addr learned my addr 172.21.15.125:0/234393683 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.483+0000 7f691f59e700 1 --2- 172.21.15.125:0/234393683 >> v2:172.21.15.184:3300/0 conn(0x7f69200b5ae0 0x7f692006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.483+0000 7f691ed9d700 1 --2- 172.21.15.125:0/234393683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69200d2e00 0x7f69200b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.483+0000 7f691dd9b700 1 -- 172.21.15.125:0/234393683 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3685399079 0 0) 0x7f6914001110 con 0x7f6920160710 2023-10-17T06:07:44.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.483+0000 7f691dd9b700 1 -- 172.21.15.125:0/234393683 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69080035d0 con 0x7f6920160710 2023-10-17T06:07:44.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.483+0000 7f691f59e700 1 -- 172.21.15.125:0/234393683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69200d2e00 msgr2=0x7f69200b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:44.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.483+0000 7f691f59e700 1 --2- 172.21.15.125:0/234393683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69200d2e00 0x7f69200b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.483+0000 7f691f59e700 1 -- 172.21.15.125:0/234393683 >> v1:172.21.15.125:6789/0 conn(0x7f6920160710 legacy=0x7f69200d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:44.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.483+0000 7f691f59e700 1 -- 172.21.15.125:0/234393683 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692015d310 con 0x7f69200b5ae0 2023-10-17T06:07:44.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.483+0000 7f691f59e700 1 --2- 172.21.15.125:0/234393683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69200b5ae0 0x7f692006db60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6918009dc0 tx=0x7f691800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d92c04444cebb88e server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:44.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.483+0000 7f691dd9b700 1 -- 172.21.15.125:0/234393683 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691800e070 con 0x7f69200b5ae0 2023-10-17T06:07:44.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.483+0000 7f691dd9b700 1 -- 172.21.15.125:0/234393683 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691800bae0 con 0x7f69200b5ae0 2023-10-17T06:07:44.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.483+0000 7f691dd9b700 1 -- 172.21.15.125:0/234393683 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691800be90 con 0x7f69200b5ae0 2023-10-17T06:07:44.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.487+0000 7f6924953700 1 -- 172.21.15.125:0/234393683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69200b5ae0 msgr2=0x7f692006db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:44.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.487+0000 7f6924953700 1 --2- 172.21.15.125:0/234393683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69200b5ae0 0x7f692006db60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6918009dc0 tx=0x7f691800b330 comp rx=0 tx=0).stop 2023-10-17T06:07:44.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.487+0000 7f6924953700 1 -- 172.21.15.125:0/234393683 shutdown_connections 2023-10-17T06:07:44.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.487+0000 7f6924953700 1 --2- 172.21.15.125:0/234393683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69200b5ae0 0x7f692006db60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.487+0000 7f6924953700 1 --2- 172.21.15.125:0/234393683 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69200d2e00 0x7f69200b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.487+0000 7f6924953700 1 -- 172.21.15.125:0/234393683 >> 172.21.15.125:0/234393683 conn(0x7f6920069f20 msgr2=0x7f692006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:44.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.487+0000 7f6924953700 1 -- 172.21.15.125:0/234393683 shutdown_connections 2023-10-17T06:07:44.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.487+0000 7f6924953700 1 -- 172.21.15.125:0/234393683 wait complete. 2023-10-17T06:07:44.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.491+0000 7f6924953700 1 Processor -- start 2023-10-17T06:07:44.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.491+0000 7f6924953700 1 -- start start 2023-10-17T06:07:44.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.491+0000 7f6924953700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69200b5ae0 0x7f6920146880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:44.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.491+0000 7f6924953700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69200d2e00 0x7f69201f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:44.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.491+0000 7f6924953700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6920160710 0x7f69200b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:44.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.491+0000 7f6924953700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69200b2750 con 0x7f69200b5ae0 2023-10-17T06:07:44.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.491+0000 7f6924953700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69201f5e50 con 0x7f6920160710 2023-10-17T06:07:44.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.491+0000 7f6924953700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69200b29c0 con 0x7f69200d2e00 2023-10-17T06:07:44.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.491+0000 7f691ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69200b5ae0 0x7f6920146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:44.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.491+0000 7f691ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69200b5ae0 0x7f6920146880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47192/0 (socket says 172.21.15.125:47192) 2023-10-17T06:07:44.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.491+0000 7f691ed9d700 1 -- 172.21.15.125:0/3978180899 learned_addr learned my addr 172.21.15.125:0/3978180899 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:44.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.491+0000 7f691e59c700 1 --2- 172.21.15.125:0/3978180899 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69200d2e00 0x7f69201f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:44.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.491+0000 7f691f59e700 1 --2- 172.21.15.125:0/3978180899 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6920160710 0x7f69200b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:44.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.491+0000 7f691ed9d700 1 -- 172.21.15.125:0/3978180899 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69200d2e00 msgr2=0x7f69201f5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:44.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.491+0000 7f691ed9d700 1 --2- 172.21.15.125:0/3978180899 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69200d2e00 0x7f69201f5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.491+0000 7f691ed9d700 1 -- 172.21.15.125:0/3978180899 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6920160710 msgr2=0x7f69200b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:44.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.491+0000 7f691ed9d700 1 --2- 172.21.15.125:0/3978180899 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6920160710 0x7f69200b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.491+0000 7f691ed9d700 1 -- 172.21.15.125:0/3978180899 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6918009a70 con 0x7f69200b5ae0 2023-10-17T06:07:44.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.491+0000 7f691f59e700 1 --2- 172.21.15.125:0/3978180899 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6920160710 0x7f69200b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:44.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.495+0000 7f691ed9d700 1 --2- 172.21.15.125:0/3978180899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69200b5ae0 0x7f6920146880 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f691000e870 tx=0x7f691000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:44.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.495+0000 7f69077fe700 1 -- 172.21.15.125:0/3978180899 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69100095a0 con 0x7f69200b5ae0 2023-10-17T06:07:44.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.495+0000 7f69077fe700 1 -- 172.21.15.125:0/3978180899 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691000ee70 con 0x7f69200b5ae0 2023-10-17T06:07:44.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.495+0000 7f6924953700 1 -- 172.21.15.125:0/3978180899 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69201f6090 con 0x7f69200b5ae0 2023-10-17T06:07:44.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.495+0000 7f69077fe700 1 -- 172.21.15.125:0/3978180899 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691000c9f0 con 0x7f69200b5ae0 2023-10-17T06:07:44.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.495+0000 7f6924953700 1 -- 172.21.15.125:0/3978180899 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69201f6650 con 0x7f69200b5ae0 2023-10-17T06:07:44.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.495+0000 7f6924953700 1 -- 172.21.15.125:0/3978180899 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f692015db90 con 0x7f69200b5ae0 2023-10-17T06:07:44.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.495+0000 7f69077fe700 1 -- 172.21.15.125:0/3978180899 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f691000cb50 con 0x7f69200b5ae0 2023-10-17T06:07:44.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.499+0000 7f69077fe700 1 --2- 172.21.15.125:0/3978180899 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f690c0656f0 0x7f690c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:44.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.499+0000 7f69077fe700 1 -- 172.21.15.125:0/3978180899 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6910083030 con 0x7f69200b5ae0 2023-10-17T06:07:44.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.499+0000 7f691e59c700 1 --2- 172.21.15.125:0/3978180899 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f690c0656f0 0x7f690c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:44.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.499+0000 7f691e59c700 1 --2- 172.21.15.125:0/3978180899 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f690c0656f0 0x7f690c067bb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f692015ca20 tx=0x7f6914009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:44.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.503+0000 7f69077fe700 1 -- 172.21.15.125:0/3978180899 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f692015db90 con 0x7f69200b5ae0 2023-10-17T06:07:44.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.683+0000 7f6924953700 1 -- 172.21.15.125:0/3978180899 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f692015db90 con 0x7f69200b5ae0 2023-10-17T06:07:44.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.683+0000 7f69077fe700 1 -- 172.21.15.125:0/3978180899 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f692015db90 con 0x7f69200b5ae0 2023-10-17T06:07:44.686 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:07:44.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.687+0000 7f6924953700 1 -- 172.21.15.125:0/3978180899 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f690c0656f0 msgr2=0x7f690c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:44.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.687+0000 7f6924953700 1 --2- 172.21.15.125:0/3978180899 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f690c0656f0 0x7f690c067bb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f692015ca20 tx=0x7f6914009040 comp rx=0 tx=0).stop 2023-10-17T06:07:44.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.687+0000 7f6924953700 1 -- 172.21.15.125:0/3978180899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69200b5ae0 msgr2=0x7f6920146880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:44.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.687+0000 7f6924953700 1 --2- 172.21.15.125:0/3978180899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69200b5ae0 0x7f6920146880 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f691000e870 tx=0x7f691000ec30 comp rx=0 tx=0).stop 2023-10-17T06:07:44.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.687+0000 7f6924953700 1 -- 172.21.15.125:0/3978180899 shutdown_connections 2023-10-17T06:07:44.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.687+0000 7f6924953700 1 --2- 172.21.15.125:0/3978180899 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f690c0656f0 0x7f690c067bb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.687+0000 7f6924953700 1 --2- 172.21.15.125:0/3978180899 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6920160710 0x7f69200b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.687+0000 7f6924953700 1 --2- 172.21.15.125:0/3978180899 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69200d2e00 0x7f69201f5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.687+0000 7f6924953700 1 --2- 172.21.15.125:0/3978180899 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69200b5ae0 0x7f6920146880 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.687+0000 7f6924953700 1 -- 172.21.15.125:0/3978180899 >> 172.21.15.125:0/3978180899 conn(0x7f6920069f20 msgr2=0x7f692015b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:44.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.687+0000 7f6924953700 1 -- 172.21.15.125:0/3978180899 shutdown_connections 2023-10-17T06:07:44.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.687+0000 7f6924953700 1 -- 172.21.15.125:0/3978180899 wait complete. 2023-10-17T06:07:44.713 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-17T06:07:44.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.887+0000 7f9a85970700 1 Processor -- start 2023-10-17T06:07:44.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.891+0000 7f9a85970700 1 -- start start 2023-10-17T06:07:44.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.891+0000 7f9a85970700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9a8015dcf0 0x7f9a8006fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:44.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.891+0000 7f9a85970700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a800d2e20 0x7f9a800d3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:44.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.891+0000 7f9a85970700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a800d37a0 con 0x7f9a800d23e0 2023-10-17T06:07:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.891+0000 7f9a85970700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a8015e160 con 0x7f9a8015dcf0 2023-10-17T06:07:44.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.891+0000 7f9a85970700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a800b6e40 con 0x7f9a800d2e20 2023-10-17T06:07:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a7effd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9a800d23e0 0x7f9a800b65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59532/0 (socket says 172.21.15.125:59532) 2023-10-17T06:07:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a7effd700 1 -- 172.21.15.125:0/2969087363 learned_addr learned my addr 172.21.15.125:0/2969087363 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a7e7fc700 1 --2- 172.21.15.125:0/2969087363 >> v2:172.21.15.184:3300/0 conn(0x7f9a8015dcf0 0x7f9a8006fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:44.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a7f7fe700 1 --2- 172.21.15.125:0/2969087363 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a800d2e20 0x7f9a800d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:44.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a7dffb700 1 -- 172.21.15.125:0/2969087363 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3811287716 0 0) 0x7f9a800d37a0 con 0x7f9a800d23e0 2023-10-17T06:07:44.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a7e7fc700 1 -- 172.21.15.125:0/2969087363 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a800d2e20 msgr2=0x7f9a800d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:44.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a7e7fc700 1 --2- 172.21.15.125:0/2969087363 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a800d2e20 0x7f9a800d3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a7e7fc700 1 -- 172.21.15.125:0/2969087363 >> v1:172.21.15.125:6789/0 conn(0x7f9a800d23e0 legacy=0x7f9a800b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:44.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a7e7fc700 1 -- 172.21.15.125:0/2969087363 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a800b7120 con 0x7f9a8015dcf0 2023-10-17T06:07:44.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a7e7fc700 1 --2- 172.21.15.125:0/2969087363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a8015dcf0 0x7f9a8006fef0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009850 tx=0x7f9a74009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22424af8d3877bc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:44.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a7dffb700 1 -- 172.21.15.125:0/2969087363 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74011830 con 0x7f9a8015dcf0 2023-10-17T06:07:44.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a7dffb700 1 -- 172.21.15.125:0/2969087363 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a74011990 con 0x7f9a8015dcf0 2023-10-17T06:07:44.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a7dffb700 1 -- 172.21.15.125:0/2969087363 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74011d40 con 0x7f9a8015dcf0 2023-10-17T06:07:44.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a85970700 1 -- 172.21.15.125:0/2969087363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a8015dcf0 msgr2=0x7f9a8006fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:44.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a85970700 1 --2- 172.21.15.125:0/2969087363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a8015dcf0 0x7f9a8006fef0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009850 tx=0x7f9a74009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:44.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a85970700 1 -- 172.21.15.125:0/2969087363 shutdown_connections 2023-10-17T06:07:44.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a85970700 1 --2- 172.21.15.125:0/2969087363 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a800d2e20 0x7f9a800d3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a85970700 1 --2- 172.21.15.125:0/2969087363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a8015dcf0 0x7f9a8006fef0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a85970700 1 -- 172.21.15.125:0/2969087363 >> 172.21.15.125:0/2969087363 conn(0x7f9a80069f20 msgr2=0x7f9a8006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:44.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a85970700 1 -- 172.21.15.125:0/2969087363 shutdown_connections 2023-10-17T06:07:44.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.895+0000 7f9a85970700 1 -- 172.21.15.125:0/2969087363 wait complete. 2023-10-17T06:07:44.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.899+0000 7f9a85970700 1 Processor -- start 2023-10-17T06:07:44.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.899+0000 7f9a85970700 1 -- start start 2023-10-17T06:07:44.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.899+0000 7f9a85970700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a800d23e0 0x7f9a80152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:44.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.899+0000 7f9a85970700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a800d2e20 0x7f9a8014dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:44.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.899+0000 7f9a85970700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a8015dcf0 0x7f9a80153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:44.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.899+0000 7f9a85970700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a801589e0 con 0x7f9a800d23e0 2023-10-17T06:07:44.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.899+0000 7f9a85970700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a801525a0 con 0x7f9a8015dcf0 2023-10-17T06:07:44.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.899+0000 7f9a85970700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a801533e0 con 0x7f9a800d2e20 2023-10-17T06:07:44.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.899+0000 7f9a7effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a800d23e0 0x7f9a80152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:44.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.899+0000 7f9a7effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a800d23e0 0x7f9a80152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47196/0 (socket says 172.21.15.125:47196) 2023-10-17T06:07:44.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.899+0000 7f9a7effd700 1 -- 172.21.15.125:0/2075203789 learned_addr learned my addr 172.21.15.125:0/2075203789 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:44.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.899+0000 7f9a7e7fc700 1 --2- 172.21.15.125:0/2075203789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a800d2e20 0x7f9a8014dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:44.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.899+0000 7f9a7f7fe700 1 --2- 172.21.15.125:0/2075203789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a8015dcf0 0x7f9a80153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:44.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.899+0000 7f9a7effd700 1 -- 172.21.15.125:0/2075203789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a800d2e20 msgr2=0x7f9a8014dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:44.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.899+0000 7f9a7effd700 1 --2- 172.21.15.125:0/2075203789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a800d2e20 0x7f9a8014dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.899+0000 7f9a7effd700 1 -- 172.21.15.125:0/2075203789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a8015dcf0 msgr2=0x7f9a80153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:44.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.899+0000 7f9a7effd700 1 --2- 172.21.15.125:0/2075203789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a8015dcf0 0x7f9a80153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:44.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.899+0000 7f9a7effd700 1 -- 172.21.15.125:0/2075203789 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a740094b0 con 0x7f9a800d23e0 2023-10-17T06:07:44.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.899+0000 7f9a7f7fe700 1 --2- 172.21.15.125:0/2075203789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a8015dcf0 0x7f9a80153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:44.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.903+0000 7f9a7effd700 1 --2- 172.21.15.125:0/2075203789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a800d23e0 0x7f9a80152060 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000c5b0 tx=0x7f9a7000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:44.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.903+0000 7f9a67fff700 1 -- 172.21.15.125:0/2075203789 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70004ca0 con 0x7f9a800d23e0 2023-10-17T06:07:44.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.903+0000 7f9a85970700 1 -- 172.21.15.125:0/2075203789 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a801527d0 con 0x7f9a800d23e0 2023-10-17T06:07:44.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.903+0000 7f9a67fff700 1 -- 172.21.15.125:0/2075203789 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a70004e20 con 0x7f9a800d23e0 2023-10-17T06:07:44.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.903+0000 7f9a67fff700 1 -- 172.21.15.125:0/2075203789 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70007310 con 0x7f9a800d23e0 2023-10-17T06:07:44.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.903+0000 7f9a85970700 1 -- 172.21.15.125:0/2075203789 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a80152d90 con 0x7f9a800d23e0 2023-10-17T06:07:44.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.903+0000 7f9a85970700 1 -- 172.21.15.125:0/2075203789 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8004e910 con 0x7f9a800d23e0 2023-10-17T06:07:44.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.907+0000 7f9a67fff700 1 -- 172.21.15.125:0/2075203789 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9a70007470 con 0x7f9a800d23e0 2023-10-17T06:07:44.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.907+0000 7f9a67fff700 1 --2- 172.21.15.125:0/2075203789 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9a6c0656f0 0x7f9a6c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:44.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.907+0000 7f9a67fff700 1 -- 172.21.15.125:0/2075203789 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9a70082f00 con 0x7f9a800d23e0 2023-10-17T06:07:44.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.907+0000 7f9a7e7fc700 1 --2- 172.21.15.125:0/2075203789 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9a6c0656f0 0x7f9a6c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:44.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.907+0000 7f9a7e7fc700 1 --2- 172.21.15.125:0/2075203789 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9a6c0656f0 0x7f9a6c067bb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9a740090b0 tx=0x7f9a7401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:44.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:44.915+0000 7f9a67fff700 1 -- 172.21.15.125:0/2075203789 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f9a70050640 con 0x7f9a800d23e0 2023-10-17T06:07:45.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.091+0000 7f9a85970700 1 -- 172.21.15.125:0/2075203789 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9a800ceac0 con 0x7f9a800d23e0 2023-10-17T06:07:45.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.091+0000 7f9a67fff700 1 -- 172.21.15.125:0/2075203789 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9a70007720 con 0x7f9a800d23e0 2023-10-17T06:07:45.095 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-17T06:07:45.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.095+0000 7f9a85970700 1 -- 172.21.15.125:0/2075203789 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9a6c0656f0 msgr2=0x7f9a6c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:45.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.095+0000 7f9a85970700 1 --2- 172.21.15.125:0/2075203789 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9a6c0656f0 0x7f9a6c067bb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9a740090b0 tx=0x7f9a7401c040 comp rx=0 tx=0).stop 2023-10-17T06:07:45.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.095+0000 7f9a85970700 1 -- 172.21.15.125:0/2075203789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a800d23e0 msgr2=0x7f9a80152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:45.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.095+0000 7f9a85970700 1 --2- 172.21.15.125:0/2075203789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a800d23e0 0x7f9a80152060 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000c5b0 tx=0x7f9a7000c970 comp rx=0 tx=0).stop 2023-10-17T06:07:45.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.095+0000 7f9a85970700 1 -- 172.21.15.125:0/2075203789 shutdown_connections 2023-10-17T06:07:45.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.095+0000 7f9a85970700 1 --2- 172.21.15.125:0/2075203789 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9a6c0656f0 0x7f9a6c067bb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.095+0000 7f9a85970700 1 --2- 172.21.15.125:0/2075203789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a8015dcf0 0x7f9a80153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.095+0000 7f9a85970700 1 --2- 172.21.15.125:0/2075203789 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9a800d2e20 0x7f9a8014dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.095+0000 7f9a85970700 1 --2- 172.21.15.125:0/2075203789 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a800d23e0 0x7f9a80152060 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.095+0000 7f9a85970700 1 -- 172.21.15.125:0/2075203789 >> 172.21.15.125:0/2075203789 conn(0x7f9a80069f20 msgr2=0x7f9a80160e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:45.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.095+0000 7f9a85970700 1 -- 172.21.15.125:0/2075203789 shutdown_connections 2023-10-17T06:07:45.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.095+0000 7f9a85970700 1 -- 172.21.15.125:0/2075203789 wait complete. 2023-10-17T06:07:45.121 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-17T06:07:45.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.295+0000 7f36c3f86700 1 Processor -- start 2023-10-17T06:07:45.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.295+0000 7f36c3f86700 1 -- start start 2023-10-17T06:07:45.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c3f86700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f36bc06ec20 0x7f36bc16c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:45.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c3f86700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36bc0cc3f0 con 0x7f36bc0c1e30 2023-10-17T06:07:45.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c3f86700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36bc06e080 con 0x7f36bc0cad50 2023-10-17T06:07:45.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c3f86700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36bc0c2210 con 0x7f36bc06ec20 2023-10-17T06:07:45.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c1d22700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f36bc0c1e30 0x7f36bc06f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59534/0 (socket says 172.21.15.125:59534) 2023-10-17T06:07:45.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c1d22700 1 -- 172.21.15.125:0/3735832395 learned_addr learned my addr 172.21.15.125:0/3735832395 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:45.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c2523700 1 --2- 172.21.15.125:0/3735832395 >> v2:172.21.15.184:3300/0 conn(0x7f36bc06ec20 0x7f36bc16c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:45.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c0d20700 1 -- 172.21.15.125:0/3735832395 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958014824 0 0) 0x7f36bc0cc3f0 con 0x7f36bc0c1e30 2023-10-17T06:07:45.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c0d20700 1 -- 172.21.15.125:0/3735832395 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36a80035d0 con 0x7f36bc0c1e30 2023-10-17T06:07:45.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c0d20700 1 -- 172.21.15.125:0/3735832395 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453022754 0 0) 0x7f36bc06e080 con 0x7f36bc0cad50 2023-10-17T06:07:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c0d20700 1 -- 172.21.15.125:0/3735832395 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36bc0cc3f0 con 0x7f36bc0cad50 2023-10-17T06:07:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c0d20700 1 -- 172.21.15.125:0/3735832395 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2117799205 0 0) 0x7f36a80035d0 con 0x7f36bc0c1e30 2023-10-17T06:07:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c0d20700 1 -- 172.21.15.125:0/3735832395 >> v2:172.21.15.184:3300/0 conn(0x7f36bc06ec20 msgr2=0x7f36bc16c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c0d20700 1 --2- 172.21.15.125:0/3735832395 >> v2:172.21.15.184:3300/0 conn(0x7f36bc06ec20 0x7f36bc16c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c0d20700 1 -- 172.21.15.125:0/3735832395 >> v1:172.21.15.184:6789/0 conn(0x7f36bc0cad50 legacy=0x7f36bc06e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:45.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c0d20700 1 -- 172.21.15.125:0/3735832395 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36bc06f0b0 con 0x7f36bc0c1e30 2023-10-17T06:07:45.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c0d20700 1 -- 172.21.15.125:0/3735832395 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7f36b8001670 con 0x7f36bc0c1e30 2023-10-17T06:07:45.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c0d20700 1 -- 172.21.15.125:0/3735832395 >> v1:172.21.15.125:6789/0 conn(0x7f36bc0c1e30 legacy=0x7f36bc06f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:45.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c0d20700 1 --2- 172.21.15.125:0/3735832395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36a8003c20 0x7f36a8004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:45.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c0d20700 1 --2- 172.21.15.125:0/3735832395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36a8004870 0x7f36a8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:45.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.299+0000 7f36c0d20700 1 --2- 172.21.15.125:0/3735832395 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36a8005230 0x7f36a800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:45.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c0d20700 1 -- 172.21.15.125:0/3735832395 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc0c2210 con 0x7f36a8004870 2023-10-17T06:07:45.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c0d20700 1 -- 172.21.15.125:0/3735832395 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a800c130 con 0x7f36a8003c20 2023-10-17T06:07:45.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c0d20700 1 -- 172.21.15.125:0/3735832395 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a800c2f0 con 0x7f36a8005230 2023-10-17T06:07:45.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c1521700 1 --2- 172.21.15.125:0/3735832395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36a8004870 0x7f36a8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:45.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c1d22700 1 --2- 172.21.15.125:0/3735832395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36a8003c20 0x7f36a8004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:45.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c1521700 1 -- 172.21.15.125:0/3735832395 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36a8005230 msgr2=0x7f36a800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:45.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c1521700 1 --2- 172.21.15.125:0/3735832395 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36a8005230 0x7f36a800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c1521700 1 -- 172.21.15.125:0/3735832395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36a8003c20 msgr2=0x7f36a8004000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:45.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c1521700 1 --2- 172.21.15.125:0/3735832395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36a8003c20 0x7f36a8004000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c1521700 1 -- 172.21.15.125:0/3735832395 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a80035d0 con 0x7f36a8004870 2023-10-17T06:07:45.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c2523700 1 -- 172.21.15.125:0/3735832395 reap_dead start 2023-10-17T06:07:45.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c1521700 1 --2- 172.21.15.125:0/3735832395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36a8004870 0x7f36a8004cf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f36ac001960 tx=0x7f36a80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd55940f45842e81 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:45.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c0d20700 1 -- 172.21.15.125:0/3735832395 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac001450 con 0x7f36a8004870 2023-10-17T06:07:45.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c0d20700 1 -- 172.21.15.125:0/3735832395 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac0052f0 con 0x7f36a8004870 2023-10-17T06:07:45.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c0d20700 1 -- 172.21.15.125:0/3735832395 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac0036a0 con 0x7f36a8004870 2023-10-17T06:07:45.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c3f86700 1 -- 172.21.15.125:0/3735832395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36a8004870 msgr2=0x7f36a8004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:45.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c3f86700 1 --2- 172.21.15.125:0/3735832395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36a8004870 0x7f36a8004cf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f36ac001960 tx=0x7f36a80058a0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c3f86700 1 -- 172.21.15.125:0/3735832395 shutdown_connections 2023-10-17T06:07:45.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c3f86700 1 --2- 172.21.15.125:0/3735832395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36a8004870 0x7f36a8004cf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c3f86700 1 -- 172.21.15.125:0/3735832395 >> 172.21.15.125:0/3735832395 conn(0x7f36bc0ce820 msgr2=0x7f36bc0cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:45.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c3f86700 1 -- 172.21.15.125:0/3735832395 shutdown_connections 2023-10-17T06:07:45.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.303+0000 7f36c3f86700 1 -- 172.21.15.125:0/3735832395 wait complete. 2023-10-17T06:07:45.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.307+0000 7f36c3f86700 1 Processor -- start 2023-10-17T06:07:45.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.307+0000 7f36c3f86700 1 -- start start 2023-10-17T06:07:45.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.307+0000 7f36c3f86700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36a8004870 0x7f36bc0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:45.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.307+0000 7f36c3f86700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36bc152e00 0x7f36bc0c00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:45.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.307+0000 7f36c3f86700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36bc0c7ac0 0x7f36bc0c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:45.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.307+0000 7f36c3f86700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc0c8480 con 0x7f36bc152e00 2023-10-17T06:07:45.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.307+0000 7f36c3f86700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc160110 con 0x7f36a8004870 2023-10-17T06:07:45.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.307+0000 7f36c3f86700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36bc153280 con 0x7f36bc0c7ac0 2023-10-17T06:07:45.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.307+0000 7f36c1521700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36bc152e00 0x7f36bc0c00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:45.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.307+0000 7f36c1521700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36bc152e00 0x7f36bc0c00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47208/0 (socket says 172.21.15.125:47208) 2023-10-17T06:07:45.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.307+0000 7f36c1521700 1 -- 172.21.15.125:0/480610440 learned_addr learned my addr 172.21.15.125:0/480610440 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:45.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.307+0000 7f36c1d22700 1 --2- 172.21.15.125:0/480610440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36a8004870 0x7f36bc0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:45.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.307+0000 7f36c2523700 1 --2- 172.21.15.125:0/480610440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36bc0c7ac0 0x7f36bc0c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:45.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.311+0000 7f36c1521700 1 -- 172.21.15.125:0/480610440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36bc0c7ac0 msgr2=0x7f36bc0c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:45.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.311+0000 7f36c1521700 1 --2- 172.21.15.125:0/480610440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36bc0c7ac0 0x7f36bc0c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.311+0000 7f36c1521700 1 -- 172.21.15.125:0/480610440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36a8004870 msgr2=0x7f36bc0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:45.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.311+0000 7f36c1521700 1 --2- 172.21.15.125:0/480610440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36a8004870 0x7f36bc0cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.311+0000 7f36c1521700 1 -- 172.21.15.125:0/480610440 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36bc0c0600 con 0x7f36bc152e00 2023-10-17T06:07:45.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.311+0000 7f36c2523700 1 --2- 172.21.15.125:0/480610440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36bc0c7ac0 0x7f36bc0c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:45.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.311+0000 7f36c1521700 1 --2- 172.21.15.125:0/480610440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36bc152e00 0x7f36bc0c00c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f36ac000c00 tx=0x7f36ac0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:45.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.311+0000 7f36b27fc700 1 -- 172.21.15.125:0/480610440 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac0013d0 con 0x7f36bc152e00 2023-10-17T06:07:45.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.311+0000 7f36b27fc700 1 -- 172.21.15.125:0/480610440 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac006a90 con 0x7f36bc152e00 2023-10-17T06:07:45.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.311+0000 7f36c3f86700 1 -- 172.21.15.125:0/480610440 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36bc0c08c0 con 0x7f36bc152e00 2023-10-17T06:07:45.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.311+0000 7f36b27fc700 1 -- 172.21.15.125:0/480610440 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac006e40 con 0x7f36bc152e00 2023-10-17T06:07:45.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.311+0000 7f36c3f86700 1 -- 172.21.15.125:0/480610440 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36bc0c0e80 con 0x7f36bc152e00 2023-10-17T06:07:45.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.311+0000 7f36c3f86700 1 -- 172.21.15.125:0/480610440 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36bc06ea40 con 0x7f36bc152e00 2023-10-17T06:07:45.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.315+0000 7f36b27fc700 1 -- 172.21.15.125:0/480610440 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f36ac007040 con 0x7f36bc152e00 2023-10-17T06:07:45.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.315+0000 7f36b27fc700 1 --2- 172.21.15.125:0/480610440 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36a00656f0 0x7f36a0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:45.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.315+0000 7f36b27fc700 1 -- 172.21.15.125:0/480610440 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f36ac083a10 con 0x7f36bc152e00 2023-10-17T06:07:45.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.315+0000 7f36c1d22700 1 --2- 172.21.15.125:0/480610440 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36a00656f0 0x7f36a0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:45.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.315+0000 7f36c1d22700 1 --2- 172.21.15.125:0/480610440 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36a00656f0 0x7f36a0067bb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f36b8001eb0 tx=0x7f36b8007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:45.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.323+0000 7f36b27fc700 1 -- 172.21.15.125:0/480610440 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f36ac054d00 con 0x7f36bc152e00 2023-10-17T06:07:45.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.507+0000 7f36c3f86700 1 -- 172.21.15.125:0/480610440 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f36bc072e60 con 0x7f36bc152e00 2023-10-17T06:07:45.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.507+0000 7f36b27fc700 1 -- 172.21.15.125:0/480610440 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f36ac054890 con 0x7f36bc152e00 2023-10-17T06:07:45.511 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:07:45.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.511+0000 7f36c3f86700 1 -- 172.21.15.125:0/480610440 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36a00656f0 msgr2=0x7f36a0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:45.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.511+0000 7f36c3f86700 1 --2- 172.21.15.125:0/480610440 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36a00656f0 0x7f36a0067bb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f36b8001eb0 tx=0x7f36b8007040 comp rx=0 tx=0).stop 2023-10-17T06:07:45.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.511+0000 7f36c3f86700 1 -- 172.21.15.125:0/480610440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36bc152e00 msgr2=0x7f36bc0c00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:45.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.511+0000 7f36c3f86700 1 --2- 172.21.15.125:0/480610440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36bc152e00 0x7f36bc0c00c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f36ac000c00 tx=0x7f36ac0012d0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.511+0000 7f36c3f86700 1 -- 172.21.15.125:0/480610440 shutdown_connections 2023-10-17T06:07:45.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.511+0000 7f36c3f86700 1 --2- 172.21.15.125:0/480610440 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36a00656f0 0x7f36a0067bb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.511+0000 7f36c3f86700 1 --2- 172.21.15.125:0/480610440 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36bc0c7ac0 0x7f36bc0c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.511+0000 7f36c3f86700 1 --2- 172.21.15.125:0/480610440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36bc152e00 0x7f36bc0c00c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.511+0000 7f36c3f86700 1 --2- 172.21.15.125:0/480610440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36a8004870 0x7f36bc0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.511+0000 7f36c3f86700 1 -- 172.21.15.125:0/480610440 >> 172.21.15.125:0/480610440 conn(0x7f36bc0ce820 msgr2=0x7f36bc0ccc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:45.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.511+0000 7f36c3f86700 1 -- 172.21.15.125:0/480610440 shutdown_connections 2023-10-17T06:07:45.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.511+0000 7f36c3f86700 1 -- 172.21.15.125:0/480610440 wait complete. 2023-10-17T06:07:45.536 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:07:45.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.707+0000 7f96a1d30700 1 Processor -- start 2023-10-17T06:07:45.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.707+0000 7f96a1d30700 1 -- start start 2023-10-17T06:07:45.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.707+0000 7f96a1d30700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f969c06d090 0x7f969c0b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:45.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.707+0000 7f96a1d30700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f969c15a410 0x7f969c15a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:45.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.707+0000 7f96a1d30700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969c071120 con 0x7f969c06d470 2023-10-17T06:07:45.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.707+0000 7f96a1d30700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969c15f4f0 con 0x7f969c06d090 2023-10-17T06:07:45.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.707+0000 7f96a1d30700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969c15e990 con 0x7f969c15a410 2023-10-17T06:07:45.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.711+0000 7f96a152f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f969c15a410 0x7f969c15a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:45.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.711+0000 7f96a152f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f969c15a410 0x7f969c15a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:33158/0 (socket says 172.21.15.125:33158) 2023-10-17T06:07:45.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.711+0000 7f96a152f700 1 -- 172.21.15.125:0/408369700 learned_addr learned my addr 172.21.15.125:0/408369700 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:45.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.711+0000 7f96a0d2e700 1 --2- 172.21.15.125:0/408369700 >> v2:172.21.15.184:3300/0 conn(0x7f969c06d090 0x7f969c0b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:45.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.711+0000 7f96a152f700 1 -- 172.21.15.125:0/408369700 >> v2:172.21.15.184:3300/0 conn(0x7f969c06d090 msgr2=0x7f969c0b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:45.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.711+0000 7f96a152f700 1 --2- 172.21.15.125:0/408369700 >> v2:172.21.15.184:3300/0 conn(0x7f969c06d090 0x7f969c0b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.711+0000 7f96a152f700 1 -- 172.21.15.125:0/408369700 >> v1:172.21.15.184:6789/0 conn(0x7f969c06d470 legacy=0x7f969c070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:45.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.711+0000 7f96a152f700 1 -- 172.21.15.125:0/408369700 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c15ec50 con 0x7f969c15a410 2023-10-17T06:07:45.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.711+0000 7f96a152f700 1 --2- 172.21.15.125:0/408369700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f969c15a410 0x7f969c15a8c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9694009e50 tx=0x7f969400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27ccff2567d29d77 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:45.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.711+0000 7f969b7fe700 1 -- 172.21.15.125:0/408369700 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969400e070 con 0x7f969c15a410 2023-10-17T06:07:45.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.711+0000 7f969b7fe700 1 -- 172.21.15.125:0/408369700 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969400b910 con 0x7f969c15a410 2023-10-17T06:07:45.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.711+0000 7f969b7fe700 1 -- 172.21.15.125:0/408369700 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969400bcc0 con 0x7f969c15a410 2023-10-17T06:07:45.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.711+0000 7f96a1d30700 1 -- 172.21.15.125:0/408369700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f969c15a410 msgr2=0x7f969c15a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:45.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.711+0000 7f96a1d30700 1 --2- 172.21.15.125:0/408369700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f969c15a410 0x7f969c15a8c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9694009e50 tx=0x7f969400b330 comp rx=0 tx=0).stop 2023-10-17T06:07:45.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.711+0000 7f96a1d30700 1 -- 172.21.15.125:0/408369700 shutdown_connections 2023-10-17T06:07:45.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.711+0000 7f96a1d30700 1 --2- 172.21.15.125:0/408369700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f969c15a410 0x7f969c15a8c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.711+0000 7f96a1d30700 1 --2- 172.21.15.125:0/408369700 >> v2:172.21.15.184:3300/0 conn(0x7f969c06d090 0x7f969c0b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.711+0000 7f96a1d30700 1 -- 172.21.15.125:0/408369700 >> 172.21.15.125:0/408369700 conn(0x7f969c0ce5c0 msgr2=0x7f969c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:45.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.711+0000 7f96a1d30700 1 -- 172.21.15.125:0/408369700 shutdown_connections 2023-10-17T06:07:45.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.711+0000 7f96a1d30700 1 -- 172.21.15.125:0/408369700 wait complete. 2023-10-17T06:07:45.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.715+0000 7f96a1d30700 1 Processor -- start 2023-10-17T06:07:45.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.715+0000 7f96a1d30700 1 -- start start 2023-10-17T06:07:45.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96a1d30700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f969c06d090 0x7f969c152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:45.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96a1d30700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f969c06d470 0x7f969c159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:45.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96a1d30700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f969c15a410 0x7f969c0c3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:45.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96a1d30700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c1f0410 con 0x7f969c06d090 2023-10-17T06:07:45.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96a1d30700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c1f1270 con 0x7f969c06d470 2023-10-17T06:07:45.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96a1d30700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969c1f0660 con 0x7f969c15a410 2023-10-17T06:07:45.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96a0d2e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f969c06d090 0x7f969c152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:45.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96a0d2e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f969c06d090 0x7f969c152340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47222/0 (socket says 172.21.15.125:47222) 2023-10-17T06:07:45.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96a0d2e700 1 -- 172.21.15.125:0/974854085 learned_addr learned my addr 172.21.15.125:0/974854085 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:45.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96a152f700 1 --2- 172.21.15.125:0/974854085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f969c15a410 0x7f969c0c3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:45.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f969bfff700 1 --2- 172.21.15.125:0/974854085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f969c06d470 0x7f969c159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:45.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96a0d2e700 1 -- 172.21.15.125:0/974854085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f969c15a410 msgr2=0x7f969c0c3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:45.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96a0d2e700 1 --2- 172.21.15.125:0/974854085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f969c15a410 0x7f969c0c3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96a0d2e700 1 -- 172.21.15.125:0/974854085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f969c06d470 msgr2=0x7f969c159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:45.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96a0d2e700 1 --2- 172.21.15.125:0/974854085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f969c06d470 0x7f969c159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96a0d2e700 1 -- 172.21.15.125:0/974854085 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9694009b30 con 0x7f969c06d090 2023-10-17T06:07:45.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96a0d2e700 1 --2- 172.21.15.125:0/974854085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f969c06d090 0x7f969c152340 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f969000ea00 tx=0x7f969000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:45.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96997fa700 1 -- 172.21.15.125:0/974854085 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690009720 con 0x7f969c06d090 2023-10-17T06:07:45.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96997fa700 1 -- 172.21.15.125:0/974854085 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969000c850 con 0x7f969c06d090 2023-10-17T06:07:45.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96997fa700 1 -- 172.21.15.125:0/974854085 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969000cbc0 con 0x7f969c06d090 2023-10-17T06:07:45.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96a1d30700 1 -- 172.21.15.125:0/974854085 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969c1f0940 con 0x7f969c06d090 2023-10-17T06:07:45.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.719+0000 7f96a1d30700 1 -- 172.21.15.125:0/974854085 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969c1f0f00 con 0x7f969c06d090 2023-10-17T06:07:45.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.723+0000 7f96a1d30700 1 -- 172.21.15.125:0/974854085 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f969c072e60 con 0x7f969c06d090 2023-10-17T06:07:45.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.723+0000 7f96997fa700 1 -- 172.21.15.125:0/974854085 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f969000cd20 con 0x7f969c06d090 2023-10-17T06:07:45.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.723+0000 7f96997fa700 1 --2- 172.21.15.125:0/974854085 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f96800656f0 0x7f9680067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:45.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.723+0000 7f96997fa700 1 -- 172.21.15.125:0/974854085 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f96900832d0 con 0x7f969c06d090 2023-10-17T06:07:45.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.727+0000 7f969bfff700 1 --2- 172.21.15.125:0/974854085 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f96800656f0 0x7f9680067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:45.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.727+0000 7f969bfff700 1 --2- 172.21.15.125:0/974854085 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f96800656f0 0x7f9680067bb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f969c152880 tx=0x7f9688009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:45.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.731+0000 7f96997fa700 1 -- 172.21.15.125:0/974854085 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f9690050980 con 0x7f969c06d090 2023-10-17T06:07:45.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.963+0000 7f96a1d30700 1 -- 172.21.15.125:0/974854085 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f969c06e030 con 0x7f969c06d090 2023-10-17T06:07:45.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.967+0000 7f96997fa700 1 -- 172.21.15.125:0/974854085 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f9690053fa0 con 0x7f969c06d090 2023-10-17T06:07:45.970 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:45.971 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/3744648044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3744648044},{"type":"v1","addr":"172.21.15.184:6833","nonce":3744648044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/181458401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181458401},{"type":"v1","addr":"172.21.15.184:6835","nonce":181458401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/908363262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":908363262},{"type":"v1","addr":"172.21.15.125:6835","nonce":908363262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:07:09.036610+0000","modified":"2023-10-17T06:07:35.578225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/3617198893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":3617198893},{"type":"v1","addr":"172.21.15.125:6837","nonce":3617198893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-17T06:07:45.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.967+0000 7f96a1d30700 1 -- 172.21.15.125:0/974854085 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f96800656f0 msgr2=0x7f9680067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:45.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.967+0000 7f96a1d30700 1 --2- 172.21.15.125:0/974854085 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f96800656f0 0x7f9680067bb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f969c152880 tx=0x7f9688009040 comp rx=0 tx=0).stop 2023-10-17T06:07:45.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.967+0000 7f96a1d30700 1 -- 172.21.15.125:0/974854085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f969c06d090 msgr2=0x7f969c152340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:45.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.967+0000 7f96a1d30700 1 --2- 172.21.15.125:0/974854085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f969c06d090 0x7f969c152340 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f969000ea00 tx=0x7f969000ed10 comp rx=0 tx=0).stop 2023-10-17T06:07:45.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.967+0000 7f96a1d30700 1 -- 172.21.15.125:0/974854085 shutdown_connections 2023-10-17T06:07:45.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.967+0000 7f96a1d30700 1 --2- 172.21.15.125:0/974854085 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f96800656f0 0x7f9680067bb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.967+0000 7f96a1d30700 1 --2- 172.21.15.125:0/974854085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f969c15a410 0x7f969c0c3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.967+0000 7f96a1d30700 1 --2- 172.21.15.125:0/974854085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f969c06d470 0x7f969c159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.967+0000 7f96a1d30700 1 --2- 172.21.15.125:0/974854085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f969c06d090 0x7f969c152340 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:45.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.967+0000 7f96a1d30700 1 -- 172.21.15.125:0/974854085 >> 172.21.15.125:0/974854085 conn(0x7f969c0ce5c0 msgr2=0x7f969c0c9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:45.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.967+0000 7f96a1d30700 1 -- 172.21.15.125:0/974854085 shutdown_connections 2023-10-17T06:07:45.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:45.967+0000 7f96a1d30700 1 -- 172.21.15.125:0/974854085 wait complete. 2023-10-17T06:07:45.976 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 9 2023-10-17T06:07:45.994 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:07:46.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.179+0000 7f54cfb08700 1 Processor -- start 2023-10-17T06:07:46.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.179+0000 7f54cfb08700 1 -- start start 2023-10-17T06:07:46.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.183+0000 7f54cfb08700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54c8146800 0x7f54c80b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:46.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.183+0000 7f54cfb08700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c815e680 con 0x7f54c815dd30 2023-10-17T06:07:46.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.183+0000 7f54cfb08700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c80b6180 con 0x7f54c80700b0 2023-10-17T06:07:46.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.183+0000 7f54cfb08700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80b6460 con 0x7f54c8146800 2023-10-17T06:07:46.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.183+0000 7f54cd0a3700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f54c815dd30 0x7f54c806f9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59536/0 (socket says 172.21.15.125:59536) 2023-10-17T06:07:46.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.183+0000 7f54cd0a3700 1 -- 172.21.15.125:0/3370324362 learned_addr learned my addr 172.21.15.125:0/3370324362 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:46.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.183+0000 7f54cd8a4700 1 --2- 172.21.15.125:0/3370324362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54c8146800 0x7f54c80b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:46.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.183+0000 7f54cc8a2700 1 -- 172.21.15.125:0/3370324362 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237375586 0 0) 0x7f54c815e680 con 0x7f54c815dd30 2023-10-17T06:07:46.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.183+0000 7f54cc8a2700 1 -- 172.21.15.125:0/3370324362 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54b40035d0 con 0x7f54c815dd30 2023-10-17T06:07:46.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.183+0000 7f54cc8a2700 1 -- 172.21.15.125:0/3370324362 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550966826 0 0) 0x7f54c80b6180 con 0x7f54c80700b0 2023-10-17T06:07:46.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.183+0000 7f54cd8a4700 1 -- 172.21.15.125:0/3370324362 >> v1:172.21.15.184:6789/0 conn(0x7f54c80700b0 legacy=0x7f54c815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:46.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.183+0000 7f54cd8a4700 1 -- 172.21.15.125:0/3370324362 >> v1:172.21.15.125:6789/0 conn(0x7f54c815dd30 legacy=0x7f54c806f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:46.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.183+0000 7f54cd8a4700 1 -- 172.21.15.125:0/3370324362 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c80b6740 con 0x7f54c8146800 2023-10-17T06:07:46.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.183+0000 7f54cd8a4700 1 --2- 172.21.15.125:0/3370324362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54c8146800 0x7f54c80b5b80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009880 tx=0x7f54c4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86170d578e7ff6e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:46.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.183+0000 7f54cc8a2700 1 -- 172.21.15.125:0/3370324362 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4011830 con 0x7f54c8146800 2023-10-17T06:07:46.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.187+0000 7f54cc8a2700 1 -- 172.21.15.125:0/3370324362 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c4011990 con 0x7f54c8146800 2023-10-17T06:07:46.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.187+0000 7f54cc8a2700 1 -- 172.21.15.125:0/3370324362 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4011d20 con 0x7f54c8146800 2023-10-17T06:07:46.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.187+0000 7f54cfb08700 1 -- 172.21.15.125:0/3370324362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54c8146800 msgr2=0x7f54c80b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:46.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.187+0000 7f54cfb08700 1 --2- 172.21.15.125:0/3370324362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54c8146800 0x7f54c80b5b80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009880 tx=0x7f54c4009b90 comp rx=0 tx=0).stop 2023-10-17T06:07:46.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.187+0000 7f54cfb08700 1 -- 172.21.15.125:0/3370324362 shutdown_connections 2023-10-17T06:07:46.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.187+0000 7f54cfb08700 1 --2- 172.21.15.125:0/3370324362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54c8146800 0x7f54c80b5b80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:46.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.187+0000 7f54cfb08700 1 -- 172.21.15.125:0/3370324362 >> 172.21.15.125:0/3370324362 conn(0x7f54c806a130 msgr2=0x7f54c806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:46.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.187+0000 7f54cfb08700 1 -- 172.21.15.125:0/3370324362 shutdown_connections 2023-10-17T06:07:46.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.187+0000 7f54cfb08700 1 -- 172.21.15.125:0/3370324362 wait complete. 2023-10-17T06:07:46.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.187+0000 7f54cfb08700 1 Processor -- start 2023-10-17T06:07:46.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.187+0000 7f54cfb08700 1 -- start start 2023-10-17T06:07:46.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54cfb08700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54c80700b0 0x7f54c80ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:46.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54cfb08700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54c8146800 0x7f54c80d24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:46.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54cfb08700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54c815dd30 0x7f54c8140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:46.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54cfb08700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c8152230 con 0x7f54c80700b0 2023-10-17T06:07:46.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54cfb08700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80b2690 con 0x7f54c815dd30 2023-10-17T06:07:46.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54cfb08700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80b2970 con 0x7f54c8146800 2023-10-17T06:07:46.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54cd0a3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54c8146800 0x7f54c80d24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:46.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54ce0a5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54c815dd30 0x7f54c8140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:46.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54cd8a4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54c80700b0 0x7f54c80ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:46.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54cd0a3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54c8146800 0x7f54c80d24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:33192/0 (socket says 172.21.15.125:33192) 2023-10-17T06:07:46.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54cd0a3700 1 -- 172.21.15.125:0/2446244281 learned_addr learned my addr 172.21.15.125:0/2446244281 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:46.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54cd8a4700 1 -- 172.21.15.125:0/2446244281 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54c8146800 msgr2=0x7f54c80d24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:46.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54cd8a4700 1 --2- 172.21.15.125:0/2446244281 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54c8146800 0x7f54c80d24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:46.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54cd8a4700 1 -- 172.21.15.125:0/2446244281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54c815dd30 msgr2=0x7f54c8140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:46.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54cd8a4700 1 --2- 172.21.15.125:0/2446244281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54c815dd30 0x7f54c8140a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:46.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54cd8a4700 1 -- 172.21.15.125:0/2446244281 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c40094b0 con 0x7f54c80700b0 2023-10-17T06:07:46.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54cd8a4700 1 --2- 172.21.15.125:0/2446244281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54c80700b0 0x7f54c80ae3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f54c4015000 tx=0x7f54c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:46.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54be7fc700 1 -- 172.21.15.125:0/2446244281 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4019950 con 0x7f54c80700b0 2023-10-17T06:07:46.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54be7fc700 1 -- 172.21.15.125:0/2446244281 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c401e070 con 0x7f54c80700b0 2023-10-17T06:07:46.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54cfb08700 1 -- 172.21.15.125:0/2446244281 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c80b2c50 con 0x7f54c80700b0 2023-10-17T06:07:46.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54be7fc700 1 -- 172.21.15.125:0/2446244281 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4019d10 con 0x7f54c80700b0 2023-10-17T06:07:46.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.191+0000 7f54cfb08700 1 -- 172.21.15.125:0/2446244281 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c80ae900 con 0x7f54c80700b0 2023-10-17T06:07:46.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.195+0000 7f54cfb08700 1 -- 172.21.15.125:0/2446244281 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c80b3170 con 0x7f54c80700b0 2023-10-17T06:07:46.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.195+0000 7f54be7fc700 1 -- 172.21.15.125:0/2446244281 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f54c402d450 con 0x7f54c80700b0 2023-10-17T06:07:46.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.195+0000 7f54be7fc700 1 --2- 172.21.15.125:0/2446244281 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f54ac0656f0 0x7f54ac067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:46.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.195+0000 7f54be7fc700 1 -- 172.21.15.125:0/2446244281 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f54c4083ff0 con 0x7f54c80700b0 2023-10-17T06:07:46.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.199+0000 7f54cd0a3700 1 --2- 172.21.15.125:0/2446244281 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f54ac0656f0 0x7f54ac067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:46.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.199+0000 7f54cd0a3700 1 --2- 172.21.15.125:0/2446244281 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f54ac0656f0 0x7f54ac067bb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f54c80b0410 tx=0x7f54b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:46.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.203+0000 7f54be7fc700 1 -- 172.21.15.125:0/2446244281 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f54c40b4d40 con 0x7f54c80700b0 2023-10-17T06:07:46.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.387+0000 7f54cfb08700 1 -- 172.21.15.125:0/2446244281 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54c8072e60 con 0x7f54c80700b0 2023-10-17T06:07:46.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.387+0000 7f54be7fc700 1 -- 172.21.15.125:0/2446244281 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20156 (secure 0 0 0) 0x7f54c80b3170 con 0x7f54c80700b0 2023-10-17T06:07:46.392 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:46.392 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":28,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:14.576796+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:07:46.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.391+0000 7f54cfb08700 1 -- 172.21.15.125:0/2446244281 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f54ac0656f0 msgr2=0x7f54ac067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:46.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.391+0000 7f54cfb08700 1 --2- 172.21.15.125:0/2446244281 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f54ac0656f0 0x7f54ac067bb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f54c80b0410 tx=0x7f54b8009040 comp rx=0 tx=0).stop 2023-10-17T06:07:46.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.391+0000 7f54cfb08700 1 -- 172.21.15.125:0/2446244281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54c80700b0 msgr2=0x7f54c80ae3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:46.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.391+0000 7f54cfb08700 1 --2- 172.21.15.125:0/2446244281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54c80700b0 0x7f54c80ae3c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f54c4015000 tx=0x7f54c4004770 comp rx=0 tx=0).stop 2023-10-17T06:07:46.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.391+0000 7f54cfb08700 1 -- 172.21.15.125:0/2446244281 shutdown_connections 2023-10-17T06:07:46.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.391+0000 7f54cfb08700 1 --2- 172.21.15.125:0/2446244281 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f54ac0656f0 0x7f54ac067bb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:46.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.391+0000 7f54cfb08700 1 --2- 172.21.15.125:0/2446244281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54c815dd30 0x7f54c8140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:46.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.391+0000 7f54cfb08700 1 --2- 172.21.15.125:0/2446244281 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54c8146800 0x7f54c80d24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:46.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.391+0000 7f54cfb08700 1 --2- 172.21.15.125:0/2446244281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f54c80700b0 0x7f54c80ae3c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:46.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.391+0000 7f54cfb08700 1 -- 172.21.15.125:0/2446244281 >> 172.21.15.125:0/2446244281 conn(0x7f54c806a130 msgr2=0x7f54c80d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:46.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.395+0000 7f54cfb08700 1 -- 172.21.15.125:0/2446244281 shutdown_connections 2023-10-17T06:07:46.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.395+0000 7f54cfb08700 1 -- 172.21.15.125:0/2446244281 wait complete. 2023-10-17T06:07:46.418 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-17T06:07:06.629169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-17T06:07:08.148117+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-17T06:07:11.895112+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-17T06:07:46.419 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:07:46.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.591+0000 7f48b359e700 1 Processor -- start 2023-10-17T06:07:46.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.591+0000 7f48b359e700 1 -- start start 2023-10-17T06:07:46.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.595+0000 7f48b359e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f48b4159bf0 0x7f48b40ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:46.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.595+0000 7f48b359e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48b40b53f0 0x7f48b406a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:46.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.595+0000 7f48b359e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f48b406a5f0 0x7f48b40cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:46.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.595+0000 7f48b359e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b406aaa0 con 0x7f48b406a5f0 2023-10-17T06:07:46.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.595+0000 7f48b359e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b406ded0 con 0x7f48b4159bf0 2023-10-17T06:07:46.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.595+0000 7f48b359e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b40cae00 con 0x7f48b40b53f0 2023-10-17T06:07:46.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.595+0000 7f48b2d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f48b406a5f0 0x7f48b40cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:46.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.595+0000 7f48b1d9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48b40b53f0 0x7f48b406a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:46.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.595+0000 7f48b1d9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48b40b53f0 0x7f48b406a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:33202/0 (socket says 172.21.15.125:33202) 2023-10-17T06:07:46.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.595+0000 7f48b1d9b700 1 -- 172.21.15.125:0/991062587 learned_addr learned my addr 172.21.15.125:0/991062587 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:46.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.595+0000 7f48b259c700 1 --2- 172.21.15.125:0/991062587 >> v2:172.21.15.184:3300/0 conn(0x7f48b4159bf0 0x7f48b40ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:46.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.599+0000 7f48b1d9b700 1 -- 172.21.15.125:0/991062587 >> v2:172.21.15.184:3300/0 conn(0x7f48b4159bf0 msgr2=0x7f48b40ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:46.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.599+0000 7f48b1d9b700 1 --2- 172.21.15.125:0/991062587 >> v2:172.21.15.184:3300/0 conn(0x7f48b4159bf0 0x7f48b40ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:46.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.599+0000 7f48b1d9b700 1 -- 172.21.15.125:0/991062587 >> v2:172.21.15.125:3300/0 conn(0x7f48b406a5f0 msgr2=0x7f48b40cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:46.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.599+0000 7f48b1d9b700 1 --2- 172.21.15.125:0/991062587 >> v2:172.21.15.125:3300/0 conn(0x7f48b406a5f0 0x7f48b40cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:46.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.599+0000 7f48b1d9b700 1 -- 172.21.15.125:0/991062587 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b4071c50 con 0x7f48b40b53f0 2023-10-17T06:07:46.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.599+0000 7f48b2d9d700 1 --2- 172.21.15.125:0/991062587 >> v2:172.21.15.125:3300/0 conn(0x7f48b406a5f0 0x7f48b40cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:07:46.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.599+0000 7f48b1d9b700 1 --2- 172.21.15.125:0/991062587 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48b40b53f0 0x7f48b406a0b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f48b406af10 tx=0x7f48a800be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=145b398f90d36883 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:46.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.599+0000 7f48b159a700 1 -- 172.21.15.125:0/991062587 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a800dd30 con 0x7f48b40b53f0 2023-10-17T06:07:46.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.599+0000 7f48b159a700 1 -- 172.21.15.125:0/991062587 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a800de90 con 0x7f48b40b53f0 2023-10-17T06:07:46.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.599+0000 7f48b159a700 1 -- 172.21.15.125:0/991062587 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a8010690 con 0x7f48b40b53f0 2023-10-17T06:07:46.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.599+0000 7f48b359e700 1 -- 172.21.15.125:0/991062587 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48b40b53f0 msgr2=0x7f48b406a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:46.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.599+0000 7f48b359e700 1 --2- 172.21.15.125:0/991062587 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48b40b53f0 0x7f48b406a0b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f48b406af10 tx=0x7f48a800be90 comp rx=0 tx=0).stop 2023-10-17T06:07:46.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.599+0000 7f48b359e700 1 -- 172.21.15.125:0/991062587 shutdown_connections 2023-10-17T06:07:46.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.599+0000 7f48b359e700 1 --2- 172.21.15.125:0/991062587 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48b40b53f0 0x7f48b406a0b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:46.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.599+0000 7f48b359e700 1 --2- 172.21.15.125:0/991062587 >> v2:172.21.15.125:3300/0 conn(0x7f48b406a5f0 0x7f48b40cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:46.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.599+0000 7f48b359e700 1 --2- 172.21.15.125:0/991062587 >> v2:172.21.15.184:3300/0 conn(0x7f48b4159bf0 0x7f48b40ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:46.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.599+0000 7f48b359e700 1 -- 172.21.15.125:0/991062587 >> 172.21.15.125:0/991062587 conn(0x7f48b40cf6b0 msgr2=0x7f48b40cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:46.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.599+0000 7f48b359e700 1 -- 172.21.15.125:0/991062587 shutdown_connections 2023-10-17T06:07:46.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.599+0000 7f48b359e700 1 -- 172.21.15.125:0/991062587 wait complete. 2023-10-17T06:07:46.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.603+0000 7f48b359e700 1 Processor -- start 2023-10-17T06:07:46.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.603+0000 7f48b359e700 1 -- start start 2023-10-17T06:07:46.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.603+0000 7f48b359e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48b406a5f0 0x7f48b40c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:46.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.603+0000 7f48b359e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48b40b53f0 0x7f48b4156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:46.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.603+0000 7f48b359e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48b4159bf0 0x7f48b40af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:46.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.603+0000 7f48b359e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b41566b0 con 0x7f48b4159bf0 2023-10-17T06:07:46.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.603+0000 7f48b359e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b415c5a0 con 0x7f48b406a5f0 2023-10-17T06:07:46.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.603+0000 7f48b359e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b415a420 con 0x7f48b40b53f0 2023-10-17T06:07:46.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.603+0000 7f48b2d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48b4159bf0 0x7f48b40af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:46.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.603+0000 7f48b2d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48b4159bf0 0x7f48b40af110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47258/0 (socket says 172.21.15.125:47258) 2023-10-17T06:07:46.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.603+0000 7f48b2d9d700 1 -- 172.21.15.125:0/1261757332 learned_addr learned my addr 172.21.15.125:0/1261757332 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:46.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.603+0000 7f48b1d9b700 1 --2- 172.21.15.125:0/1261757332 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48b40b53f0 0x7f48b4156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:46.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.603+0000 7f48b259c700 1 --2- 172.21.15.125:0/1261757332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48b406a5f0 0x7f48b40c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:46.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.607+0000 7f48b2d9d700 1 -- 172.21.15.125:0/1261757332 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48b40b53f0 msgr2=0x7f48b4156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:46.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.607+0000 7f48b2d9d700 1 --2- 172.21.15.125:0/1261757332 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48b40b53f0 0x7f48b4156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:46.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.607+0000 7f48b2d9d700 1 -- 172.21.15.125:0/1261757332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48b406a5f0 msgr2=0x7f48b40c91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:46.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.607+0000 7f48b2d9d700 1 --2- 172.21.15.125:0/1261757332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48b406a5f0 0x7f48b40c91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:46.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.607+0000 7f48b2d9d700 1 -- 172.21.15.125:0/1261757332 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac009a70 con 0x7f48b4159bf0 2023-10-17T06:07:46.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.607+0000 7f48b259c700 1 --2- 172.21.15.125:0/1261757332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48b406a5f0 0x7f48b40c91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:46.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.607+0000 7f48b2d9d700 1 --2- 172.21.15.125:0/1261757332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48b4159bf0 0x7f48b40af110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00eed0 tx=0x7f48ac00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:46.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.607+0000 7f48a2ffd700 1 -- 172.21.15.125:0/1261757332 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac010040 con 0x7f48b4159bf0 2023-10-17T06:07:46.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.607+0000 7f48a2ffd700 1 -- 172.21.15.125:0/1261757332 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac00bb30 con 0x7f48b4159bf0 2023-10-17T06:07:46.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.607+0000 7f48b359e700 1 -- 172.21.15.125:0/1261757332 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a800b810 con 0x7f48b4159bf0 2023-10-17T06:07:46.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.607+0000 7f48a2ffd700 1 -- 172.21.15.125:0/1261757332 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ac003a40 con 0x7f48b4159bf0 2023-10-17T06:07:46.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.607+0000 7f48b359e700 1 -- 172.21.15.125:0/1261757332 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b415cb20 con 0x7f48b4159bf0 2023-10-17T06:07:46.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.607+0000 7f48b359e700 1 -- 172.21.15.125:0/1261757332 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b4072020 con 0x7f48b4159bf0 2023-10-17T06:07:46.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.611+0000 7f48a2ffd700 1 -- 172.21.15.125:0/1261757332 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f48ac01d410 con 0x7f48b4159bf0 2023-10-17T06:07:46.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.611+0000 7f48a2ffd700 1 --2- 172.21.15.125:0/1261757332 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f48940656f0 0x7f4894067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:46.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.611+0000 7f48a2ffd700 1 -- 172.21.15.125:0/1261757332 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f48ac0835d0 con 0x7f48b4159bf0 2023-10-17T06:07:46.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.611+0000 7f48b259c700 1 --2- 172.21.15.125:0/1261757332 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f48940656f0 0x7f4894067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:46.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.611+0000 7f48b259c700 1 --2- 172.21.15.125:0/1261757332 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f48940656f0 0x7f4894067bb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f48b40ad9e0 tx=0x7f48a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:46.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.619+0000 7f48a2ffd700 1 -- 172.21.15.125:0/1261757332 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f48ac050d10 con 0x7f48b4159bf0 2023-10-17T06:07:46.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.807+0000 7f48b359e700 1 -- 172.21.15.125:0/1261757332 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f48b4066d10 con 0x7f48b4159bf0 2023-10-17T06:07:46.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.807+0000 7f48a2ffd700 1 -- 172.21.15.125:0/1261757332 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f48ac054330 con 0x7f48b4159bf0 2023-10-17T06:07:46.811 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:07:46.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.811+0000 7f48b359e700 1 -- 172.21.15.125:0/1261757332 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f48940656f0 msgr2=0x7f4894067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:46.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.811+0000 7f48b359e700 1 --2- 172.21.15.125:0/1261757332 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f48940656f0 0x7f4894067bb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f48b40ad9e0 tx=0x7f48a4008040 comp rx=0 tx=0).stop 2023-10-17T06:07:46.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.811+0000 7f48b359e700 1 -- 172.21.15.125:0/1261757332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48b4159bf0 msgr2=0x7f48b40af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:46.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.811+0000 7f48b359e700 1 --2- 172.21.15.125:0/1261757332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48b4159bf0 0x7f48b40af110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00eed0 tx=0x7f48ac00b390 comp rx=0 tx=0).stop 2023-10-17T06:07:46.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.811+0000 7f48b359e700 1 -- 172.21.15.125:0/1261757332 shutdown_connections 2023-10-17T06:07:46.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.811+0000 7f48b359e700 1 --2- 172.21.15.125:0/1261757332 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f48940656f0 0x7f4894067bb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:46.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.811+0000 7f48b359e700 1 --2- 172.21.15.125:0/1261757332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48b4159bf0 0x7f48b40af110 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:46.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.811+0000 7f48b359e700 1 --2- 172.21.15.125:0/1261757332 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48b40b53f0 0x7f48b4156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:46.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.811+0000 7f48b359e700 1 --2- 172.21.15.125:0/1261757332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48b406a5f0 0x7f48b40c91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:46.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.811+0000 7f48b359e700 1 -- 172.21.15.125:0/1261757332 >> 172.21.15.125:0/1261757332 conn(0x7f48b40cf6b0 msgr2=0x7f48b40cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:46.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.811+0000 7f48b359e700 1 -- 172.21.15.125:0/1261757332 shutdown_connections 2023-10-17T06:07:46.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:46.811+0000 7f48b359e700 1 -- 172.21.15.125:0/1261757332 wait complete. 2023-10-17T06:07:46.833 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:07:47.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.011+0000 7f249b59e700 1 Processor -- start 2023-10-17T06:07:47.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.011+0000 7f249b59e700 1 -- start start 2023-10-17T06:07:47.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.011+0000 7f249b59e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f249c06d470 0x7f249c070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:47.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.011+0000 7f249b59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f249c070f50 0x7f249c15a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:47.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f249b59e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f249c15e990 con 0x7f249c06d090 2023-10-17T06:07:47.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f249b59e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f249c15f4f0 con 0x7f249c06d470 2023-10-17T06:07:47.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f249b59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f249c0b2ca0 con 0x7f249c070f50 2023-10-17T06:07:47.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f2491d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f249c06d470 0x7f249c070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:47.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f2491d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f249c06d470 0x7f249c070a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47272/0 (socket says 172.21.15.125:47272) 2023-10-17T06:07:47.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f2491d9b700 1 -- 172.21.15.125:0/2524432404 learned_addr learned my addr 172.21.15.125:0/2524432404 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:47.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f249ad9d700 1 --2- 172.21.15.125:0/2524432404 >> v2:172.21.15.184:3300/0 conn(0x7f249c070f50 0x7f249c15a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:47.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f2491d9b700 1 -- 172.21.15.125:0/2524432404 >> v2:172.21.15.184:3300/0 conn(0x7f249c070f50 msgr2=0x7f249c15a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:47.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f2491d9b700 1 --2- 172.21.15.125:0/2524432404 >> v2:172.21.15.184:3300/0 conn(0x7f249c070f50 0x7f249c15a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f2491d9b700 1 -- 172.21.15.125:0/2524432404 >> v1:172.21.15.125:6789/0 conn(0x7f249c06d090 legacy=0x7f249c0b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:47.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f2491d9b700 1 -- 172.21.15.125:0/2524432404 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c15ec50 con 0x7f249c06d470 2023-10-17T06:07:47.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f2491d9b700 1 --2- 172.21.15.125:0/2524432404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f249c06d470 0x7f249c070a10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f249c0b1b40 tx=0x7f2484009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04bbb5176c24035 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:47.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f2499d9b700 1 -- 172.21.15.125:0/2524432404 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248400b8a0 con 0x7f249c06d470 2023-10-17T06:07:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f2499d9b700 1 -- 172.21.15.125:0/2524432404 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248400ba00 con 0x7f249c06d470 2023-10-17T06:07:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f2499d9b700 1 -- 172.21.15.125:0/2524432404 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248400bd90 con 0x7f249c06d470 2023-10-17T06:07:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f249b59e700 1 -- 172.21.15.125:0/2524432404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f249c06d470 msgr2=0x7f249c070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f249b59e700 1 --2- 172.21.15.125:0/2524432404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f249c06d470 0x7f249c070a10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f249c0b1b40 tx=0x7f2484009bf0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f249b59e700 1 -- 172.21.15.125:0/2524432404 shutdown_connections 2023-10-17T06:07:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f249b59e700 1 --2- 172.21.15.125:0/2524432404 >> v2:172.21.15.184:3300/0 conn(0x7f249c070f50 0x7f249c15a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f249b59e700 1 --2- 172.21.15.125:0/2524432404 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f249c06d470 0x7f249c070a10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f249b59e700 1 -- 172.21.15.125:0/2524432404 >> 172.21.15.125:0/2524432404 conn(0x7f249c0ce5c0 msgr2=0x7f249c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f249b59e700 1 -- 172.21.15.125:0/2524432404 shutdown_connections 2023-10-17T06:07:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.015+0000 7f249b59e700 1 -- 172.21.15.125:0/2524432404 wait complete. 2023-10-17T06:07:47.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.019+0000 7f249b59e700 1 Processor -- start 2023-10-17T06:07:47.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.019+0000 7f249b59e700 1 -- start start 2023-10-17T06:07:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.023+0000 7f249b59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f249c06d090 0x7f249c1efa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.023+0000 7f249b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f249c06d470 0x7f249c0c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:47.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.023+0000 7f249b59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f249c070f50 0x7f249c0c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:47.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.023+0000 7f249b59e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c1f0bc0 con 0x7f249c06d470 2023-10-17T06:07:47.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.023+0000 7f249b59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c1f1050 con 0x7f249c06d090 2023-10-17T06:07:47.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.023+0000 7f249b59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249c1541a0 con 0x7f249c070f50 2023-10-17T06:07:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.023+0000 7f2491d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f249c06d470 0x7f249c0c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.023+0000 7f2491d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f249c06d470 0x7f249c0c6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47280/0 (socket says 172.21.15.125:47280) 2023-10-17T06:07:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.023+0000 7f2491d9b700 1 -- 172.21.15.125:0/1443847194 learned_addr learned my addr 172.21.15.125:0/1443847194 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.023+0000 7f249a59c700 1 --2- 172.21.15.125:0/1443847194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f249c06d090 0x7f249c1efa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.023+0000 7f249ad9d700 1 --2- 172.21.15.125:0/1443847194 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f249c070f50 0x7f249c0c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.023+0000 7f2491d9b700 1 -- 172.21.15.125:0/1443847194 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f249c070f50 msgr2=0x7f249c0c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.023+0000 7f2491d9b700 1 --2- 172.21.15.125:0/1443847194 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f249c070f50 0x7f249c0c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.023+0000 7f2491d9b700 1 -- 172.21.15.125:0/1443847194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f249c06d090 msgr2=0x7f249c1efa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:47.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.023+0000 7f2491d9b700 1 --2- 172.21.15.125:0/1443847194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f249c06d090 0x7f249c1efa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.023+0000 7f2491d9b700 1 -- 172.21.15.125:0/1443847194 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2484009570 con 0x7f249c06d470 2023-10-17T06:07:47.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.023+0000 7f2491d9b700 1 --2- 172.21.15.125:0/1443847194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f249c06d470 0x7f249c0c6020 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f249c06b190 tx=0x7f2484004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:47.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.027+0000 7f24937fe700 1 -- 172.21.15.125:0/1443847194 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24840036c0 con 0x7f249c06d470 2023-10-17T06:07:47.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.027+0000 7f24937fe700 1 -- 172.21.15.125:0/1443847194 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248401f070 con 0x7f249c06d470 2023-10-17T06:07:47.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.027+0000 7f24937fe700 1 -- 172.21.15.125:0/1443847194 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2484003a80 con 0x7f249c06d470 2023-10-17T06:07:47.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.027+0000 7f249b59e700 1 -- 172.21.15.125:0/1443847194 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249c0c6a00 con 0x7f249c06d470 2023-10-17T06:07:47.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.027+0000 7f249b59e700 1 -- 172.21.15.125:0/1443847194 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249c1f0570 con 0x7f249c06d470 2023-10-17T06:07:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.027+0000 7f249b59e700 1 -- 172.21.15.125:0/1443847194 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c1f0d30 con 0x7f249c06d470 2023-10-17T06:07:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.027+0000 7f24937fe700 1 -- 172.21.15.125:0/1443847194 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2484021030 con 0x7f249c06d470 2023-10-17T06:07:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.027+0000 7f24937fe700 1 --2- 172.21.15.125:0/1443847194 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f24800656f0 0x7f2480067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.027+0000 7f24937fe700 1 -- 172.21.15.125:0/1443847194 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2484084620 con 0x7f249c06d470 2023-10-17T06:07:47.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.031+0000 7f249a59c700 1 --2- 172.21.15.125:0/1443847194 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f24800656f0 0x7f2480067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:47.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.031+0000 7f249a59c700 1 --2- 172.21.15.125:0/1443847194 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f24800656f0 0x7f2480067bb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f248c0018a0 tx=0x7f248c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:47.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.035+0000 7f24937fe700 1 -- 172.21.15.125:0/1443847194 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2484051e80 con 0x7f249c06d470 2023-10-17T06:07:47.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.215+0000 7f249b59e700 1 -- 172.21.15.125:0/1443847194 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f249c15efc0 con 0x7f249c06d470 2023-10-17T06:07:47.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.215+0000 7f24937fe700 1 -- 172.21.15.125:0/1443847194 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f24840554a0 con 0x7f249c06d470 2023-10-17T06:07:47.219 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:07:47.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.219+0000 7f249b59e700 1 -- 172.21.15.125:0/1443847194 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f24800656f0 msgr2=0x7f2480067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:47.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.219+0000 7f249b59e700 1 --2- 172.21.15.125:0/1443847194 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f24800656f0 0x7f2480067bb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f248c0018a0 tx=0x7f248c009040 comp rx=0 tx=0).stop 2023-10-17T06:07:47.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.219+0000 7f249b59e700 1 -- 172.21.15.125:0/1443847194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f249c06d470 msgr2=0x7f249c0c6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:47.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.219+0000 7f249b59e700 1 --2- 172.21.15.125:0/1443847194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f249c06d470 0x7f249c0c6020 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f249c06b190 tx=0x7f2484004770 comp rx=0 tx=0).stop 2023-10-17T06:07:47.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.219+0000 7f249b59e700 1 -- 172.21.15.125:0/1443847194 shutdown_connections 2023-10-17T06:07:47.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.219+0000 7f249b59e700 1 --2- 172.21.15.125:0/1443847194 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f24800656f0 0x7f2480067bb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.219+0000 7f249b59e700 1 --2- 172.21.15.125:0/1443847194 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f249c070f50 0x7f249c0c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.219+0000 7f249b59e700 1 --2- 172.21.15.125:0/1443847194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f249c06d470 0x7f249c0c6020 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.219+0000 7f249b59e700 1 --2- 172.21.15.125:0/1443847194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f249c06d090 0x7f249c1efa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.219+0000 7f249b59e700 1 -- 172.21.15.125:0/1443847194 >> 172.21.15.125:0/1443847194 conn(0x7f249c0ce5c0 msgr2=0x7f249c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:47.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.219+0000 7f249b59e700 1 -- 172.21.15.125:0/1443847194 shutdown_connections 2023-10-17T06:07:47.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.219+0000 7f249b59e700 1 -- 172.21.15.125:0/1443847194 wait complete. 2023-10-17T06:07:47.240 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-17T06:07:47.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.419+0000 7ff797f86700 1 Processor -- start 2023-10-17T06:07:47.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.419+0000 7ff797f86700 1 -- start start 2023-10-17T06:07:47.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.423+0000 7ff797f86700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff7900b5b80 0x7ff79015d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:47.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.423+0000 7ff797f86700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff79006f9a0 0x7ff79006fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:47.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.423+0000 7ff797f86700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff790146ba0 con 0x7ff7901467c0 2023-10-17T06:07:47.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.423+0000 7ff797f86700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7900d0920 con 0x7ff7900b5b80 2023-10-17T06:07:47.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.423+0000 7ff797f86700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff790070320 con 0x7ff79006f9a0 2023-10-17T06:07:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.423+0000 7ff795d22700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff7901467c0 0x7ff7901612e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59562/0 (socket says 172.21.15.125:59562) 2023-10-17T06:07:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.423+0000 7ff795d22700 1 -- 172.21.15.125:0/273453145 learned_addr learned my addr 172.21.15.125:0/273453145 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.423+0000 7ff795521700 1 --2- 172.21.15.125:0/273453145 >> v2:172.21.15.184:3300/0 conn(0x7ff7900b5b80 0x7ff79015d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.423+0000 7ff796523700 1 --2- 172.21.15.125:0/273453145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff79006f9a0 0x7ff79006fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.423+0000 7ff794d20700 1 -- 172.21.15.125:0/273453145 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723068096 0 0) 0x7ff790146ba0 con 0x7ff7901467c0 2023-10-17T06:07:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.423+0000 7ff794d20700 1 -- 172.21.15.125:0/273453145 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff77c0035d0 con 0x7ff7901467c0 2023-10-17T06:07:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.423+0000 7ff795521700 1 -- 172.21.15.125:0/273453145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff79006f9a0 msgr2=0x7ff79006fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.423+0000 7ff795521700 1 --2- 172.21.15.125:0/273453145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff79006f9a0 0x7ff79006fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.423+0000 7ff795521700 1 -- 172.21.15.125:0/273453145 >> v1:172.21.15.125:6789/0 conn(0x7ff7901467c0 legacy=0x7ff7901612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:47.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.423+0000 7ff795521700 1 -- 172.21.15.125:0/273453145 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7900b6160 con 0x7ff7900b5b80 2023-10-17T06:07:47.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.423+0000 7ff795521700 1 --2- 172.21.15.125:0/273453145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7900b5b80 0x7ff79015d310 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff780009850 tx=0x7ff780009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdbb758665572fe6 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:47.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.423+0000 7ff794d20700 1 -- 172.21.15.125:0/273453145 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780011830 con 0x7ff7900b5b80 2023-10-17T06:07:47.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.427+0000 7ff794d20700 1 -- 172.21.15.125:0/273453145 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff780011990 con 0x7ff7900b5b80 2023-10-17T06:07:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.427+0000 7ff794d20700 1 -- 172.21.15.125:0/273453145 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780011d40 con 0x7ff7900b5b80 2023-10-17T06:07:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.427+0000 7ff797f86700 1 -- 172.21.15.125:0/273453145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7900b5b80 msgr2=0x7ff79015d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.427+0000 7ff797f86700 1 --2- 172.21.15.125:0/273453145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7900b5b80 0x7ff79015d310 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff780009850 tx=0x7ff780009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.427+0000 7ff797f86700 1 -- 172.21.15.125:0/273453145 shutdown_connections 2023-10-17T06:07:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.427+0000 7ff797f86700 1 --2- 172.21.15.125:0/273453145 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff79006f9a0 0x7ff79006fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.427+0000 7ff797f86700 1 --2- 172.21.15.125:0/273453145 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7900b5b80 0x7ff79015d310 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.427+0000 7ff797f86700 1 -- 172.21.15.125:0/273453145 >> 172.21.15.125:0/273453145 conn(0x7ff79006a130 msgr2=0x7ff79006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.427+0000 7ff797f86700 1 -- 172.21.15.125:0/273453145 shutdown_connections 2023-10-17T06:07:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.427+0000 7ff797f86700 1 -- 172.21.15.125:0/273453145 wait complete. 2023-10-17T06:07:47.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.431+0000 7ff797f86700 1 Processor -- start 2023-10-17T06:07:47.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.431+0000 7ff797f86700 1 -- start start 2023-10-17T06:07:47.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.431+0000 7ff797f86700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff79006f9a0 0x7ff79015c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:47.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.431+0000 7ff797f86700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7900b5b80 0x7ff790160b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:47.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.431+0000 7ff797f86700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7901467c0 0x7ff790161070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:47.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.431+0000 7ff797f86700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff790140080 con 0x7ff79006f9a0 2023-10-17T06:07:47.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.431+0000 7ff797f86700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79015e320 con 0x7ff7901467c0 2023-10-17T06:07:47.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.431+0000 7ff797f86700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79015e040 con 0x7ff7900b5b80 2023-10-17T06:07:47.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.431+0000 7ff795d22700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff79006f9a0 0x7ff79015c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:47.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.431+0000 7ff795d22700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff79006f9a0 0x7ff79015c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47296/0 (socket says 172.21.15.125:47296) 2023-10-17T06:07:47.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.431+0000 7ff795d22700 1 -- 172.21.15.125:0/2623708550 learned_addr learned my addr 172.21.15.125:0/2623708550 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:47.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.431+0000 7ff795521700 1 --2- 172.21.15.125:0/2623708550 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7900b5b80 0x7ff790160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:47.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.431+0000 7ff796523700 1 --2- 172.21.15.125:0/2623708550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7901467c0 0x7ff790161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:47.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.431+0000 7ff795d22700 1 -- 172.21.15.125:0/2623708550 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7900b5b80 msgr2=0x7ff790160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:47.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.431+0000 7ff795d22700 1 --2- 172.21.15.125:0/2623708550 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7900b5b80 0x7ff790160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.431+0000 7ff795d22700 1 -- 172.21.15.125:0/2623708550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7901467c0 msgr2=0x7ff790161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:47.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.431+0000 7ff795d22700 1 --2- 172.21.15.125:0/2623708550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7901467c0 0x7ff790161070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.431+0000 7ff795d22700 1 -- 172.21.15.125:0/2623708550 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7800094b0 con 0x7ff79006f9a0 2023-10-17T06:07:47.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.431+0000 7ff795d22700 1 --2- 172.21.15.125:0/2623708550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff79006f9a0 0x7ff79015c5f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff78c00c4d0 tx=0x7ff78c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:47.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.435+0000 7ff7867fc700 1 -- 172.21.15.125:0/2623708550 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c005d90 con 0x7ff79006f9a0 2023-10-17T06:07:47.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.435+0000 7ff7867fc700 1 -- 172.21.15.125:0/2623708550 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c0070d0 con 0x7ff79006f9a0 2023-10-17T06:07:47.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.435+0000 7ff797f86700 1 -- 172.21.15.125:0/2623708550 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff79013f9c0 con 0x7ff79006f9a0 2023-10-17T06:07:47.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.435+0000 7ff7867fc700 1 -- 172.21.15.125:0/2623708550 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c007480 con 0x7ff79006f9a0 2023-10-17T06:07:47.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.435+0000 7ff797f86700 1 -- 172.21.15.125:0/2623708550 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff790160470 con 0x7ff79006f9a0 2023-10-17T06:07:47.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.435+0000 7ff797f86700 1 -- 172.21.15.125:0/2623708550 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7901606f0 con 0x7ff79006f9a0 2023-10-17T06:07:47.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.435+0000 7ff7867fc700 1 -- 172.21.15.125:0/2623708550 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff78c0075e0 con 0x7ff79006f9a0 2023-10-17T06:07:47.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.439+0000 7ff7867fc700 1 --2- 172.21.15.125:0/2623708550 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff774065720 0x7ff774067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:47.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.439+0000 7ff7867fc700 1 -- 172.21.15.125:0/2623708550 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff78c0824b0 con 0x7ff79006f9a0 2023-10-17T06:07:47.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.439+0000 7ff795521700 1 --2- 172.21.15.125:0/2623708550 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff774065720 0x7ff774067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:47.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.439+0000 7ff795521700 1 --2- 172.21.15.125:0/2623708550 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff774065720 0x7ff774067be0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff7800090b0 tx=0x7ff780008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:47.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.443+0000 7ff7867fc700 1 -- 172.21.15.125:0/2623708550 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff7901606f0 con 0x7ff79006f9a0 2023-10-17T06:07:47.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.627+0000 7ff797f86700 1 -- 172.21.15.125:0/2623708550 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7901606c0 con 0x7ff79006f9a0 2023-10-17T06:07:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.627+0000 7ff7867fc700 1 -- 172.21.15.125:0/2623708550 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff78c04fc70 con 0x7ff79006f9a0 2023-10-17T06:07:47.632 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:07:47.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.631+0000 7ff797f86700 1 -- 172.21.15.125:0/2623708550 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff774065720 msgr2=0x7ff774067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:47.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.631+0000 7ff797f86700 1 --2- 172.21.15.125:0/2623708550 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff774065720 0x7ff774067be0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff7800090b0 tx=0x7ff780008030 comp rx=0 tx=0).stop 2023-10-17T06:07:47.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.631+0000 7ff797f86700 1 -- 172.21.15.125:0/2623708550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff79006f9a0 msgr2=0x7ff79015c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:47.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.631+0000 7ff797f86700 1 --2- 172.21.15.125:0/2623708550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff79006f9a0 0x7ff79015c5f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff78c00c4d0 tx=0x7ff78c00c7e0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.631+0000 7ff797f86700 1 -- 172.21.15.125:0/2623708550 shutdown_connections 2023-10-17T06:07:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.631+0000 7ff797f86700 1 --2- 172.21.15.125:0/2623708550 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff774065720 0x7ff774067be0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.631+0000 7ff797f86700 1 --2- 172.21.15.125:0/2623708550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff7901467c0 0x7ff790161070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.631+0000 7ff797f86700 1 --2- 172.21.15.125:0/2623708550 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7900b5b80 0x7ff790160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.631+0000 7ff797f86700 1 --2- 172.21.15.125:0/2623708550 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff79006f9a0 0x7ff79015c5f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.631+0000 7ff797f86700 1 -- 172.21.15.125:0/2623708550 >> 172.21.15.125:0/2623708550 conn(0x7ff79006a130 msgr2=0x7ff79006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.631+0000 7ff797f86700 1 -- 172.21.15.125:0/2623708550 shutdown_connections 2023-10-17T06:07:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.631+0000 7ff797f86700 1 -- 172.21.15.125:0/2623708550 wait complete. 2023-10-17T06:07:47.655 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-17T06:07:47.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.835+0000 7f027ef9e700 1 Processor -- start 2023-10-17T06:07:47.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.839+0000 7f027ef9e700 1 -- start start 2023-10-17T06:07:47.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.839+0000 7f027ef9e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02780b48e0 0x7f027806d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:47.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.839+0000 7f027ef9e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f027806eae0 con 0x7f027815cb00 2023-10-17T06:07:47.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.839+0000 7f027ef9e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f027806ded0 con 0x7f0278070b70 2023-10-17T06:07:47.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.839+0000 7f027ef9e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027806e1b0 con 0x7f02780b48e0 2023-10-17T06:07:47.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.839+0000 7f027df9c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f027815cb00 0x7f0278070460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59570/0 (socket says 172.21.15.125:59570) 2023-10-17T06:07:47.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.839+0000 7f027df9c700 1 -- 172.21.15.125:0/1490001343 learned_addr learned my addr 172.21.15.125:0/1490001343 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:47.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.843+0000 7f027e79d700 1 --2- 172.21.15.125:0/1490001343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02780b48e0 0x7f027806d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:47.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.843+0000 7f027cf9a700 1 -- 172.21.15.125:0/1490001343 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477587497 0 0) 0x7f027806eae0 con 0x7f027815cb00 2023-10-17T06:07:47.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.843+0000 7f027cf9a700 1 -- 172.21.15.125:0/1490001343 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02640035d0 con 0x7f027815cb00 2023-10-17T06:07:47.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.843+0000 7f027cf9a700 1 -- 172.21.15.125:0/1490001343 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879016479 0 0) 0x7f027806ded0 con 0x7f0278070b70 2023-10-17T06:07:47.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.843+0000 7f027cf9a700 1 -- 172.21.15.125:0/1490001343 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f027806eae0 con 0x7f0278070b70 2023-10-17T06:07:47.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.843+0000 7f027e79d700 1 -- 172.21.15.125:0/1490001343 >> v1:172.21.15.184:6789/0 conn(0x7f0278070b70 legacy=0x7f027806d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:47.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.843+0000 7f027e79d700 1 -- 172.21.15.125:0/1490001343 >> v1:172.21.15.125:6789/0 conn(0x7f027815cb00 legacy=0x7f0278070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:47.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.843+0000 7f027e79d700 1 -- 172.21.15.125:0/1490001343 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027806e490 con 0x7f02780b48e0 2023-10-17T06:07:47.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.843+0000 7f027e79d700 1 --2- 172.21.15.125:0/1490001343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02780b48e0 0x7f027806d850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0270009dc0 tx=0x7f027000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ff0f22d0795b942 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:47.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.843+0000 7f027cf9a700 1 -- 172.21.15.125:0/1490001343 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027000e070 con 0x7f02780b48e0 2023-10-17T06:07:47.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.843+0000 7f027cf9a700 1 -- 172.21.15.125:0/1490001343 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027000bb20 con 0x7f02780b48e0 2023-10-17T06:07:47.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.843+0000 7f027cf9a700 1 -- 172.21.15.125:0/1490001343 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027000be90 con 0x7f02780b48e0 2023-10-17T06:07:47.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.843+0000 7f027ef9e700 1 -- 172.21.15.125:0/1490001343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02780b48e0 msgr2=0x7f027806d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:47.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.843+0000 7f027ef9e700 1 --2- 172.21.15.125:0/1490001343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02780b48e0 0x7f027806d850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0270009dc0 tx=0x7f027000b330 comp rx=0 tx=0).stop 2023-10-17T06:07:47.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.843+0000 7f027ef9e700 1 -- 172.21.15.125:0/1490001343 shutdown_connections 2023-10-17T06:07:47.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.843+0000 7f027ef9e700 1 --2- 172.21.15.125:0/1490001343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02780b48e0 0x7f027806d850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.843+0000 7f027ef9e700 1 -- 172.21.15.125:0/1490001343 >> 172.21.15.125:0/1490001343 conn(0x7f02780cf500 msgr2=0x7f02780cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:47.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.847+0000 7f027ef9e700 1 -- 172.21.15.125:0/1490001343 shutdown_connections 2023-10-17T06:07:47.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.847+0000 7f027ef9e700 1 -- 172.21.15.125:0/1490001343 wait complete. 2023-10-17T06:07:47.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.847+0000 7f027ef9e700 1 Processor -- start 2023-10-17T06:07:47.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.847+0000 7f027ef9e700 1 -- start start 2023-10-17T06:07:47.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.847+0000 7f027ef9e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0278070b70 0x7f027815b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:47.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.847+0000 7f027ef9e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02780b48e0 0x7f027815b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:47.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.847+0000 7f027ef9e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f027815cb00 0x7f02781e5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:47.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.847+0000 7f027ef9e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027815d3c0 con 0x7f027815cb00 2023-10-17T06:07:47.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.847+0000 7f027ef9e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027815d6a0 con 0x7f02780b48e0 2023-10-17T06:07:47.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.847+0000 7f027ef9e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027815d980 con 0x7f0278070b70 2023-10-17T06:07:47.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.851+0000 7f027e79d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f027815cb00 0x7f02781e5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:47.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.851+0000 7f027e79d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f027815cb00 0x7f02781e5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47306/0 (socket says 172.21.15.125:47306) 2023-10-17T06:07:47.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.851+0000 7f027e79d700 1 -- 172.21.15.125:0/3396742000 learned_addr learned my addr 172.21.15.125:0/3396742000 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:47.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.851+0000 7f027d79b700 1 --2- 172.21.15.125:0/3396742000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02780b48e0 0x7f027815b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:47.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.851+0000 7f027df9c700 1 --2- 172.21.15.125:0/3396742000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0278070b70 0x7f027815b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:47.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.851+0000 7f027e79d700 1 -- 172.21.15.125:0/3396742000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0278070b70 msgr2=0x7f027815b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:47.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.851+0000 7f027e79d700 1 --2- 172.21.15.125:0/3396742000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0278070b70 0x7f027815b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.851+0000 7f027e79d700 1 -- 172.21.15.125:0/3396742000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02780b48e0 msgr2=0x7f027815b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:47.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.851+0000 7f027e79d700 1 --2- 172.21.15.125:0/3396742000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02780b48e0 0x7f027815b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:47.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.851+0000 7f027e79d700 1 -- 172.21.15.125:0/3396742000 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0270009a70 con 0x7f027815cb00 2023-10-17T06:07:47.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.851+0000 7f027e79d700 1 --2- 172.21.15.125:0/3396742000 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f027815cb00 0x7f02781e5410 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0270009fd0 tx=0x7f0270004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:47.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.851+0000 7f026e7fc700 1 -- 172.21.15.125:0/3396742000 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02700098f0 con 0x7f027815cb00 2023-10-17T06:07:47.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.851+0000 7f026e7fc700 1 -- 172.21.15.125:0/3396742000 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027001f070 con 0x7f027815cb00 2023-10-17T06:07:47.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.851+0000 7f027ef9e700 1 -- 172.21.15.125:0/3396742000 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027815dc60 con 0x7f027815cb00 2023-10-17T06:07:47.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.851+0000 7f026e7fc700 1 -- 172.21.15.125:0/3396742000 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0270003c60 con 0x7f027815cb00 2023-10-17T06:07:47.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.851+0000 7f027ef9e700 1 -- 172.21.15.125:0/3396742000 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02781e5950 con 0x7f027815cb00 2023-10-17T06:07:47.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.855+0000 7f027ef9e700 1 -- 172.21.15.125:0/3396742000 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027815e180 con 0x7f027815cb00 2023-10-17T06:07:47.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.855+0000 7f026e7fc700 1 -- 172.21.15.125:0/3396742000 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0270025450 con 0x7f027815cb00 2023-10-17T06:07:47.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.855+0000 7f026e7fc700 1 --2- 172.21.15.125:0/3396742000 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f025c0656f0 0x7f025c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:47.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.855+0000 7f026e7fc700 1 -- 172.21.15.125:0/3396742000 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0270084a20 con 0x7f027815cb00 2023-10-17T06:07:47.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.855+0000 7f027df9c700 1 --2- 172.21.15.125:0/3396742000 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f025c0656f0 0x7f025c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:47.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.859+0000 7f027df9c700 1 --2- 172.21.15.125:0/3396742000 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f025c0656f0 0x7f025c067bb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0274000f60 tx=0x7f0274007e20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:47.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:47.863+0000 7f026e7fc700 1 -- 172.21.15.125:0/3396742000 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f027815e180 con 0x7f027815cb00 2023-10-17T06:07:48.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.047+0000 7f027ef9e700 1 -- 172.21.15.125:0/3396742000 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f027815e180 con 0x7f027815cb00 2023-10-17T06:07:48.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.047+0000 7f026e7fc700 1 -- 172.21.15.125:0/3396742000 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f027815e180 con 0x7f027815cb00 2023-10-17T06:07:48.051 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-17T06:07:48.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.051+0000 7f027ef9e700 1 -- 172.21.15.125:0/3396742000 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f025c0656f0 msgr2=0x7f025c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:48.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.051+0000 7f027ef9e700 1 --2- 172.21.15.125:0/3396742000 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f025c0656f0 0x7f025c067bb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0274000f60 tx=0x7f0274007e20 comp rx=0 tx=0).stop 2023-10-17T06:07:48.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.051+0000 7f027ef9e700 1 -- 172.21.15.125:0/3396742000 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f027815cb00 msgr2=0x7f02781e5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:48.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.051+0000 7f027ef9e700 1 --2- 172.21.15.125:0/3396742000 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f027815cb00 0x7f02781e5410 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0270009fd0 tx=0x7f0270004af0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.051+0000 7f027ef9e700 1 -- 172.21.15.125:0/3396742000 shutdown_connections 2023-10-17T06:07:48.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.051+0000 7f027ef9e700 1 --2- 172.21.15.125:0/3396742000 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f025c0656f0 0x7f025c067bb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.051+0000 7f027ef9e700 1 --2- 172.21.15.125:0/3396742000 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f027815cb00 0x7f02781e5410 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.051+0000 7f027ef9e700 1 --2- 172.21.15.125:0/3396742000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02780b48e0 0x7f027815b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.051+0000 7f027ef9e700 1 --2- 172.21.15.125:0/3396742000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0278070b70 0x7f027815b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.051+0000 7f027ef9e700 1 -- 172.21.15.125:0/3396742000 >> 172.21.15.125:0/3396742000 conn(0x7f02780cf500 msgr2=0x7f027814f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:48.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.051+0000 7f027ef9e700 1 -- 172.21.15.125:0/3396742000 shutdown_connections 2023-10-17T06:07:48.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.051+0000 7f027ef9e700 1 -- 172.21.15.125:0/3396742000 wait complete. 2023-10-17T06:07:48.076 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-17T06:07:48.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.247+0000 7fb6cbfff700 1 Processor -- start 2023-10-17T06:07:48.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.247+0000 7fb6cbfff700 1 -- start start 2023-10-17T06:07:48.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.251+0000 7fb6cbfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6cc160710 0x7fb6cc0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:48.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.251+0000 7fb6cbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb6cc0b5ae0 0x7fb6cc06db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:48.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.251+0000 7fb6cbfff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6cc15d0d0 con 0x7fb6cc0d2e00 2023-10-17T06:07:48.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.251+0000 7fb6cbfff700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6cc15df90 con 0x7fb6cc0b5ae0 2023-10-17T06:07:48.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.251+0000 7fb6cbfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc06f0f0 con 0x7fb6cc160710 2023-10-17T06:07:48.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.251+0000 7fb6caffd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fb6cc0d2e00 0x7fb6cc0d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:33572/0 (socket says 172.21.15.125:33572) 2023-10-17T06:07:48.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.251+0000 7fb6caffd700 1 -- 172.21.15.125:0/2994392124 learned_addr learned my addr 172.21.15.125:0/2994392124 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:48.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.251+0000 7fb6ca7fc700 1 --2- 172.21.15.125:0/2994392124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6cc160710 0x7fb6cc0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:48.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.251+0000 7fb6cb7fe700 1 --2- 172.21.15.125:0/2994392124 >> v2:172.21.15.125:3300/0 conn(0x7fb6cc0b5ae0 0x7fb6cc06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:48.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.251+0000 7fb6cb7fe700 1 -- 172.21.15.125:0/2994392124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6cc160710 msgr2=0x7fb6cc0b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:48.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.251+0000 7fb6cb7fe700 1 --2- 172.21.15.125:0/2994392124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6cc160710 0x7fb6cc0b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.251+0000 7fb6c9ffb700 1 -- 172.21.15.125:0/2994392124 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 489130722 0 0) 0x7fb6bc001110 con 0x7fb6cc0d2e00 2023-10-17T06:07:48.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.251+0000 7fb6cb7fe700 1 -- 172.21.15.125:0/2994392124 >> v1:172.21.15.184:6789/0 conn(0x7fb6cc0d2e00 legacy=0x7fb6cc0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:48.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.251+0000 7fb6cb7fe700 1 -- 172.21.15.125:0/2994392124 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc15d310 con 0x7fb6cc0b5ae0 2023-10-17T06:07:48.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.251+0000 7fb6cb7fe700 1 --2- 172.21.15.125:0/2994392124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6cc0b5ae0 0x7fb6cc06db60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4009dc0 tx=0x7fb6c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c35cc9b6f53ef4 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:48.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.251+0000 7fb6c9ffb700 1 -- 172.21.15.125:0/2994392124 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c400e070 con 0x7fb6cc0b5ae0 2023-10-17T06:07:48.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.251+0000 7fb6c9ffb700 1 -- 172.21.15.125:0/2994392124 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c400bae0 con 0x7fb6cc0b5ae0 2023-10-17T06:07:48.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.251+0000 7fb6c9ffb700 1 -- 172.21.15.125:0/2994392124 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c400be90 con 0x7fb6cc0b5ae0 2023-10-17T06:07:48.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.255+0000 7fb6cbfff700 1 -- 172.21.15.125:0/2994392124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6cc0b5ae0 msgr2=0x7fb6cc06db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:48.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.255+0000 7fb6cbfff700 1 --2- 172.21.15.125:0/2994392124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6cc0b5ae0 0x7fb6cc06db60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4009dc0 tx=0x7fb6c400b330 comp rx=0 tx=0).stop 2023-10-17T06:07:48.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.255+0000 7fb6cbfff700 1 -- 172.21.15.125:0/2994392124 shutdown_connections 2023-10-17T06:07:48.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.255+0000 7fb6cbfff700 1 --2- 172.21.15.125:0/2994392124 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6cc0b5ae0 0x7fb6cc06db60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.255+0000 7fb6cbfff700 1 --2- 172.21.15.125:0/2994392124 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6cc160710 0x7fb6cc0b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.255+0000 7fb6cbfff700 1 -- 172.21.15.125:0/2994392124 >> 172.21.15.125:0/2994392124 conn(0x7fb6cc069f20 msgr2=0x7fb6cc06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:48.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.255+0000 7fb6cbfff700 1 -- 172.21.15.125:0/2994392124 shutdown_connections 2023-10-17T06:07:48.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.255+0000 7fb6cbfff700 1 -- 172.21.15.125:0/2994392124 wait complete. 2023-10-17T06:07:48.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.259+0000 7fb6cbfff700 1 Processor -- start 2023-10-17T06:07:48.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.259+0000 7fb6cbfff700 1 -- start start 2023-10-17T06:07:48.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.259+0000 7fb6cbfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6cc0b5ae0 0x7fb6cc1548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:48.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.259+0000 7fb6cbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6cc0d2e00 0x7fb6cc1519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:48.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.259+0000 7fb6cbfff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6cc160710 0x7fb6cc1fa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:48.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.259+0000 7fb6cbfff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1f7120 con 0x7fb6cc0d2e00 2023-10-17T06:07:48.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.259+0000 7fb6cbfff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1fab20 con 0x7fb6cc160710 2023-10-17T06:07:48.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.259+0000 7fb6cbfff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1fae00 con 0x7fb6cc0b5ae0 2023-10-17T06:07:48.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.259+0000 7fb6ca7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6cc0d2e00 0x7fb6cc1519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:48.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.259+0000 7fb6ca7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6cc0d2e00 0x7fb6cc1519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47322/0 (socket says 172.21.15.125:47322) 2023-10-17T06:07:48.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.259+0000 7fb6ca7fc700 1 -- 172.21.15.125:0/3314865934 learned_addr learned my addr 172.21.15.125:0/3314865934 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:48.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.259+0000 7fb6caffd700 1 --2- 172.21.15.125:0/3314865934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6cc0b5ae0 0x7fb6cc1548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:48.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.259+0000 7fb6cb7fe700 1 --2- 172.21.15.125:0/3314865934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6cc160710 0x7fb6cc1fa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:48.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.263+0000 7fb6ca7fc700 1 -- 172.21.15.125:0/3314865934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6cc0b5ae0 msgr2=0x7fb6cc1548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:48.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.263+0000 7fb6ca7fc700 1 --2- 172.21.15.125:0/3314865934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6cc0b5ae0 0x7fb6cc1548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.263+0000 7fb6ca7fc700 1 -- 172.21.15.125:0/3314865934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6cc160710 msgr2=0x7fb6cc1fa220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:48.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.263+0000 7fb6ca7fc700 1 --2- 172.21.15.125:0/3314865934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6cc160710 0x7fb6cc1fa220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.263+0000 7fb6ca7fc700 1 -- 172.21.15.125:0/3314865934 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c4009a70 con 0x7fb6cc0d2e00 2023-10-17T06:07:48.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.263+0000 7fb6ca7fc700 1 --2- 172.21.15.125:0/3314865934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6cc0d2e00 0x7fb6cc1519e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb6c000e9a0 tx=0x7fb6c000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:48.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.263+0000 7fb6b37fe700 1 -- 172.21.15.125:0/3314865934 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0009720 con 0x7fb6cc0d2e00 2023-10-17T06:07:48.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.263+0000 7fb6b37fe700 1 -- 172.21.15.125:0/3314865934 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c000c690 con 0x7fb6cc0d2e00 2023-10-17T06:07:48.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.263+0000 7fb6cbfff700 1 -- 172.21.15.125:0/3314865934 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6cc1fb0e0 con 0x7fb6cc0d2e00 2023-10-17T06:07:48.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.263+0000 7fb6b37fe700 1 -- 172.21.15.125:0/3314865934 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c000ca20 con 0x7fb6cc0d2e00 2023-10-17T06:07:48.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.263+0000 7fb6cbfff700 1 -- 172.21.15.125:0/3314865934 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6cc1fa760 con 0x7fb6cc0d2e00 2023-10-17T06:07:48.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.263+0000 7fb6cbfff700 1 -- 172.21.15.125:0/3314865934 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6cc04e910 con 0x7fb6cc0d2e00 2023-10-17T06:07:48.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.267+0000 7fb6b37fe700 1 -- 172.21.15.125:0/3314865934 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb6c000cb80 con 0x7fb6cc0d2e00 2023-10-17T06:07:48.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.267+0000 7fb6b37fe700 1 --2- 172.21.15.125:0/3314865934 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb6b80656f0 0x7fb6b8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:48.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.267+0000 7fb6b37fe700 1 -- 172.21.15.125:0/3314865934 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb6c00830c0 con 0x7fb6cc0d2e00 2023-10-17T06:07:48.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.267+0000 7fb6caffd700 1 --2- 172.21.15.125:0/3314865934 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb6b80656f0 0x7fb6b8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:48.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.267+0000 7fb6caffd700 1 --2- 172.21.15.125:0/3314865934 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb6b80656f0 0x7fb6b8067bb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc007c60 tx=0x7fb6bc007bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:48.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.271+0000 7fb6b37fe700 1 -- 172.21.15.125:0/3314865934 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fb6c0054280 con 0x7fb6cc0d2e00 2023-10-17T06:07:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.451+0000 7fb6cbfff700 1 -- 172.21.15.125:0/3314865934 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb6cc06a5e0 con 0x7fb6cc0d2e00 2023-10-17T06:07:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.451+0000 7fb6b37fe700 1 -- 172.21.15.125:0/3314865934 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb6c0053e10 con 0x7fb6cc0d2e00 2023-10-17T06:07:48.456 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:07:48.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.455+0000 7fb6cbfff700 1 -- 172.21.15.125:0/3314865934 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb6b80656f0 msgr2=0x7fb6b8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:48.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.455+0000 7fb6cbfff700 1 --2- 172.21.15.125:0/3314865934 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb6b80656f0 0x7fb6b8067bb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc007c60 tx=0x7fb6bc007bb0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.455+0000 7fb6cbfff700 1 -- 172.21.15.125:0/3314865934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6cc0d2e00 msgr2=0x7fb6cc1519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:48.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.455+0000 7fb6cbfff700 1 --2- 172.21.15.125:0/3314865934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6cc0d2e00 0x7fb6cc1519e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb6c000e9a0 tx=0x7fb6c000ecb0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.455+0000 7fb6cbfff700 1 -- 172.21.15.125:0/3314865934 shutdown_connections 2023-10-17T06:07:48.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.455+0000 7fb6cbfff700 1 --2- 172.21.15.125:0/3314865934 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb6b80656f0 0x7fb6b8067bb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.455+0000 7fb6cbfff700 1 --2- 172.21.15.125:0/3314865934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6cc160710 0x7fb6cc1fa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.455+0000 7fb6cbfff700 1 --2- 172.21.15.125:0/3314865934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb6cc0d2e00 0x7fb6cc1519e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.455+0000 7fb6cbfff700 1 --2- 172.21.15.125:0/3314865934 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb6cc0b5ae0 0x7fb6cc1548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.455+0000 7fb6cbfff700 1 -- 172.21.15.125:0/3314865934 >> 172.21.15.125:0/3314865934 conn(0x7fb6cc069f20 msgr2=0x7fb6cc0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:48.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.455+0000 7fb6cbfff700 1 -- 172.21.15.125:0/3314865934 shutdown_connections 2023-10-17T06:07:48.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.455+0000 7fb6cbfff700 1 -- 172.21.15.125:0/3314865934 wait complete. 2023-10-17T06:07:48.480 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:07:48.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.659+0000 7fad21c11700 1 Processor -- start 2023-10-17T06:07:48.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.663+0000 7fad21c11700 1 -- start start 2023-10-17T06:07:48.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.663+0000 7fad21c11700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad1c06e8a0 0x7fad1c0cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:48.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.663+0000 7fad21c11700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad1c0cb6d0 0x7fad1c06f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:48.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.663+0000 7fad21c11700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad1c15e130 con 0x7fad1c154040 2023-10-17T06:07:48.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.663+0000 7fad21c11700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1c0cbb60 con 0x7fad1c0cb6d0 2023-10-17T06:07:48.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.663+0000 7fad21c11700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c0cdfa0 con 0x7fad1c06e8a0 2023-10-17T06:07:48.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.667+0000 7fad1bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad1c0cb6d0 0x7fad1c06f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:48.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.667+0000 7fad1bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad1c0cb6d0 0x7fad1c06f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47324/0 (socket says 172.21.15.125:47324) 2023-10-17T06:07:48.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.667+0000 7fad1bfff700 1 -- 172.21.15.125:0/1664214452 learned_addr learned my addr 172.21.15.125:0/1664214452 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:48.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.667+0000 7fad13fff700 1 --2- 172.21.15.125:0/1664214452 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad1c06e8a0 0x7fad1c0cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:48.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.667+0000 7fad1bfff700 1 -- 172.21.15.125:0/1664214452 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad1c06e8a0 msgr2=0x7fad1c0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:48.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.667+0000 7fad1bfff700 1 --2- 172.21.15.125:0/1664214452 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad1c06e8a0 0x7fad1c0cb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.667+0000 7fad1bfff700 1 -- 172.21.15.125:0/1664214452 >> v1:172.21.15.184:6789/0 conn(0x7fad1c154040 legacy=0x7fad1c0cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:48.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.667+0000 7fad1bfff700 1 -- 172.21.15.125:0/1664214452 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c0ce1b0 con 0x7fad1c0cb6d0 2023-10-17T06:07:48.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.667+0000 7fad1bfff700 1 --2- 172.21.15.125:0/1664214452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad1c0cb6d0 0x7fad1c06f970 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fad14009e50 tx=0x7fad1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc9b06ff198093c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:48.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.667+0000 7fad1affd700 1 -- 172.21.15.125:0/1664214452 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1400e070 con 0x7fad1c0cb6d0 2023-10-17T06:07:48.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.667+0000 7fad1affd700 1 -- 172.21.15.125:0/1664214452 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1400b910 con 0x7fad1c0cb6d0 2023-10-17T06:07:48.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.667+0000 7fad1affd700 1 -- 172.21.15.125:0/1664214452 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1400bcc0 con 0x7fad1c0cb6d0 2023-10-17T06:07:48.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.667+0000 7fad21c11700 1 -- 172.21.15.125:0/1664214452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad1c0cb6d0 msgr2=0x7fad1c06f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:48.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.667+0000 7fad21c11700 1 --2- 172.21.15.125:0/1664214452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad1c0cb6d0 0x7fad1c06f970 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fad14009e50 tx=0x7fad1400b330 comp rx=0 tx=0).stop 2023-10-17T06:07:48.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.667+0000 7fad21c11700 1 -- 172.21.15.125:0/1664214452 shutdown_connections 2023-10-17T06:07:48.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.667+0000 7fad21c11700 1 --2- 172.21.15.125:0/1664214452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad1c0cb6d0 0x7fad1c06f970 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.667+0000 7fad21c11700 1 --2- 172.21.15.125:0/1664214452 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad1c06e8a0 0x7fad1c0cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.667+0000 7fad21c11700 1 -- 172.21.15.125:0/1664214452 >> 172.21.15.125:0/1664214452 conn(0x7fad1c06a340 msgr2=0x7fad1c0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:48.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.667+0000 7fad21c11700 1 -- 172.21.15.125:0/1664214452 shutdown_connections 2023-10-17T06:07:48.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.667+0000 7fad21c11700 1 -- 172.21.15.125:0/1664214452 wait complete. 2023-10-17T06:07:48.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.671+0000 7fad21c11700 1 Processor -- start 2023-10-17T06:07:48.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.671+0000 7fad21c11700 1 -- start start 2023-10-17T06:07:48.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.671+0000 7fad21c11700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad1c06e8a0 0x7fad1c1f1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:48.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.671+0000 7fad21c11700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad1c0cb6d0 0x7fad1c0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:48.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.671+0000 7fad21c11700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad1c154040 0x7fad1c0aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:48.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.671+0000 7fad21c11700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c1544c0 con 0x7fad1c06e8a0 2023-10-17T06:07:48.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.671+0000 7fad21c11700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c1547a0 con 0x7fad1c154040 2023-10-17T06:07:48.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.671+0000 7fad21c11700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c154a80 con 0x7fad1c0cb6d0 2023-10-17T06:07:48.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.671+0000 7fad1b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad1c06e8a0 0x7fad1c1f1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:48.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.671+0000 7fad1b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad1c06e8a0 0x7fad1c1f1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47338/0 (socket says 172.21.15.125:47338) 2023-10-17T06:07:48.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.671+0000 7fad1b7fe700 1 -- 172.21.15.125:0/1966780210 learned_addr learned my addr 172.21.15.125:0/1966780210 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:48.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.675+0000 7fad13fff700 1 --2- 172.21.15.125:0/1966780210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad1c0cb6d0 0x7fad1c0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:48.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.675+0000 7fad1bfff700 1 --2- 172.21.15.125:0/1966780210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad1c154040 0x7fad1c0aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:48.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.675+0000 7fad1b7fe700 1 -- 172.21.15.125:0/1966780210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad1c0cb6d0 msgr2=0x7fad1c0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:48.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.675+0000 7fad1b7fe700 1 --2- 172.21.15.125:0/1966780210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad1c0cb6d0 0x7fad1c0aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.675+0000 7fad1b7fe700 1 -- 172.21.15.125:0/1966780210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad1c154040 msgr2=0x7fad1c0aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:48.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.675+0000 7fad1b7fe700 1 --2- 172.21.15.125:0/1966780210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad1c154040 0x7fad1c0aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.675+0000 7fad1b7fe700 1 -- 172.21.15.125:0/1966780210 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad14009b30 con 0x7fad1c06e8a0 2023-10-17T06:07:48.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.675+0000 7fad1b7fe700 1 --2- 172.21.15.125:0/1966780210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad1c06e8a0 0x7fad1c1f1cc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00c500 tx=0x7fad0c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:48.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.675+0000 7fad18ff9700 1 -- 172.21.15.125:0/1966780210 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c0052d0 con 0x7fad1c06e8a0 2023-10-17T06:07:48.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.675+0000 7fad18ff9700 1 -- 172.21.15.125:0/1966780210 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c005430 con 0x7fad1c06e8a0 2023-10-17T06:07:48.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.675+0000 7fad21c11700 1 -- 172.21.15.125:0/1966780210 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1c154d60 con 0x7fad1c06e8a0 2023-10-17T06:07:48.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.675+0000 7fad18ff9700 1 -- 172.21.15.125:0/1966780210 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c0055a0 con 0x7fad1c06e8a0 2023-10-17T06:07:48.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.675+0000 7fad21c11700 1 -- 172.21.15.125:0/1966780210 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1c1f2200 con 0x7fad1c06e8a0 2023-10-17T06:07:48.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.675+0000 7fad21c11700 1 -- 172.21.15.125:0/1966780210 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1c06ee70 con 0x7fad1c06e8a0 2023-10-17T06:07:48.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.679+0000 7fad18ff9700 1 -- 172.21.15.125:0/1966780210 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fad0c0038e0 con 0x7fad1c06e8a0 2023-10-17T06:07:48.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.679+0000 7fad18ff9700 1 --2- 172.21.15.125:0/1966780210 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7facfc0656f0 0x7facfc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:48.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.679+0000 7fad18ff9700 1 -- 172.21.15.125:0/1966780210 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fad0c0824c0 con 0x7fad1c06e8a0 2023-10-17T06:07:48.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.679+0000 7fad13fff700 1 --2- 172.21.15.125:0/1966780210 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7facfc0656f0 0x7facfc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:48.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.683+0000 7fad13fff700 1 --2- 172.21.15.125:0/1966780210 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7facfc0656f0 0x7facfc067bb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0b0c30 tx=0x7fad04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:48.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.683+0000 7fad18ff9700 1 -- 172.21.15.125:0/1966780210 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fad0c04fd20 con 0x7fad1c06e8a0 2023-10-17T06:07:48.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.915+0000 7fad21c11700 1 -- 172.21.15.125:0/1966780210 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad1c072e60 con 0x7fad1c06e8a0 2023-10-17T06:07:48.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.915+0000 7fad18ff9700 1 -- 172.21.15.125:0/1966780210 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7fad0c053340 con 0x7fad1c06e8a0 2023-10-17T06:07:48.920 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:48.920 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/3744648044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3744648044},{"type":"v1","addr":"172.21.15.184:6833","nonce":3744648044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/181458401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181458401},{"type":"v1","addr":"172.21.15.184:6835","nonce":181458401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/908363262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":908363262},{"type":"v1","addr":"172.21.15.125:6835","nonce":908363262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:07:09.036610+0000","modified":"2023-10-17T06:07:35.578225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/3617198893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":3617198893},{"type":"v1","addr":"172.21.15.125:6837","nonce":3617198893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-17T06:07:48.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.919+0000 7fad21c11700 1 -- 172.21.15.125:0/1966780210 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7facfc0656f0 msgr2=0x7facfc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:48.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.919+0000 7fad21c11700 1 --2- 172.21.15.125:0/1966780210 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7facfc0656f0 0x7facfc067bb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0b0c30 tx=0x7fad04008040 comp rx=0 tx=0).stop 2023-10-17T06:07:48.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.919+0000 7fad21c11700 1 -- 172.21.15.125:0/1966780210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad1c06e8a0 msgr2=0x7fad1c1f1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:48.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.919+0000 7fad21c11700 1 --2- 172.21.15.125:0/1966780210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad1c06e8a0 0x7fad1c1f1cc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00c500 tx=0x7fad0c00c8c0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.919+0000 7fad21c11700 1 -- 172.21.15.125:0/1966780210 shutdown_connections 2023-10-17T06:07:48.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.919+0000 7fad21c11700 1 --2- 172.21.15.125:0/1966780210 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7facfc0656f0 0x7facfc067bb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.919+0000 7fad21c11700 1 --2- 172.21.15.125:0/1966780210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad1c154040 0x7fad1c0aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.919+0000 7fad21c11700 1 --2- 172.21.15.125:0/1966780210 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fad1c0cb6d0 0x7fad1c0aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.919+0000 7fad21c11700 1 --2- 172.21.15.125:0/1966780210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad1c06e8a0 0x7fad1c1f1cc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:48.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.919+0000 7fad21c11700 1 -- 172.21.15.125:0/1966780210 >> 172.21.15.125:0/1966780210 conn(0x7fad1c06a340 msgr2=0x7fad1c0b36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:48.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.919+0000 7fad21c11700 1 -- 172.21.15.125:0/1966780210 shutdown_connections 2023-10-17T06:07:48.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:48.919+0000 7fad21c11700 1 -- 172.21.15.125:0/1966780210 wait complete. 2023-10-17T06:07:48.926 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 9 2023-10-17T06:07:48.947 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:07:49.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.123+0000 7f1845356700 1 Processor -- start 2023-10-17T06:07:49.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.123+0000 7f1845356700 1 -- start start 2023-10-17T06:07:49.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.123+0000 7f1845356700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1840155420 0x7f18400cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:49.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.123+0000 7f1845356700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f184015bf00 0x7f18400cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:49.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.123+0000 7f1845356700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18400cbc80 con 0x7f18400b0f90 2023-10-17T06:07:49.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.123+0000 7f1845356700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1840155800 con 0x7f184015bf00 2023-10-17T06:07:49.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.123+0000 7f1845356700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18400cb9a0 con 0x7f1840155420 2023-10-17T06:07:49.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.123+0000 7f183e7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f184015bf00 0x7f18400cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:49.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.123+0000 7f183f7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f18400b0f90 0x7f18400cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59576/0 (socket says 172.21.15.125:59576) 2023-10-17T06:07:49.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.123+0000 7f183f7fe700 1 -- 172.21.15.125:0/4101250965 learned_addr learned my addr 172.21.15.125:0/4101250965 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:49.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.123+0000 7f183effd700 1 --2- 172.21.15.125:0/4101250965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1840155420 0x7f18400cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:49.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.123+0000 7f183e7fc700 1 -- 172.21.15.125:0/4101250965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1840155420 msgr2=0x7f18400cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:49.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.123+0000 7f183e7fc700 1 --2- 172.21.15.125:0/4101250965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1840155420 0x7f18400cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.123+0000 7f183e7fc700 1 -- 172.21.15.125:0/4101250965 >> v1:172.21.15.125:6789/0 conn(0x7f18400b0f90 legacy=0x7f18400cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:49.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.123+0000 7f183e7fc700 1 -- 172.21.15.125:0/4101250965 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184015b420 con 0x7f184015bf00 2023-10-17T06:07:49.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.123+0000 7f183dffb700 1 -- 172.21.15.125:0/4101250965 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417435779 0 0) 0x7f18400cbc80 con 0x7f18400b0f90 2023-10-17T06:07:49.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.127+0000 7f183e7fc700 1 --2- 172.21.15.125:0/4101250965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f184015bf00 0x7f18400cdc10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1834009850 tx=0x7f1834009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c1c4f5ffd037bb server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:49.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.127+0000 7f183dffb700 1 -- 172.21.15.125:0/4101250965 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1834011830 con 0x7f184015bf00 2023-10-17T06:07:49.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.127+0000 7f183dffb700 1 -- 172.21.15.125:0/4101250965 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1834011990 con 0x7f184015bf00 2023-10-17T06:07:49.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.127+0000 7f183dffb700 1 -- 172.21.15.125:0/4101250965 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1834011d20 con 0x7f184015bf00 2023-10-17T06:07:49.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.127+0000 7f1845356700 1 -- 172.21.15.125:0/4101250965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f184015bf00 msgr2=0x7f18400cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:49.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.127+0000 7f1845356700 1 --2- 172.21.15.125:0/4101250965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f184015bf00 0x7f18400cdc10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1834009850 tx=0x7f1834009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:49.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.127+0000 7f1845356700 1 -- 172.21.15.125:0/4101250965 shutdown_connections 2023-10-17T06:07:49.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.127+0000 7f1845356700 1 --2- 172.21.15.125:0/4101250965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f184015bf00 0x7f18400cdc10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.127+0000 7f1845356700 1 --2- 172.21.15.125:0/4101250965 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1840155420 0x7f18400cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.127+0000 7f1845356700 1 -- 172.21.15.125:0/4101250965 >> 172.21.15.125:0/4101250965 conn(0x7f184006a340 msgr2=0x7f18400b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:49.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.127+0000 7f1845356700 1 -- 172.21.15.125:0/4101250965 shutdown_connections 2023-10-17T06:07:49.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.127+0000 7f1845356700 1 -- 172.21.15.125:0/4101250965 wait complete. 2023-10-17T06:07:49.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.131+0000 7f1845356700 1 Processor -- start 2023-10-17T06:07:49.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.131+0000 7f1845356700 1 -- start start 2023-10-17T06:07:49.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.131+0000 7f1845356700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18400b0f90 0x7f184013a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:49.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.131+0000 7f1845356700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1840155420 0x7f184015cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:49.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.131+0000 7f1845356700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f184015bf00 0x7f184015d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:49.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.131+0000 7f1845356700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18401f01d0 con 0x7f18400b0f90 2023-10-17T06:07:49.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.131+0000 7f1845356700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18401f04b0 con 0x7f1840155420 2023-10-17T06:07:49.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.131+0000 7f1845356700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18401f0790 con 0x7f184015bf00 2023-10-17T06:07:49.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.131+0000 7f183effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18400b0f90 0x7f184013a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:49.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.131+0000 7f183effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18400b0f90 0x7f184013a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47356/0 (socket says 172.21.15.125:47356) 2023-10-17T06:07:49.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.131+0000 7f183effd700 1 -- 172.21.15.125:0/1646418522 learned_addr learned my addr 172.21.15.125:0/1646418522 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:49.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.131+0000 7f183e7fc700 1 --2- 172.21.15.125:0/1646418522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1840155420 0x7f184015cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:49.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.131+0000 7f183f7fe700 1 --2- 172.21.15.125:0/1646418522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f184015bf00 0x7f184015d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:49.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.135+0000 7f183effd700 1 -- 172.21.15.125:0/1646418522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f184015bf00 msgr2=0x7f184015d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:49.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.135+0000 7f183effd700 1 --2- 172.21.15.125:0/1646418522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f184015bf00 0x7f184015d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.135+0000 7f183effd700 1 -- 172.21.15.125:0/1646418522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1840155420 msgr2=0x7f184015cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:49.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.135+0000 7f183effd700 1 --2- 172.21.15.125:0/1646418522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1840155420 0x7f184015cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.135+0000 7f183effd700 1 -- 172.21.15.125:0/1646418522 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18340094b0 con 0x7f18400b0f90 2023-10-17T06:07:49.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.135+0000 7f183f7fe700 1 --2- 172.21.15.125:0/1646418522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f184015bf00 0x7f184015d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:49.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.135+0000 7f183effd700 1 --2- 172.21.15.125:0/1646418522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18400b0f90 0x7f184013a030 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f183000d800 tx=0x7f183000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:49.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.135+0000 7f18277fe700 1 -- 172.21.15.125:0/1646418522 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18300125f0 con 0x7f18400b0f90 2023-10-17T06:07:49.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.135+0000 7f18277fe700 1 -- 172.21.15.125:0/1646418522 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1830012750 con 0x7f18400b0f90 2023-10-17T06:07:49.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.135+0000 7f18277fe700 1 -- 172.21.15.125:0/1646418522 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830012ac0 con 0x7f18400b0f90 2023-10-17T06:07:49.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.135+0000 7f1845356700 1 -- 172.21.15.125:0/1646418522 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18401f0a70 con 0x7f18400b0f90 2023-10-17T06:07:49.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.135+0000 7f1845356700 1 -- 172.21.15.125:0/1646418522 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184013a570 con 0x7f18400b0f90 2023-10-17T06:07:49.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.135+0000 7f1845356700 1 -- 172.21.15.125:0/1646418522 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1840072e60 con 0x7f18400b0f90 2023-10-17T06:07:49.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.135+0000 7f18277fe700 1 -- 172.21.15.125:0/1646418522 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1830012c20 con 0x7f18400b0f90 2023-10-17T06:07:49.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.139+0000 7f18277fe700 1 --2- 172.21.15.125:0/1646418522 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f182c065740 0x7f182c067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:49.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.139+0000 7f18277fe700 1 -- 172.21.15.125:0/1646418522 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f18300834d0 con 0x7f18400b0f90 2023-10-17T06:07:49.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.139+0000 7f183e7fc700 1 --2- 172.21.15.125:0/1646418522 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f182c065740 0x7f182c067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:49.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.139+0000 7f183e7fc700 1 --2- 172.21.15.125:0/1646418522 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f182c065740 0x7f182c067c00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f18340090b0 tx=0x7f1834008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:49.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.143+0000 7f18277fe700 1 -- 172.21.15.125:0/1646418522 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f18300546d0 con 0x7f18400b0f90 2023-10-17T06:07:49.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.323+0000 7f1845356700 1 -- 172.21.15.125:0/1646418522 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1840157d10 con 0x7f18400b0f90 2023-10-17T06:07:49.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.327+0000 7f18277fe700 1 -- 172.21.15.125:0/1646418522 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20252 (secure 0 0 0) 0x7f1830012ed0 con 0x7f18400b0f90 2023-10-17T06:07:49.331 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:49.331 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":29,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:48.697857+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:07:49.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.331+0000 7f1845356700 1 -- 172.21.15.125:0/1646418522 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f182c065740 msgr2=0x7f182c067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:49.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.331+0000 7f1845356700 1 --2- 172.21.15.125:0/1646418522 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f182c065740 0x7f182c067c00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f18340090b0 tx=0x7f1834008030 comp rx=0 tx=0).stop 2023-10-17T06:07:49.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.331+0000 7f1845356700 1 -- 172.21.15.125:0/1646418522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18400b0f90 msgr2=0x7f184013a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:49.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.331+0000 7f1845356700 1 --2- 172.21.15.125:0/1646418522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18400b0f90 0x7f184013a030 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f183000d800 tx=0x7f183000dbc0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.331+0000 7f1845356700 1 -- 172.21.15.125:0/1646418522 shutdown_connections 2023-10-17T06:07:49.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.331+0000 7f1845356700 1 --2- 172.21.15.125:0/1646418522 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f182c065740 0x7f182c067c00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.331+0000 7f1845356700 1 --2- 172.21.15.125:0/1646418522 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f184015bf00 0x7f184015d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.331+0000 7f1845356700 1 --2- 172.21.15.125:0/1646418522 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1840155420 0x7f184015cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.331+0000 7f1845356700 1 --2- 172.21.15.125:0/1646418522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18400b0f90 0x7f184013a030 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.331+0000 7f1845356700 1 -- 172.21.15.125:0/1646418522 >> 172.21.15.125:0/1646418522 conn(0x7f184006a340 msgr2=0x7f184015c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:49.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.331+0000 7f1845356700 1 -- 172.21.15.125:0/1646418522 shutdown_connections 2023-10-17T06:07:49.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.331+0000 7f1845356700 1 -- 172.21.15.125:0/1646418522 wait complete. 2023-10-17T06:07:49.358 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:07:49.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.531+0000 7f5d999e6700 1 Processor -- start 2023-10-17T06:07:49.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.531+0000 7f5d999e6700 1 -- start start 2023-10-17T06:07:49.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d999e6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d940d2e00 0x7f5d940b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:49.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d999e6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d9415d0d0 con 0x7f5d94160710 2023-10-17T06:07:49.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d999e6700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d9406f0f0 con 0x7f5d940b5ae0 2023-10-17T06:07:49.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d999e6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9415df90 con 0x7f5d940d2e00 2023-10-17T06:07:49.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d927fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5d94160710 0x7f5d940d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59592/0 (socket says 172.21.15.125:59592) 2023-10-17T06:07:49.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d927fc700 1 -- 172.21.15.125:0/3293619643 learned_addr learned my addr 172.21.15.125:0/3293619643 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:49.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d92ffd700 1 --2- 172.21.15.125:0/3293619643 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d940d2e00 0x7f5d940b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:49.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d91ffb700 1 -- 172.21.15.125:0/3293619643 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978244181 0 0) 0x7f5d7c001110 con 0x7f5d94160710 2023-10-17T06:07:49.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d91ffb700 1 -- 172.21.15.125:0/3293619643 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d800035d0 con 0x7f5d94160710 2023-10-17T06:07:49.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d91ffb700 1 -- 172.21.15.125:0/3293619643 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977932680 0 0) 0x7f5d9406f0f0 con 0x7f5d940b5ae0 2023-10-17T06:07:49.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d91ffb700 1 -- 172.21.15.125:0/3293619643 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d7c001110 con 0x7f5d940b5ae0 2023-10-17T06:07:49.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d91ffb700 1 -- 172.21.15.125:0/3293619643 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 62807761 0 0) 0x7f5d800035d0 con 0x7f5d94160710 2023-10-17T06:07:49.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d91ffb700 1 -- 172.21.15.125:0/3293619643 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d940d2e00 msgr2=0x7f5d940b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:49.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d91ffb700 1 --2- 172.21.15.125:0/3293619643 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d940d2e00 0x7f5d940b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d91ffb700 1 -- 172.21.15.125:0/3293619643 >> v1:172.21.15.184:6789/0 conn(0x7f5d940b5ae0 legacy=0x7f5d9406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:49.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d91ffb700 1 -- 172.21.15.125:0/3293619643 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9415d310 con 0x7f5d94160710 2023-10-17T06:07:49.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d91ffb700 1 -- 172.21.15.125:0/3293619643 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7f5d7c001800 con 0x7f5d94160710 2023-10-17T06:07:49.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d91ffb700 1 -- 172.21.15.125:0/3293619643 >> v1:172.21.15.125:6789/0 conn(0x7f5d94160710 legacy=0x7f5d940d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:49.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d91ffb700 1 --2- 172.21.15.125:0/3293619643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d80003be0 0x7f5d80003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:49.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d91ffb700 1 --2- 172.21.15.125:0/3293619643 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d80004870 0x7f5d80004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:49.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d91ffb700 1 --2- 172.21.15.125:0/3293619643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d80005230 0x7f5d8000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:49.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d91ffb700 1 -- 172.21.15.125:0/3293619643 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9415df90 con 0x7f5d80003be0 2023-10-17T06:07:49.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d91ffb700 1 -- 172.21.15.125:0/3293619643 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8000c020 con 0x7f5d80005230 2023-10-17T06:07:49.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d91ffb700 1 -- 172.21.15.125:0/3293619643 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8000c1e0 con 0x7f5d80004870 2023-10-17T06:07:49.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.535+0000 7f5d92ffd700 1 --2- 172.21.15.125:0/3293619643 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d940d2e00 0x7f5d940b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:07:49.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.539+0000 7f5d92ffd700 1 --2- 172.21.15.125:0/3293619643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d80003be0 0x7f5d80003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:49.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.539+0000 7f5d927fc700 1 --2- 172.21.15.125:0/3293619643 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d80004870 0x7f5d80004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:49.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.539+0000 7f5d937fe700 1 --2- 172.21.15.125:0/3293619643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d80005230 0x7f5d8000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:49.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.539+0000 7f5d92ffd700 1 -- 172.21.15.125:0/3293619643 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d80004870 msgr2=0x7f5d80004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:49.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.539+0000 7f5d92ffd700 1 --2- 172.21.15.125:0/3293619643 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d80004870 0x7f5d80004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.539+0000 7f5d92ffd700 1 -- 172.21.15.125:0/3293619643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d80005230 msgr2=0x7f5d8000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:49.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.539+0000 7f5d92ffd700 1 --2- 172.21.15.125:0/3293619643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d80005230 0x7f5d8000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.539+0000 7f5d92ffd700 1 -- 172.21.15.125:0/3293619643 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d800035d0 con 0x7f5d80003be0 2023-10-17T06:07:49.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.539+0000 7f5d92ffd700 1 --2- 172.21.15.125:0/3293619643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d80003be0 0x7f5d80003fe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5d940d2dd0 tx=0x7f5d800058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2844e9d2eb1e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:49.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.539+0000 7f5d91ffb700 1 -- 172.21.15.125:0/3293619643 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84004030 con 0x7f5d80003be0 2023-10-17T06:07:49.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.539+0000 7f5d91ffb700 1 -- 172.21.15.125:0/3293619643 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d84004190 con 0x7f5d80003be0 2023-10-17T06:07:49.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.539+0000 7f5d91ffb700 1 -- 172.21.15.125:0/3293619643 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84004540 con 0x7f5d80003be0 2023-10-17T06:07:49.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.539+0000 7f5d999e6700 1 -- 172.21.15.125:0/3293619643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d80003be0 msgr2=0x7f5d80003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:49.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.539+0000 7f5d999e6700 1 --2- 172.21.15.125:0/3293619643 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d80003be0 0x7f5d80003fe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5d940d2dd0 tx=0x7f5d800058a0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.539+0000 7f5d937fe700 1 -- 172.21.15.125:0/3293619643 reap_dead start 2023-10-17T06:07:49.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.539+0000 7f5d999e6700 1 -- 172.21.15.125:0/3293619643 shutdown_connections 2023-10-17T06:07:49.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.539+0000 7f5d999e6700 1 -- 172.21.15.125:0/3293619643 >> 172.21.15.125:0/3293619643 conn(0x7f5d94069f20 msgr2=0x7f5d9406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:49.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.539+0000 7f5d999e6700 1 -- 172.21.15.125:0/3293619643 shutdown_connections 2023-10-17T06:07:49.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.539+0000 7f5d999e6700 1 -- 172.21.15.125:0/3293619643 wait complete. 2023-10-17T06:07:49.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.543+0000 7f5d999e6700 1 Processor -- start 2023-10-17T06:07:49.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.543+0000 7f5d999e6700 1 -- start start 2023-10-17T06:07:49.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.543+0000 7f5d999e6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d80003be0 0x7f5d940ad760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:49.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.543+0000 7f5d999e6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d940cebd0 0x7f5d940b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:49.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.543+0000 7f5d999e6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d940b0650 0x7f5d940ac7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:49.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.543+0000 7f5d999e6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9414afd0 con 0x7f5d80003be0 2023-10-17T06:07:49.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.543+0000 7f5d999e6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d940b0ad0 con 0x7f5d940b0650 2023-10-17T06:07:49.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.543+0000 7f5d999e6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9414a350 con 0x7f5d940cebd0 2023-10-17T06:07:49.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.543+0000 7f5d92ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d80003be0 0x7f5d940ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:49.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.547+0000 7f5d92ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d80003be0 0x7f5d940ad760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47376/0 (socket says 172.21.15.125:47376) 2023-10-17T06:07:49.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.547+0000 7f5d92ffd700 1 -- 172.21.15.125:0/2154513193 learned_addr learned my addr 172.21.15.125:0/2154513193 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:49.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.547+0000 7f5d937fe700 1 --2- 172.21.15.125:0/2154513193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d940b0650 0x7f5d940ac7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:49.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.547+0000 7f5d927fc700 1 --2- 172.21.15.125:0/2154513193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d940cebd0 0x7f5d940b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:49.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.547+0000 7f5d92ffd700 1 -- 172.21.15.125:0/2154513193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d940cebd0 msgr2=0x7f5d940b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:49.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.547+0000 7f5d92ffd700 1 --2- 172.21.15.125:0/2154513193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d940cebd0 0x7f5d940b0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.547+0000 7f5d92ffd700 1 -- 172.21.15.125:0/2154513193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d940b0650 msgr2=0x7f5d940ac7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:49.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.547+0000 7f5d92ffd700 1 --2- 172.21.15.125:0/2154513193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d940b0650 0x7f5d940ac7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.547+0000 7f5d92ffd700 1 -- 172.21.15.125:0/2154513193 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9414a630 con 0x7f5d80003be0 2023-10-17T06:07:49.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.547+0000 7f5d927fc700 1 --2- 172.21.15.125:0/2154513193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d940cebd0 0x7f5d940b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:07:49.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.547+0000 7f5d92ffd700 1 --2- 172.21.15.125:0/2154513193 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d80003be0 0x7f5d940ad760 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400e4b0 tx=0x7f5d840047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:49.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.547+0000 7f5d8bfff700 1 -- 172.21.15.125:0/2154513193 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8400e6c0 con 0x7f5d80003be0 2023-10-17T06:07:49.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.547+0000 7f5d8bfff700 1 -- 172.21.15.125:0/2154513193 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d84021070 con 0x7f5d80003be0 2023-10-17T06:07:49.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.547+0000 7f5d999e6700 1 -- 172.21.15.125:0/2154513193 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d9414a910 con 0x7f5d80003be0 2023-10-17T06:07:49.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.547+0000 7f5d8bfff700 1 -- 172.21.15.125:0/2154513193 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8400ea80 con 0x7f5d80003be0 2023-10-17T06:07:49.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.547+0000 7f5d999e6700 1 -- 172.21.15.125:0/2154513193 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d940cf030 con 0x7f5d80003be0 2023-10-17T06:07:49.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.547+0000 7f5d999e6700 1 -- 172.21.15.125:0/2154513193 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d940cf2b0 con 0x7f5d80003be0 2023-10-17T06:07:49.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.551+0000 7f5d8bfff700 1 -- 172.21.15.125:0/2154513193 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5d84023030 con 0x7f5d80003be0 2023-10-17T06:07:49.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.551+0000 7f5d8bfff700 1 --2- 172.21.15.125:0/2154513193 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5d740656f0 0x7f5d74067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:49.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.551+0000 7f5d8bfff700 1 -- 172.21.15.125:0/2154513193 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5d840848f0 con 0x7f5d80003be0 2023-10-17T06:07:49.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.551+0000 7f5d927fc700 1 --2- 172.21.15.125:0/2154513193 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5d740656f0 0x7f5d74067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:49.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.551+0000 7f5d927fc700 1 --2- 172.21.15.125:0/2154513193 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5d740656f0 0x7f5d74067bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5d9415ae50 tx=0x7f5d7c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:49.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.559+0000 7f5d8bfff700 1 -- 172.21.15.125:0/2154513193 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f5d84052070 con 0x7f5d80003be0 2023-10-17T06:07:49.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.811+0000 7f5d999e6700 1 -- 172.21.15.125:0/2154513193 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d9414b240 con 0x7f5d80003be0 2023-10-17T06:07:49.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.815+0000 7f5d8bfff700 1 -- 172.21.15.125:0/2154513193 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f5d84055690 con 0x7f5d80003be0 2023-10-17T06:07:49.817 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:07:49.817 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/3744648044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3744648044},{"type":"v1","addr":"172.21.15.184:6833","nonce":3744648044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/181458401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181458401},{"type":"v1","addr":"172.21.15.184:6835","nonce":181458401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/908363262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":908363262},{"type":"v1","addr":"172.21.15.125:6835","nonce":908363262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:07:09.036610+0000","modified":"2023-10-17T06:07:35.578225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/3617198893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":3617198893},{"type":"v1","addr":"172.21.15.125:6837","nonce":3617198893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-17T06:07:49.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.815+0000 7f5d999e6700 1 -- 172.21.15.125:0/2154513193 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5d740656f0 msgr2=0x7f5d74067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:49.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.815+0000 7f5d999e6700 1 --2- 172.21.15.125:0/2154513193 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5d740656f0 0x7f5d74067bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5d9415ae50 tx=0x7f5d7c009040 comp rx=0 tx=0).stop 2023-10-17T06:07:49.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.815+0000 7f5d999e6700 1 -- 172.21.15.125:0/2154513193 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d80003be0 msgr2=0x7f5d940ad760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:49.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.815+0000 7f5d999e6700 1 --2- 172.21.15.125:0/2154513193 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d80003be0 0x7f5d940ad760 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400e4b0 tx=0x7f5d840047e0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.815+0000 7f5d999e6700 1 -- 172.21.15.125:0/2154513193 shutdown_connections 2023-10-17T06:07:49.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.815+0000 7f5d999e6700 1 --2- 172.21.15.125:0/2154513193 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f5d740656f0 0x7f5d74067bb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.815+0000 7f5d999e6700 1 --2- 172.21.15.125:0/2154513193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d940b0650 0x7f5d940ac7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.815+0000 7f5d999e6700 1 --2- 172.21.15.125:0/2154513193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5d940cebd0 0x7f5d940b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.815+0000 7f5d999e6700 1 --2- 172.21.15.125:0/2154513193 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d80003be0 0x7f5d940ad760 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:49.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.815+0000 7f5d999e6700 1 -- 172.21.15.125:0/2154513193 >> 172.21.15.125:0/2154513193 conn(0x7f5d94069f20 msgr2=0x7f5d9415c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:49.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.819+0000 7f5d999e6700 1 -- 172.21.15.125:0/2154513193 shutdown_connections 2023-10-17T06:07:49.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:49.819+0000 7f5d999e6700 1 -- 172.21.15.125:0/2154513193 wait complete. 2023-10-17T06:07:49.822 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 9 2023-10-17T06:07:50.243 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-17T06:07:09.036610+0000', 'modified': '2023-10-17T06:07:35.578225+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.125:6837/3617198893', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6836', 'nonce': 3617198893}, {'type': 'v1', 'addr': '172.21.15.125:6837', 'nonce': 3617198893}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-17T06:07:50.243 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-17T06:07:50.243 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-17T06:07:50.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.423+0000 7fea16aeb700 1 Processor -- start 2023-10-17T06:07:50.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.423+0000 7fea16aeb700 1 -- start start 2023-10-17T06:07:50.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.427+0000 7fea16aeb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea100c9c70 0x7fea100cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.427+0000 7fea16aeb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1006f4f0 con 0x7fea1006ee20 2023-10-17T06:07:50.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.427+0000 7fea16aeb700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1006f790 con 0x7fea1006d610 2023-10-17T06:07:50.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.427+0000 7fea16aeb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea100616d0 con 0x7fea100c9c70 2023-10-17T06:07:50.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.427+0000 7fea15ae9700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fea1006ee20 0x7fea10158e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59596/0 (socket says 172.21.15.125:59596) 2023-10-17T06:07:50.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.427+0000 7fea15ae9700 1 -- 172.21.15.125:0/3892495432 learned_addr learned my addr 172.21.15.125:0/3892495432 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:50.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.427+0000 7fea162ea700 1 --2- 172.21.15.125:0/3892495432 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea100c9c70 0x7fea100cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.427+0000 7fea14ae7700 1 -- 172.21.15.125:0/3892495432 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594044734 0 0) 0x7fea1006f4f0 con 0x7fea1006ee20 2023-10-17T06:07:50.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.427+0000 7fea14ae7700 1 -- 172.21.15.125:0/3892495432 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9fc0035d0 con 0x7fea1006ee20 2023-10-17T06:07:50.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.427+0000 7fea14ae7700 1 -- 172.21.15.125:0/3892495432 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490619468 0 0) 0x7fea1006f790 con 0x7fea1006d610 2023-10-17T06:07:50.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.427+0000 7fea14ae7700 1 -- 172.21.15.125:0/3892495432 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea1006f4f0 con 0x7fea1006d610 2023-10-17T06:07:50.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.427+0000 7fea14ae7700 1 -- 172.21.15.125:0/3892495432 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 410668386 0 0) 0x7fe9fc0035d0 con 0x7fea1006ee20 2023-10-17T06:07:50.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.427+0000 7fea14ae7700 1 -- 172.21.15.125:0/3892495432 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea100c9c70 msgr2=0x7fea100cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:50.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.427+0000 7fea14ae7700 1 --2- 172.21.15.125:0/3892495432 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea100c9c70 0x7fea100cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.427+0000 7fea14ae7700 1 -- 172.21.15.125:0/3892495432 >> v1:172.21.15.184:6789/0 conn(0x7fea1006d610 legacy=0x7fea10060fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:50.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.427+0000 7fea14ae7700 1 -- 172.21.15.125:0/3892495432 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1006fa70 con 0x7fea1006ee20 2023-10-17T06:07:50.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.427+0000 7fea14ae7700 1 -- 172.21.15.125:0/3892495432 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7fea0c001690 con 0x7fea1006ee20 2023-10-17T06:07:50.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.427+0000 7fea14ae7700 1 -- 172.21.15.125:0/3892495432 >> v1:172.21.15.125:6789/0 conn(0x7fea1006ee20 legacy=0x7fea10158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:50.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea14ae7700 1 --2- 172.21.15.125:0/3892495432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9fc004c40 0x7fe9fc005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea14ae7700 1 --2- 172.21.15.125:0/3892495432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9fc003810 0x7fe9fc003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea14ae7700 1 --2- 172.21.15.125:0/3892495432 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea100c9c70 0x7fe9fc0041f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea14ae7700 1 -- 172.21.15.125:0/3892495432 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea100616d0 con 0x7fe9fc004c40 2023-10-17T06:07:50.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea14ae7700 1 -- 172.21.15.125:0/3892495432 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc00dd50 con 0x7fe9fc003810 2023-10-17T06:07:50.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea14ae7700 1 -- 172.21.15.125:0/3892495432 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc00bb90 con 0x7fea100c9c70 2023-10-17T06:07:50.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea15ae9700 1 --2- 172.21.15.125:0/3892495432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9fc004c40 0x7fe9fc005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea152e8700 1 --2- 172.21.15.125:0/3892495432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9fc003810 0x7fe9fc003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea162ea700 1 --2- 172.21.15.125:0/3892495432 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea100c9c70 0x7fe9fc0041f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea152e8700 1 -- 172.21.15.125:0/3892495432 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea100c9c70 msgr2=0x7fe9fc0041f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:50.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea152e8700 1 --2- 172.21.15.125:0/3892495432 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fea100c9c70 0x7fe9fc0041f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea152e8700 1 -- 172.21.15.125:0/3892495432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9fc004c40 msgr2=0x7fe9fc005040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:50.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea152e8700 1 --2- 172.21.15.125:0/3892495432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9fc004c40 0x7fe9fc005040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea152e8700 1 -- 172.21.15.125:0/3892495432 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc0035d0 con 0x7fe9fc003810 2023-10-17T06:07:50.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea15ae9700 1 --2- 172.21.15.125:0/3892495432 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9fc004c40 0x7fe9fc005040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:07:50.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea152e8700 1 --2- 172.21.15.125:0/3892495432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9fc003810 0x7fe9fc003c90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fea00001960 tx=0x7fe9fc0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=965d02b50f47cd19 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:50.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea14ae7700 1 -- 172.21.15.125:0/3892495432 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00001450 con 0x7fe9fc003810 2023-10-17T06:07:50.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea14ae7700 1 -- 172.21.15.125:0/3892495432 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea000052f0 con 0x7fe9fc003810 2023-10-17T06:07:50.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea14ae7700 1 -- 172.21.15.125:0/3892495432 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea000036a0 con 0x7fe9fc003810 2023-10-17T06:07:50.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea16aeb700 1 -- 172.21.15.125:0/3892495432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9fc003810 msgr2=0x7fe9fc003c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:50.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea16aeb700 1 --2- 172.21.15.125:0/3892495432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9fc003810 0x7fe9fc003c90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fea00001960 tx=0x7fe9fc0058a0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.431+0000 7fea162ea700 1 -- 172.21.15.125:0/3892495432 reap_dead start 2023-10-17T06:07:50.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.435+0000 7fea16aeb700 1 -- 172.21.15.125:0/3892495432 shutdown_connections 2023-10-17T06:07:50.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.435+0000 7fea16aeb700 1 -- 172.21.15.125:0/3892495432 >> 172.21.15.125:0/3892495432 conn(0x7fea100b09b0 msgr2=0x7fea100b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:50.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.435+0000 7fea16aeb700 1 -- 172.21.15.125:0/3892495432 shutdown_connections 2023-10-17T06:07:50.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.435+0000 7fea16aeb700 1 -- 172.21.15.125:0/3892495432 wait complete. 2023-10-17T06:07:50.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.435+0000 7fea16aeb700 1 Processor -- start 2023-10-17T06:07:50.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.435+0000 7fea16aeb700 1 -- start start 2023-10-17T06:07:50.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea16aeb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9fc003810 0x7fea10145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea16aeb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea101f23d0 0x7fea101f1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea16aeb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea101f1c90 0x7fea100c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea16aeb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea10145a80 con 0x7fea101f1c90 2023-10-17T06:07:50.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea16aeb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea101f2110 con 0x7fea101f23d0 2023-10-17T06:07:50.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea16aeb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea100c6960 con 0x7fe9fc003810 2023-10-17T06:07:50.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea162ea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea101f1c90 0x7fea100c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea162ea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea101f1c90 0x7fea100c6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47404/0 (socket says 172.21.15.125:47404) 2023-10-17T06:07:50.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea162ea700 1 -- 172.21.15.125:0/3805854461 learned_addr learned my addr 172.21.15.125:0/3805854461 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:50.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea152e8700 1 --2- 172.21.15.125:0/3805854461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea101f23d0 0x7fea101f1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea15ae9700 1 --2- 172.21.15.125:0/3805854461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9fc003810 0x7fea10145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea162ea700 1 -- 172.21.15.125:0/3805854461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9fc003810 msgr2=0x7fea10145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:50.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea162ea700 1 --2- 172.21.15.125:0/3805854461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9fc003810 0x7fea10145540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea162ea700 1 -- 172.21.15.125:0/3805854461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea101f23d0 msgr2=0x7fea101f1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:50.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea162ea700 1 --2- 172.21.15.125:0/3805854461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea101f23d0 0x7fea101f1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea162ea700 1 -- 172.21.15.125:0/3805854461 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea100c6030 con 0x7fea101f1c90 2023-10-17T06:07:50.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea152e8700 1 --2- 172.21.15.125:0/3805854461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea101f23d0 0x7fea101f1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:50.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea162ea700 1 --2- 172.21.15.125:0/3805854461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea101f1c90 0x7fea100c6df0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fea1015dc10 tx=0x7fea0800f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:50.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea067fc700 1 -- 172.21.15.125:0/3805854461 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0800e040 con 0x7fea101f1c90 2023-10-17T06:07:50.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea067fc700 1 -- 172.21.15.125:0/3805854461 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0800f040 con 0x7fea101f1c90 2023-10-17T06:07:50.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea16aeb700 1 -- 172.21.15.125:0/3805854461 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea100c6310 con 0x7fea101f1c90 2023-10-17T06:07:50.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea067fc700 1 -- 172.21.15.125:0/3805854461 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08011e50 con 0x7fea101f1c90 2023-10-17T06:07:50.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.439+0000 7fea16aeb700 1 -- 172.21.15.125:0/3805854461 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea100b3360 con 0x7fea101f1c90 2023-10-17T06:07:50.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.443+0000 7fea067fc700 1 -- 172.21.15.125:0/3805854461 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fea08022460 con 0x7fea101f1c90 2023-10-17T06:07:50.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea067fc700 1 --2- 172.21.15.125:0/3805854461 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe9f40656f0 0x7fe9f4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea067fc700 1 -- 172.21.15.125:0/3805854461 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fea08083430 con 0x7fea101f1c90 2023-10-17T06:07:50.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea15ae9700 1 --2- 172.21.15.125:0/3805854461 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe9f40656f0 0x7fe9f4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea1afe5740 1 Processor -- start 2023-10-17T06:07:50.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea1afe5740 1 -- start start 2023-10-17T06:07:50.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea15ae9700 1 --2- 172.21.15.125:0/3805854461 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe9f40656f0 0x7fe9f4067bb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fea0c001220 tx=0x7fea0c001e20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:50.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea1afe5740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26c04a0 0x26c0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea1afe5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e9ad0 0x26e9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea1afe5740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 0x2707110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea1afe5740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x2632f90 con 0x2706d30 2023-10-17T06:07:50.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea1afe5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x2630680 con 0x26e9ad0 2023-10-17T06:07:50.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea1afe5740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x262bf70 con 0x26c04a0 2023-10-17T06:07:50.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea162ea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 0x2707110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea162ea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 0x2707110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47412/0 (socket says 172.21.15.125:47412) 2023-10-17T06:07:50.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea162ea700 1 -- 172.21.15.125:0/2372435070 learned_addr learned my addr 172.21.15.125:0/2372435070 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:50.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea15ae9700 1 --2- 172.21.15.125:0/2372435070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26c04a0 0x26c0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea152e8700 1 --2- 172.21.15.125:0/2372435070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e9ad0 0x26e9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea162ea700 1 -- 172.21.15.125:0/2372435070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26c04a0 msgr2=0x26c0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:50.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea162ea700 1 --2- 172.21.15.125:0/2372435070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26c04a0 0x26c0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea162ea700 1 -- 172.21.15.125:0/2372435070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e9ad0 msgr2=0x26e9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:50.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea162ea700 1 --2- 172.21.15.125:0/2372435070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e9ad0 0x26e9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea162ea700 1 -- 172.21.15.125:0/2372435070 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x26511a0 con 0x2706d30 2023-10-17T06:07:50.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.447+0000 7fea152e8700 1 --2- 172.21.15.125:0/2372435070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e9ad0 0x26e9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:50.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.451+0000 7fea162ea700 1 --2- 172.21.15.125:0/2372435070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 0x2707110 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fea080813a0 tx=0x7fea08054270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d4beabc3122d46 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:50.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.451+0000 7fe9f37fe700 1 -- 172.21.15.125:0/2372435070 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0805c4f0 con 0x2706d30 2023-10-17T06:07:50.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.451+0000 7fe9f37fe700 1 -- 172.21.15.125:0/2372435070 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea08052b80 con 0x2706d30 2023-10-17T06:07:50.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.451+0000 7fe9f37fe700 1 -- 172.21.15.125:0/2372435070 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08083230 con 0x2706d30 2023-10-17T06:07:50.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.451+0000 7fea1afe5740 1 -- 172.21.15.125:0/2372435070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 msgr2=0x2707110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:50.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.451+0000 7fea1afe5740 1 --2- 172.21.15.125:0/2372435070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 0x2707110 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fea080813a0 tx=0x7fea08054270 comp rx=0 tx=0).stop 2023-10-17T06:07:50.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.451+0000 7fea1afe5740 1 -- 172.21.15.125:0/2372435070 shutdown_connections 2023-10-17T06:07:50.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.451+0000 7fea1afe5740 1 --2- 172.21.15.125:0/2372435070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 0x2707110 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.451+0000 7fea1afe5740 1 --2- 172.21.15.125:0/2372435070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e9ad0 0x26e9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.451+0000 7fea1afe5740 1 --2- 172.21.15.125:0/2372435070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26c04a0 0x26c0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.451+0000 7fea1afe5740 1 -- 172.21.15.125:0/2372435070 >> 172.21.15.125:0/2372435070 conn(0x2452550 msgr2=0x26ecd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:50.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.451+0000 7fea1afe5740 1 -- 172.21.15.125:0/2372435070 shutdown_connections 2023-10-17T06:07:50.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.451+0000 7fea1afe5740 1 -- 172.21.15.125:0/2372435070 wait complete. 2023-10-17T06:07:50.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.451+0000 7fea1afe5740 1 -- start start 2023-10-17T06:07:50.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.451+0000 7fea1afe5740 1 Processor -- start 2023-10-17T06:07:50.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea1afe5740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x26c04a0 0x26c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea1afe5740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26e9ad0 0x2714890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea1afe5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2706d30 0x2714dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea1afe5740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x25ecb00 con 0x26c04a0 2023-10-17T06:07:50.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea1afe5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x25eb470 con 0x2706d30 2023-10-17T06:07:50.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea1afe5740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x24d6b20 con 0x26e9ad0 2023-10-17T06:07:50.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea1afe5740 10 client.0 _ll_register_callbacks cb 0x2625810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-17T06:07:50.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea15ae9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x26c04a0 0x26c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea15ae9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x26c04a0 0x26c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47422/0 (socket says 172.21.15.125:47422) 2023-10-17T06:07:50.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea15ae9700 1 -- 172.21.15.125:0/4076123659 learned_addr learned my addr 172.21.15.125:0/4076123659 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:50.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea152e8700 1 --2- 172.21.15.125:0/4076123659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26e9ad0 0x2714890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea162ea700 1 --2- 172.21.15.125:0/4076123659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2706d30 0x2714dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea15ae9700 1 -- 172.21.15.125:0/4076123659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26e9ad0 msgr2=0x2714890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:50.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea15ae9700 1 --2- 172.21.15.125:0/4076123659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26e9ad0 0x2714890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea15ae9700 1 -- 172.21.15.125:0/4076123659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2706d30 msgr2=0x2714dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:50.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea15ae9700 1 --2- 172.21.15.125:0/4076123659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2706d30 0x2714dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea15ae9700 1 -- 172.21.15.125:0/4076123659 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea100b3360 con 0x26c04a0 2023-10-17T06:07:50.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea152e8700 1 --2- 172.21.15.125:0/4076123659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26e9ad0 0x2714890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:50.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea15ae9700 1 --2- 172.21.15.125:0/4076123659 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x26c04a0 0x26c4850 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fea0c015720 tx=0x7fea0c001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af399d102209578d server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:50.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fe9f0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-17T06:07:50.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fe9f0ff9700 1 -- 172.21.15.125:0/4076123659 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c01a040 con 0x26c04a0 2023-10-17T06:07:50.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fe9f0ff9700 1 -- 172.21.15.125:0/4076123659 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fea0c0225b0 con 0x26c04a0 2023-10-17T06:07:50.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea1afe5740 1 -- 172.21.15.125:0/4076123659 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2624f50 con 0x26c04a0 2023-10-17T06:07:50.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fe9f0ff9700 1 -- 172.21.15.125:0/4076123659 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea0c022770 con 0x26c04a0 2023-10-17T06:07:50.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea1afe5740 10 client.4911 fetch_fsmap learned FSMap version 9 2023-10-17T06:07:50.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.455+0000 7fea1afe5740 1 -- 172.21.15.125:0/4076123659 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x249d9e0 con 0x26c04a0 2023-10-17T06:07:50.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fe9f0ff9700 1 -- 172.21.15.125:0/4076123659 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2624f50 con 0x26c04a0 2023-10-17T06:07:50.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fe9f0ff9700 1 -- 172.21.15.125:0/4076123659 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fea0c020050 con 0x26c04a0 2023-10-17T06:07:50.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fea1afe5740 10 client.4911 fetch_fsmap finished waiting for FSMap version 9 2023-10-17T06:07:50.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fea1afe5740 10 client.4911 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-17T06:07:50.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fea1afe5740 20 client.4911 populate_metadata read hostname 'smithi125' 2023-10-17T06:07:50.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fea1afe5740 1 --2- 172.21.15.125:0/4076123659 >> [v2:172.21.15.125:6836/3617198893,v1:172.21.15.125:6837/3617198893] conn(0x26c1170 0x26c1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fea1afe5740 4 client.4911 mds_command: new command op to 4290 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-17T06:07:50.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fea1afe5740 1 -- 172.21.15.125:0/4076123659 --> [v2:172.21.15.125:6836/3617198893,v1:172.21.15.125:6837/3617198893] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2624c70 con 0x26c1170 2023-10-17T06:07:50.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fea152e8700 1 --2- 172.21.15.125:0/4076123659 >> [v2:172.21.15.125:6836/3617198893,v1:172.21.15.125:6837/3617198893] conn(0x26c1170 0x26c1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fe9f0ff9700 10 client.4911 ms_handle_connect on v2:172.21.15.125:6836/3617198893 2023-10-17T06:07:50.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fea152e8700 1 --2- 172.21.15.125:0/4076123659 >> [v2:172.21.15.125:6836/3617198893,v1:172.21.15.125:6837/3617198893] conn(0x26c1170 0x26c1550 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62c4a74f2e7acce server_cookie=bc56b082cd64dd3f in_seq=0 out_seq=0 2023-10-17T06:07:50.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fe9f0ff9700 1 -- 172.21.15.125:0/4076123659 <== mds.0 v2:172.21.15.125:6836/3617198893 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x2624c70 con 0x26c1170 2023-10-17T06:07:50.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fe9f0ff9700 10 client.4911 handle_command_reply: tid=0 2023-10-17T06:07:50.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fea1afe5740 1 client.4911 shutdown 2023-10-17T06:07:50.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fea1afe5740 1 -- 172.21.15.125:0/4076123659 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x26c04a0 msgr2=0x26c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:50.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fea1afe5740 1 --2- 172.21.15.125:0/4076123659 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x26c04a0 0x26c4850 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fea0c015720 tx=0x7fea0c001a10 comp rx=0 tx=0).stop 2023-10-17T06:07:50.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fea1afe5740 1 -- 172.21.15.125:0/4076123659 shutdown_connections 2023-10-17T06:07:50.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fea1afe5740 1 --2- 172.21.15.125:0/4076123659 >> [v2:172.21.15.125:6836/3617198893,v1:172.21.15.125:6837/3617198893] conn(0x26c1170 0x26c1550 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fea1afe5740 1 --2- 172.21.15.125:0/4076123659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2706d30 0x2714dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fea1afe5740 1 --2- 172.21.15.125:0/4076123659 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26e9ad0 0x2714890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fe9f0ff9700 0 client.4911 ms_handle_reset on v2:172.21.15.125:6836/3617198893 2023-10-17T06:07:50.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fea1afe5740 1 --2- 172.21.15.125:0/4076123659 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x26c04a0 0x26c4850 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fea1afe5740 1 -- 172.21.15.125:0/4076123659 >> 172.21.15.125:0/4076123659 conn(0x2452550 msgr2=0x26bf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:50.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.459+0000 7fea1afe5740 1 -- 172.21.15.125:0/4076123659 shutdown_connections 2023-10-17T06:07:50.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.463+0000 7fea1afe5740 1 -- 172.21.15.125:0/4076123659 wait complete. 2023-10-17T06:07:50.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.463+0000 7fea1afe5740 20 client.4911 trim_cache size 0 max 16384 2023-10-17T06:07:50.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.483+0000 7fea1afe5740 1 Processor -- start 2023-10-17T06:07:50.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.483+0000 7fea1afe5740 1 -- start start 2023-10-17T06:07:50.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.483+0000 7fea1afe5740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26c04a0 0x26ed2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.483+0000 7fea1afe5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e9ad0 0x26e8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.483+0000 7fea1afe5740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 0x26e8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.483+0000 7fea1afe5740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x262ae00 con 0x2706d30 2023-10-17T06:07:50.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.483+0000 7fea1afe5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x26278e0 con 0x26e9ad0 2023-10-17T06:07:50.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.483+0000 7fea1afe5740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x25e9b60 con 0x26c04a0 2023-10-17T06:07:50.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.483+0000 7fea162ea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 0x26e8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.483+0000 7fea162ea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 0x26e8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47426/0 (socket says 172.21.15.125:47426) 2023-10-17T06:07:50.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.483+0000 7fea162ea700 1 -- 172.21.15.125:0/1423676738 learned_addr learned my addr 172.21.15.125:0/1423676738 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:50.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.483+0000 7fea15ae9700 1 --2- 172.21.15.125:0/1423676738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26c04a0 0x26ed2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.483+0000 7fea152e8700 1 --2- 172.21.15.125:0/1423676738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e9ad0 0x26e8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.483+0000 7fea162ea700 1 -- 172.21.15.125:0/1423676738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26c04a0 msgr2=0x26ed2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:50.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.483+0000 7fea162ea700 1 --2- 172.21.15.125:0/1423676738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26c04a0 0x26ed2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.483+0000 7fea162ea700 1 -- 172.21.15.125:0/1423676738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e9ad0 msgr2=0x26e8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:50.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.483+0000 7fea162ea700 1 --2- 172.21.15.125:0/1423676738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e9ad0 0x26e8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.483+0000 7fea162ea700 1 -- 172.21.15.125:0/1423676738 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x25f0250 con 0x2706d30 2023-10-17T06:07:50.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.487+0000 7fea162ea700 1 --2- 172.21.15.125:0/1423676738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 0x26e8fc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fea08050ce0 tx=0x7fea0805a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b7efdf7eeb6b67 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:50.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.487+0000 7fe9f3fff700 1 -- 172.21.15.125:0/1423676738 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0805c4f0 con 0x2706d30 2023-10-17T06:07:50.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.487+0000 7fe9f3fff700 1 -- 172.21.15.125:0/1423676738 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea080830b0 con 0x2706d30 2023-10-17T06:07:50.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.487+0000 7fe9f3fff700 1 -- 172.21.15.125:0/1423676738 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08053ed0 con 0x2706d30 2023-10-17T06:07:50.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.487+0000 7fea1afe5740 1 -- 172.21.15.125:0/1423676738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 msgr2=0x26e8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:50.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.487+0000 7fea1afe5740 1 --2- 172.21.15.125:0/1423676738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 0x26e8fc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fea08050ce0 tx=0x7fea0805a050 comp rx=0 tx=0).stop 2023-10-17T06:07:50.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.487+0000 7fea1afe5740 1 -- 172.21.15.125:0/1423676738 shutdown_connections 2023-10-17T06:07:50.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.487+0000 7fea1afe5740 1 --2- 172.21.15.125:0/1423676738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 0x26e8fc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.487+0000 7fea1afe5740 1 --2- 172.21.15.125:0/1423676738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e9ad0 0x26e8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.487+0000 7fea1afe5740 1 --2- 172.21.15.125:0/1423676738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26c04a0 0x26ed2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.487+0000 7fea1afe5740 1 -- 172.21.15.125:0/1423676738 >> 172.21.15.125:0/1423676738 conn(0x2452550 msgr2=0x26e8370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:50.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.487+0000 7fea1afe5740 1 -- 172.21.15.125:0/1423676738 shutdown_connections 2023-10-17T06:07:50.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.487+0000 7fea1afe5740 1 -- 172.21.15.125:0/1423676738 wait complete. 2023-10-17T06:07:50.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.487+0000 7fea1afe5740 1 -- start start 2023-10-17T06:07:50.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.487+0000 7fea1afe5740 1 Processor -- start 2023-10-17T06:07:50.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.491+0000 7fea1afe5740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26c04a0 0x271b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.491+0000 7fea1afe5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e9ad0 0x2768fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.491+0000 7fea1afe5740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 0x276a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.491+0000 7fea1afe5740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x271a550 con 0x2706d30 2023-10-17T06:07:50.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.491+0000 7fea1afe5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x26340a0 con 0x26e9ad0 2023-10-17T06:07:50.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.491+0000 7fea1afe5740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x26e96b0 con 0x26c04a0 2023-10-17T06:07:50.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.491+0000 7fea1afe5740 10 client.0 _ll_register_callbacks cb 0x25d8120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-17T06:07:50.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.491+0000 7fea162ea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 0x276a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.491+0000 7fea162ea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 0x276a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47436/0 (socket says 172.21.15.125:47436) 2023-10-17T06:07:50.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.491+0000 7fea162ea700 1 -- 172.21.15.125:0/2887412595 learned_addr learned my addr 172.21.15.125:0/2887412595 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:50.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.491+0000 7fea152e8700 1 --2- 172.21.15.125:0/2887412595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e9ad0 0x2768fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.491+0000 7fea15ae9700 1 --2- 172.21.15.125:0/2887412595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26c04a0 0x271b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.491+0000 7fea162ea700 1 -- 172.21.15.125:0/2887412595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26c04a0 msgr2=0x271b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:50.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.491+0000 7fea162ea700 1 --2- 172.21.15.125:0/2887412595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26c04a0 0x271b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.491+0000 7fea162ea700 1 -- 172.21.15.125:0/2887412595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e9ad0 msgr2=0x2768fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:50.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.491+0000 7fea162ea700 1 --2- 172.21.15.125:0/2887412595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e9ad0 0x2768fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.491+0000 7fea162ea700 1 -- 172.21.15.125:0/2887412595 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x26511a0 con 0x2706d30 2023-10-17T06:07:50.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.491+0000 7fea152e8700 1 --2- 172.21.15.125:0/2887412595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e9ad0 0x2768fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:07:50.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea162ea700 1 --2- 172.21.15.125:0/2887412595 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 0x276a0d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fea08050ce0 tx=0x7fea08004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21e7a72157a7ed9 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:50.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fe9f0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-17T06:07:50.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fe9f0ff9700 1 -- 172.21.15.125:0/2887412595 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08083220 con 0x2706d30 2023-10-17T06:07:50.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fe9f0ff9700 1 -- 172.21.15.125:0/2887412595 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fea0805c4f0 con 0x2706d30 2023-10-17T06:07:50.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea1afe5740 1 -- 172.21.15.125:0/2887412595 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fea08052b80 con 0x2706d30 2023-10-17T06:07:50.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fe9f0ff9700 1 -- 172.21.15.125:0/2887412595 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea0806bb70 con 0x2706d30 2023-10-17T06:07:50.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea1afe5740 10 client.4917 fetch_fsmap learned FSMap version 9 2023-10-17T06:07:50.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea1afe5740 1 -- 172.21.15.125:0/2887412595 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x25d65c0 con 0x2706d30 2023-10-17T06:07:50.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fe9f0ff9700 1 -- 172.21.15.125:0/2887412595 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea08052b80 con 0x2706d30 2023-10-17T06:07:50.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fe9f0ff9700 1 -- 172.21.15.125:0/2887412595 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fea0806bcd0 con 0x2706d30 2023-10-17T06:07:50.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea1afe5740 10 client.4917 fetch_fsmap finished waiting for FSMap version 9 2023-10-17T06:07:50.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea1afe5740 10 client.4917 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-17T06:07:50.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea1afe5740 20 client.4917 populate_metadata read hostname 'smithi125' 2023-10-17T06:07:50.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea1afe5740 1 --2- 172.21.15.125:0/2887412595 >> [v2:172.21.15.125:6836/3617198893,v1:172.21.15.125:6837/3617198893] conn(0x276a610 0x2718430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:50.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea1afe5740 4 client.4917 mds_command: new command op to 4290 tid=0[{"prefix": "status"}] 2023-10-17T06:07:50.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea1afe5740 1 -- 172.21.15.125:0/2887412595 --> [v2:172.21.15.125:6836/3617198893,v1:172.21.15.125:6837/3617198893] -- command(tid 0: {"prefix": "status"}) v1 -- 0x24a94e0 con 0x276a610 2023-10-17T06:07:50.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea15ae9700 1 --2- 172.21.15.125:0/2887412595 >> [v2:172.21.15.125:6836/3617198893,v1:172.21.15.125:6837/3617198893] conn(0x276a610 0x2718430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:50.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fe9f0ff9700 10 client.4917 ms_handle_connect on v2:172.21.15.125:6836/3617198893 2023-10-17T06:07:50.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea15ae9700 1 --2- 172.21.15.125:0/2887412595 >> [v2:172.21.15.125:6836/3617198893,v1:172.21.15.125:6837/3617198893] conn(0x276a610 0x2718430 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f99bbc285850ef61 server_cookie=2e69d19590d78da in_seq=0 out_seq=0 2023-10-17T06:07:50.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fe9f0ff9700 1 -- 172.21.15.125:0/2887412595 <== mds.0 v2:172.21.15.125:6836/3617198893 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x24a94e0 con 0x276a610 2023-10-17T06:07:50.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fe9f0ff9700 10 client.4917 handle_command_reply: tid=0 2023-10-17T06:07:50.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea1afe5740 1 client.4917 shutdown 2023-10-17T06:07:50.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea1afe5740 1 -- 172.21.15.125:0/2887412595 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 msgr2=0x276a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:50.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea1afe5740 1 --2- 172.21.15.125:0/2887412595 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 0x276a0d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fea08050ce0 tx=0x7fea08004b60 comp rx=0 tx=0).stop 2023-10-17T06:07:50.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea1afe5740 1 -- 172.21.15.125:0/2887412595 shutdown_connections 2023-10-17T06:07:50.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea1afe5740 1 --2- 172.21.15.125:0/2887412595 >> [v2:172.21.15.125:6836/3617198893,v1:172.21.15.125:6837/3617198893] conn(0x276a610 0x2718430 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea1afe5740 1 --2- 172.21.15.125:0/2887412595 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x2706d30 0x276a0d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea1afe5740 1 --2- 172.21.15.125:0/2887412595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x26e9ad0 0x2768fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea1afe5740 1 --2- 172.21.15.125:0/2887412595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x26c04a0 0x271b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fea1afe5740 1 -- 172.21.15.125:0/2887412595 >> 172.21.15.125:0/2887412595 conn(0x2452550 msgr2=0x26e8370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:50.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.495+0000 7fe9f0ff9700 0 client.4917 ms_handle_reset on v2:172.21.15.125:6836/3617198893 2023-10-17T06:07:50.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.499+0000 7fea1afe5740 1 -- 172.21.15.125:0/2887412595 shutdown_connections 2023-10-17T06:07:50.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.499+0000 7fea1afe5740 1 -- 172.21.15.125:0/2887412595 wait complete. 2023-10-17T06:07:50.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.499+0000 7fea1afe5740 20 client.4917 trim_cache size 0 max 16384 2023-10-17T06:07:50.509 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-17T06:07:50.509 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_fsid": "c779df02-0ec4-47de-a0f3-2371e60a2dde", 2023-10-17T06:07:50.509 INFO:teuthology.orchestra.run.smithi125.stdout: "whoami": 0, 2023-10-17T06:07:50.510 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 4290, 2023-10-17T06:07:50.510 INFO:teuthology.orchestra.run.smithi125.stdout: "want_state": "up:active", 2023-10-17T06:07:50.510 INFO:teuthology.orchestra.run.smithi125.stdout: "state": "up:active", 2023-10-17T06:07:50.510 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs", 2023-10-17T06:07:50.510 INFO:teuthology.orchestra.run.smithi125.stdout: "rank_uptime": 40.711517639999997, 2023-10-17T06:07:50.511 INFO:teuthology.orchestra.run.smithi125.stdout: "mdsmap_epoch": 9, 2023-10-17T06:07:50.511 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch": 30, 2023-10-17T06:07:50.511 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch_barrier": 28, 2023-10-17T06:07:50.511 INFO:teuthology.orchestra.run.smithi125.stdout: "uptime": 47.604639921 2023-10-17T06:07:50.511 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-17T06:07:50.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.499+0000 7fea16aeb700 1 -- 172.21.15.125:0/3805854461 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe9f40656f0 msgr2=0x7fe9f4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:50.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.499+0000 7fea16aeb700 1 --2- 172.21.15.125:0/3805854461 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe9f40656f0 0x7fe9f4067bb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fea0c001220 tx=0x7fea0c001e20 comp rx=0 tx=0).stop 2023-10-17T06:07:50.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.499+0000 7fea16aeb700 1 -- 172.21.15.125:0/3805854461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea101f1c90 msgr2=0x7fea100c6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:50.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.499+0000 7fea16aeb700 1 --2- 172.21.15.125:0/3805854461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea101f1c90 0x7fea100c6df0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fea1015dc10 tx=0x7fea0800f490 comp rx=0 tx=0).stop 2023-10-17T06:07:50.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.499+0000 7fea16aeb700 1 -- 172.21.15.125:0/3805854461 shutdown_connections 2023-10-17T06:07:50.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.499+0000 7fea16aeb700 1 --2- 172.21.15.125:0/3805854461 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe9f40656f0 0x7fe9f4067bb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.499+0000 7fea16aeb700 1 --2- 172.21.15.125:0/3805854461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea101f1c90 0x7fea100c6df0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.499+0000 7fea16aeb700 1 --2- 172.21.15.125:0/3805854461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea101f23d0 0x7fea101f1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.499+0000 7fea16aeb700 1 --2- 172.21.15.125:0/3805854461 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9fc003810 0x7fea10145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:50.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.499+0000 7fea16aeb700 1 -- 172.21.15.125:0/3805854461 >> 172.21.15.125:0/3805854461 conn(0x7fea100b09b0 msgr2=0x7fea10156460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:50.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.499+0000 7fea16aeb700 1 -- 172.21.15.125:0/3805854461 shutdown_connections 2023-10-17T06:07:50.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:50.499+0000 7fea16aeb700 1 -- 172.21.15.125:0/3805854461 wait complete. 2023-10-17T06:07:50.526 INFO:teuthology.run_tasks:Running task kclient... 2023-10-17T06:07:50.539 INFO:tasks.kclient:Mounting kernel clients... 2023-10-17T06:07:50.539 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-17T06:07:50.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:50.540 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-10-17T06:07:50.561 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-17T06:07:50.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:50.563 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-17T06:07:50.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:50.642 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link delete ceph-brx 2023-10-17T06:07:50.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:50.889 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-10-17T06:07:50.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:50.911 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link delete ceph-brx 2023-10-17T06:07:50.992 INFO:teuthology.orchestra.run.smithi125.stderr:Cannot find device "ceph-brx" 2023-10-17T06:07:50.996 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-17T06:07:50.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:50.997 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-17T06:07:51.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:51.016 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-10-17T06:07:51.101 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2023-10-17T06:07:51.105 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-17T06:07:51.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:51.106 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-17T06:07:51.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:51.171 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-10-17T06:07:51.261 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2023-10-17T06:07:51.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-17T06:07:51.266 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-17T06:07:51.266 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-17T06:07:51.266 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-17T06:07:51.267 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-17T06:07:51.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.439+0000 7f4d99447700 1 Processor -- start 2023-10-17T06:07:51.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.439+0000 7f4d99447700 1 -- start start 2023-10-17T06:07:51.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.443+0000 7f4d99447700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d9406d470 0x7f4d94070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:51.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.443+0000 7f4d99447700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d9415e990 con 0x7f4d94070f50 2023-10-17T06:07:51.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.443+0000 7f4d99447700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d9415ec50 con 0x7f4d9406d090 2023-10-17T06:07:51.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.443+0000 7f4d99447700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9415f4f0 con 0x7f4d9406d470 2023-10-17T06:07:51.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.443+0000 7f4d98c46700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4d94070f50 0x7f4d9415a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59606/0 (socket says 172.21.15.125:59606) 2023-10-17T06:07:51.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.443+0000 7f4d93fff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f4d9406d090 0x7f4d940b2590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:33624/0 (socket says 172.21.15.125:33624) 2023-10-17T06:07:51.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.443+0000 7f4d98c46700 1 -- 172.21.15.125:0/1576981395 learned_addr learned my addr 172.21.15.125:0/1576981395 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:51.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.443+0000 7f4d8b7fe700 1 --2- 172.21.15.125:0/1576981395 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d9406d470 0x7f4d94070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:51.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.443+0000 7f4d937fe700 1 -- 172.21.15.125:0/1576981395 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756340867 0 0) 0x7f4d9415ec50 con 0x7f4d9406d090 2023-10-17T06:07:51.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.443+0000 7f4d937fe700 1 -- 172.21.15.125:0/1576981395 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d800035d0 con 0x7f4d9406d090 2023-10-17T06:07:51.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.443+0000 7f4d937fe700 1 -- 172.21.15.125:0/1576981395 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020161677 0 0) 0x7f4d9415e990 con 0x7f4d94070f50 2023-10-17T06:07:51.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.443+0000 7f4d937fe700 1 -- 172.21.15.125:0/1576981395 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d9415ec50 con 0x7f4d94070f50 2023-10-17T06:07:51.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.443+0000 7f4d8b7fe700 1 -- 172.21.15.125:0/1576981395 >> v1:172.21.15.184:6789/0 conn(0x7f4d9406d090 legacy=0x7f4d940b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:51.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.443+0000 7f4d8b7fe700 1 -- 172.21.15.125:0/1576981395 >> v1:172.21.15.125:6789/0 conn(0x7f4d94070f50 legacy=0x7f4d9415a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:51.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.443+0000 7f4d8b7fe700 1 -- 172.21.15.125:0/1576981395 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9415ef30 con 0x7f4d9406d470 2023-10-17T06:07:51.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.447+0000 7f4d8b7fe700 1 --2- 172.21.15.125:0/1576981395 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d9406d470 0x7f4d94070a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009880 tx=0x7f4d7c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc6677bc84e77424 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:51.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.447+0000 7f4d937fe700 1 -- 172.21.15.125:0/1576981395 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c011830 con 0x7f4d9406d470 2023-10-17T06:07:51.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.447+0000 7f4d937fe700 1 -- 172.21.15.125:0/1576981395 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c011990 con 0x7f4d9406d470 2023-10-17T06:07:51.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.447+0000 7f4d937fe700 1 -- 172.21.15.125:0/1576981395 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c011d20 con 0x7f4d9406d470 2023-10-17T06:07:51.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.447+0000 7f4d99447700 1 -- 172.21.15.125:0/1576981395 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d9406d470 msgr2=0x7f4d94070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:51.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.447+0000 7f4d99447700 1 --2- 172.21.15.125:0/1576981395 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d9406d470 0x7f4d94070a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009880 tx=0x7f4d7c009b90 comp rx=0 tx=0).stop 2023-10-17T06:07:51.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.447+0000 7f4d99447700 1 -- 172.21.15.125:0/1576981395 shutdown_connections 2023-10-17T06:07:51.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.447+0000 7f4d99447700 1 --2- 172.21.15.125:0/1576981395 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d9406d470 0x7f4d94070a10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:51.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.447+0000 7f4d99447700 1 -- 172.21.15.125:0/1576981395 >> 172.21.15.125:0/1576981395 conn(0x7f4d940ce5c0 msgr2=0x7f4d940ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:51.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.447+0000 7f4d99447700 1 -- 172.21.15.125:0/1576981395 shutdown_connections 2023-10-17T06:07:51.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.447+0000 7f4d99447700 1 -- 172.21.15.125:0/1576981395 wait complete. 2023-10-17T06:07:51.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.451+0000 7f4d99447700 1 Processor -- start 2023-10-17T06:07:51.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.451+0000 7f4d99447700 1 -- start start 2023-10-17T06:07:51.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.451+0000 7f4d99447700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d9406d090 0x7f4d94150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:51.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.451+0000 7f4d99447700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d9406d470 0x7f4d9415c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:51.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.451+0000 7f4d99447700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d94070f50 0x7f4d94157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:51.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.451+0000 7f4d99447700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9415d240 con 0x7f4d9406d090 2023-10-17T06:07:51.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.451+0000 7f4d99447700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d941510e0 con 0x7f4d94070f50 2023-10-17T06:07:51.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.451+0000 7f4d99447700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9415cc80 con 0x7f4d9406d470 2023-10-17T06:07:51.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.451+0000 7f4d93fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d9406d090 0x7f4d94150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:51.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.451+0000 7f4d93fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d9406d090 0x7f4d94150ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47446/0 (socket says 172.21.15.125:47446) 2023-10-17T06:07:51.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.451+0000 7f4d93fff700 1 -- 172.21.15.125:0/3860600067 learned_addr learned my addr 172.21.15.125:0/3860600067 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:51.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.455+0000 7f4d8b7fe700 1 --2- 172.21.15.125:0/3860600067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d9406d470 0x7f4d9415c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:51.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.455+0000 7f4d98c46700 1 --2- 172.21.15.125:0/3860600067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d94070f50 0x7f4d94157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:51.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.455+0000 7f4d93fff700 1 -- 172.21.15.125:0/3860600067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d9406d470 msgr2=0x7f4d9415c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:51.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.455+0000 7f4d93fff700 1 --2- 172.21.15.125:0/3860600067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d9406d470 0x7f4d9415c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:51.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.455+0000 7f4d93fff700 1 -- 172.21.15.125:0/3860600067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d94070f50 msgr2=0x7f4d94157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:51.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.455+0000 7f4d93fff700 1 --2- 172.21.15.125:0/3860600067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d94070f50 0x7f4d94157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:51.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.455+0000 7f4d93fff700 1 -- 172.21.15.125:0/3860600067 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c0094b0 con 0x7f4d9406d090 2023-10-17T06:07:51.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.455+0000 7f4d98c46700 1 --2- 172.21.15.125:0/3860600067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d94070f50 0x7f4d94157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:51.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.455+0000 7f4d93fff700 1 --2- 172.21.15.125:0/3860600067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d9406d090 0x7f4d94150ba0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400c700 tx=0x7f4d8400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:51.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.455+0000 7f4d917fa700 1 -- 172.21.15.125:0/3860600067 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84005cd0 con 0x7f4d9406d090 2023-10-17T06:07:51.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.455+0000 7f4d917fa700 1 -- 172.21.15.125:0/3860600067 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d84005e30 con 0x7f4d9406d090 2023-10-17T06:07:51.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.455+0000 7f4d917fa700 1 -- 172.21.15.125:0/3860600067 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84007310 con 0x7f4d9406d090 2023-10-17T06:07:51.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.455+0000 7f4d99447700 1 -- 172.21.15.125:0/3860600067 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d9415cf60 con 0x7f4d9406d090 2023-10-17T06:07:51.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.455+0000 7f4d99447700 1 -- 172.21.15.125:0/3860600067 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d940c5b10 con 0x7f4d9406d090 2023-10-17T06:07:51.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.455+0000 7f4d99447700 1 -- 172.21.15.125:0/3860600067 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d940c5670 con 0x7f4d9406d090 2023-10-17T06:07:51.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.459+0000 7f4d917fa700 1 -- 172.21.15.125:0/3860600067 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4d84007470 con 0x7f4d9406d090 2023-10-17T06:07:51.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.459+0000 7f4d917fa700 1 --2- 172.21.15.125:0/3860600067 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4d74065720 0x7f4d74067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:51.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.459+0000 7f4d917fa700 1 -- 172.21.15.125:0/3860600067 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4d84082570 con 0x7f4d9406d090 2023-10-17T06:07:51.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.459+0000 7f4d8b7fe700 1 --2- 172.21.15.125:0/3860600067 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4d74065720 0x7f4d74067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:51.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.463+0000 7f4d8b7fe700 1 --2- 172.21.15.125:0/3860600067 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4d74065720 0x7f4d74067be0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0090b0 tx=0x7f4d7c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:51.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.467+0000 7f4d917fa700 1 -- 172.21.15.125:0/3860600067 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f4d8404fd00 con 0x7f4d9406d090 2023-10-17T06:07:51.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.803+0000 7f4d99447700 1 -- 172.21.15.125:0/3860600067 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4d94072e60 con 0x7f4d9406d090 2023-10-17T06:07:51.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.803+0000 7f4d917fa700 1 -- 172.21.15.125:0/3860600067 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4d84053320 con 0x7f4d9406d090 2023-10-17T06:07:51.807 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-17T06:07:51.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.807+0000 7f4d99447700 1 -- 172.21.15.125:0/3860600067 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4d74065720 msgr2=0x7f4d74067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:51.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.807+0000 7f4d99447700 1 --2- 172.21.15.125:0/3860600067 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4d74065720 0x7f4d74067be0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0090b0 tx=0x7f4d7c01c040 comp rx=0 tx=0).stop 2023-10-17T06:07:51.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.807+0000 7f4d99447700 1 -- 172.21.15.125:0/3860600067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d9406d090 msgr2=0x7f4d94150ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:51.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.807+0000 7f4d99447700 1 --2- 172.21.15.125:0/3860600067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d9406d090 0x7f4d94150ba0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400c700 tx=0x7f4d8400ca10 comp rx=0 tx=0).stop 2023-10-17T06:07:51.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.807+0000 7f4d99447700 1 -- 172.21.15.125:0/3860600067 shutdown_connections 2023-10-17T06:07:51.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.807+0000 7f4d99447700 1 --2- 172.21.15.125:0/3860600067 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4d74065720 0x7f4d74067be0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:51.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.807+0000 7f4d99447700 1 --2- 172.21.15.125:0/3860600067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4d94070f50 0x7f4d94157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:51.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.807+0000 7f4d99447700 1 --2- 172.21.15.125:0/3860600067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4d9406d470 0x7f4d9415c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:51.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.807+0000 7f4d99447700 1 --2- 172.21.15.125:0/3860600067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d9406d090 0x7f4d94150ba0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:51.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.807+0000 7f4d99447700 1 -- 172.21.15.125:0/3860600067 >> 172.21.15.125:0/3860600067 conn(0x7f4d940ce5c0 msgr2=0x7f4d940ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:51.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.807+0000 7f4d99447700 1 -- 172.21.15.125:0/3860600067 shutdown_connections 2023-10-17T06:07:51.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:51.807+0000 7f4d99447700 1 -- 172.21.15.125:0/3860600067 wait complete. 2023-10-17T06:07:51.836 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-17T06:07:51.836 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-17T06:07:51.836 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-10-17T06:07:51.837 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-17T06:07:51.837 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-17T06:07:51.837 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-17T06:07:51.837 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-17T06:07:51.838 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-17T06:07:51.838 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-17T06:07:51.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:51.839 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-10-17T06:07:51.856 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-17T06:07:51.856 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-17T06:07:51.856 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-10-17T06:07:51.856 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:51.857 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-10-17T06:07:51.857 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:51.857 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:07:51.857 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:51.857 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f0 2023-10-17T06:07:51.858 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:07:51.858 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:51.858 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f1 2023-10-17T06:07:51.858 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:07:51.858 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:51.859 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-17T06:07:51.859 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:51.859 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-17T06:07:51.859 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42376sec preferred_lft 42376sec 2023-10-17T06:07:51.859 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::ec4:7aff:fe8f:d739/64 scope link 2023-10-17T06:07:51.859 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:51.860 INFO:teuthology.orchestra.run.smithi125.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-17T06:07:51.860 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 02:42:72:b2:4f:6c brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:51.860 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-17T06:07:51.860 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:51.861 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-17T06:07:51.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:51.862 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-17T06:07:51.862 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-17T06:07:51.863 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link add name ceph-brx type bridge 2023-10-17T06:07:51.863 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip addr flush dev ceph-brx 2023-10-17T06:07:51.863 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set ceph-brx up 2023-10-17T06:07:51.863 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-17T06:07:51.864 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-17T06:07:52.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:52.015 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-17T06:07:52.050 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-10-17T06:07:52.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:52.053 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-10-17T06:07:52.114 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-10-17T06:07:52.115 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-17T06:07:52.115 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-17T06:07:52.115 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-17T06:07:52.116 INFO:teuthology.orchestra.run.smithi125.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-17T06:07:52.116 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-17T06:07:52.117 INFO:teuthology.orchestra.run.smithi125.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-17T06:07:52.117 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-17T06:07:52.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:52.118 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-17T06:07:52.119 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-17T06:07:52.119 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-17T06:07:52.119 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-17T06:07:52.120 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-17T06:07:52.120 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-17T06:07:52.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:52.253 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-10-17T06:07:52.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:52.272 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list-id 2023-10-17T06:07:52.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:52.333 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-17T06:07:52.333 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-17T06:07:52.334 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-17T06:07:52.334 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-17T06:07:52.334 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-17T06:07:52.456 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-17T06:07:52.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:52.457 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-17T06:07:52.457 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-17T06:07:52.458 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-17T06:07:52.458 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-17T06:07:52.458 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-17T06:07:52.459 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-17T06:07:52.459 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-17T06:07:52.459 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-17T06:07:52.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:52.607 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-17T06:07:52.608 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-17T06:07:52.608 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2023-10-17T06:07:52.608 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set dev brx.0 master ceph-brx 2023-10-17T06:07:52.608 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-17T06:07:52.675 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-17T06:07:52.676 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-17T06:07:52.692 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-17T06:07:52.693 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-17T06:07:52.693 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-17T06:07:52.758 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-17T06:07:52.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:52.759 DEBUG:teuthology.orchestra.run.smithi125:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:07:52.886 INFO:teuthology.orchestra.run.smithi125.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:07:52.886 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-17T06:07:53.028 INFO:teuthology.orchestra.run.smithi125.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:07:53.029 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-17T06:07:53.029 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: resolved to: "172.21.15.125:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-10-17T06:07:53.029 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: trying mount with new device syntax: 0@c779df02-0ec4-47de-a0f3-2371e60a2dde.cephfs=/ 2023-10-17T06:07:53.029 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.125:3300/172.21.15.184:3300/172.21.15.184:3301" will pass to kernel 2023-10-17T06:07:53.035 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-17T06:07:53.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:53.036 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-17T06:07:53.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:53.073 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-17T06:07:53.145 INFO:teuthology.orchestra.run.smithi125.stdout:client4688 2023-10-17T06:07:53.146 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:07:53.146 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:07:53.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:53.207 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-17T06:07:53.273 INFO:teuthology.orchestra.run.smithi125.stdout:client4688 2023-10-17T06:07:53.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:53.274 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-17T06:07:53.343 INFO:teuthology.orchestra.run.smithi125.stdout:client4688 2023-10-17T06:07:53.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:53.343 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c779df02-0ec4-47de-a0f3-2371e60a2dde.client4688/status') 2023-10-17T06:07:53.427 INFO:teuthology.orchestra.run.smithi125.stdout:instance: client.4688 (3)172.21.15.125:0/2337493579 2023-10-17T06:07:53.427 INFO:teuthology.orchestra.run.smithi125.stdout:blocklisted: false 2023-10-17T06:07:53.427 INFO:teuthology.orchestra.run.smithi125.stderr:0+1 records in 2023-10-17T06:07:53.428 INFO:teuthology.orchestra.run.smithi125.stderr:0+1 records out 2023-10-17T06:07:53.428 INFO:teuthology.orchestra.run.smithi125.stderr:71 bytes copied, 0.000188184 s, 377 kB/s 2023-10-17T06:07:53.430 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-17T06:07:53.431 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-17T06:07:53.431 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-17T06:07:53.431 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-17T06:07:53.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.647+0000 7feee88fa700 1 Processor -- start 2023-10-17T06:07:53.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.647+0000 7feee88fa700 1 -- start start 2023-10-17T06:07:53.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.651+0000 7feee88fa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feee4155420 0x7feee40cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:53.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.651+0000 7feee88fa700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feee415bf00 0x7feee40cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:53.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.651+0000 7feee88fa700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee40cbc80 con 0x7feee40b0f90 2023-10-17T06:07:53.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.651+0000 7feee88fa700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee4155800 con 0x7feee415bf00 2023-10-17T06:07:53.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.651+0000 7feee88fa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee40cb9a0 con 0x7feee4155420 2023-10-17T06:07:53.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.651+0000 7feedbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7feee415bf00 0x7feee40cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:53.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.651+0000 7feee2d9d700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7feee40b0f90 0x7feee40cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:58336/0 (socket says 172.21.15.125:58336) 2023-10-17T06:07:53.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.651+0000 7feee2d9d700 1 -- 172.21.15.125:0/745334422 learned_addr learned my addr 172.21.15.125:0/745334422 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:53.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.651+0000 7feee259c700 1 --2- 172.21.15.125:0/745334422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feee4155420 0x7feee40cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:53.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.651+0000 7feedbfff700 1 -- 172.21.15.125:0/745334422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feee4155420 msgr2=0x7feee40cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:53.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.651+0000 7feedbfff700 1 --2- 172.21.15.125:0/745334422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feee4155420 0x7feee40cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:53.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.651+0000 7feedbfff700 1 -- 172.21.15.125:0/745334422 >> v1:172.21.15.184:6789/0 conn(0x7feee40b0f90 legacy=0x7feee40cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:53.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.651+0000 7feedbfff700 1 -- 172.21.15.125:0/745334422 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee415b420 con 0x7feee415bf00 2023-10-17T06:07:53.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.651+0000 7feee1d9b700 1 -- 172.21.15.125:0/745334422 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151649777 0 0) 0x7feee40cbc80 con 0x7feee40b0f90 2023-10-17T06:07:53.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.655+0000 7feedbfff700 1 --2- 172.21.15.125:0/745334422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feee415bf00 0x7feee40cdc10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7feecc009850 tx=0x7feecc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10c1511dc4a1698 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:53.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.655+0000 7feee1d9b700 1 -- 172.21.15.125:0/745334422 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc011830 con 0x7feee415bf00 2023-10-17T06:07:53.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.655+0000 7feee1d9b700 1 -- 172.21.15.125:0/745334422 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feecc011990 con 0x7feee415bf00 2023-10-17T06:07:53.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.655+0000 7feee1d9b700 1 -- 172.21.15.125:0/745334422 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc011d40 con 0x7feee415bf00 2023-10-17T06:07:53.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.655+0000 7feee88fa700 1 -- 172.21.15.125:0/745334422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feee415bf00 msgr2=0x7feee40cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:53.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.655+0000 7feee88fa700 1 --2- 172.21.15.125:0/745334422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feee415bf00 0x7feee40cdc10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7feecc009850 tx=0x7feecc009b60 comp rx=0 tx=0).stop 2023-10-17T06:07:53.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.655+0000 7feee88fa700 1 -- 172.21.15.125:0/745334422 shutdown_connections 2023-10-17T06:07:53.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.655+0000 7feee88fa700 1 --2- 172.21.15.125:0/745334422 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feee415bf00 0x7feee40cdc10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:53.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.655+0000 7feee88fa700 1 --2- 172.21.15.125:0/745334422 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feee4155420 0x7feee40cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:53.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.655+0000 7feee88fa700 1 -- 172.21.15.125:0/745334422 >> 172.21.15.125:0/745334422 conn(0x7feee406a340 msgr2=0x7feee40b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:53.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.655+0000 7feee88fa700 1 -- 172.21.15.125:0/745334422 shutdown_connections 2023-10-17T06:07:53.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.655+0000 7feee88fa700 1 -- 172.21.15.125:0/745334422 wait complete. 2023-10-17T06:07:53.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.655+0000 7feee88fa700 1 Processor -- start 2023-10-17T06:07:53.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feee88fa700 1 -- start start 2023-10-17T06:07:53.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feee88fa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feee40b0f90 0x7feee415cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:53.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feee88fa700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feee4155420 0x7feee40c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:53.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feee88fa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feee415bf00 0x7feee40c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:53.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feee88fa700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee4134fe0 con 0x7feee40b0f90 2023-10-17T06:07:53.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feee88fa700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee4142cb0 con 0x7feee4155420 2023-10-17T06:07:53.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feee88fa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee40c6380 con 0x7feee415bf00 2023-10-17T06:07:53.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feee259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feee40b0f90 0x7feee415cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:53.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feee259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feee40b0f90 0x7feee415cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52820/0 (socket says 172.21.15.125:52820) 2023-10-17T06:07:53.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feee259c700 1 -- 172.21.15.125:0/1217941536 learned_addr learned my addr 172.21.15.125:0/1217941536 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:53.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feedbfff700 1 --2- 172.21.15.125:0/1217941536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feee4155420 0x7feee40c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:53.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feee2d9d700 1 --2- 172.21.15.125:0/1217941536 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feee415bf00 0x7feee40c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:53.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feee259c700 1 -- 172.21.15.125:0/1217941536 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feee415bf00 msgr2=0x7feee40c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:53.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feee259c700 1 --2- 172.21.15.125:0/1217941536 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feee415bf00 0x7feee40c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:53.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feee259c700 1 -- 172.21.15.125:0/1217941536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feee4155420 msgr2=0x7feee40c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:53.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feee259c700 1 --2- 172.21.15.125:0/1217941536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feee4155420 0x7feee40c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:53.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feee259c700 1 -- 172.21.15.125:0/1217941536 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc0094b0 con 0x7feee40b0f90 2023-10-17T06:07:53.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feee2d9d700 1 --2- 172.21.15.125:0/1217941536 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feee415bf00 0x7feee40c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:07:53.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feee259c700 1 --2- 172.21.15.125:0/1217941536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feee40b0f90 0x7feee415cf00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feed400e840 tx=0x7feed400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:53.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feedaffd700 1 -- 172.21.15.125:0/1217941536 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed40095a0 con 0x7feee40b0f90 2023-10-17T06:07:53.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feedaffd700 1 -- 172.21.15.125:0/1217941536 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed4013680 con 0x7feee40b0f90 2023-10-17T06:07:53.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feee88fa700 1 -- 172.21.15.125:0/1217941536 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee40c6660 con 0x7feee40b0f90 2023-10-17T06:07:53.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feedaffd700 1 -- 172.21.15.125:0/1217941536 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed40139f0 con 0x7feee40b0f90 2023-10-17T06:07:53.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.659+0000 7feee88fa700 1 -- 172.21.15.125:0/1217941536 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee4134c00 con 0x7feee40b0f90 2023-10-17T06:07:53.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.663+0000 7feee88fa700 1 -- 172.21.15.125:0/1217941536 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee4072e60 con 0x7feee40b0f90 2023-10-17T06:07:53.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.663+0000 7feedaffd700 1 -- 172.21.15.125:0/1217941536 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7feed4013b50 con 0x7feee40b0f90 2023-10-17T06:07:53.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.667+0000 7feedaffd700 1 --2- 172.21.15.125:0/1217941536 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7feec80656f0 0x7feec8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:53.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.667+0000 7feedaffd700 1 -- 172.21.15.125:0/1217941536 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feed4082fe0 con 0x7feee40b0f90 2023-10-17T06:07:53.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.667+0000 7feedbfff700 1 --2- 172.21.15.125:0/1217941536 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7feec80656f0 0x7feec8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:53.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.667+0000 7feedbfff700 1 --2- 172.21.15.125:0/1217941536 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7feec80656f0 0x7feec8067bb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feecc0090b0 tx=0x7feecc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:53.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:53.671+0000 7feedaffd700 1 -- 172.21.15.125:0/1217941536 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7feed4054250 con 0x7feee40b0f90 2023-10-17T06:07:54.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:54.015+0000 7feee88fa700 1 -- 172.21.15.125:0/1217941536 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feee4061110 con 0x7feee40b0f90 2023-10-17T06:07:54.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:54.015+0000 7feedaffd700 1 -- 172.21.15.125:0/1217941536 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7feed4053de0 con 0x7feee40b0f90 2023-10-17T06:07:54.020 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-17T06:07:54.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:54.019+0000 7feee88fa700 1 -- 172.21.15.125:0/1217941536 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7feec80656f0 msgr2=0x7feec8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:54.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:54.019+0000 7feee88fa700 1 --2- 172.21.15.125:0/1217941536 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7feec80656f0 0x7feec8067bb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feecc0090b0 tx=0x7feecc008030 comp rx=0 tx=0).stop 2023-10-17T06:07:54.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:54.019+0000 7feee88fa700 1 -- 172.21.15.125:0/1217941536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feee40b0f90 msgr2=0x7feee415cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:54.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:54.019+0000 7feee88fa700 1 --2- 172.21.15.125:0/1217941536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feee40b0f90 0x7feee415cf00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feed400e840 tx=0x7feed400eb50 comp rx=0 tx=0).stop 2023-10-17T06:07:54.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:54.019+0000 7feee88fa700 1 -- 172.21.15.125:0/1217941536 shutdown_connections 2023-10-17T06:07:54.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:54.019+0000 7feee88fa700 1 --2- 172.21.15.125:0/1217941536 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7feec80656f0 0x7feec8067bb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:54.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:54.019+0000 7feee88fa700 1 --2- 172.21.15.125:0/1217941536 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feee415bf00 0x7feee40c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:54.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:54.019+0000 7feee88fa700 1 --2- 172.21.15.125:0/1217941536 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feee4155420 0x7feee40c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:54.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:54.019+0000 7feee88fa700 1 --2- 172.21.15.125:0/1217941536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feee40b0f90 0x7feee415cf00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:54.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:54.019+0000 7feee88fa700 1 -- 172.21.15.125:0/1217941536 >> 172.21.15.125:0/1217941536 conn(0x7feee406a340 msgr2=0x7feee415dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:54.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:54.019+0000 7feee88fa700 1 -- 172.21.15.125:0/1217941536 shutdown_connections 2023-10-17T06:07:54.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:54.019+0000 7feee88fa700 1 -- 172.21.15.125:0/1217941536 wait complete. 2023-10-17T06:07:54.044 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-17T06:07:54.044 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-17T06:07:54.045 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-10-17T06:07:54.045 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-17T06:07:54.045 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-17T06:07:54.045 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-17T06:07:54.046 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-17T06:07:54.046 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-17T06:07:54.046 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-17T06:07:54.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:54.047 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-10-17T06:07:54.064 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-17T06:07:54.064 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-17T06:07:54.064 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-10-17T06:07:54.064 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:54.065 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-10-17T06:07:54.065 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:54.065 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:07:54.065 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:54.065 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f0 2023-10-17T06:07:54.066 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:07:54.066 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:54.066 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f1 2023-10-17T06:07:54.066 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:07:54.066 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:54.067 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-17T06:07:54.067 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:54.067 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-17T06:07:54.067 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42374sec preferred_lft 42374sec 2023-10-17T06:07:54.068 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::ec4:7aff:fe8f:d739/64 scope link 2023-10-17T06:07:54.068 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:54.068 INFO:teuthology.orchestra.run.smithi125.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-17T06:07:54.068 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 02:42:72:b2:4f:6c brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:54.068 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-17T06:07:54.068 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:54.069 INFO:teuthology.orchestra.run.smithi125.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-17T06:07:54.069 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 86:a3:a0:1e:b3:10 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:54.069 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-17T06:07:54.069 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:54.069 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::5cb5:97ff:fe65:f7ee/64 scope link 2023-10-17T06:07:54.069 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:54.070 INFO:teuthology.orchestra.run.smithi125.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-17T06:07:54.070 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 86:a3:a0:1e:b3:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-17T06:07:54.070 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::84a3:a0ff:fe1e:b310/64 scope link tentative 2023-10-17T06:07:54.070 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:54.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:54.072 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-17T06:07:54.149 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-10-17T06:07:54.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:54.152 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-10-17T06:07:54.216 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-10-17T06:07:54.216 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-17T06:07:54.216 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-17T06:07:54.216 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-17T06:07:54.217 INFO:teuthology.orchestra.run.smithi125.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-17T06:07:54.217 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-17T06:07:54.217 INFO:teuthology.orchestra.run.smithi125.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-17T06:07:54.217 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-17T06:07:54.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:54.218 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-17T06:07:54.218 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-17T06:07:54.219 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-17T06:07:54.219 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-17T06:07:54.219 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-17T06:07:54.219 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-17T06:07:54.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:54.357 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-10-17T06:07:54.377 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-17T06:07:54.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:54.379 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list-id 2023-10-17T06:07:54.437 INFO:teuthology.orchestra.run.smithi125.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-17T06:07:54.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:54.439 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-17T06:07:54.439 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-17T06:07:54.439 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-17T06:07:54.440 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-17T06:07:54.440 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-17T06:07:54.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:54.556 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-17T06:07:54.594 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-17T06:07:54.595 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-17T06:07:54.595 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-10-17T06:07:54.595 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:54.595 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-10-17T06:07:54.595 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:54.596 INFO:teuthology.orchestra.run.smithi125.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-17T06:07:54.596 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 4a:43:00:e3:12:60 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-17T06:07:54.596 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-17T06:07:54.597 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:54.597 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::4843:ff:fee3:1260/64 scope link 2023-10-17T06:07:54.597 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:54.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:54.600 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-17T06:07:54.677 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-17T06:07:54.678 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-17T06:07:54.678 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-10-17T06:07:54.678 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:54.678 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-10-17T06:07:54.679 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:54.679 INFO:teuthology.orchestra.run.smithi125.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-17T06:07:54.679 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 4a:43:00:e3:12:60 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-17T06:07:54.679 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-17T06:07:54.679 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:54.680 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::4843:ff:fee3:1260/64 scope link 2023-10-17T06:07:54.680 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:54.682 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-17T06:07:54.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:54.683 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-17T06:07:54.683 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-17T06:07:54.683 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-17T06:07:54.684 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-17T06:07:54.684 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-17T06:07:54.684 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-17T06:07:54.684 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-17T06:07:54.685 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-17T06:07:54.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:54.871 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-17T06:07:54.871 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-17T06:07:54.872 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.1 up 2023-10-17T06:07:54.872 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set dev brx.1 master ceph-brx 2023-10-17T06:07:54.872 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-17T06:07:54.945 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-17T06:07:54.946 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-17T06:07:54.961 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-17T06:07:54.961 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-17T06:07:54.962 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-17T06:07:55.022 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-17T06:07:55.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:55.023 DEBUG:teuthology.orchestra.run.smithi125:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:07:55.155 INFO:teuthology.orchestra.run.smithi125.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:07:55.155 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-17T06:07:55.182 INFO:teuthology.orchestra.run.smithi125.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:07:55.183 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-17T06:07:55.183 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: resolved to: "172.21.15.125:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-10-17T06:07:55.183 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: trying mount with new device syntax: 2@c779df02-0ec4-47de-a0f3-2371e60a2dde.cephfs=/ 2023-10-17T06:07:55.183 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.125:3300/172.21.15.184:3300/172.21.15.184:3301" will pass to kernel 2023-10-17T06:07:55.190 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-17T06:07:55.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:55.191 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-17T06:07:55.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:55.225 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-17T06:07:55.295 INFO:teuthology.orchestra.run.smithi125.stdout:client4697 2023-10-17T06:07:55.295 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:07:55.296 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:07:55.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:55.357 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-17T06:07:55.429 INFO:teuthology.orchestra.run.smithi125.stdout:client4697 2023-10-17T06:07:55.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:55.430 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-17T06:07:55.502 INFO:teuthology.orchestra.run.smithi125.stdout:client4697 2023-10-17T06:07:55.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:55.503 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c779df02-0ec4-47de-a0f3-2371e60a2dde.client4697/status') 2023-10-17T06:07:55.578 INFO:teuthology.orchestra.run.smithi125.stdout:instance: client.4697 (3)172.21.15.125:0/738118883 2023-10-17T06:07:55.578 INFO:teuthology.orchestra.run.smithi125.stdout:blocklisted: false 2023-10-17T06:07:55.579 INFO:teuthology.orchestra.run.smithi125.stderr:0+1 records in 2023-10-17T06:07:55.579 INFO:teuthology.orchestra.run.smithi125.stderr:0+1 records out 2023-10-17T06:07:55.579 INFO:teuthology.orchestra.run.smithi125.stderr:70 bytes copied, 0.000159368 s, 439 kB/s 2023-10-17T06:07:55.581 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-17T06:07:55.581 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-17T06:07:55.581 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-17T06:07:55.582 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-17T06:07:55.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.799+0000 7fc8015ca700 1 Processor -- start 2023-10-17T06:07:55.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.799+0000 7fc8015ca700 1 -- start start 2023-10-17T06:07:55.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.803+0000 7fc8015ca700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc7fc0b3d40 0x7fc7fc0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:55.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.803+0000 7fc8015ca700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc7fc164a20 0x7fc7fc0c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:55.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.803+0000 7fc8015ca700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7fc0ca200 con 0x7fc7fc06ce20 2023-10-17T06:07:55.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.803+0000 7fc8015ca700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7fc06e2d0 con 0x7fc7fc164a20 2023-10-17T06:07:55.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.803+0000 7fc8015ca700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7fc0ca4c0 con 0x7fc7fc0b3d40 2023-10-17T06:07:55.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.803+0000 7fc800dc9700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc7fc06ce20 0x7fc7fc06f970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45926/0 (socket says 172.21.15.125:45926) 2023-10-17T06:07:55.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.803+0000 7fc800dc9700 1 -- 172.21.15.125:0/3929497066 learned_addr learned my addr 172.21.15.125:0/3929497066 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:55.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.803+0000 7fc7f37fe700 1 --2- 172.21.15.125:0/3929497066 >> v2:172.21.15.125:3300/0 conn(0x7fc7fc164a20 0x7fc7fc0c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:55.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.803+0000 7fc7fbfff700 1 --2- 172.21.15.125:0/3929497066 >> v2:172.21.15.184:3300/0 conn(0x7fc7fc0b3d40 0x7fc7fc0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:55.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.803+0000 7fc7f37fe700 1 -- 172.21.15.125:0/3929497066 >> v2:172.21.15.184:3300/0 conn(0x7fc7fc0b3d40 msgr2=0x7fc7fc0cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:07:55.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.803+0000 7fc7f37fe700 1 --2- 172.21.15.125:0/3929497066 >> v2:172.21.15.184:3300/0 conn(0x7fc7fc0b3d40 0x7fc7fc0cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:55.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.803+0000 7fc7f37fe700 1 -- 172.21.15.125:0/3929497066 >> v1:172.21.15.125:6789/0 conn(0x7fc7fc06ce20 legacy=0x7fc7fc06f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:55.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.803+0000 7fc7f37fe700 1 -- 172.21.15.125:0/3929497066 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7fc0ca7a0 con 0x7fc7fc164a20 2023-10-17T06:07:55.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.803+0000 7fc7fb7fe700 1 -- 172.21.15.125:0/3929497066 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365320027 0 0) 0x7fc7fc0ca200 con 0x7fc7fc06ce20 2023-10-17T06:07:55.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.803+0000 7fc7f37fe700 1 --2- 172.21.15.125:0/3929497066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7fc164a20 0x7fc7fc0c9cc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc06e760 tx=0x7fc7e4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f22bec387bc69d server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:55.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.803+0000 7fc7fb7fe700 1 -- 172.21.15.125:0/3929497066 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4011830 con 0x7fc7fc164a20 2023-10-17T06:07:55.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.803+0000 7fc7fb7fe700 1 -- 172.21.15.125:0/3929497066 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e4011990 con 0x7fc7fc164a20 2023-10-17T06:07:55.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.803+0000 7fc7fb7fe700 1 -- 172.21.15.125:0/3929497066 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4011d20 con 0x7fc7fc164a20 2023-10-17T06:07:55.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.807+0000 7fc8015ca700 1 -- 172.21.15.125:0/3929497066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7fc164a20 msgr2=0x7fc7fc0c9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:55.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.807+0000 7fc8015ca700 1 --2- 172.21.15.125:0/3929497066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7fc164a20 0x7fc7fc0c9cc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc06e760 tx=0x7fc7e4009b30 comp rx=0 tx=0).stop 2023-10-17T06:07:55.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.807+0000 7fc8015ca700 1 -- 172.21.15.125:0/3929497066 shutdown_connections 2023-10-17T06:07:55.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.807+0000 7fc8015ca700 1 --2- 172.21.15.125:0/3929497066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7fc164a20 0x7fc7fc0c9cc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:55.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.807+0000 7fc8015ca700 1 --2- 172.21.15.125:0/3929497066 >> v2:172.21.15.184:3300/0 conn(0x7fc7fc0b3d40 0x7fc7fc0cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:55.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.807+0000 7fc8015ca700 1 -- 172.21.15.125:0/3929497066 >> 172.21.15.125:0/3929497066 conn(0x7fc7fc0ce5c0 msgr2=0x7fc7fc0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:55.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.807+0000 7fc8015ca700 1 -- 172.21.15.125:0/3929497066 shutdown_connections 2023-10-17T06:07:55.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.807+0000 7fc8015ca700 1 -- 172.21.15.125:0/3929497066 wait complete. 2023-10-17T06:07:55.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc8015ca700 1 Processor -- start 2023-10-17T06:07:55.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc8015ca700 1 -- start start 2023-10-17T06:07:55.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc8015ca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7fc06ce20 0x7fc7fc0c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:55.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc8015ca700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7fc0b3d40 0x7fc7fc0c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:55.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc8015ca700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7fc164a20 0x7fc7fc1f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:55.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc8015ca700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc0b1880 con 0x7fc7fc06ce20 2023-10-17T06:07:55.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc8015ca700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc0b1b60 con 0x7fc7fc164a20 2023-10-17T06:07:55.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc8015ca700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc0b1e40 con 0x7fc7fc0b3d40 2023-10-17T06:07:55.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc7fbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7fc06ce20 0x7fc7fc0c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:55.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc7fbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7fc06ce20 0x7fc7fc0c60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52838/0 (socket says 172.21.15.125:52838) 2023-10-17T06:07:55.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc7fbfff700 1 -- 172.21.15.125:0/1233783411 learned_addr learned my addr 172.21.15.125:0/1233783411 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:55.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc7fbfff700 1 -- 172.21.15.125:0/1233783411 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7fc0b3d40 msgr2=0x7fc7fc0c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:55.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc7fbfff700 1 --2- 172.21.15.125:0/1233783411 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7fc0b3d40 0x7fc7fc0c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:55.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc7fbfff700 1 -- 172.21.15.125:0/1233783411 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7fc164a20 msgr2=0x7fc7fc1f6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:55.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc7fbfff700 1 --2- 172.21.15.125:0/1233783411 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7fc164a20 0x7fc7fc1f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:55.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc7fbfff700 1 -- 172.21.15.125:0/1233783411 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e40094b0 con 0x7fc7fc06ce20 2023-10-17T06:07:55.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc7fbfff700 1 --2- 172.21.15.125:0/1233783411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7fc06ce20 0x7fc7fc0c60d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00e9d0 tx=0x7fc7ec00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:55.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc7f97fa700 1 -- 172.21.15.125:0/1233783411 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec009720 con 0x7fc7fc06ce20 2023-10-17T06:07:55.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc7f97fa700 1 -- 172.21.15.125:0/1233783411 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ec00c850 con 0x7fc7fc06ce20 2023-10-17T06:07:55.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc7f97fa700 1 -- 172.21.15.125:0/1233783411 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec00cbc0 con 0x7fc7fc06ce20 2023-10-17T06:07:55.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc8015ca700 1 -- 172.21.15.125:0/1233783411 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7fc0b2120 con 0x7fc7fc06ce20 2023-10-17T06:07:55.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.811+0000 7fc8015ca700 1 -- 172.21.15.125:0/1233783411 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7fc0c8400 con 0x7fc7fc06ce20 2023-10-17T06:07:55.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.815+0000 7fc8015ca700 1 -- 172.21.15.125:0/1233783411 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7fc072e60 con 0x7fc7fc06ce20 2023-10-17T06:07:55.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.815+0000 7fc7f97fa700 1 -- 172.21.15.125:0/1233783411 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc7ec00cd20 con 0x7fc7fc06ce20 2023-10-17T06:07:55.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.815+0000 7fc7f97fa700 1 --2- 172.21.15.125:0/1233783411 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc7dc065720 0x7fc7dc067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:55.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.815+0000 7fc7f97fa700 1 -- 172.21.15.125:0/1233783411 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc7ec083260 con 0x7fc7fc06ce20 2023-10-17T06:07:55.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.819+0000 7fc7f37fe700 1 --2- 172.21.15.125:0/1233783411 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc7dc065720 0x7fc7dc067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:55.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.819+0000 7fc7f37fe700 1 --2- 172.21.15.125:0/1233783411 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc7dc065720 0x7fc7dc067be0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc15ed60 tx=0x7fc7e4010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:55.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:55.823+0000 7fc7f97fa700 1 -- 172.21.15.125:0/1233783411 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc7ec0543e0 con 0x7fc7fc06ce20 2023-10-17T06:07:56.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:56.127+0000 7fc8015ca700 1 -- 172.21.15.125:0/1233783411 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc7fc0cde70 con 0x7fc7fc06ce20 2023-10-17T06:07:56.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:56.131+0000 7fc7f97fa700 1 -- 172.21.15.125:0/1233783411 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fc7ec053f70 con 0x7fc7fc06ce20 2023-10-17T06:07:56.133 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-17T06:07:56.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:56.135+0000 7fc8015ca700 1 -- 172.21.15.125:0/1233783411 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc7dc065720 msgr2=0x7fc7dc067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:56.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:56.135+0000 7fc8015ca700 1 --2- 172.21.15.125:0/1233783411 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc7dc065720 0x7fc7dc067be0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc15ed60 tx=0x7fc7e4010000 comp rx=0 tx=0).stop 2023-10-17T06:07:56.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:56.135+0000 7fc8015ca700 1 -- 172.21.15.125:0/1233783411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7fc06ce20 msgr2=0x7fc7fc0c60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:56.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:56.135+0000 7fc8015ca700 1 --2- 172.21.15.125:0/1233783411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7fc06ce20 0x7fc7fc0c60d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00e9d0 tx=0x7fc7ec00ed90 comp rx=0 tx=0).stop 2023-10-17T06:07:56.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:56.135+0000 7fc8015ca700 1 -- 172.21.15.125:0/1233783411 shutdown_connections 2023-10-17T06:07:56.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:56.135+0000 7fc8015ca700 1 --2- 172.21.15.125:0/1233783411 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc7dc065720 0x7fc7dc067be0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:56.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:56.135+0000 7fc8015ca700 1 --2- 172.21.15.125:0/1233783411 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7fc164a20 0x7fc7fc1f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:56.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:56.135+0000 7fc8015ca700 1 --2- 172.21.15.125:0/1233783411 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7fc0b3d40 0x7fc7fc0c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:56.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:56.135+0000 7fc8015ca700 1 --2- 172.21.15.125:0/1233783411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7fc06ce20 0x7fc7fc0c60d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:56.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:56.135+0000 7fc8015ca700 1 -- 172.21.15.125:0/1233783411 >> 172.21.15.125:0/1233783411 conn(0x7fc7fc0ce5c0 msgr2=0x7fc7fc0c9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:56.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:56.135+0000 7fc8015ca700 1 -- 172.21.15.125:0/1233783411 shutdown_connections 2023-10-17T06:07:56.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:56.135+0000 7fc8015ca700 1 -- 172.21.15.125:0/1233783411 wait complete. 2023-10-17T06:07:56.160 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-17T06:07:56.160 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-17T06:07:56.161 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-10-17T06:07:56.161 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-17T06:07:56.161 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-17T06:07:56.162 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-17T06:07:56.162 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-17T06:07:56.162 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-17T06:07:56.163 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-17T06:07:56.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:56.163 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-10-17T06:07:56.181 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-17T06:07:56.181 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-17T06:07:56.182 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-17T06:07:56.182 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:56.182 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-17T06:07:56.182 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:56.182 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:07:56.183 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:56.183 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-10-17T06:07:56.183 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:07:56.183 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:56.183 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-10-17T06:07:56.184 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:07:56.184 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:56.184 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-17T06:07:56.184 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:56.184 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-17T06:07:56.185 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42375sec preferred_lft 42375sec 2023-10-17T06:07:56.185 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-10-17T06:07:56.185 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:56.185 INFO:teuthology.orchestra.run.smithi184.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-17T06:07:56.185 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 02:42:64:45:c8:05 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:56.186 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-17T06:07:56.186 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:56.187 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-17T06:07:56.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:56.187 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-17T06:07:56.188 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-17T06:07:56.188 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add name ceph-brx type bridge 2023-10-17T06:07:56.188 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr flush dev ceph-brx 2023-10-17T06:07:56.188 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set ceph-brx up 2023-10-17T06:07:56.189 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-17T06:07:56.189 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-17T06:07:56.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:56.335 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-17T06:07:56.368 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-17T06:07:56.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:56.372 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-10-17T06:07:56.459 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-10-17T06:07:56.459 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-17T06:07:56.459 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-17T06:07:56.460 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-17T06:07:56.460 INFO:teuthology.orchestra.run.smithi184.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-17T06:07:56.460 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-17T06:07:56.460 INFO:teuthology.orchestra.run.smithi184.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-17T06:07:56.460 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-17T06:07:56.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:56.461 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-17T06:07:56.462 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-17T06:07:56.462 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-17T06:07:56.462 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-17T06:07:56.464 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-17T06:07:56.464 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-17T06:07:56.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:56.601 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-17T06:07:56.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:56.619 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list-id 2023-10-17T06:07:56.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:56.681 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-17T06:07:56.681 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-17T06:07:56.682 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-17T06:07:56.682 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-17T06:07:56.682 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-17T06:07:56.789 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-17T06:07:56.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:56.790 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-17T06:07:56.790 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-17T06:07:56.790 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-17T06:07:56.791 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-17T06:07:56.791 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-17T06:07:56.791 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-17T06:07:56.792 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-17T06:07:56.792 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-17T06:07:56.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:56.980 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-17T06:07:56.980 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-17T06:07:56.980 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-10-17T06:07:56.980 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set dev brx.0 master ceph-brx 2023-10-17T06:07:56.981 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-17T06:07:57.056 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-17T06:07:57.057 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-17T06:07:57.074 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-17T06:07:57.075 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-17T06:07:57.075 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-17T06:07:57.136 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-17T06:07:57.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:57.137 DEBUG:teuthology.orchestra.run.smithi184:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:07:57.267 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:07:57.268 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-17T06:07:57.411 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:07:57.412 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-17T06:07:57.412 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.125:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-10-17T06:07:57.412 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: trying mount with new device syntax: 1@c779df02-0ec4-47de-a0f3-2371e60a2dde.cephfs=/ 2023-10-17T06:07:57.412 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.125:3300/172.21.15.184:3300/172.21.15.184:3301" will pass to kernel 2023-10-17T06:07:57.418 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-17T06:07:57.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:57.419 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-17T06:07:57.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:57.453 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-17T06:07:57.538 INFO:teuthology.orchestra.run.smithi184.stdout:client4941 2023-10-17T06:07:57.539 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:07:57.539 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:07:57.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:57.601 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-17T06:07:57.668 INFO:teuthology.orchestra.run.smithi184.stdout:client4941 2023-10-17T06:07:57.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:57.668 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-17T06:07:57.733 INFO:teuthology.orchestra.run.smithi184.stdout:client4941 2023-10-17T06:07:57.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:57.734 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c779df02-0ec4-47de-a0f3-2371e60a2dde.client4941/status') 2023-10-17T06:07:57.813 INFO:teuthology.orchestra.run.smithi184.stdout:instance: client.4941 (3)172.21.15.184:0/3063383395 2023-10-17T06:07:57.814 INFO:teuthology.orchestra.run.smithi184.stdout:blocklisted: false 2023-10-17T06:07:57.814 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records in 2023-10-17T06:07:57.814 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records out 2023-10-17T06:07:57.815 INFO:teuthology.orchestra.run.smithi184.stderr:71 bytes copied, 0.000131544 s, 540 kB/s 2023-10-17T06:07:57.816 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-17T06:07:57.817 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-17T06:07:57.817 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-17T06:07:57.818 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-17T06:07:57.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.991+0000 7f74aee7b700 1 Processor -- start 2023-10-17T06:07:57.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.991+0000 7f74aee7b700 1 -- start start 2023-10-17T06:07:57.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.991+0000 7f74aee7b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74a8156640 0x7f74a80b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:57.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.991+0000 7f74aee7b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a81590b0 con 0x7f74a8159b70 2023-10-17T06:07:57.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.991+0000 7f74aee7b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a80ca9f0 con 0x7f74a806ce20 2023-10-17T06:07:57.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.991+0000 7f74aee7b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a80cacd0 con 0x7f74a8156640 2023-10-17T06:07:57.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.991+0000 7f74ad678700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f74a8159b70 0x7f74a80ca110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45928/0 (socket says 172.21.15.125:45928) 2023-10-17T06:07:57.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.995+0000 7f74ad678700 1 -- 172.21.15.125:0/2673390640 learned_addr learned my addr 172.21.15.125:0/2673390640 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:07:57.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.995+0000 7f74ade79700 1 --2- 172.21.15.125:0/2673390640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74a8156640 0x7f74a80b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:57.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.995+0000 7f74ace77700 1 -- 172.21.15.125:0/2673390640 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564053267 0 0) 0x7f74a81590b0 con 0x7f74a8159b70 2023-10-17T06:07:57.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.995+0000 7f74ade79700 1 -- 172.21.15.125:0/2673390640 >> v1:172.21.15.184:6789/0 conn(0x7f74a806ce20 legacy=0x7f74a815a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:57.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.995+0000 7f74ade79700 1 -- 172.21.15.125:0/2673390640 >> v1:172.21.15.125:6789/0 conn(0x7f74a8159b70 legacy=0x7f74a80ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:57.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.995+0000 7f74ade79700 1 -- 172.21.15.125:0/2673390640 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8159370 con 0x7f74a8156640 2023-10-17T06:07:57.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.995+0000 7f74ade79700 1 --2- 172.21.15.125:0/2673390640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74a8156640 0x7f74a80b0d20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f74a400a9a0 tx=0x7f74a400acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11dd30ef59fb07b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:58.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.995+0000 7f74ace77700 1 -- 172.21.15.125:0/2673390640 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4004230 con 0x7f74a8156640 2023-10-17T06:07:58.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.995+0000 7f74ace77700 1 -- 172.21.15.125:0/2673390640 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a4004390 con 0x7f74a8156640 2023-10-17T06:07:58.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.995+0000 7f74ace77700 1 -- 172.21.15.125:0/2673390640 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a400c8f0 con 0x7f74a8156640 2023-10-17T06:07:58.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.995+0000 7f74aee7b700 1 -- 172.21.15.125:0/2673390640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74a8156640 msgr2=0x7f74a80b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:58.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.995+0000 7f74aee7b700 1 --2- 172.21.15.125:0/2673390640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74a8156640 0x7f74a80b0d20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f74a400a9a0 tx=0x7f74a400acb0 comp rx=0 tx=0).stop 2023-10-17T06:07:58.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.995+0000 7f74aee7b700 1 -- 172.21.15.125:0/2673390640 shutdown_connections 2023-10-17T06:07:58.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.995+0000 7f74aee7b700 1 --2- 172.21.15.125:0/2673390640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74a8156640 0x7f74a80b0d20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:58.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.995+0000 7f74aee7b700 1 -- 172.21.15.125:0/2673390640 >> 172.21.15.125:0/2673390640 conn(0x7f74a806a3f0 msgr2=0x7f74a80ce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:58.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.995+0000 7f74aee7b700 1 -- 172.21.15.125:0/2673390640 shutdown_connections 2023-10-17T06:07:58.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.995+0000 7f74aee7b700 1 -- 172.21.15.125:0/2673390640 wait complete. 2023-10-17T06:07:58.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.999+0000 7f74aee7b700 1 Processor -- start 2023-10-17T06:07:58.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:57.999+0000 7f74aee7b700 1 -- start start 2023-10-17T06:07:58.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f74aee7b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74a806ce20 0x7f74a8145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:58.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f74aee7b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74a8156640 0x7f74a8157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:58.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f74aee7b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74a8159b70 0x7f74a8158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:58.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f74aee7b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a80c5830 con 0x7f74a8159b70 2023-10-17T06:07:58.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f74aee7b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a80c5b10 con 0x7f74a8156640 2023-10-17T06:07:58.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f74aee7b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a80c5df0 con 0x7f74a806ce20 2023-10-17T06:07:58.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f74ae67a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74a8159b70 0x7f74a8158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:58.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f74ad678700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74a8156640 0x7f74a8157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:58.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f74ade79700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74a806ce20 0x7f74a8145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:58.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f74ade79700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74a806ce20 0x7f74a8145080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:56898/0 (socket says 172.21.15.125:56898) 2023-10-17T06:07:58.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f74ade79700 1 -- 172.21.15.125:0/2291322878 learned_addr learned my addr 172.21.15.125:0/2291322878 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:07:58.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f74ade79700 1 -- 172.21.15.125:0/2291322878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74a8156640 msgr2=0x7f74a8157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:58.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f74ade79700 1 --2- 172.21.15.125:0/2291322878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74a8156640 0x7f74a8157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:58.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f74ade79700 1 -- 172.21.15.125:0/2291322878 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74a8159b70 msgr2=0x7f74a8158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:58.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f74ade79700 1 --2- 172.21.15.125:0/2291322878 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74a8159b70 0x7f74a8158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:58.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f74ade79700 1 -- 172.21.15.125:0/2291322878 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a400a650 con 0x7f74a806ce20 2023-10-17T06:07:58.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f74ae67a700 1 --2- 172.21.15.125:0/2291322878 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74a8159b70 0x7f74a8158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:07:58.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f74ade79700 1 --2- 172.21.15.125:0/2291322878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74a806ce20 0x7f74a8145080 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f74a400a1c0 tx=0x7f74a40047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:58.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f749e7fc700 1 -- 172.21.15.125:0/2291322878 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a401e070 con 0x7f74a806ce20 2023-10-17T06:07:58.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f749e7fc700 1 -- 172.21.15.125:0/2291322878 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a4006e80 con 0x7f74a806ce20 2023-10-17T06:07:58.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f74aee7b700 1 -- 172.21.15.125:0/2291322878 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a80c60d0 con 0x7f74a806ce20 2023-10-17T06:07:58.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.003+0000 7f749e7fc700 1 -- 172.21.15.125:0/2291322878 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4003b30 con 0x7f74a806ce20 2023-10-17T06:07:58.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.007+0000 7f74aee7b700 1 -- 172.21.15.125:0/2291322878 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a81455c0 con 0x7f74a806ce20 2023-10-17T06:07:58.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.007+0000 7f74aee7b700 1 -- 172.21.15.125:0/2291322878 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a80c65f0 con 0x7f74a806ce20 2023-10-17T06:07:58.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.007+0000 7f749e7fc700 1 -- 172.21.15.125:0/2291322878 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f74a4003c90 con 0x7f74a806ce20 2023-10-17T06:07:58.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.011+0000 7f749e7fc700 1 --2- 172.21.15.125:0/2291322878 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f748c065740 0x7f748c067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:07:58.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.011+0000 7f749e7fc700 1 -- 172.21.15.125:0/2291322878 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f74a4084640 con 0x7f74a806ce20 2023-10-17T06:07:58.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.011+0000 7f74ad678700 1 --2- 172.21.15.125:0/2291322878 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f748c065740 0x7f748c067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:07:58.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.011+0000 7f74ad678700 1 --2- 172.21.15.125:0/2291322878 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f748c065740 0x7f748c067c00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f74a80c8720 tx=0x7f7498004a70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:07:58.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.019+0000 7f749e7fc700 1 -- 172.21.15.125:0/2291322878 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f74a80c65f0 con 0x7f74a806ce20 2023-10-17T06:07:58.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.379+0000 7f74aee7b700 1 -- 172.21.15.125:0/2291322878 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f74a80c65f0 con 0x7f74a806ce20 2023-10-17T06:07:58.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.379+0000 7f749e7fc700 1 -- 172.21.15.125:0/2291322878 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f74a80c65f0 con 0x7f74a806ce20 2023-10-17T06:07:58.385 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-17T06:07:58.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.387+0000 7f74aee7b700 1 -- 172.21.15.125:0/2291322878 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f748c065740 msgr2=0x7f748c067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:58.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.387+0000 7f74aee7b700 1 --2- 172.21.15.125:0/2291322878 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f748c065740 0x7f748c067c00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f74a80c8720 tx=0x7f7498004a70 comp rx=0 tx=0).stop 2023-10-17T06:07:58.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.387+0000 7f74aee7b700 1 -- 172.21.15.125:0/2291322878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74a806ce20 msgr2=0x7f74a8145080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:07:58.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.387+0000 7f74aee7b700 1 --2- 172.21.15.125:0/2291322878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74a806ce20 0x7f74a8145080 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f74a400a1c0 tx=0x7f74a40047e0 comp rx=0 tx=0).stop 2023-10-17T06:07:58.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.387+0000 7f74aee7b700 1 -- 172.21.15.125:0/2291322878 shutdown_connections 2023-10-17T06:07:58.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.387+0000 7f74aee7b700 1 --2- 172.21.15.125:0/2291322878 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f748c065740 0x7f748c067c00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:58.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.387+0000 7f74aee7b700 1 --2- 172.21.15.125:0/2291322878 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74a8159b70 0x7f74a8158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:58.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.387+0000 7f74aee7b700 1 --2- 172.21.15.125:0/2291322878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74a8156640 0x7f74a8157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:58.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.387+0000 7f74aee7b700 1 --2- 172.21.15.125:0/2291322878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74a806ce20 0x7f74a8145080 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:07:58.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.387+0000 7f74aee7b700 1 -- 172.21.15.125:0/2291322878 >> 172.21.15.125:0/2291322878 conn(0x7f74a806a3f0 msgr2=0x7f74a80cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:07:58.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.387+0000 7f74aee7b700 1 -- 172.21.15.125:0/2291322878 shutdown_connections 2023-10-17T06:07:58.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:07:58.387+0000 7f74aee7b700 1 -- 172.21.15.125:0/2291322878 wait complete. 2023-10-17T06:07:58.418 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-17T06:07:58.419 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-17T06:07:58.419 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-10-17T06:07:58.419 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-17T06:07:58.419 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-17T06:07:58.420 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-17T06:07:58.420 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-17T06:07:58.420 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-17T06:07:58.420 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-17T06:07:58.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:58.421 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-10-17T06:07:58.440 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-17T06:07:58.441 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-17T06:07:58.441 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-17T06:07:58.441 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:58.441 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-17T06:07:58.442 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:58.442 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:07:58.442 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:58.442 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-10-17T06:07:58.442 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:07:58.443 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:58.443 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-10-17T06:07:58.443 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:07:58.443 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:58.443 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-17T06:07:58.444 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:58.444 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-17T06:07:58.444 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42373sec preferred_lft 42373sec 2023-10-17T06:07:58.444 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-10-17T06:07:58.445 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:58.445 INFO:teuthology.orchestra.run.smithi184.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-17T06:07:58.445 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 02:42:64:45:c8:05 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:58.445 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-17T06:07:58.445 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:58.445 INFO:teuthology.orchestra.run.smithi184.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-17T06:07:58.446 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 36:65:c0:53:e3:0e brd ff:ff:ff:ff:ff:ff 2023-10-17T06:07:58.446 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-17T06:07:58.446 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:58.446 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::5805:71ff:fefd:36ab/64 scope link 2023-10-17T06:07:58.447 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:58.447 INFO:teuthology.orchestra.run.smithi184.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-17T06:07:58.447 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 36:65:c0:53:e3:0e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-17T06:07:58.447 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::3465:c0ff:fe53:e30e/64 scope link 2023-10-17T06:07:58.448 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:58.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:58.449 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-17T06:07:58.528 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-17T06:07:58.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:58.532 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-10-17T06:07:58.592 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-10-17T06:07:58.593 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-17T06:07:58.593 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-17T06:07:58.593 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-17T06:07:58.594 INFO:teuthology.orchestra.run.smithi184.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-17T06:07:58.594 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-17T06:07:58.594 INFO:teuthology.orchestra.run.smithi184.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-17T06:07:58.594 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-17T06:07:58.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:58.596 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-17T06:07:58.597 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-17T06:07:58.597 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-17T06:07:58.598 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-17T06:07:58.598 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-17T06:07:58.598 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-17T06:07:58.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:58.727 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-17T06:07:58.746 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-17T06:07:58.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:58.748 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list-id 2023-10-17T06:07:58.806 INFO:teuthology.orchestra.run.smithi184.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-17T06:07:58.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:58.807 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-17T06:07:58.807 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-17T06:07:58.808 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-17T06:07:58.808 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-17T06:07:58.808 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-17T06:07:58.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:58.936 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-17T06:07:58.977 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-17T06:07:58.977 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-17T06:07:58.977 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-17T06:07:58.977 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:58.978 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-17T06:07:58.978 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:58.978 INFO:teuthology.orchestra.run.smithi184.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-17T06:07:58.978 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether f6:02:d9:79:57:d1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-17T06:07:58.979 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-17T06:07:58.979 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:58.979 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::f402:d9ff:fe79:57d1/64 scope link 2023-10-17T06:07:58.979 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:58.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:58.981 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-17T06:07:59.064 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-17T06:07:59.065 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-17T06:07:59.065 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-17T06:07:59.065 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:59.065 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-17T06:07:59.066 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:59.066 INFO:teuthology.orchestra.run.smithi184.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-17T06:07:59.066 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether f6:02:d9:79:57:d1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-17T06:07:59.067 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-17T06:07:59.067 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:59.067 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::f402:d9ff:fe79:57d1/64 scope link 2023-10-17T06:07:59.067 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:07:59.069 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-17T06:07:59.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:59.069 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-17T06:07:59.070 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-17T06:07:59.070 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-17T06:07:59.070 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-17T06:07:59.071 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-17T06:07:59.071 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-17T06:07:59.071 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-17T06:07:59.071 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-17T06:07:59.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:59.259 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-17T06:07:59.259 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-17T06:07:59.259 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.1 up 2023-10-17T06:07:59.259 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set dev brx.1 master ceph-brx 2023-10-17T06:07:59.260 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-17T06:07:59.329 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-17T06:07:59.330 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-17T06:07:59.346 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-17T06:07:59.346 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-17T06:07:59.346 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-17T06:07:59.409 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-17T06:07:59.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:59.410 DEBUG:teuthology.orchestra.run.smithi184:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:07:59.544 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:07:59.544 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-17T06:07:59.568 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:07:59.569 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-17T06:07:59.569 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.125:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-10-17T06:07:59.569 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: trying mount with new device syntax: 3@c779df02-0ec4-47de-a0f3-2371e60a2dde.cephfs=/ 2023-10-17T06:07:59.569 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.125:3300/172.21.15.184:3300/172.21.15.184:3301" will pass to kernel 2023-10-17T06:07:59.575 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-17T06:07:59.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:59.576 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-17T06:07:59.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:59.606 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-17T06:07:59.671 INFO:teuthology.orchestra.run.smithi184.stdout:client4950 2023-10-17T06:07:59.672 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:07:59.672 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:07:59.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:59.735 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-17T06:07:59.804 INFO:teuthology.orchestra.run.smithi184.stdout:client4950 2023-10-17T06:07:59.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:59.804 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-17T06:07:59.871 INFO:teuthology.orchestra.run.smithi184.stdout:client4950 2023-10-17T06:07:59.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:07:59.871 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c779df02-0ec4-47de-a0f3-2371e60a2dde.client4950/status') 2023-10-17T06:07:59.956 INFO:teuthology.orchestra.run.smithi184.stdout:instance: client.4950 (3)172.21.15.184:0/1319479066 2023-10-17T06:07:59.956 INFO:teuthology.orchestra.run.smithi184.stdout:blocklisted: false 2023-10-17T06:07:59.956 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records in 2023-10-17T06:07:59.956 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records out 2023-10-17T06:07:59.957 INFO:teuthology.orchestra.run.smithi184.stderr:71 bytes copied, 0.000157928 s, 450 kB/s 2023-10-17T06:07:59.959 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-17T06:07:59.974 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:08:00.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.151+0000 7fe12aeca700 1 Processor -- start 2023-10-17T06:08:00.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.151+0000 7fe12aeca700 1 -- start start 2023-10-17T06:08:00.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.151+0000 7fe12aeca700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe124146800 0x7fe1240b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:00.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.151+0000 7fe12aeca700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe12415dd30 0x7fe12406f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:00.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.151+0000 7fe12aeca700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe12415e680 con 0x7fe12406fee0 2023-10-17T06:08:00.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.151+0000 7fe12aeca700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe124070370 con 0x7fe124146800 2023-10-17T06:08:00.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.151+0000 7fe12aeca700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1240b6180 con 0x7fe12415dd30 2023-10-17T06:08:00.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.155+0000 7fe128c66700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe124146800 0x7fe1240b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:00.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.155+0000 7fe128c66700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe124146800 0x7fe1240b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52852/0 (socket says 172.21.15.125:52852) 2023-10-17T06:08:00.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.155+0000 7fe128c66700 1 -- 172.21.15.125:0/1744851631 learned_addr learned my addr 172.21.15.125:0/1744851631 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:00.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.155+0000 7fe123fff700 1 --2- 172.21.15.125:0/1744851631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe12415dd30 0x7fe12406f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:00.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.155+0000 7fe128c66700 1 -- 172.21.15.125:0/1744851631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe12415dd30 msgr2=0x7fe12406f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:00.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.155+0000 7fe128c66700 1 --2- 172.21.15.125:0/1744851631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe12415dd30 0x7fe12406f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.155+0000 7fe128c66700 1 -- 172.21.15.125:0/1744851631 >> v1:172.21.15.184:6789/0 conn(0x7fe12406fee0 legacy=0x7fe1241608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:00.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.155+0000 7fe128c66700 1 -- 172.21.15.125:0/1744851631 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1240b6460 con 0x7fe124146800 2023-10-17T06:08:00.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.155+0000 7fe128c66700 1 --2- 172.21.15.125:0/1744851631 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe124146800 0x7fe1240b5b80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe118009910 tx=0x7fe118009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7647cd1e6eb9a7e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:00.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.155+0000 7fe1237fe700 1 -- 172.21.15.125:0/1744851631 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe118011830 con 0x7fe124146800 2023-10-17T06:08:00.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.155+0000 7fe1237fe700 1 -- 172.21.15.125:0/1744851631 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe118011990 con 0x7fe124146800 2023-10-17T06:08:00.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.155+0000 7fe1237fe700 1 -- 172.21.15.125:0/1744851631 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe118011d40 con 0x7fe124146800 2023-10-17T06:08:00.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.155+0000 7fe12aeca700 1 -- 172.21.15.125:0/1744851631 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe124146800 msgr2=0x7fe1240b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:00.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.155+0000 7fe12aeca700 1 --2- 172.21.15.125:0/1744851631 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe124146800 0x7fe1240b5b80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe118009910 tx=0x7fe118009c20 comp rx=0 tx=0).stop 2023-10-17T06:08:00.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.155+0000 7fe12aeca700 1 -- 172.21.15.125:0/1744851631 shutdown_connections 2023-10-17T06:08:00.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.155+0000 7fe12aeca700 1 --2- 172.21.15.125:0/1744851631 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe12415dd30 0x7fe12406f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.155+0000 7fe12aeca700 1 --2- 172.21.15.125:0/1744851631 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe124146800 0x7fe1240b5b80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.155+0000 7fe12aeca700 1 -- 172.21.15.125:0/1744851631 >> 172.21.15.125:0/1744851631 conn(0x7fe12406a130 msgr2=0x7fe12406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:00.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.155+0000 7fe12aeca700 1 -- 172.21.15.125:0/1744851631 shutdown_connections 2023-10-17T06:08:00.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.155+0000 7fe12aeca700 1 -- 172.21.15.125:0/1744851631 wait complete. 2023-10-17T06:08:00.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.159+0000 7fe12aeca700 1 Processor -- start 2023-10-17T06:08:00.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.159+0000 7fe12aeca700 1 -- start start 2023-10-17T06:08:00.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.159+0000 7fe12aeca700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe12406fee0 0x7fe1241445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:00.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.159+0000 7fe12aeca700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe124146800 0x7fe1241f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:00.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.159+0000 7fe12aeca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe12415dd30 0x7fe1241f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:00.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.159+0000 7fe12aeca700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1240ae480 con 0x7fe12415dd30 2023-10-17T06:08:00.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.159+0000 7fe12aeca700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1241f24d0 con 0x7fe12406fee0 2023-10-17T06:08:00.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.159+0000 7fe12aeca700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1240adff0 con 0x7fe124146800 2023-10-17T06:08:00.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.159+0000 7fe129467700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe12415dd30 0x7fe1241f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:00.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.159+0000 7fe123fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe124146800 0x7fe1241f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:00.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.159+0000 7fe129467700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe12415dd30 0x7fe1241f1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52862/0 (socket says 172.21.15.125:52862) 2023-10-17T06:08:00.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.159+0000 7fe129467700 1 -- 172.21.15.125:0/2675355995 learned_addr learned my addr 172.21.15.125:0/2675355995 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:00.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.159+0000 7fe128c66700 1 --2- 172.21.15.125:0/2675355995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe12406fee0 0x7fe1241445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:00.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.159+0000 7fe129467700 1 -- 172.21.15.125:0/2675355995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe124146800 msgr2=0x7fe1241f1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:00.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.159+0000 7fe129467700 1 --2- 172.21.15.125:0/2675355995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe124146800 0x7fe1241f1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.159+0000 7fe129467700 1 -- 172.21.15.125:0/2675355995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe12406fee0 msgr2=0x7fe1241445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:00.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.159+0000 7fe129467700 1 --2- 172.21.15.125:0/2675355995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe12406fee0 0x7fe1241445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.159+0000 7fe129467700 1 -- 172.21.15.125:0/2675355995 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe118009570 con 0x7fe12415dd30 2023-10-17T06:08:00.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.159+0000 7fe128c66700 1 --2- 172.21.15.125:0/2675355995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe12406fee0 0x7fe1241445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:00.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.159+0000 7fe129467700 1 --2- 172.21.15.125:0/2675355995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe12415dd30 0x7fe1241f1f90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe11c00cc50 tx=0x7fe11c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:00.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.163+0000 7fe1217fa700 1 -- 172.21.15.125:0/2675355995 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c003c20 con 0x7fe12415dd30 2023-10-17T06:08:00.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.163+0000 7fe1217fa700 1 -- 172.21.15.125:0/2675355995 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11c003d80 con 0x7fe12415dd30 2023-10-17T06:08:00.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.163+0000 7fe1217fa700 1 -- 172.21.15.125:0/2675355995 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c00ab00 con 0x7fe12415dd30 2023-10-17T06:08:00.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.163+0000 7fe12aeca700 1 -- 172.21.15.125:0/2675355995 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1240ad3e0 con 0x7fe12415dd30 2023-10-17T06:08:00.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.163+0000 7fe12aeca700 1 -- 172.21.15.125:0/2675355995 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1240ad9a0 con 0x7fe12415dd30 2023-10-17T06:08:00.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.163+0000 7fe12aeca700 1 -- 172.21.15.125:0/2675355995 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1240ae1a0 con 0x7fe12415dd30 2023-10-17T06:08:00.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.163+0000 7fe1217fa700 1 -- 172.21.15.125:0/2675355995 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe11c00ac60 con 0x7fe12415dd30 2023-10-17T06:08:00.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.167+0000 7fe1217fa700 1 --2- 172.21.15.125:0/2675355995 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe1080656f0 0x7fe108067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:00.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.167+0000 7fe1217fa700 1 -- 172.21.15.125:0/2675355995 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe11c0831e0 con 0x7fe12415dd30 2023-10-17T06:08:00.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.167+0000 7fe128c66700 1 --2- 172.21.15.125:0/2675355995 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe1080656f0 0x7fe108067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:00.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.167+0000 7fe128c66700 1 --2- 172.21.15.125:0/2675355995 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe1080656f0 0x7fe108067bb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe1240b58c0 tx=0x7fe118008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:00.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.171+0000 7fe1217fa700 1 -- 172.21.15.125:0/2675355995 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe1240ae1a0 con 0x7fe12415dd30 2023-10-17T06:08:00.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.351+0000 7fe12aeca700 1 -- 172.21.15.125:0/2675355995 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1240ae160 con 0x7fe12415dd30 2023-10-17T06:08:00.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.355+0000 7fe1217fa700 1 -- 172.21.15.125:0/2675355995 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20252 (secure 0 0 0) 0x7fe11c050850 con 0x7fe12415dd30 2023-10-17T06:08:00.359 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:00.360 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":30,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:49.710984+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:08:00.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.359+0000 7fe12aeca700 1 -- 172.21.15.125:0/2675355995 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe1080656f0 msgr2=0x7fe108067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:00.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.359+0000 7fe12aeca700 1 --2- 172.21.15.125:0/2675355995 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe1080656f0 0x7fe108067bb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe1240b58c0 tx=0x7fe118008030 comp rx=0 tx=0).stop 2023-10-17T06:08:00.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.359+0000 7fe12aeca700 1 -- 172.21.15.125:0/2675355995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe12415dd30 msgr2=0x7fe1241f1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:00.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.359+0000 7fe12aeca700 1 --2- 172.21.15.125:0/2675355995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe12415dd30 0x7fe1241f1f90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe11c00cc50 tx=0x7fe11c00cf60 comp rx=0 tx=0).stop 2023-10-17T06:08:00.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.359+0000 7fe12aeca700 1 -- 172.21.15.125:0/2675355995 shutdown_connections 2023-10-17T06:08:00.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.359+0000 7fe12aeca700 1 --2- 172.21.15.125:0/2675355995 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe1080656f0 0x7fe108067bb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.359+0000 7fe12aeca700 1 --2- 172.21.15.125:0/2675355995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe12415dd30 0x7fe1241f1f90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.359+0000 7fe12aeca700 1 --2- 172.21.15.125:0/2675355995 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe124146800 0x7fe1241f1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.359+0000 7fe12aeca700 1 --2- 172.21.15.125:0/2675355995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe12406fee0 0x7fe1241445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.359+0000 7fe12aeca700 1 -- 172.21.15.125:0/2675355995 >> 172.21.15.125:0/2675355995 conn(0x7fe12406a130 msgr2=0x7fe1240d3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:00.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.359+0000 7fe12aeca700 1 -- 172.21.15.125:0/2675355995 shutdown_connections 2023-10-17T06:08:00.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.359+0000 7fe12aeca700 1 -- 172.21.15.125:0/2675355995 wait complete. 2023-10-17T06:08:00.389 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-17T06:07:06.629169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-17T06:07:08.148117+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-17T06:07:11.895112+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-17T06:08:00.390 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:08:00.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.575+0000 7f00b6524700 1 Processor -- start 2023-10-17T06:08:00.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.575+0000 7f00b6524700 1 -- start start 2023-10-17T06:08:00.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00b6524700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f00b01467c0 0x7f00b00b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:00.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00b6524700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b0146ba0 con 0x7f00b006f9a0 2023-10-17T06:08:00.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00b6524700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b00d0920 con 0x7f00b01612e0 2023-10-17T06:08:00.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00b6524700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b00b6160 con 0x7f00b01467c0 2023-10-17T06:08:00.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00b4ac1700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f00b006f9a0 0x7f00b00d0db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45944/0 (socket says 172.21.15.125:45944) 2023-10-17T06:08:00.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00b4ac1700 1 -- 172.21.15.125:0/3815746472 learned_addr learned my addr 172.21.15.125:0/3815746472 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:00.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00affff700 1 --2- 172.21.15.125:0/3815746472 >> v2:172.21.15.184:3300/0 conn(0x7f00b01467c0 0x7f00b00b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:00.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00af7fe700 1 -- 172.21.15.125:0/3815746472 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548785559 0 0) 0x7f00b0146ba0 con 0x7f00b006f9a0 2023-10-17T06:08:00.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00af7fe700 1 -- 172.21.15.125:0/3815746472 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f009c0035d0 con 0x7f00b006f9a0 2023-10-17T06:08:00.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00af7fe700 1 -- 172.21.15.125:0/3815746472 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3824392680 0 0) 0x7f009c0035d0 con 0x7f00b006f9a0 2023-10-17T06:08:00.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00af7fe700 1 -- 172.21.15.125:0/3815746472 >> v2:172.21.15.184:3300/0 conn(0x7f00b01467c0 msgr2=0x7f00b00b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:00.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00af7fe700 1 --2- 172.21.15.125:0/3815746472 >> v2:172.21.15.184:3300/0 conn(0x7f00b01467c0 0x7f00b00b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00af7fe700 1 -- 172.21.15.125:0/3815746472 >> v1:172.21.15.184:6789/0 conn(0x7f00b01612e0 legacy=0x7f00b015d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:00.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00af7fe700 1 -- 172.21.15.125:0/3815746472 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b00b6440 con 0x7f00b006f9a0 2023-10-17T06:08:00.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00af7fe700 1 -- 172.21.15.125:0/3815746472 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7f00a80019f0 con 0x7f00b006f9a0 2023-10-17T06:08:00.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00af7fe700 1 -- 172.21.15.125:0/3815746472 >> v1:172.21.15.125:6789/0 conn(0x7f00b006f9a0 legacy=0x7f00b00d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:00.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00af7fe700 1 --2- 172.21.15.125:0/3815746472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f009c003a90 0x7f009c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:00.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00af7fe700 1 --2- 172.21.15.125:0/3815746472 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f009c004870 0x7f009c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:00.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00af7fe700 1 --2- 172.21.15.125:0/3815746472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f009c005230 0x7f009c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:00.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00af7fe700 1 -- 172.21.15.125:0/3815746472 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00b6160 con 0x7f009c005230 2023-10-17T06:08:00.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00af7fe700 1 -- 172.21.15.125:0/3815746472 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009c00c100 con 0x7f009c003a90 2023-10-17T06:08:00.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00af7fe700 1 -- 172.21.15.125:0/3815746472 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009c00c2c0 con 0x7f009c004870 2023-10-17T06:08:00.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00b4ac1700 1 --2- 172.21.15.125:0/3815746472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f009c005230 0x7f009c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:00.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00affff700 1 --2- 172.21.15.125:0/3815746472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f009c003a90 0x7f009c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:00.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.579+0000 7f00a77fe700 1 --2- 172.21.15.125:0/3815746472 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f009c004870 0x7f009c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:00.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.583+0000 7f00b4ac1700 1 -- 172.21.15.125:0/3815746472 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f009c004870 msgr2=0x7f009c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:00.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.583+0000 7f00b4ac1700 1 --2- 172.21.15.125:0/3815746472 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f009c004870 0x7f009c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.583+0000 7f00b4ac1700 1 -- 172.21.15.125:0/3815746472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f009c003a90 msgr2=0x7f009c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:00.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.583+0000 7f00b4ac1700 1 --2- 172.21.15.125:0/3815746472 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f009c003a90 0x7f009c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.583+0000 7f00b4ac1700 1 -- 172.21.15.125:0/3815746472 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009c0035d0 con 0x7f009c005230 2023-10-17T06:08:00.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.583+0000 7f00b4ac1700 1 -- 172.21.15.125:0/3815746472 reap_dead start 2023-10-17T06:08:00.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.583+0000 7f00b4ac1700 1 --2- 172.21.15.125:0/3815746472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f009c005230 0x7f009c00ba30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f00a800a810 tx=0x7f009c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d901a65c129e99ad server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:00.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.583+0000 7f00af7fe700 1 -- 172.21.15.125:0/3815746472 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a800a250 con 0x7f009c005230 2023-10-17T06:08:00.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.583+0000 7f00af7fe700 1 -- 172.21.15.125:0/3815746472 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a80072f0 con 0x7f009c005230 2023-10-17T06:08:00.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.583+0000 7f00af7fe700 1 -- 172.21.15.125:0/3815746472 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a80076a0 con 0x7f009c005230 2023-10-17T06:08:00.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.583+0000 7f00b6524700 1 -- 172.21.15.125:0/3815746472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f009c005230 msgr2=0x7f009c00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:00.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.583+0000 7f00b6524700 1 --2- 172.21.15.125:0/3815746472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f009c005230 0x7f009c00ba30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f00a800a810 tx=0x7f009c0058a0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.583+0000 7f00b6524700 1 -- 172.21.15.125:0/3815746472 shutdown_connections 2023-10-17T06:08:00.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.583+0000 7f00b6524700 1 --2- 172.21.15.125:0/3815746472 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f009c005230 0x7f009c00ba30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.583+0000 7f00b6524700 1 -- 172.21.15.125:0/3815746472 >> 172.21.15.125:0/3815746472 conn(0x7f00b006a130 msgr2=0x7f00b006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:00.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.583+0000 7f00b6524700 1 -- 172.21.15.125:0/3815746472 shutdown_connections 2023-10-17T06:08:00.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.583+0000 7f00b6524700 1 -- 172.21.15.125:0/3815746472 wait complete. 2023-10-17T06:08:00.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.587+0000 7f00b6524700 1 Processor -- start 2023-10-17T06:08:00.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.587+0000 7f00b6524700 1 -- start start 2023-10-17T06:08:00.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.587+0000 7f00b6524700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f009c005230 0x7f00b00cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:00.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.587+0000 7f00b6524700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b015c1d0 0x7f00b015c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:00.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.587+0000 7f00b6524700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00b00c80e0 0x7f00b00c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:00.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.587+0000 7f00b6524700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b015cb90 con 0x7f009c005230 2023-10-17T06:08:00.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.587+0000 7f00b6524700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00c8e30 con 0x7f00b015c1d0 2023-10-17T06:08:00.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.587+0000 7f00b6524700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00c9110 con 0x7f00b00c80e0 2023-10-17T06:08:00.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.587+0000 7f00affff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f009c005230 0x7f00b00cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:00.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.587+0000 7f00affff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f009c005230 0x7f00b00cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52890/0 (socket says 172.21.15.125:52890) 2023-10-17T06:08:00.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.587+0000 7f00affff700 1 -- 172.21.15.125:0/216646920 learned_addr learned my addr 172.21.15.125:0/216646920 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:00.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.587+0000 7f00b4ac1700 1 --2- 172.21.15.125:0/216646920 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00b00c80e0 0x7f00b00c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:00.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.587+0000 7f00a77fe700 1 --2- 172.21.15.125:0/216646920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b015c1d0 0x7f00b015c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:00.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.591+0000 7f00affff700 1 -- 172.21.15.125:0/216646920 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00b00c80e0 msgr2=0x7f00b00c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:00.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.591+0000 7f00affff700 1 --2- 172.21.15.125:0/216646920 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00b00c80e0 0x7f00b00c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.591+0000 7f00affff700 1 -- 172.21.15.125:0/216646920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b015c1d0 msgr2=0x7f00b015c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:00.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.591+0000 7f00affff700 1 --2- 172.21.15.125:0/216646920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b015c1d0 0x7f00b015c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.591+0000 7f00affff700 1 -- 172.21.15.125:0/216646920 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b00c93f0 con 0x7f009c005230 2023-10-17T06:08:00.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.591+0000 7f00affff700 1 --2- 172.21.15.125:0/216646920 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f009c005230 0x7f00b00cce10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f00a0011980 tx=0x7f00a0011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:00.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.591+0000 7f00ad7fa700 1 -- 172.21.15.125:0/216646920 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a000f780 con 0x7f009c005230 2023-10-17T06:08:00.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.591+0000 7f00ad7fa700 1 -- 172.21.15.125:0/216646920 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a000f900 con 0x7f009c005230 2023-10-17T06:08:00.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.591+0000 7f00b6524700 1 -- 172.21.15.125:0/216646920 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b00c96d0 con 0x7f009c005230 2023-10-17T06:08:00.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.591+0000 7f00ad7fa700 1 -- 172.21.15.125:0/216646920 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a000fcb0 con 0x7f009c005230 2023-10-17T06:08:00.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.591+0000 7f00b6524700 1 -- 172.21.15.125:0/216646920 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b00c8aa0 con 0x7f009c005230 2023-10-17T06:08:00.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.591+0000 7f00b6524700 1 -- 172.21.15.125:0/216646920 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b00ca560 con 0x7f009c005230 2023-10-17T06:08:00.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.595+0000 7f00ad7fa700 1 -- 172.21.15.125:0/216646920 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f00a0014440 con 0x7f009c005230 2023-10-17T06:08:00.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.595+0000 7f00ad7fa700 1 --2- 172.21.15.125:0/216646920 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0090065720 0x7f0090067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:00.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.595+0000 7f00ad7fa700 1 -- 172.21.15.125:0/216646920 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f00a00837b0 con 0x7f009c005230 2023-10-17T06:08:00.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.595+0000 7f00a77fe700 1 --2- 172.21.15.125:0/216646920 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0090065720 0x7f0090067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:00.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.595+0000 7f00a77fe700 1 --2- 172.21.15.125:0/216646920 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0090065720 0x7f0090067be0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f00b01433c0 tx=0x7f0098009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:00.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.603+0000 7f00ad7fa700 1 -- 172.21.15.125:0/216646920 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f00a0050e30 con 0x7f009c005230 2023-10-17T06:08:00.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.783+0000 7f00b6524700 1 -- 172.21.15.125:0/216646920 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00b0072e60 con 0x7f009c005230 2023-10-17T06:08:00.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.783+0000 7f00ad7fa700 1 -- 172.21.15.125:0/216646920 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f00a0054450 con 0x7f009c005230 2023-10-17T06:08:00.786 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:08:00.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.787+0000 7f00b6524700 1 -- 172.21.15.125:0/216646920 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0090065720 msgr2=0x7f0090067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:00.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.787+0000 7f00b6524700 1 --2- 172.21.15.125:0/216646920 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0090065720 0x7f0090067be0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f00b01433c0 tx=0x7f0098009040 comp rx=0 tx=0).stop 2023-10-17T06:08:00.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.787+0000 7f00b6524700 1 -- 172.21.15.125:0/216646920 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f009c005230 msgr2=0x7f00b00cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:00.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.787+0000 7f00b6524700 1 --2- 172.21.15.125:0/216646920 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f009c005230 0x7f00b00cce10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f00a0011980 tx=0x7f00a0011c90 comp rx=0 tx=0).stop 2023-10-17T06:08:00.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.787+0000 7f00b6524700 1 -- 172.21.15.125:0/216646920 shutdown_connections 2023-10-17T06:08:00.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.787+0000 7f00b6524700 1 --2- 172.21.15.125:0/216646920 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0090065720 0x7f0090067be0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.787+0000 7f00b6524700 1 --2- 172.21.15.125:0/216646920 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00b00c80e0 0x7f00b00c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.787+0000 7f00b6524700 1 --2- 172.21.15.125:0/216646920 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00b015c1d0 0x7f00b015c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.787+0000 7f00b6524700 1 --2- 172.21.15.125:0/216646920 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f009c005230 0x7f00b00cce10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.787+0000 7f00b6524700 1 -- 172.21.15.125:0/216646920 >> 172.21.15.125:0/216646920 conn(0x7f00b006a130 msgr2=0x7f00b006d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:00.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.787+0000 7f00b6524700 1 -- 172.21.15.125:0/216646920 shutdown_connections 2023-10-17T06:08:00.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.787+0000 7f00b6524700 1 -- 172.21.15.125:0/216646920 wait complete. 2023-10-17T06:08:00.816 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:08:00.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.987+0000 7f3085777700 1 Processor -- start 2023-10-17T06:08:00.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.987+0000 7f3085777700 1 -- start start 2023-10-17T06:08:00.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.987+0000 7f3085777700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f308015adf0 0x7f30800cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:00.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.987+0000 7f3085777700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f30800cce10 0x7f30800b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:00.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.987+0000 7f3085777700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f30800b1e80 0x7f30800b2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:00.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.987+0000 7f3085777700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30800ca590 con 0x7f30800b1e80 2023-10-17T06:08:00.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.987+0000 7f3085777700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f308015b1d0 con 0x7f30800cce10 2023-10-17T06:08:00.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.987+0000 7f3085777700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30800ce600 con 0x7f308015adf0 2023-10-17T06:08:00.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.987+0000 7f307f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f30800b1e80 0x7f30800b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:00.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.987+0000 7f307e7fc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f30800cce10 0x7f30800b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:00.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.987+0000 7f307f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f30800b1e80 0x7f30800b2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52894/0 (socket says 172.21.15.125:52894) 2023-10-17T06:08:00.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.991+0000 7f307f7fe700 1 -- 172.21.15.125:0/356076035 learned_addr learned my addr 172.21.15.125:0/356076035 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:00.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.991+0000 7f307effd700 1 --2- 172.21.15.125:0/356076035 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f308015adf0 0x7f30800cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:00.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.991+0000 7f307f7fe700 1 -- 172.21.15.125:0/356076035 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f308015adf0 msgr2=0x7f30800cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:00.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.991+0000 7f307f7fe700 1 --2- 172.21.15.125:0/356076035 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f308015adf0 0x7f30800cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.991+0000 7f307f7fe700 1 -- 172.21.15.125:0/356076035 >> v2:172.21.15.184:3300/0 conn(0x7f30800cce10 msgr2=0x7f30800b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:00.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.991+0000 7f307f7fe700 1 --2- 172.21.15.125:0/356076035 >> v2:172.21.15.184:3300/0 conn(0x7f30800cce10 0x7f30800b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.991+0000 7f307f7fe700 1 -- 172.21.15.125:0/356076035 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30800cd580 con 0x7f30800b1e80 2023-10-17T06:08:00.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.991+0000 7f307f7fe700 1 --2- 172.21.15.125:0/356076035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30800b1e80 0x7f30800b2310 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f30800cf920 tx=0x7f307800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af92f30cf2e147c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:00.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.991+0000 7f307dffb700 1 -- 172.21.15.125:0/356076035 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307800e070 con 0x7f30800b1e80 2023-10-17T06:08:00.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.991+0000 7f307dffb700 1 -- 172.21.15.125:0/356076035 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307800b910 con 0x7f30800b1e80 2023-10-17T06:08:00.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.991+0000 7f307dffb700 1 -- 172.21.15.125:0/356076035 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307800bcc0 con 0x7f30800b1e80 2023-10-17T06:08:00.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.991+0000 7f3085777700 1 -- 172.21.15.125:0/356076035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30800b1e80 msgr2=0x7f30800b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:00.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.991+0000 7f3085777700 1 --2- 172.21.15.125:0/356076035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30800b1e80 0x7f30800b2310 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f30800cf920 tx=0x7f307800b330 comp rx=0 tx=0).stop 2023-10-17T06:08:00.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.991+0000 7f3085777700 1 -- 172.21.15.125:0/356076035 shutdown_connections 2023-10-17T06:08:00.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.991+0000 7f3085777700 1 --2- 172.21.15.125:0/356076035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30800b1e80 0x7f30800b2310 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.991+0000 7f3085777700 1 --2- 172.21.15.125:0/356076035 >> v2:172.21.15.184:3300/0 conn(0x7f30800cce10 0x7f30800b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.991+0000 7f3085777700 1 --2- 172.21.15.125:0/356076035 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f308015adf0 0x7f30800cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:00.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.991+0000 7f3085777700 1 -- 172.21.15.125:0/356076035 >> 172.21.15.125:0/356076035 conn(0x7f30800ce820 msgr2=0x7f30800cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:00.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.991+0000 7f3085777700 1 -- 172.21.15.125:0/356076035 shutdown_connections 2023-10-17T06:08:00.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.991+0000 7f3085777700 1 -- 172.21.15.125:0/356076035 wait complete. 2023-10-17T06:08:01.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.995+0000 7f3085777700 1 Processor -- start 2023-10-17T06:08:01.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.995+0000 7f3085777700 1 -- start start 2023-10-17T06:08:01.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.995+0000 7f3085777700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30800b1e80 0x7f3080158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:01.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.995+0000 7f3085777700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30800cce10 0x7f308006e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:01.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.995+0000 7f3085777700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f308015adf0 0x7f30800af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:01.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.995+0000 7f3085777700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308015e3c0 con 0x7f30800cce10 2023-10-17T06:08:01.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.995+0000 7f3085777700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308015d5f0 con 0x7f308015adf0 2023-10-17T06:08:01.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.995+0000 7f3085777700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308015d840 con 0x7f30800b1e80 2023-10-17T06:08:01.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.995+0000 7f307e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30800cce10 0x7f308006e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:01.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.995+0000 7f307e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30800cce10 0x7f308006e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52906/0 (socket says 172.21.15.125:52906) 2023-10-17T06:08:01.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.995+0000 7f307e7fc700 1 -- 172.21.15.125:0/1231861951 learned_addr learned my addr 172.21.15.125:0/1231861951 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:01.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.995+0000 7f307f7fe700 1 --2- 172.21.15.125:0/1231861951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f308015adf0 0x7f30800af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:01.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.995+0000 7f307effd700 1 --2- 172.21.15.125:0/1231861951 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30800b1e80 0x7f3080158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:01.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.995+0000 7f307e7fc700 1 -- 172.21.15.125:0/1231861951 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30800b1e80 msgr2=0x7f3080158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:01.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.995+0000 7f307e7fc700 1 --2- 172.21.15.125:0/1231861951 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30800b1e80 0x7f3080158170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:01.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.995+0000 7f307e7fc700 1 -- 172.21.15.125:0/1231861951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f308015adf0 msgr2=0x7f30800af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:01.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.995+0000 7f307e7fc700 1 --2- 172.21.15.125:0/1231861951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f308015adf0 0x7f30800af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:01.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.995+0000 7f307e7fc700 1 -- 172.21.15.125:0/1231861951 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3078009b30 con 0x7f30800cce10 2023-10-17T06:08:01.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.995+0000 7f307e7fc700 1 --2- 172.21.15.125:0/1231861951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30800cce10 0x7f308006e120 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f307400e940 tx=0x7f307400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:01.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.999+0000 7f30677fe700 1 -- 172.21.15.125:0/1231861951 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30740096a0 con 0x7f30800cce10 2023-10-17T06:08:01.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.999+0000 7f30677fe700 1 -- 172.21.15.125:0/1231861951 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307400c850 con 0x7f30800cce10 2023-10-17T06:08:01.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.999+0000 7f30677fe700 1 -- 172.21.15.125:0/1231861951 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307400cbe0 con 0x7f30800cce10 2023-10-17T06:08:01.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.999+0000 7f3085777700 1 -- 172.21.15.125:0/1231861951 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f308015db20 con 0x7f30800cce10 2023-10-17T06:08:01.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.999+0000 7f3085777700 1 -- 172.21.15.125:0/1231861951 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f308015e0e0 con 0x7f30800cce10 2023-10-17T06:08:01.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.999+0000 7f3085777700 1 -- 172.21.15.125:0/1231861951 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30800cc210 con 0x7f30800cce10 2023-10-17T06:08:01.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:00.999+0000 7f30677fe700 1 -- 172.21.15.125:0/1231861951 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f307400cd40 con 0x7f30800cce10 2023-10-17T06:08:01.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.003+0000 7f30677fe700 1 --2- 172.21.15.125:0/1231861951 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f306c0656f0 0x7f306c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:01.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.003+0000 7f30677fe700 1 -- 172.21.15.125:0/1231861951 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3074083120 con 0x7f30800cce10 2023-10-17T06:08:01.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.003+0000 7f307effd700 1 --2- 172.21.15.125:0/1231861951 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f306c0656f0 0x7f306c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:01.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.003+0000 7f307effd700 1 --2- 172.21.15.125:0/1231861951 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f306c0656f0 0x7f306c067bb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f30800c5150 tx=0x7f3070008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:01.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.011+0000 7f30677fe700 1 -- 172.21.15.125:0/1231861951 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f30740543d0 con 0x7f30800cce10 2023-10-17T06:08:01.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.191+0000 7f3085777700 1 -- 172.21.15.125:0/1231861951 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3080072e60 con 0x7f30800cce10 2023-10-17T06:08:01.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.191+0000 7f30677fe700 1 -- 172.21.15.125:0/1231861951 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3074053f60 con 0x7f30800cce10 2023-10-17T06:08:01.196 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:08:01.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.195+0000 7f3085777700 1 -- 172.21.15.125:0/1231861951 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f306c0656f0 msgr2=0x7f306c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:01.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.195+0000 7f3085777700 1 --2- 172.21.15.125:0/1231861951 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f306c0656f0 0x7f306c067bb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f30800c5150 tx=0x7f3070008040 comp rx=0 tx=0).stop 2023-10-17T06:08:01.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.195+0000 7f3085777700 1 -- 172.21.15.125:0/1231861951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30800cce10 msgr2=0x7f308006e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:01.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.195+0000 7f3085777700 1 --2- 172.21.15.125:0/1231861951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30800cce10 0x7f308006e120 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f307400e940 tx=0x7f307400ed00 comp rx=0 tx=0).stop 2023-10-17T06:08:01.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.195+0000 7f3085777700 1 -- 172.21.15.125:0/1231861951 shutdown_connections 2023-10-17T06:08:01.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.195+0000 7f3085777700 1 --2- 172.21.15.125:0/1231861951 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f306c0656f0 0x7f306c067bb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:01.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.195+0000 7f3085777700 1 --2- 172.21.15.125:0/1231861951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f308015adf0 0x7f30800af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:01.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.195+0000 7f3085777700 1 --2- 172.21.15.125:0/1231861951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30800cce10 0x7f308006e120 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:01.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.195+0000 7f3085777700 1 --2- 172.21.15.125:0/1231861951 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f30800b1e80 0x7f3080158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:01.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.195+0000 7f3085777700 1 -- 172.21.15.125:0/1231861951 >> 172.21.15.125:0/1231861951 conn(0x7f30800ce820 msgr2=0x7f3080159eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:01.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.195+0000 7f3085777700 1 -- 172.21.15.125:0/1231861951 shutdown_connections 2023-10-17T06:08:01.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.195+0000 7f3085777700 1 -- 172.21.15.125:0/1231861951 wait complete. 2023-10-17T06:08:01.223 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-17T06:08:01.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.403+0000 7f27309a0700 1 Processor -- start 2023-10-17T06:08:01.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.403+0000 7f27309a0700 1 -- start start 2023-10-17T06:08:01.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.407+0000 7f27309a0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f272c0c1e30 0x7f272c06f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:01.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.407+0000 7f27309a0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272c0cc3f0 con 0x7f272c0cad50 2023-10-17T06:08:01.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.407+0000 7f27309a0700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272c06e080 con 0x7f272c06ec20 2023-10-17T06:08:01.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.407+0000 7f27309a0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272c0c2210 con 0x7f272c0c1e30 2023-10-17T06:08:01.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.407+0000 7f272a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f272c0c1e30 0x7f272c06f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:01.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.407+0000 7f272a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f272c0c1e30 0x7f272c06f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52908/0 (socket says 172.21.15.125:52908) 2023-10-17T06:08:01.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.407+0000 7f272a59c700 1 -- 172.21.15.125:0/3811821479 learned_addr learned my addr 172.21.15.125:0/3811821479 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:01.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.407+0000 7f2729d9b700 1 --1- 172.21.15.125:0/3811821479 >> v1:172.21.15.125:6789/0 conn(0x7f272c0cad50 0x7f272c06e510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45946/0 (socket says 172.21.15.125:45946) 2023-10-17T06:08:01.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.407+0000 7f272a59c700 1 -- 172.21.15.125:0/3811821479 >> v1:172.21.15.184:6789/0 conn(0x7f272c06ec20 legacy=0x7f272c0c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:01.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.407+0000 7f272a59c700 1 -- 172.21.15.125:0/3811821479 >> v1:172.21.15.125:6789/0 conn(0x7f272c0cad50 legacy=0x7f272c06e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:01.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.407+0000 7f272a59c700 1 -- 172.21.15.125:0/3811821479 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c06f0b0 con 0x7f272c0c1e30 2023-10-17T06:08:01.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.407+0000 7f272a59c700 1 --2- 172.21.15.125:0/3811821479 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f272c0c1e30 0x7f272c06f450 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f271c009910 tx=0x7f271c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389f7f76fc557ac7 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:01.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.407+0000 7f272959a700 1 -- 172.21.15.125:0/3811821479 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c004230 con 0x7f272c0c1e30 2023-10-17T06:08:01.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.407+0000 7f272959a700 1 -- 172.21.15.125:0/3811821479 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c004390 con 0x7f272c0c1e30 2023-10-17T06:08:01.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.407+0000 7f272959a700 1 -- 172.21.15.125:0/3811821479 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c009e60 con 0x7f272c0c1e30 2023-10-17T06:08:01.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.411+0000 7f27309a0700 1 -- 172.21.15.125:0/3811821479 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f272c0c1e30 msgr2=0x7f272c06f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:01.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.411+0000 7f27309a0700 1 --2- 172.21.15.125:0/3811821479 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f272c0c1e30 0x7f272c06f450 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f271c009910 tx=0x7f271c009c20 comp rx=0 tx=0).stop 2023-10-17T06:08:01.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.411+0000 7f27309a0700 1 -- 172.21.15.125:0/3811821479 shutdown_connections 2023-10-17T06:08:01.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.411+0000 7f27309a0700 1 --2- 172.21.15.125:0/3811821479 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f272c0c1e30 0x7f272c06f450 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:01.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.411+0000 7f27309a0700 1 -- 172.21.15.125:0/3811821479 >> 172.21.15.125:0/3811821479 conn(0x7f272c0ce820 msgr2=0x7f272c0cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:01.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.411+0000 7f27309a0700 1 -- 172.21.15.125:0/3811821479 shutdown_connections 2023-10-17T06:08:01.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.411+0000 7f27309a0700 1 -- 172.21.15.125:0/3811821479 wait complete. 2023-10-17T06:08:01.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.415+0000 7f27309a0700 1 Processor -- start 2023-10-17T06:08:01.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.415+0000 7f27309a0700 1 -- start start 2023-10-17T06:08:01.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.415+0000 7f27309a0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f272c06ec20 0x7f272c150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:01.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.415+0000 7f27309a0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f272c0c1e30 0x7f272c14d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:01.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.415+0000 7f27309a0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f272c0cad50 0x7f272c0b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:01.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.415+0000 7f27309a0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c14ea70 con 0x7f272c0cad50 2023-10-17T06:08:01.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.415+0000 7f27309a0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c1510f0 con 0x7f272c06ec20 2023-10-17T06:08:01.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.415+0000 7f27309a0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c1e6890 con 0x7f272c0c1e30 2023-10-17T06:08:01.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.415+0000 7f272ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f272c0cad50 0x7f272c0b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:01.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.415+0000 7f272ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f272c0cad50 0x7f272c0b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52922/0 (socket says 172.21.15.125:52922) 2023-10-17T06:08:01.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.415+0000 7f272ad9d700 1 -- 172.21.15.125:0/1026678730 learned_addr learned my addr 172.21.15.125:0/1026678730 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:01.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.415+0000 7f272a59c700 1 --2- 172.21.15.125:0/1026678730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f272c06ec20 0x7f272c150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:01.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.415+0000 7f2729d9b700 1 --2- 172.21.15.125:0/1026678730 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f272c0c1e30 0x7f272c14d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:01.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.415+0000 7f272ad9d700 1 -- 172.21.15.125:0/1026678730 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f272c0c1e30 msgr2=0x7f272c14d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:01.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.415+0000 7f272ad9d700 1 --2- 172.21.15.125:0/1026678730 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f272c0c1e30 0x7f272c14d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:01.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.415+0000 7f272ad9d700 1 -- 172.21.15.125:0/1026678730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f272c06ec20 msgr2=0x7f272c150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:01.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.415+0000 7f272ad9d700 1 --2- 172.21.15.125:0/1026678730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f272c06ec20 0x7f272c150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:01.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.415+0000 7f272ad9d700 1 -- 172.21.15.125:0/1026678730 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c009570 con 0x7f272c0cad50 2023-10-17T06:08:01.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.415+0000 7f272ad9d700 1 --2- 172.21.15.125:0/1026678730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f272c0cad50 0x7f272c0b3530 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f272400cc10 tx=0x7f272400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:01.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.415+0000 7f271affd700 1 -- 172.21.15.125:0/1026678730 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272400ab10 con 0x7f272c0cad50 2023-10-17T06:08:01.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.419+0000 7f27309a0700 1 -- 172.21.15.125:0/1026678730 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272c14e140 con 0x7f272c0cad50 2023-10-17T06:08:01.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.419+0000 7f271affd700 1 -- 172.21.15.125:0/1026678730 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272400ac70 con 0x7f272c0cad50 2023-10-17T06:08:01.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.419+0000 7f271affd700 1 -- 172.21.15.125:0/1026678730 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724012420 con 0x7f272c0cad50 2023-10-17T06:08:01.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.419+0000 7f27309a0700 1 -- 172.21.15.125:0/1026678730 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c14e700 con 0x7f272c0cad50 2023-10-17T06:08:01.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.419+0000 7f27309a0700 1 -- 172.21.15.125:0/1026678730 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272c154500 con 0x7f272c0cad50 2023-10-17T06:08:01.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.419+0000 7f271affd700 1 -- 172.21.15.125:0/1026678730 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2724012580 con 0x7f272c0cad50 2023-10-17T06:08:01.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.423+0000 7f271affd700 1 --2- 172.21.15.125:0/1026678730 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f270c0656f0 0x7f270c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:01.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.423+0000 7f271affd700 1 -- 172.21.15.125:0/1026678730 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2724083680 con 0x7f272c0cad50 2023-10-17T06:08:01.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.423+0000 7f272a59c700 1 --2- 172.21.15.125:0/1026678730 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f270c0656f0 0x7f270c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:01.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.423+0000 7f272a59c700 1 --2- 172.21.15.125:0/1026678730 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f270c0656f0 0x7f270c067bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f271c009910 tx=0x7f271c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:01.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.427+0000 7f271affd700 1 -- 172.21.15.125:0/1026678730 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f27240546f0 con 0x7f272c0cad50 2023-10-17T06:08:01.449 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:08:01.456 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:08:01.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.667+0000 7f27309a0700 1 -- 172.21.15.125:0/1026678730 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f272c072e60 con 0x7f272c0cad50 2023-10-17T06:08:01.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.667+0000 7f271affd700 1 -- 172.21.15.125:0/1026678730 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2724054280 con 0x7f272c0cad50 2023-10-17T06:08:01.672 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:01.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.675+0000 7f27309a0700 1 -- 172.21.15.125:0/1026678730 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f270c0656f0 msgr2=0x7f270c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:01.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.675+0000 7f27309a0700 1 --2- 172.21.15.125:0/1026678730 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f270c0656f0 0x7f270c067bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f271c009910 tx=0x7f271c008030 comp rx=0 tx=0).stop 2023-10-17T06:08:01.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.675+0000 7f27309a0700 1 -- 172.21.15.125:0/1026678730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f272c0cad50 msgr2=0x7f272c0b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:01.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.675+0000 7f27309a0700 1 --2- 172.21.15.125:0/1026678730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f272c0cad50 0x7f272c0b3530 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f272400cc10 tx=0x7f272400cf20 comp rx=0 tx=0).stop 2023-10-17T06:08:01.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.675+0000 7f27309a0700 1 -- 172.21.15.125:0/1026678730 shutdown_connections 2023-10-17T06:08:01.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.675+0000 7f27309a0700 1 --2- 172.21.15.125:0/1026678730 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f270c0656f0 0x7f270c067bb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:01.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.675+0000 7f27309a0700 1 --2- 172.21.15.125:0/1026678730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f272c0cad50 0x7f272c0b3530 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:01.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.675+0000 7f27309a0700 1 --2- 172.21.15.125:0/1026678730 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f272c0c1e30 0x7f272c14d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:01.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.675+0000 7f27309a0700 1 --2- 172.21.15.125:0/1026678730 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f272c06ec20 0x7f272c150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:01.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.675+0000 7f27309a0700 1 -- 172.21.15.125:0/1026678730 >> 172.21.15.125:0/1026678730 conn(0x7f272c0ce820 msgr2=0x7f272c0c4860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:01.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.675+0000 7f27309a0700 1 -- 172.21.15.125:0/1026678730 shutdown_connections 2023-10-17T06:08:01.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.675+0000 7f27309a0700 1 -- 172.21.15.125:0/1026678730 wait complete. 2023-10-17T06:08:01.701 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-17T06:08:01.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.867+0000 7f62eebe8700 1 Processor -- start 2023-10-17T06:08:01.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.867+0000 7f62eebe8700 1 -- start start 2023-10-17T06:08:01.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.871+0000 7f62eebe8700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f62e81467c0 0x7f62e80b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:01.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.871+0000 7f62eebe8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f62e806f9a0 0x7f62e806fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:01.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.871+0000 7f62eebe8700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e8146ba0 con 0x7f62e81612e0 2023-10-17T06:08:01.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.871+0000 7f62eebe8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e80d0920 con 0x7f62e806f9a0 2023-10-17T06:08:01.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.871+0000 7f62eebe8700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e8070320 con 0x7f62e81467c0 2023-10-17T06:08:01.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.871+0000 7f62ed185700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f62e806f9a0 0x7f62e806fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:01.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.871+0000 7f62ed185700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f62e806f9a0 0x7f62e806fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52938/0 (socket says 172.21.15.125:52938) 2023-10-17T06:08:01.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.871+0000 7f62ed185700 1 -- 172.21.15.125:0/4020191635 learned_addr learned my addr 172.21.15.125:0/4020191635 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:01.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.875+0000 7f62ec984700 1 --2- 172.21.15.125:0/4020191635 >> v2:172.21.15.184:3300/0 conn(0x7f62e81467c0 0x7f62e80b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:01.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.875+0000 7f62ed185700 1 -- 172.21.15.125:0/4020191635 >> v2:172.21.15.184:3300/0 conn(0x7f62e81467c0 msgr2=0x7f62e80b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:01.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.875+0000 7f62ed185700 1 --2- 172.21.15.125:0/4020191635 >> v2:172.21.15.184:3300/0 conn(0x7f62e81467c0 0x7f62e80b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:01.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.875+0000 7f62ed185700 1 -- 172.21.15.125:0/4020191635 >> v1:172.21.15.184:6789/0 conn(0x7f62e81612e0 legacy=0x7f62e815d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:01.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.875+0000 7f62ed185700 1 -- 172.21.15.125:0/4020191635 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e80b6160 con 0x7f62e806f9a0 2023-10-17T06:08:01.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.875+0000 7f62ed185700 1 --2- 172.21.15.125:0/4020191635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62e806f9a0 0x7f62e806fde0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f62e80b6f30 tx=0x7f62e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c96506a6ece0b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:01.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.875+0000 7f62e77fe700 1 -- 172.21.15.125:0/4020191635 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e000e070 con 0x7f62e806f9a0 2023-10-17T06:08:01.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.875+0000 7f62e77fe700 1 -- 172.21.15.125:0/4020191635 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e000b910 con 0x7f62e806f9a0 2023-10-17T06:08:01.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.875+0000 7f62e77fe700 1 -- 172.21.15.125:0/4020191635 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e000bcc0 con 0x7f62e806f9a0 2023-10-17T06:08:01.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.875+0000 7f62eebe8700 1 -- 172.21.15.125:0/4020191635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62e806f9a0 msgr2=0x7f62e806fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:01.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.875+0000 7f62eebe8700 1 --2- 172.21.15.125:0/4020191635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62e806f9a0 0x7f62e806fde0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f62e80b6f30 tx=0x7f62e000b330 comp rx=0 tx=0).stop 2023-10-17T06:08:01.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.875+0000 7f62eebe8700 1 -- 172.21.15.125:0/4020191635 shutdown_connections 2023-10-17T06:08:01.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.875+0000 7f62eebe8700 1 --2- 172.21.15.125:0/4020191635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62e806f9a0 0x7f62e806fde0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:01.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.875+0000 7f62eebe8700 1 --2- 172.21.15.125:0/4020191635 >> v2:172.21.15.184:3300/0 conn(0x7f62e81467c0 0x7f62e80b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:01.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.875+0000 7f62eebe8700 1 -- 172.21.15.125:0/4020191635 >> 172.21.15.125:0/4020191635 conn(0x7f62e806a130 msgr2=0x7f62e806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:01.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.875+0000 7f62eebe8700 1 -- 172.21.15.125:0/4020191635 shutdown_connections 2023-10-17T06:08:01.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.875+0000 7f62eebe8700 1 -- 172.21.15.125:0/4020191635 wait complete. 2023-10-17T06:08:01.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62eebe8700 1 Processor -- start 2023-10-17T06:08:01.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62eebe8700 1 -- start start 2023-10-17T06:08:01.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62eebe8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62e806f9a0 0x7f62e815c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:01.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62eebe8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62e81467c0 0x7f62e8144b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:01.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62eebe8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62e81612e0 0x7f62e81f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:01.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62eebe8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e815c910 con 0x7f62e81612e0 2023-10-17T06:08:01.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62eebe8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e8145070 con 0x7f62e806f9a0 2023-10-17T06:08:01.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62eebe8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e813c580 con 0x7f62e81467c0 2023-10-17T06:08:01.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62ed185700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62e81612e0 0x7f62e81f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:01.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62ed185700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62e81612e0 0x7f62e81f2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52944/0 (socket says 172.21.15.125:52944) 2023-10-17T06:08:01.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62ed185700 1 -- 172.21.15.125:0/678331225 learned_addr learned my addr 172.21.15.125:0/678331225 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:01.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62e7fff700 1 --2- 172.21.15.125:0/678331225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62e81467c0 0x7f62e8144b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:01.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62ec984700 1 --2- 172.21.15.125:0/678331225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62e806f9a0 0x7f62e815c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:01.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62ed185700 1 -- 172.21.15.125:0/678331225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62e81467c0 msgr2=0x7f62e8144b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:01.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62ed185700 1 --2- 172.21.15.125:0/678331225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62e81467c0 0x7f62e8144b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:01.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62ed185700 1 -- 172.21.15.125:0/678331225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62e806f9a0 msgr2=0x7f62e815c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:01.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62ed185700 1 --2- 172.21.15.125:0/678331225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62e806f9a0 0x7f62e815c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:01.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62ed185700 1 -- 172.21.15.125:0/678331225 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e0009b30 con 0x7f62e81612e0 2023-10-17T06:08:01.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62ec984700 1 --2- 172.21.15.125:0/678331225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62e806f9a0 0x7f62e815c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:01.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62ed185700 1 --2- 172.21.15.125:0/678331225 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62e81612e0 0x7f62e81f2580 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f62e8070690 tx=0x7f62e0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:01.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.879+0000 7f62e57fa700 1 -- 172.21.15.125:0/678331225 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e0004930 con 0x7f62e81612e0 2023-10-17T06:08:01.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.883+0000 7f62e57fa700 1 -- 172.21.15.125:0/678331225 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e00092e0 con 0x7f62e81612e0 2023-10-17T06:08:01.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.883+0000 7f62e57fa700 1 -- 172.21.15.125:0/678331225 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e001c660 con 0x7f62e81612e0 2023-10-17T06:08:01.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.883+0000 7f62eebe8700 1 -- 172.21.15.125:0/678331225 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e813c860 con 0x7f62e81612e0 2023-10-17T06:08:01.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.883+0000 7f62eebe8700 1 -- 172.21.15.125:0/678331225 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e813ce20 con 0x7f62e81612e0 2023-10-17T06:08:01.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.883+0000 7f62eebe8700 1 -- 172.21.15.125:0/678331225 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e8072e60 con 0x7f62e81612e0 2023-10-17T06:08:01.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.887+0000 7f62e57fa700 1 -- 172.21.15.125:0/678331225 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f62e001c7c0 con 0x7f62e81612e0 2023-10-17T06:08:01.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.887+0000 7f62e57fa700 1 --2- 172.21.15.125:0/678331225 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f62cc0656f0 0x7f62cc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:01.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.887+0000 7f62e57fa700 1 -- 172.21.15.125:0/678331225 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f62e0084ac0 con 0x7f62e81612e0 2023-10-17T06:08:01.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.887+0000 7f62ec984700 1 --2- 172.21.15.125:0/678331225 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f62cc0656f0 0x7f62cc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:01.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.891+0000 7f62ec984700 1 --2- 172.21.15.125:0/678331225 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f62cc0656f0 0x7f62cc067bb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009c40 tx=0x7f62dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:01.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:01.895+0000 7f62e57fa700 1 -- 172.21.15.125:0/678331225 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f62e0052240 con 0x7f62e81612e0 2023-10-17T06:08:02.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.067+0000 7f62eebe8700 1 -- 172.21.15.125:0/678331225 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f62e8060c90 con 0x7f62e81612e0 2023-10-17T06:08:02.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.067+0000 7f62e57fa700 1 -- 172.21.15.125:0/678331225 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f62e0055860 con 0x7f62e81612e0 2023-10-17T06:08:02.070 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-17T06:08:02.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.071+0000 7f62eebe8700 1 -- 172.21.15.125:0/678331225 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f62cc0656f0 msgr2=0x7f62cc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:02.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.071+0000 7f62eebe8700 1 --2- 172.21.15.125:0/678331225 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f62cc0656f0 0x7f62cc067bb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009c40 tx=0x7f62dc008040 comp rx=0 tx=0).stop 2023-10-17T06:08:02.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.071+0000 7f62eebe8700 1 -- 172.21.15.125:0/678331225 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62e81612e0 msgr2=0x7f62e81f2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:02.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.071+0000 7f62eebe8700 1 --2- 172.21.15.125:0/678331225 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62e81612e0 0x7f62e81f2580 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f62e8070690 tx=0x7f62e0004af0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.071+0000 7f62eebe8700 1 -- 172.21.15.125:0/678331225 shutdown_connections 2023-10-17T06:08:02.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.071+0000 7f62eebe8700 1 --2- 172.21.15.125:0/678331225 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f62cc0656f0 0x7f62cc067bb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.071+0000 7f62eebe8700 1 --2- 172.21.15.125:0/678331225 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62e81612e0 0x7f62e81f2580 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.071+0000 7f62eebe8700 1 --2- 172.21.15.125:0/678331225 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62e81467c0 0x7f62e8144b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.071+0000 7f62eebe8700 1 --2- 172.21.15.125:0/678331225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62e806f9a0 0x7f62e815c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.071+0000 7f62eebe8700 1 -- 172.21.15.125:0/678331225 >> 172.21.15.125:0/678331225 conn(0x7f62e806a130 msgr2=0x7f62e815d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:02.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.071+0000 7f62eebe8700 1 -- 172.21.15.125:0/678331225 shutdown_connections 2023-10-17T06:08:02.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.071+0000 7f62eebe8700 1 -- 172.21.15.125:0/678331225 wait complete. 2023-10-17T06:08:02.098 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-17T06:08:02.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.275+0000 7f705b59e700 1 Processor -- start 2023-10-17T06:08:02.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.275+0000 7f705b59e700 1 -- start start 2023-10-17T06:08:02.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.279+0000 7f705b59e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f705c0d2e00 0x7f705c0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:02.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.279+0000 7f705b59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f705c160710 0x7f705c0d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:02.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.279+0000 7f705b59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f705c0b5ae0 0x7f705c06db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:02.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.279+0000 7f705b59e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705c15df90 con 0x7f705c0d2e00 2023-10-17T06:08:02.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.279+0000 7f705b59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f705c15d0d0 con 0x7f705c160710 2023-10-17T06:08:02.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.279+0000 7f705b59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c06f0f0 con 0x7f705c0b5ae0 2023-10-17T06:08:02.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.279+0000 7f705a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f705c0d2e00 0x7f705c0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:02.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.279+0000 7f705a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f705c0d2e00 0x7f705c0b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52946/0 (socket says 172.21.15.125:52946) 2023-10-17T06:08:02.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.279+0000 7f705a59c700 1 -- 172.21.15.125:0/1322713628 learned_addr learned my addr 172.21.15.125:0/1322713628 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:02.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.279+0000 7f7059d9b700 1 --2- 172.21.15.125:0/1322713628 >> v2:172.21.15.184:3300/0 conn(0x7f705c160710 0x7f705c0d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:02.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.279+0000 7f705ad9d700 1 --2- 172.21.15.125:0/1322713628 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f705c0b5ae0 0x7f705c06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:02.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.279+0000 7f705a59c700 1 -- 172.21.15.125:0/1322713628 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f705c0b5ae0 msgr2=0x7f705c06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:02.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.279+0000 7f705a59c700 1 --2- 172.21.15.125:0/1322713628 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f705c0b5ae0 0x7f705c06db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.279+0000 7f705a59c700 1 -- 172.21.15.125:0/1322713628 >> v2:172.21.15.184:3300/0 conn(0x7f705c160710 msgr2=0x7f705c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:02.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.279+0000 7f705a59c700 1 --2- 172.21.15.125:0/1322713628 >> v2:172.21.15.184:3300/0 conn(0x7f705c160710 0x7f705c0d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.279+0000 7f705a59c700 1 -- 172.21.15.125:0/1322713628 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c0d3720 con 0x7f705c0d2e00 2023-10-17T06:08:02.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.279+0000 7f7059d9b700 1 --2- 172.21.15.125:0/1322713628 >> v2:172.21.15.184:3300/0 conn(0x7f705c160710 0x7f705c0d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:08:02.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.279+0000 7f705a59c700 1 --2- 172.21.15.125:0/1322713628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f705c0d2e00 0x7f705c0b6e00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f705c0d2420 tx=0x7f704c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbc8e07c12fe6e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:02.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.283+0000 7f705959a700 1 -- 172.21.15.125:0/1322713628 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c011830 con 0x7f705c0d2e00 2023-10-17T06:08:02.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.283+0000 7f705959a700 1 -- 172.21.15.125:0/1322713628 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704c011990 con 0x7f705c0d2e00 2023-10-17T06:08:02.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.283+0000 7f705959a700 1 -- 172.21.15.125:0/1322713628 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c011d20 con 0x7f705c0d2e00 2023-10-17T06:08:02.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.283+0000 7f705b59e700 1 -- 172.21.15.125:0/1322713628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f705c0d2e00 msgr2=0x7f705c0b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:02.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.283+0000 7f705b59e700 1 --2- 172.21.15.125:0/1322713628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f705c0d2e00 0x7f705c0b6e00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f705c0d2420 tx=0x7f704c009bf0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.283+0000 7f705b59e700 1 -- 172.21.15.125:0/1322713628 shutdown_connections 2023-10-17T06:08:02.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.283+0000 7f705b59e700 1 --2- 172.21.15.125:0/1322713628 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f705c0b5ae0 0x7f705c06db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.283+0000 7f705b59e700 1 --2- 172.21.15.125:0/1322713628 >> v2:172.21.15.184:3300/0 conn(0x7f705c160710 0x7f705c0d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.283+0000 7f705b59e700 1 --2- 172.21.15.125:0/1322713628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f705c0d2e00 0x7f705c0b6e00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.283+0000 7f705b59e700 1 -- 172.21.15.125:0/1322713628 >> 172.21.15.125:0/1322713628 conn(0x7f705c069f20 msgr2=0x7f705c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:02.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.283+0000 7f705b59e700 1 -- 172.21.15.125:0/1322713628 shutdown_connections 2023-10-17T06:08:02.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.283+0000 7f705b59e700 1 -- 172.21.15.125:0/1322713628 wait complete. 2023-10-17T06:08:02.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.283+0000 7f705b59e700 1 Processor -- start 2023-10-17T06:08:02.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f705b59e700 1 -- start start 2023-10-17T06:08:02.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f705b59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f705c0b5ae0 0x7f705c14e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:02.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f705b59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f705c0d2e00 0x7f705c0b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:02.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f705b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f705c160710 0x7f705c0b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:02.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f705b59e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c14f750 con 0x7f705c160710 2023-10-17T06:08:02.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f705b59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705c14e890 con 0x7f705c0d2e00 2023-10-17T06:08:02.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f705b59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705c14eb40 con 0x7f705c0b5ae0 2023-10-17T06:08:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f705ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f705c160710 0x7f705c0b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f705ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f705c160710 0x7f705c0b1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52950/0 (socket says 172.21.15.125:52950) 2023-10-17T06:08:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f705ad9d700 1 -- 172.21.15.125:0/1521841932 learned_addr learned my addr 172.21.15.125:0/1521841932 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:02.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f705a59c700 1 --2- 172.21.15.125:0/1521841932 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f705c0b5ae0 0x7f705c14e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:02.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f7059d9b700 1 --2- 172.21.15.125:0/1521841932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f705c0d2e00 0x7f705c0b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:02.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f705ad9d700 1 -- 172.21.15.125:0/1521841932 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f705c0b5ae0 msgr2=0x7f705c14e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:02.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f705ad9d700 1 --2- 172.21.15.125:0/1521841932 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f705c0b5ae0 0x7f705c14e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f705ad9d700 1 -- 172.21.15.125:0/1521841932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f705c0d2e00 msgr2=0x7f705c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:02.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f705ad9d700 1 --2- 172.21.15.125:0/1521841932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f705c0d2e00 0x7f705c0b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f705ad9d700 1 -- 172.21.15.125:0/1521841932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70500094b0 con 0x7f705c160710 2023-10-17T06:08:02.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f705ad9d700 1 --2- 172.21.15.125:0/1521841932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f705c160710 0x7f705c0b1270 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f705400eed0 tx=0x7f705400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:02.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f704affd700 1 -- 172.21.15.125:0/1521841932 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054010040 con 0x7f705c160710 2023-10-17T06:08:02.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f704affd700 1 -- 172.21.15.125:0/1521841932 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705400b9f0 con 0x7f705c160710 2023-10-17T06:08:02.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f705b59e700 1 -- 172.21.15.125:0/1521841932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f704c009570 con 0x7f705c160710 2023-10-17T06:08:02.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f704affd700 1 -- 172.21.15.125:0/1521841932 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705400bda0 con 0x7f705c160710 2023-10-17T06:08:02.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.287+0000 7f705b59e700 1 -- 172.21.15.125:0/1521841932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f705c14f100 con 0x7f705c160710 2023-10-17T06:08:02.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.291+0000 7f705b59e700 1 -- 172.21.15.125:0/1521841932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f705c14f8c0 con 0x7f705c160710 2023-10-17T06:08:02.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.291+0000 7f704affd700 1 -- 172.21.15.125:0/1521841932 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7054014400 con 0x7f705c160710 2023-10-17T06:08:02.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.295+0000 7f704affd700 1 --2- 172.21.15.125:0/1521841932 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f703c0656f0 0x7f703c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:02.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.295+0000 7f704affd700 1 -- 172.21.15.125:0/1521841932 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7054006e40 con 0x7f705c160710 2023-10-17T06:08:02.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.295+0000 7f705a59c700 1 --2- 172.21.15.125:0/1521841932 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f703c0656f0 0x7f703c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:02.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.295+0000 7f705a59c700 1 --2- 172.21.15.125:0/1521841932 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f703c0656f0 0x7f703c067bb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f704c000c00 tx=0x7f704c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:02.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.303+0000 7f704affd700 1 -- 172.21.15.125:0/1521841932 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f7054050c70 con 0x7f705c160710 2023-10-17T06:08:02.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.475+0000 7f705b59e700 1 -- 172.21.15.125:0/1521841932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f705c04e910 con 0x7f705c160710 2023-10-17T06:08:02.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.475+0000 7f704affd700 1 -- 172.21.15.125:0/1521841932 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7054054290 con 0x7f705c160710 2023-10-17T06:08:02.478 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:02.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.475+0000 7f705b59e700 1 -- 172.21.15.125:0/1521841932 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f703c0656f0 msgr2=0x7f703c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:02.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.475+0000 7f705b59e700 1 --2- 172.21.15.125:0/1521841932 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f703c0656f0 0x7f703c067bb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f704c000c00 tx=0x7f704c008030 comp rx=0 tx=0).stop 2023-10-17T06:08:02.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.475+0000 7f705b59e700 1 -- 172.21.15.125:0/1521841932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f705c160710 msgr2=0x7f705c0b1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:02.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.475+0000 7f705b59e700 1 --2- 172.21.15.125:0/1521841932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f705c160710 0x7f705c0b1270 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f705400eed0 tx=0x7f705400ef00 comp rx=0 tx=0).stop 2023-10-17T06:08:02.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.475+0000 7f705b59e700 1 -- 172.21.15.125:0/1521841932 shutdown_connections 2023-10-17T06:08:02.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.475+0000 7f705b59e700 1 --2- 172.21.15.125:0/1521841932 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f703c0656f0 0x7f703c067bb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.475+0000 7f705b59e700 1 --2- 172.21.15.125:0/1521841932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f705c160710 0x7f705c0b1270 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.475+0000 7f705b59e700 1 --2- 172.21.15.125:0/1521841932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f705c0d2e00 0x7f705c0b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.475+0000 7f705b59e700 1 --2- 172.21.15.125:0/1521841932 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f705c0b5ae0 0x7f705c14e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.475+0000 7f705b59e700 1 -- 172.21.15.125:0/1521841932 >> 172.21.15.125:0/1521841932 conn(0x7f705c069f20 msgr2=0x7f705c15b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:02.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.479+0000 7f705b59e700 1 -- 172.21.15.125:0/1521841932 shutdown_connections 2023-10-17T06:08:02.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.479+0000 7f705b59e700 1 -- 172.21.15.125:0/1521841932 wait complete. 2023-10-17T06:08:02.499 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:08:02.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.671+0000 7f8676c3e700 1 Processor -- start 2023-10-17T06:08:02.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.675+0000 7f8676c3e700 1 -- start start 2023-10-17T06:08:02.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.675+0000 7f8676c3e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f867015bf00 0x7f86700cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:02.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.675+0000 7f8676c3e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f86700b0f90 0x7f86700ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:02.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.675+0000 7f8676c3e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86700cbc80 con 0x7f8670155420 2023-10-17T06:08:02.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.675+0000 7f8676c3e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8670155800 con 0x7f86700b0f90 2023-10-17T06:08:02.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.675+0000 7f8676c3e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86700cb9a0 con 0x7f867015bf00 2023-10-17T06:08:02.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.675+0000 7f86751db700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f86700b0f90 0x7f86700ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:02.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.675+0000 7f86749da700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8670155420 0x7f86700cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45952/0 (socket says 172.21.15.125:45952) 2023-10-17T06:08:02.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.675+0000 7f86751db700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f86700b0f90 0x7f86700ce150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52952/0 (socket says 172.21.15.125:52952) 2023-10-17T06:08:02.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.675+0000 7f86749da700 1 -- 172.21.15.125:0/2952321152 learned_addr learned my addr 172.21.15.125:0/2952321152 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:02.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.675+0000 7f8667fff700 1 --2- 172.21.15.125:0/2952321152 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f867015bf00 0x7f86700cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:02.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.675+0000 7f86751db700 1 -- 172.21.15.125:0/2952321152 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f867015bf00 msgr2=0x7f86700cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:02.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.675+0000 7f86751db700 1 --2- 172.21.15.125:0/2952321152 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f867015bf00 0x7f86700cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.675+0000 7f86751db700 1 -- 172.21.15.125:0/2952321152 >> v1:172.21.15.125:6789/0 conn(0x7f8670155420 legacy=0x7f86700cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:02.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.675+0000 7f86751db700 1 -- 172.21.15.125:0/2952321152 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867015b420 con 0x7f86700b0f90 2023-10-17T06:08:02.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.675+0000 7f86677fe700 1 -- 172.21.15.125:0/2952321152 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1197211745 0 0) 0x7f86700cbc80 con 0x7f8670155420 2023-10-17T06:08:02.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.679+0000 7f86751db700 1 --2- 172.21.15.125:0/2952321152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86700b0f90 0x7f86700ce150 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8668009850 tx=0x7f8668009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923e323f19b324c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:02.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.679+0000 7f86677fe700 1 -- 172.21.15.125:0/2952321152 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8668011830 con 0x7f86700b0f90 2023-10-17T06:08:02.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.679+0000 7f86677fe700 1 -- 172.21.15.125:0/2952321152 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8668011990 con 0x7f86700b0f90 2023-10-17T06:08:02.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.679+0000 7f86677fe700 1 -- 172.21.15.125:0/2952321152 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8668011d20 con 0x7f86700b0f90 2023-10-17T06:08:02.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.679+0000 7f8676c3e700 1 -- 172.21.15.125:0/2952321152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86700b0f90 msgr2=0x7f86700ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:02.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.679+0000 7f8676c3e700 1 --2- 172.21.15.125:0/2952321152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86700b0f90 0x7f86700ce150 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8668009850 tx=0x7f8668009b60 comp rx=0 tx=0).stop 2023-10-17T06:08:02.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.679+0000 7f8676c3e700 1 -- 172.21.15.125:0/2952321152 shutdown_connections 2023-10-17T06:08:02.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.679+0000 7f8676c3e700 1 --2- 172.21.15.125:0/2952321152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86700b0f90 0x7f86700ce150 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.679+0000 7f8676c3e700 1 --2- 172.21.15.125:0/2952321152 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f867015bf00 0x7f86700cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.679+0000 7f8676c3e700 1 -- 172.21.15.125:0/2952321152 >> 172.21.15.125:0/2952321152 conn(0x7f867006a340 msgr2=0x7f86700b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:02.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.679+0000 7f8676c3e700 1 -- 172.21.15.125:0/2952321152 shutdown_connections 2023-10-17T06:08:02.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.679+0000 7f8676c3e700 1 -- 172.21.15.125:0/2952321152 wait complete. 2023-10-17T06:08:02.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f8676c3e700 1 Processor -- start 2023-10-17T06:08:02.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f8676c3e700 1 -- start start 2023-10-17T06:08:02.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f8676c3e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86700b0f90 0x7f86701547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:02.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f8676c3e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8670155420 0x7f8670159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:02.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f8676c3e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f867015bf00 0x7f8670157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:02.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f8676c3e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8670154d20 con 0x7f86700b0f90 2023-10-17T06:08:02.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f8676c3e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8670158560 con 0x7f8670155420 2023-10-17T06:08:02.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f8676c3e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8670158840 con 0x7f867015bf00 2023-10-17T06:08:02.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f86749da700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86700b0f90 0x7f86701547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:02.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f86749da700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86700b0f90 0x7f86701547e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52964/0 (socket says 172.21.15.125:52964) 2023-10-17T06:08:02.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f86749da700 1 -- 172.21.15.125:0/1651331222 learned_addr learned my addr 172.21.15.125:0/1651331222 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:02.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f86751db700 1 --2- 172.21.15.125:0/1651331222 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f867015bf00 0x7f8670157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:02.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f8667fff700 1 --2- 172.21.15.125:0/1651331222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8670155420 0x7f8670159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:02.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f86749da700 1 -- 172.21.15.125:0/1651331222 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f867015bf00 msgr2=0x7f8670157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:02.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f86749da700 1 --2- 172.21.15.125:0/1651331222 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f867015bf00 0x7f8670157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f86749da700 1 -- 172.21.15.125:0/1651331222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8670155420 msgr2=0x7f8670159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:02.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f86749da700 1 --2- 172.21.15.125:0/1651331222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8670155420 0x7f8670159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f86749da700 1 -- 172.21.15.125:0/1651331222 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86680094b0 con 0x7f86700b0f90 2023-10-17T06:08:02.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f86751db700 1 --2- 172.21.15.125:0/1651331222 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f867015bf00 0x7f8670157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:02.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f8667fff700 1 --2- 172.21.15.125:0/1651331222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8670155420 0x7f8670159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:02.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f86749da700 1 --2- 172.21.15.125:0/1651331222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86700b0f90 0x7f86701547e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f866c00cfa0 tx=0x7f866c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:02.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f86657fa700 1 -- 172.21.15.125:0/1651331222 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c00adb0 con 0x7f86700b0f90 2023-10-17T06:08:02.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f86657fa700 1 -- 172.21.15.125:0/1651331222 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c011560 con 0x7f86700b0f90 2023-10-17T06:08:02.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f8676c3e700 1 -- 172.21.15.125:0/1651331222 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8670158b20 con 0x7f86700b0f90 2023-10-17T06:08:02.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f86657fa700 1 -- 172.21.15.125:0/1651331222 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c011910 con 0x7f86700b0f90 2023-10-17T06:08:02.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.683+0000 7f8676c3e700 1 -- 172.21.15.125:0/1651331222 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86701590e0 con 0x7f86700b0f90 2023-10-17T06:08:02.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.687+0000 7f8676c3e700 1 -- 172.21.15.125:0/1651331222 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8670072e60 con 0x7f86700b0f90 2023-10-17T06:08:02.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.687+0000 7f86657fa700 1 -- 172.21.15.125:0/1651331222 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f866c017020 con 0x7f86700b0f90 2023-10-17T06:08:02.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.691+0000 7f86657fa700 1 --2- 172.21.15.125:0/1651331222 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f865c065720 0x7f865c067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:02.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.691+0000 7f86657fa700 1 -- 172.21.15.125:0/1651331222 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f866c087480 con 0x7f86700b0f90 2023-10-17T06:08:02.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.691+0000 7f8667fff700 1 --2- 172.21.15.125:0/1651331222 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f865c065720 0x7f865c067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:02.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.691+0000 7f8667fff700 1 --2- 172.21.15.125:0/1651331222 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f865c065720 0x7f865c067be0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f867015d1d0 tx=0x7f8660008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:02.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.695+0000 7f86657fa700 1 -- 172.21.15.125:0/1651331222 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f866c054c10 con 0x7f86700b0f90 2023-10-17T06:08:02.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.879+0000 7f8676c3e700 1 -- 172.21.15.125:0/1651331222 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86700cf150 con 0x7f86700b0f90 2023-10-17T06:08:02.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.879+0000 7f86657fa700 1 -- 172.21.15.125:0/1651331222 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20252 (secure 0 0 0) 0x7f866c058230 con 0x7f86700b0f90 2023-10-17T06:08:02.884 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:02.885 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":30,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:49.710984+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:08:02.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.883+0000 7f8676c3e700 1 -- 172.21.15.125:0/1651331222 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f865c065720 msgr2=0x7f865c067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:02.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.883+0000 7f8676c3e700 1 --2- 172.21.15.125:0/1651331222 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f865c065720 0x7f865c067be0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f867015d1d0 tx=0x7f8660008040 comp rx=0 tx=0).stop 2023-10-17T06:08:02.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.883+0000 7f8676c3e700 1 -- 172.21.15.125:0/1651331222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86700b0f90 msgr2=0x7f86701547e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:02.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.883+0000 7f8676c3e700 1 --2- 172.21.15.125:0/1651331222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86700b0f90 0x7f86701547e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f866c00cfa0 tx=0x7f866c00a340 comp rx=0 tx=0).stop 2023-10-17T06:08:02.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.883+0000 7f8676c3e700 1 -- 172.21.15.125:0/1651331222 shutdown_connections 2023-10-17T06:08:02.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.883+0000 7f8676c3e700 1 --2- 172.21.15.125:0/1651331222 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f865c065720 0x7f865c067be0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.883+0000 7f8676c3e700 1 --2- 172.21.15.125:0/1651331222 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f867015bf00 0x7f8670157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.883+0000 7f8676c3e700 1 --2- 172.21.15.125:0/1651331222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8670155420 0x7f8670159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.883+0000 7f8676c3e700 1 --2- 172.21.15.125:0/1651331222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86700b0f90 0x7f86701547e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:02.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.883+0000 7f8676c3e700 1 -- 172.21.15.125:0/1651331222 >> 172.21.15.125:0/1651331222 conn(0x7f867006a340 msgr2=0x7f86700cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:02.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.883+0000 7f8676c3e700 1 -- 172.21.15.125:0/1651331222 shutdown_connections 2023-10-17T06:08:02.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:02.883+0000 7f8676c3e700 1 -- 172.21.15.125:0/1651331222 wait complete. 2023-10-17T06:08:02.910 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-17T06:07:06.629169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-17T06:07:08.148117+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-17T06:07:11.895112+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-17T06:08:02.911 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:08:03.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.087+0000 7f0d75a11700 1 Processor -- start 2023-10-17T06:08:03.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.087+0000 7f0d75a11700 1 -- start start 2023-10-17T06:08:03.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.087+0000 7f0d75a11700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0d701467c0 0x7f0d700b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:03.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d75a11700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0d7006f9a0 0x7f0d7006fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:03.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d75a11700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d70146ba0 con 0x7f0d701612e0 2023-10-17T06:08:03.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d75a11700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d700d0920 con 0x7f0d7006f9a0 2023-10-17T06:08:03.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d75a11700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d70070320 con 0x7f0d701467c0 2023-10-17T06:08:03.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d6f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0d7006f9a0 0x7f0d7006fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:03.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d6effd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0d701467c0 0x7f0d700b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:03.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d6f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0d7006f9a0 0x7f0d7006fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52976/0 (socket says 172.21.15.125:52976) 2023-10-17T06:08:03.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d6f7fe700 1 -- 172.21.15.125:0/3917301778 learned_addr learned my addr 172.21.15.125:0/3917301778 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:03.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d6f7fe700 1 -- 172.21.15.125:0/3917301778 >> v2:172.21.15.184:3300/0 conn(0x7f0d701467c0 msgr2=0x7f0d700b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:03.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d6f7fe700 1 --2- 172.21.15.125:0/3917301778 >> v2:172.21.15.184:3300/0 conn(0x7f0d701467c0 0x7f0d700b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d6f7fe700 1 -- 172.21.15.125:0/3917301778 >> v1:172.21.15.125:6789/0 conn(0x7f0d701612e0 legacy=0x7f0d7015d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:03.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d6f7fe700 1 -- 172.21.15.125:0/3917301778 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d700b6160 con 0x7f0d7006f9a0 2023-10-17T06:08:03.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d6dffb700 1 -- 172.21.15.125:0/3917301778 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210022822 0 0) 0x7f0d70146ba0 con 0x7f0d701612e0 2023-10-17T06:08:03.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d6effd700 1 --2- 172.21.15.125:0/3917301778 >> v2:172.21.15.184:3300/0 conn(0x7f0d701467c0 0x7f0d700b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:08:03.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d6f7fe700 1 --2- 172.21.15.125:0/3917301778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d7006f9a0 0x7f0d7006fde0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0d700b6f30 tx=0x7f0d6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd7251d6c2f8766 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:03.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d6dffb700 1 -- 172.21.15.125:0/3917301778 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6800e070 con 0x7f0d7006f9a0 2023-10-17T06:08:03.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d6dffb700 1 -- 172.21.15.125:0/3917301778 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6800b910 con 0x7f0d7006f9a0 2023-10-17T06:08:03.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d6dffb700 1 -- 172.21.15.125:0/3917301778 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6800bcc0 con 0x7f0d7006f9a0 2023-10-17T06:08:03.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d75a11700 1 -- 172.21.15.125:0/3917301778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d7006f9a0 msgr2=0x7f0d7006fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:03.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d75a11700 1 --2- 172.21.15.125:0/3917301778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d7006f9a0 0x7f0d7006fde0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0d700b6f30 tx=0x7f0d6800b330 comp rx=0 tx=0).stop 2023-10-17T06:08:03.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d75a11700 1 -- 172.21.15.125:0/3917301778 shutdown_connections 2023-10-17T06:08:03.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d75a11700 1 --2- 172.21.15.125:0/3917301778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d7006f9a0 0x7f0d7006fde0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d75a11700 1 --2- 172.21.15.125:0/3917301778 >> v2:172.21.15.184:3300/0 conn(0x7f0d701467c0 0x7f0d700b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d75a11700 1 -- 172.21.15.125:0/3917301778 >> 172.21.15.125:0/3917301778 conn(0x7f0d7006a130 msgr2=0x7f0d7006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:03.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d75a11700 1 -- 172.21.15.125:0/3917301778 shutdown_connections 2023-10-17T06:08:03.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.091+0000 7f0d75a11700 1 -- 172.21.15.125:0/3917301778 wait complete. 2023-10-17T06:08:03.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.095+0000 7f0d75a11700 1 Processor -- start 2023-10-17T06:08:03.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.095+0000 7f0d75a11700 1 -- start start 2023-10-17T06:08:03.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.095+0000 7f0d75a11700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d7006f9a0 0x7f0d700ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:03.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.095+0000 7f0d75a11700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d701467c0 0x7f0d700c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:03.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.095+0000 7f0d75a11700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d701612e0 0x7f0d700c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:03.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.095+0000 7f0d75a11700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7015ff10 con 0x7f0d7006f9a0 2023-10-17T06:08:03.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.095+0000 7f0d75a11700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7015fc30 con 0x7f0d701467c0 2023-10-17T06:08:03.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.095+0000 7f0d75a11700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7014c7e0 con 0x7f0d701612e0 2023-10-17T06:08:03.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.095+0000 7f0d6effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d7006f9a0 0x7f0d700ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:03.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.095+0000 7f0d6effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d7006f9a0 0x7f0d700ce4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52986/0 (socket says 172.21.15.125:52986) 2023-10-17T06:08:03.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.095+0000 7f0d6effd700 1 -- 172.21.15.125:0/24011820 learned_addr learned my addr 172.21.15.125:0/24011820 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:03.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.095+0000 7f0d6e7fc700 1 --2- 172.21.15.125:0/24011820 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d701467c0 0x7f0d700c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:03.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.095+0000 7f0d6f7fe700 1 --2- 172.21.15.125:0/24011820 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d701612e0 0x7f0d700c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:03.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.095+0000 7f0d6effd700 1 -- 172.21.15.125:0/24011820 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d701612e0 msgr2=0x7f0d700c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:03.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.095+0000 7f0d6effd700 1 --2- 172.21.15.125:0/24011820 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d701612e0 0x7f0d700c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.095+0000 7f0d6effd700 1 -- 172.21.15.125:0/24011820 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d701467c0 msgr2=0x7f0d700c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:03.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.095+0000 7f0d6effd700 1 --2- 172.21.15.125:0/24011820 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d701467c0 0x7f0d700c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.095+0000 7f0d6effd700 1 -- 172.21.15.125:0/24011820 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d600094b0 con 0x7f0d7006f9a0 2023-10-17T06:08:03.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.099+0000 7f0d6effd700 1 --2- 172.21.15.125:0/24011820 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d7006f9a0 0x7f0d700ce4f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000ebe0 tx=0x7f0d6000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:03.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.099+0000 7f0d57fff700 1 -- 172.21.15.125:0/24011820 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6000c850 con 0x7f0d7006f9a0 2023-10-17T06:08:03.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.099+0000 7f0d57fff700 1 -- 172.21.15.125:0/24011820 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6000c9b0 con 0x7f0d7006f9a0 2023-10-17T06:08:03.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.099+0000 7f0d57fff700 1 -- 172.21.15.125:0/24011820 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6000cd40 con 0x7f0d7006f9a0 2023-10-17T06:08:03.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.099+0000 7f0d75a11700 1 -- 172.21.15.125:0/24011820 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d68009b30 con 0x7f0d7006f9a0 2023-10-17T06:08:03.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.099+0000 7f0d75a11700 1 -- 172.21.15.125:0/24011820 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7014cda0 con 0x7f0d7006f9a0 2023-10-17T06:08:03.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.099+0000 7f0d75a11700 1 -- 172.21.15.125:0/24011820 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d7015cad0 con 0x7f0d7006f9a0 2023-10-17T06:08:03.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.099+0000 7f0d57fff700 1 -- 172.21.15.125:0/24011820 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0d60013470 con 0x7f0d7006f9a0 2023-10-17T06:08:03.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.103+0000 7f0d57fff700 1 --2- 172.21.15.125:0/24011820 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0d5c0656f0 0x7f0d5c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:03.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.103+0000 7f0d57fff700 1 -- 172.21.15.125:0/24011820 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0d60083190 con 0x7f0d7006f9a0 2023-10-17T06:08:03.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.103+0000 7f0d6e7fc700 1 --2- 172.21.15.125:0/24011820 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0d5c0656f0 0x7f0d5c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:03.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.103+0000 7f0d6e7fc700 1 --2- 172.21.15.125:0/24011820 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0d5c0656f0 0x7f0d5c067bb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0d7013ed30 tx=0x7f0d64009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:03.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.107+0000 7f0d57fff700 1 -- 172.21.15.125:0/24011820 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0d7015cad0 con 0x7f0d7006f9a0 2023-10-17T06:08:03.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.283+0000 7f0d75a11700 1 -- 172.21.15.125:0/24011820 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d7015cad0 con 0x7f0d7006f9a0 2023-10-17T06:08:03.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.283+0000 7f0d57fff700 1 -- 172.21.15.125:0/24011820 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d7015cad0 con 0x7f0d7006f9a0 2023-10-17T06:08:03.286 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:08:03.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.287+0000 7f0d75a11700 1 -- 172.21.15.125:0/24011820 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0d5c0656f0 msgr2=0x7f0d5c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:03.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.287+0000 7f0d75a11700 1 --2- 172.21.15.125:0/24011820 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0d5c0656f0 0x7f0d5c067bb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0d7013ed30 tx=0x7f0d64009040 comp rx=0 tx=0).stop 2023-10-17T06:08:03.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.287+0000 7f0d75a11700 1 -- 172.21.15.125:0/24011820 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d7006f9a0 msgr2=0x7f0d700ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:03.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.287+0000 7f0d75a11700 1 --2- 172.21.15.125:0/24011820 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d7006f9a0 0x7f0d700ce4f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000ebe0 tx=0x7f0d6000eef0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.287+0000 7f0d75a11700 1 -- 172.21.15.125:0/24011820 shutdown_connections 2023-10-17T06:08:03.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.287+0000 7f0d75a11700 1 --2- 172.21.15.125:0/24011820 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0d5c0656f0 0x7f0d5c067bb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.287+0000 7f0d75a11700 1 --2- 172.21.15.125:0/24011820 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0d701612e0 0x7f0d700c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.287+0000 7f0d75a11700 1 --2- 172.21.15.125:0/24011820 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d701467c0 0x7f0d700c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.287+0000 7f0d75a11700 1 --2- 172.21.15.125:0/24011820 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0d7006f9a0 0x7f0d700ce4f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.287+0000 7f0d75a11700 1 -- 172.21.15.125:0/24011820 >> 172.21.15.125:0/24011820 conn(0x7f0d7006a130 msgr2=0x7f0d701459d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:03.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.287+0000 7f0d75a11700 1 -- 172.21.15.125:0/24011820 shutdown_connections 2023-10-17T06:08:03.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.287+0000 7f0d75a11700 1 -- 172.21.15.125:0/24011820 wait complete. 2023-10-17T06:08:03.310 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:08:03.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.495+0000 7faca9a25700 1 Processor -- start 2023-10-17T06:08:03.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.495+0000 7faca9a25700 1 -- start start 2023-10-17T06:08:03.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca9a25700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faca4153710 0x7faca40c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:03.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca9a25700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faca406ffe0 0x7faca4163cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:03.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca9a25700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca40cddc0 con 0x7faca406f450 2023-10-17T06:08:03.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca9a25700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca40c9150 con 0x7faca4153710 2023-10-17T06:08:03.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca9a25700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca40ce2f0 con 0x7faca406ffe0 2023-10-17T06:08:03.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faca4153710 0x7faca40c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:03.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faca4153710 0x7faca40c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60828/0 (socket says 172.21.15.125:60828) 2023-10-17T06:08:03.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca27fc700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7faca406f450 0x7faca406f8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:55514/0 (socket says 172.21.15.125:55514) 2023-10-17T06:08:03.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca2ffd700 1 -- 172.21.15.125:0/4107772809 learned_addr learned my addr 172.21.15.125:0/4107772809 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:03.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca37fe700 1 --2- 172.21.15.125:0/4107772809 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faca406ffe0 0x7faca4163cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:03.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca1ffb700 1 -- 172.21.15.125:0/4107772809 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277304088 0 0) 0x7faca40cddc0 con 0x7faca406f450 2023-10-17T06:08:03.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca1ffb700 1 -- 172.21.15.125:0/4107772809 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac8c0035d0 con 0x7faca406f450 2023-10-17T06:08:03.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca2ffd700 1 -- 172.21.15.125:0/4107772809 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faca406ffe0 msgr2=0x7faca4163cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:03.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca2ffd700 1 --2- 172.21.15.125:0/4107772809 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faca406ffe0 0x7faca4163cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca2ffd700 1 -- 172.21.15.125:0/4107772809 >> v1:172.21.15.184:6789/0 conn(0x7faca406f450 legacy=0x7faca406f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:03.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca2ffd700 1 -- 172.21.15.125:0/4107772809 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca415d8f0 con 0x7faca4153710 2023-10-17T06:08:03.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca37fe700 1 --2- 172.21.15.125:0/4107772809 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faca406ffe0 0x7faca4163cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:08:03.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca2ffd700 1 --2- 172.21.15.125:0/4107772809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faca4153710 0x7faca40c8c10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fac9400bbb0 tx=0x7fac9400bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6fd0dfe43657ce server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:03.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca1ffb700 1 -- 172.21.15.125:0/4107772809 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9400dd30 con 0x7faca4153710 2023-10-17T06:08:03.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca1ffb700 1 -- 172.21.15.125:0/4107772809 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9400de90 con 0x7faca4153710 2023-10-17T06:08:03.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.499+0000 7faca1ffb700 1 -- 172.21.15.125:0/4107772809 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac94010690 con 0x7faca4153710 2023-10-17T06:08:03.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.503+0000 7faca9a25700 1 -- 172.21.15.125:0/4107772809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faca4153710 msgr2=0x7faca40c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:03.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.503+0000 7faca9a25700 1 --2- 172.21.15.125:0/4107772809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faca4153710 0x7faca40c8c10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fac9400bbb0 tx=0x7fac9400bec0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.503+0000 7faca9a25700 1 -- 172.21.15.125:0/4107772809 shutdown_connections 2023-10-17T06:08:03.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.503+0000 7faca9a25700 1 --2- 172.21.15.125:0/4107772809 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faca406ffe0 0x7faca4163cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.503+0000 7faca9a25700 1 --2- 172.21.15.125:0/4107772809 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faca4153710 0x7faca40c8c10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.503+0000 7faca9a25700 1 -- 172.21.15.125:0/4107772809 >> 172.21.15.125:0/4107772809 conn(0x7faca40ce5c0 msgr2=0x7faca40ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:03.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.503+0000 7faca9a25700 1 -- 172.21.15.125:0/4107772809 shutdown_connections 2023-10-17T06:08:03.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.503+0000 7faca9a25700 1 -- 172.21.15.125:0/4107772809 wait complete. 2023-10-17T06:08:03.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.507+0000 7faca9a25700 1 Processor -- start 2023-10-17T06:08:03.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.507+0000 7faca9a25700 1 -- start start 2023-10-17T06:08:03.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.507+0000 7faca9a25700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faca406f450 0x7faca41549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:03.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.507+0000 7faca9a25700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faca406ffe0 0x7faca4146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:03.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.507+0000 7faca9a25700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faca4153710 0x7faca40b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:03.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.507+0000 7faca9a25700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca4154f20 con 0x7faca406f450 2023-10-17T06:08:03.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.507+0000 7faca9a25700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca41472f0 con 0x7faca406ffe0 2023-10-17T06:08:03.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.507+0000 7faca9a25700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca40b4250 con 0x7faca4153710 2023-10-17T06:08:03.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.507+0000 7faca2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faca406f450 0x7faca41549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:03.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.507+0000 7faca2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faca406f450 0x7faca41549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60842/0 (socket says 172.21.15.125:60842) 2023-10-17T06:08:03.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.507+0000 7faca2ffd700 1 -- 172.21.15.125:0/2796499969 learned_addr learned my addr 172.21.15.125:0/2796499969 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:03.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.507+0000 7faca27fc700 1 --2- 172.21.15.125:0/2796499969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faca406ffe0 0x7faca4146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:03.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.507+0000 7faca37fe700 1 --2- 172.21.15.125:0/2796499969 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faca4153710 0x7faca40b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:03.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.507+0000 7faca2ffd700 1 -- 172.21.15.125:0/2796499969 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faca4153710 msgr2=0x7faca40b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:03.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.507+0000 7faca2ffd700 1 --2- 172.21.15.125:0/2796499969 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faca4153710 0x7faca40b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.507+0000 7faca2ffd700 1 -- 172.21.15.125:0/2796499969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faca406ffe0 msgr2=0x7faca4146db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:03.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.507+0000 7faca2ffd700 1 --2- 172.21.15.125:0/2796499969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faca406ffe0 0x7faca4146db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.507+0000 7faca2ffd700 1 -- 172.21.15.125:0/2796499969 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c009a70 con 0x7faca406f450 2023-10-17T06:08:03.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.507+0000 7faca2ffd700 1 --2- 172.21.15.125:0/2796499969 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faca406f450 0x7faca41549e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faca406e230 tx=0x7fac94004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:03.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.511+0000 7fac8bfff700 1 -- 172.21.15.125:0/2796499969 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac94003c10 con 0x7faca406f450 2023-10-17T06:08:03.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.511+0000 7faca9a25700 1 -- 172.21.15.125:0/2796499969 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac9400b810 con 0x7faca406f450 2023-10-17T06:08:03.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.511+0000 7fac8bfff700 1 -- 172.21.15.125:0/2796499969 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac94003d70 con 0x7faca406f450 2023-10-17T06:08:03.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.511+0000 7fac8bfff700 1 -- 172.21.15.125:0/2796499969 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac940106b0 con 0x7faca406f450 2023-10-17T06:08:03.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.511+0000 7faca9a25700 1 -- 172.21.15.125:0/2796499969 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca4153f00 con 0x7faca406f450 2023-10-17T06:08:03.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.511+0000 7faca9a25700 1 -- 172.21.15.125:0/2796499969 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca404e910 con 0x7faca406f450 2023-10-17T06:08:03.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.511+0000 7fac8bfff700 1 -- 172.21.15.125:0/2796499969 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fac9402c440 con 0x7faca406f450 2023-10-17T06:08:03.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.515+0000 7fac8bfff700 1 --2- 172.21.15.125:0/2796499969 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fac900656f0 0x7fac90067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:03.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.515+0000 7fac8bfff700 1 -- 172.21.15.125:0/2796499969 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fac940848b0 con 0x7faca406f450 2023-10-17T06:08:03.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.515+0000 7faca27fc700 1 --2- 172.21.15.125:0/2796499969 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fac900656f0 0x7fac90067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:03.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.515+0000 7faca27fc700 1 --2- 172.21.15.125:0/2796499969 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fac900656f0 0x7fac90067bb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faca40705a0 tx=0x7fac98007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:03.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.519+0000 7fac8bfff700 1 -- 172.21.15.125:0/2796499969 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fac94051fb0 con 0x7faca406f450 2023-10-17T06:08:03.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.699+0000 7faca9a25700 1 -- 172.21.15.125:0/2796499969 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faca415c480 con 0x7faca406f450 2023-10-17T06:08:03.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.699+0000 7fac8bfff700 1 -- 172.21.15.125:0/2796499969 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fac940555d0 con 0x7faca406f450 2023-10-17T06:08:03.703 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:08:03.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.703+0000 7faca9a25700 1 -- 172.21.15.125:0/2796499969 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fac900656f0 msgr2=0x7fac90067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:03.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.703+0000 7faca9a25700 1 --2- 172.21.15.125:0/2796499969 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fac900656f0 0x7fac90067bb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faca40705a0 tx=0x7fac98007de0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.703+0000 7faca9a25700 1 -- 172.21.15.125:0/2796499969 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faca406f450 msgr2=0x7faca41549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:03.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.703+0000 7faca9a25700 1 --2- 172.21.15.125:0/2796499969 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faca406f450 0x7faca41549e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faca406e230 tx=0x7fac94004770 comp rx=0 tx=0).stop 2023-10-17T06:08:03.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.703+0000 7faca9a25700 1 -- 172.21.15.125:0/2796499969 shutdown_connections 2023-10-17T06:08:03.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.703+0000 7faca9a25700 1 --2- 172.21.15.125:0/2796499969 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fac900656f0 0x7fac90067bb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.703+0000 7faca9a25700 1 --2- 172.21.15.125:0/2796499969 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faca4153710 0x7faca40b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.703+0000 7faca9a25700 1 --2- 172.21.15.125:0/2796499969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faca406ffe0 0x7faca4146db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.703+0000 7faca9a25700 1 --2- 172.21.15.125:0/2796499969 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faca406f450 0x7faca41549e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.703+0000 7faca9a25700 1 -- 172.21.15.125:0/2796499969 >> 172.21.15.125:0/2796499969 conn(0x7faca40ce5c0 msgr2=0x7faca415b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:03.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.703+0000 7faca9a25700 1 -- 172.21.15.125:0/2796499969 shutdown_connections 2023-10-17T06:08:03.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.703+0000 7faca9a25700 1 -- 172.21.15.125:0/2796499969 wait complete. 2023-10-17T06:08:03.768 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-17T06:08:03.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.947+0000 7f7666524700 1 Processor -- start 2023-10-17T06:08:03.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.947+0000 7f7666524700 1 -- start start 2023-10-17T06:08:03.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.947+0000 7f7666524700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f766015ce30 0x7f7660160a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:03.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.951+0000 7f7666524700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f766006f450 0x7f7660160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:03.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.951+0000 7f7666524700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76600ca840 con 0x7f76600caa10 2023-10-17T06:08:03.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.951+0000 7f7666524700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76600ca560 con 0x7f766015ce30 2023-10-17T06:08:03.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.951+0000 7f7666524700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76600ccf30 con 0x7f766006f450 2023-10-17T06:08:03.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.951+0000 7f765f7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f766006f450 0x7f7660160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:03.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.951+0000 7f765ffff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f766015ce30 0x7f7660160a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:03.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.951+0000 7f7664ac1700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f76600caa10 0x7f766006e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:55530/0 (socket says 172.21.15.125:55530) 2023-10-17T06:08:03.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.951+0000 7f7664ac1700 1 -- 172.21.15.125:0/2206867365 learned_addr learned my addr 172.21.15.125:0/2206867365 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:03.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.951+0000 7f765ffff700 1 -- 172.21.15.125:0/2206867365 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f766006f450 msgr2=0x7f7660160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:03.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.951+0000 7f765ffff700 1 --2- 172.21.15.125:0/2206867365 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f766006f450 0x7f7660160f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.951+0000 7f765ffff700 1 -- 172.21.15.125:0/2206867365 >> v1:172.21.15.184:6789/0 conn(0x7f76600caa10 legacy=0x7f766006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:03.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.951+0000 7f765ffff700 1 -- 172.21.15.125:0/2206867365 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76600cd210 con 0x7f766015ce30 2023-10-17T06:08:03.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.951+0000 7f765ffff700 1 --2- 172.21.15.125:0/2206867365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f766015ce30 0x7f7660160a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7650009850 tx=0x7f7650009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57f6dded40ee0ffb server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:03.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.951+0000 7f765effd700 1 -- 172.21.15.125:0/2206867365 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7650011830 con 0x7f766015ce30 2023-10-17T06:08:03.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.951+0000 7f765effd700 1 -- 172.21.15.125:0/2206867365 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7650011990 con 0x7f766015ce30 2023-10-17T06:08:03.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.951+0000 7f765effd700 1 -- 172.21.15.125:0/2206867365 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7650011d40 con 0x7f766015ce30 2023-10-17T06:08:03.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.951+0000 7f7666524700 1 -- 172.21.15.125:0/2206867365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f766015ce30 msgr2=0x7f7660160a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:03.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.951+0000 7f7666524700 1 --2- 172.21.15.125:0/2206867365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f766015ce30 0x7f7660160a10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7650009850 tx=0x7f7650009b60 comp rx=0 tx=0).stop 2023-10-17T06:08:03.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.955+0000 7f7666524700 1 -- 172.21.15.125:0/2206867365 shutdown_connections 2023-10-17T06:08:03.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.955+0000 7f7666524700 1 --2- 172.21.15.125:0/2206867365 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f766006f450 0x7f7660160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.955+0000 7f7666524700 1 --2- 172.21.15.125:0/2206867365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f766015ce30 0x7f7660160a10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.955+0000 7f7666524700 1 -- 172.21.15.125:0/2206867365 >> 172.21.15.125:0/2206867365 conn(0x7f76600ce820 msgr2=0x7f76600cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:03.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.955+0000 7f7666524700 1 -- 172.21.15.125:0/2206867365 shutdown_connections 2023-10-17T06:08:03.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.955+0000 7f7666524700 1 -- 172.21.15.125:0/2206867365 wait complete. 2023-10-17T06:08:03.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.955+0000 7f7666524700 1 Processor -- start 2023-10-17T06:08:03.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.959+0000 7f7666524700 1 -- start start 2023-10-17T06:08:03.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.959+0000 7f7666524700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f766006f450 0x7f7660146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:03.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.959+0000 7f7666524700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76600caa10 0x7f766015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:03.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.959+0000 7f7666524700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f766015ce30 0x7f766015ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:03.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.959+0000 7f7666524700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76601f3430 con 0x7f766006f450 2023-10-17T06:08:03.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.959+0000 7f7666524700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766015d690 con 0x7f76600caa10 2023-10-17T06:08:03.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.959+0000 7f7666524700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766015ff30 con 0x7f766015ce30 2023-10-17T06:08:03.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.959+0000 7f765ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f766006f450 0x7f7660146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:03.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.959+0000 7f765ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f766006f450 0x7f7660146930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60858/0 (socket says 172.21.15.125:60858) 2023-10-17T06:08:03.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.959+0000 7f765ffff700 1 -- 172.21.15.125:0/1753368372 learned_addr learned my addr 172.21.15.125:0/1753368372 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:03.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.959+0000 7f765f7fe700 1 --2- 172.21.15.125:0/1753368372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76600caa10 0x7f766015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:03.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.959+0000 7f7664ac1700 1 --2- 172.21.15.125:0/1753368372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f766015ce30 0x7f766015ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:03.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.959+0000 7f765ffff700 1 -- 172.21.15.125:0/1753368372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f766015ce30 msgr2=0x7f766015ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:03.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.959+0000 7f765ffff700 1 --2- 172.21.15.125:0/1753368372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f766015ce30 0x7f766015ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.959+0000 7f765ffff700 1 -- 172.21.15.125:0/1753368372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76600caa10 msgr2=0x7f766015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:03.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.959+0000 7f765ffff700 1 --2- 172.21.15.125:0/1753368372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76600caa10 0x7f766015a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:03.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.959+0000 7f765ffff700 1 -- 172.21.15.125:0/1753368372 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76500094b0 con 0x7f766006f450 2023-10-17T06:08:03.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.963+0000 7f765ffff700 1 --2- 172.21.15.125:0/1753368372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f766006f450 0x7f7660146930 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7660067000 tx=0x7f7650004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:03.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.963+0000 7f765cff9700 1 -- 172.21.15.125:0/1753368372 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76500036c0 con 0x7f766006f450 2023-10-17T06:08:03.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.963+0000 7f765cff9700 1 -- 172.21.15.125:0/1753368372 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765001f070 con 0x7f766006f450 2023-10-17T06:08:03.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.963+0000 7f7666524700 1 -- 172.21.15.125:0/1753368372 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76601f3150 con 0x7f766006f450 2023-10-17T06:08:03.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.963+0000 7f765cff9700 1 -- 172.21.15.125:0/1753368372 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7650003a80 con 0x7f766006f450 2023-10-17T06:08:03.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.963+0000 7f7666524700 1 -- 172.21.15.125:0/1753368372 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76601496e0 con 0x7f766006f450 2023-10-17T06:08:03.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.963+0000 7f7666524700 1 -- 172.21.15.125:0/1753368372 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7660072e60 con 0x7f766006f450 2023-10-17T06:08:03.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.967+0000 7f765cff9700 1 -- 172.21.15.125:0/1753368372 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7650021030 con 0x7f766006f450 2023-10-17T06:08:03.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.967+0000 7f765cff9700 1 --2- 172.21.15.125:0/1753368372 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f76400656f0 0x7f7640067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:03.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.967+0000 7f765cff9700 1 -- 172.21.15.125:0/1753368372 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7650084590 con 0x7f766006f450 2023-10-17T06:08:03.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.967+0000 7f765f7fe700 1 --2- 172.21.15.125:0/1753368372 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f76400656f0 0x7f7640067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:03.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.967+0000 7f765f7fe700 1 --2- 172.21.15.125:0/1753368372 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f76400656f0 0x7f7640067bb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7660158ba0 tx=0x7f7648009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:03.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:03.975+0000 7f765cff9700 1 -- 172.21.15.125:0/1753368372 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f7650051ed0 con 0x7f766006f450 2023-10-17T06:08:04.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.159+0000 7f7666524700 1 -- 172.21.15.125:0/1753368372 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f766006d0f0 con 0x7f766006f450 2023-10-17T06:08:04.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.159+0000 7f765cff9700 1 -- 172.21.15.125:0/1753368372 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f76500554f0 con 0x7f766006f450 2023-10-17T06:08:04.163 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:04.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.163+0000 7f7666524700 1 -- 172.21.15.125:0/1753368372 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f76400656f0 msgr2=0x7f7640067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:04.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.163+0000 7f7666524700 1 --2- 172.21.15.125:0/1753368372 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f76400656f0 0x7f7640067bb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7660158ba0 tx=0x7f7648009240 comp rx=0 tx=0).stop 2023-10-17T06:08:04.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.163+0000 7f7666524700 1 -- 172.21.15.125:0/1753368372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f766006f450 msgr2=0x7f7660146930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:04.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.163+0000 7f7666524700 1 --2- 172.21.15.125:0/1753368372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f766006f450 0x7f7660146930 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7660067000 tx=0x7f7650004770 comp rx=0 tx=0).stop 2023-10-17T06:08:04.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.163+0000 7f7666524700 1 -- 172.21.15.125:0/1753368372 shutdown_connections 2023-10-17T06:08:04.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.163+0000 7f7666524700 1 --2- 172.21.15.125:0/1753368372 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f76400656f0 0x7f7640067bb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.163+0000 7f7666524700 1 --2- 172.21.15.125:0/1753368372 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f766015ce30 0x7f766015ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.163+0000 7f7666524700 1 --2- 172.21.15.125:0/1753368372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76600caa10 0x7f766015a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.163+0000 7f7666524700 1 --2- 172.21.15.125:0/1753368372 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f766006f450 0x7f7660146930 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.163+0000 7f7666524700 1 -- 172.21.15.125:0/1753368372 >> 172.21.15.125:0/1753368372 conn(0x7f76600ce820 msgr2=0x7f7660160880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:04.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.163+0000 7f7666524700 1 -- 172.21.15.125:0/1753368372 shutdown_connections 2023-10-17T06:08:04.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.163+0000 7f7666524700 1 -- 172.21.15.125:0/1753368372 wait complete. 2023-10-17T06:08:04.189 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-17T06:08:04.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.359+0000 7f1b6755f700 1 Processor -- start 2023-10-17T06:08:04.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.359+0000 7f1b6755f700 1 -- start start 2023-10-17T06:08:04.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.363+0000 7f1b6755f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1b60159750 0x7f1b60070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:04.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.363+0000 7f1b6755f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b60070aa0 0x7f1b600cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:04.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.363+0000 7f1b6755f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1b600cde70 0x7f1b600cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:04.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.363+0000 7f1b6755f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b600c9aa0 con 0x7f1b60159750 2023-10-17T06:08:04.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.363+0000 7f1b6755f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b60070f00 con 0x7f1b600cde70 2023-10-17T06:08:04.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.363+0000 7f1b6755f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600b14f0 con 0x7f1b60070aa0 2023-10-17T06:08:04.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.363+0000 7f1b6655d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1b60159750 0x7f1b60070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:04.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b6655d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1b60159750 0x7f1b60070560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60872/0 (socket says 172.21.15.125:60872) 2023-10-17T06:08:04.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b6655d700 1 -- 172.21.15.125:0/601854633 learned_addr learned my addr 172.21.15.125:0/601854633 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:04.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b65d5c700 1 --2- 172.21.15.125:0/601854633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b60070aa0 0x7f1b600cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:04.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b66d5e700 1 --2- 172.21.15.125:0/601854633 >> v2:172.21.15.184:3300/0 conn(0x7f1b600cde70 0x7f1b600cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:04.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b6655d700 1 -- 172.21.15.125:0/601854633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b60070aa0 msgr2=0x7f1b600cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:04.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b6655d700 1 --2- 172.21.15.125:0/601854633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b60070aa0 0x7f1b600cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b6655d700 1 -- 172.21.15.125:0/601854633 >> v2:172.21.15.184:3300/0 conn(0x7f1b600cde70 msgr2=0x7f1b600cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:04.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b6655d700 1 --2- 172.21.15.125:0/601854633 >> v2:172.21.15.184:3300/0 conn(0x7f1b600cde70 0x7f1b600cc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b6655d700 1 -- 172.21.15.125:0/601854633 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6015d590 con 0x7f1b60159750 2023-10-17T06:08:04.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b6655d700 1 --2- 172.21.15.125:0/601854633 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b60159750 0x7f1b60070560 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1b600b40b0 tx=0x7f1b5c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13892710d4de0d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:04.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b6555b700 1 -- 172.21.15.125:0/601854633 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00b8a0 con 0x7f1b60159750 2023-10-17T06:08:04.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b6555b700 1 -- 172.21.15.125:0/601854633 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c00ba00 con 0x7f1b60159750 2023-10-17T06:08:04.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b6555b700 1 -- 172.21.15.125:0/601854633 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c00bd90 con 0x7f1b60159750 2023-10-17T06:08:04.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b6755f700 1 -- 172.21.15.125:0/601854633 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b60159750 msgr2=0x7f1b60070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:04.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b6755f700 1 --2- 172.21.15.125:0/601854633 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b60159750 0x7f1b60070560 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1b600b40b0 tx=0x7f1b5c009bf0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b6755f700 1 -- 172.21.15.125:0/601854633 shutdown_connections 2023-10-17T06:08:04.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b6755f700 1 --2- 172.21.15.125:0/601854633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b60070aa0 0x7f1b600cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b6755f700 1 --2- 172.21.15.125:0/601854633 >> v2:172.21.15.184:3300/0 conn(0x7f1b600cde70 0x7f1b600cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b6755f700 1 --2- 172.21.15.125:0/601854633 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b60159750 0x7f1b60070560 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b6755f700 1 -- 172.21.15.125:0/601854633 >> 172.21.15.125:0/601854633 conn(0x7f1b600ce5c0 msgr2=0x7f1b600ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:04.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b6755f700 1 -- 172.21.15.125:0/601854633 shutdown_connections 2023-10-17T06:08:04.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.367+0000 7f1b6755f700 1 -- 172.21.15.125:0/601854633 wait complete. 2023-10-17T06:08:04.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.371+0000 7f1b6755f700 1 Processor -- start 2023-10-17T06:08:04.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.371+0000 7f1b6755f700 1 -- start start 2023-10-17T06:08:04.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.371+0000 7f1b6755f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b60070aa0 0x7f1b600c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:04.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.371+0000 7f1b6755f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b600cde70 0x7f1b600c3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:04.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.371+0000 7f1b6755f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b60159750 0x7f1b600c39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:04.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.371+0000 7f1b6755f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600c5e70 con 0x7f1b600cde70 2023-10-17T06:08:04.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.371+0000 7f1b6755f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b600c5b90 con 0x7f1b60159750 2023-10-17T06:08:04.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.371+0000 7f1b6755f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b60157210 con 0x7f1b60070aa0 2023-10-17T06:08:04.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.371+0000 7f1b65d5c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b600cde70 0x7f1b600c3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:04.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.371+0000 7f1b65d5c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b600cde70 0x7f1b600c3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60876/0 (socket says 172.21.15.125:60876) 2023-10-17T06:08:04.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.371+0000 7f1b65d5c700 1 -- 172.21.15.125:0/3775802487 learned_addr learned my addr 172.21.15.125:0/3775802487 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:04.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.371+0000 7f1b66d5e700 1 --2- 172.21.15.125:0/3775802487 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b60159750 0x7f1b600c39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:04.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.371+0000 7f1b6655d700 1 --2- 172.21.15.125:0/3775802487 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b60070aa0 0x7f1b600c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:04.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.371+0000 7f1b65d5c700 1 -- 172.21.15.125:0/3775802487 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b60070aa0 msgr2=0x7f1b600c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:04.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.371+0000 7f1b65d5c700 1 --2- 172.21.15.125:0/3775802487 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b60070aa0 0x7f1b600c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.371+0000 7f1b65d5c700 1 -- 172.21.15.125:0/3775802487 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b60159750 msgr2=0x7f1b600c39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:04.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.371+0000 7f1b65d5c700 1 --2- 172.21.15.125:0/3775802487 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b60159750 0x7f1b600c39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.371+0000 7f1b65d5c700 1 -- 172.21.15.125:0/3775802487 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c009570 con 0x7f1b600cde70 2023-10-17T06:08:04.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.375+0000 7f1b65d5c700 1 --2- 172.21.15.125:0/3775802487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b600cde70 0x7f1b600c3460 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1b5000d800 tx=0x7f1b5000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:04.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.375+0000 7f1b56ffd700 1 -- 172.21.15.125:0/3775802487 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b500125f0 con 0x7f1b600cde70 2023-10-17T06:08:04.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.375+0000 7f1b56ffd700 1 -- 172.21.15.125:0/3775802487 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b50012750 con 0x7f1b600cde70 2023-10-17T06:08:04.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.375+0000 7f1b56ffd700 1 -- 172.21.15.125:0/3775802487 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b50012ac0 con 0x7f1b600cde70 2023-10-17T06:08:04.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.375+0000 7f1b6755f700 1 -- 172.21.15.125:0/3775802487 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b601574f0 con 0x7f1b600cde70 2023-10-17T06:08:04.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.375+0000 7f1b6755f700 1 -- 172.21.15.125:0/3775802487 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b600c8350 con 0x7f1b600cde70 2023-10-17T06:08:04.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.375+0000 7f1b6755f700 1 -- 172.21.15.125:0/3775802487 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b60157070 con 0x7f1b600cde70 2023-10-17T06:08:04.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.379+0000 7f1b56ffd700 1 -- 172.21.15.125:0/3775802487 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1b50012c20 con 0x7f1b600cde70 2023-10-17T06:08:04.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.379+0000 7f1b56ffd700 1 --2- 172.21.15.125:0/3775802487 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1b44065720 0x7f1b44067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:04.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.379+0000 7f1b56ffd700 1 -- 172.21.15.125:0/3775802487 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1b50083570 con 0x7f1b600cde70 2023-10-17T06:08:04.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.379+0000 7f1b6655d700 1 --2- 172.21.15.125:0/3775802487 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1b44065720 0x7f1b44067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:04.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.379+0000 7f1b6655d700 1 --2- 172.21.15.125:0/3775802487 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1b44065720 0x7f1b44067be0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c000c00 tx=0x7f1b5c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:04.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.383+0000 7f1b56ffd700 1 -- 172.21.15.125:0/3775802487 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f1b60157070 con 0x7f1b600cde70 2023-10-17T06:08:04.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.555+0000 7f1b6755f700 1 -- 172.21.15.125:0/3775802487 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1b60157070 con 0x7f1b600cde70 2023-10-17T06:08:04.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.555+0000 7f1b56ffd700 1 -- 172.21.15.125:0/3775802487 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1b60157070 con 0x7f1b600cde70 2023-10-17T06:08:04.561 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-17T06:08:04.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.559+0000 7f1b6755f700 1 -- 172.21.15.125:0/3775802487 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1b44065720 msgr2=0x7f1b44067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:04.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.559+0000 7f1b6755f700 1 --2- 172.21.15.125:0/3775802487 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1b44065720 0x7f1b44067be0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c000c00 tx=0x7f1b5c008030 comp rx=0 tx=0).stop 2023-10-17T06:08:04.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.559+0000 7f1b6755f700 1 -- 172.21.15.125:0/3775802487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b600cde70 msgr2=0x7f1b600c3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:04.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.559+0000 7f1b6755f700 1 --2- 172.21.15.125:0/3775802487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b600cde70 0x7f1b600c3460 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1b5000d800 tx=0x7f1b5000dbc0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.563+0000 7f1b6755f700 1 -- 172.21.15.125:0/3775802487 shutdown_connections 2023-10-17T06:08:04.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.563+0000 7f1b6755f700 1 --2- 172.21.15.125:0/3775802487 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1b44065720 0x7f1b44067be0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.563+0000 7f1b6755f700 1 --2- 172.21.15.125:0/3775802487 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b60159750 0x7f1b600c39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.563+0000 7f1b6755f700 1 --2- 172.21.15.125:0/3775802487 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b600cde70 0x7f1b600c3460 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.563+0000 7f1b6755f700 1 --2- 172.21.15.125:0/3775802487 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1b60070aa0 0x7f1b600c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.563+0000 7f1b6755f700 1 -- 172.21.15.125:0/3775802487 >> 172.21.15.125:0/3775802487 conn(0x7f1b600ce5c0 msgr2=0x7f1b60070350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:04.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.563+0000 7f1b6755f700 1 -- 172.21.15.125:0/3775802487 shutdown_connections 2023-10-17T06:08:04.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.563+0000 7f1b6755f700 1 -- 172.21.15.125:0/3775802487 wait complete. 2023-10-17T06:08:04.587 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-17T06:08:04.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.751+0000 7f022d908700 1 Processor -- start 2023-10-17T06:08:04.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.751+0000 7f022d908700 1 -- start start 2023-10-17T06:08:04.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.755+0000 7f022d908700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f022815a410 0x7f022815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:04.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.755+0000 7f022d908700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0228071120 con 0x7f022806d090 2023-10-17T06:08:04.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.755+0000 7f022d908700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022815e990 con 0x7f022806d470 2023-10-17T06:08:04.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.755+0000 7f022d908700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f022815f4f0 con 0x7f022815a410 2023-10-17T06:08:04.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.755+0000 7f0226ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f022806d090 0x7f02280b2590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45106/0 (socket says 172.21.15.125:45106) 2023-10-17T06:08:04.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.755+0000 7f0226ffd700 1 -- 172.21.15.125:0/2625607559 learned_addr learned my addr 172.21.15.125:0/2625607559 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:04.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.755+0000 7f02277fe700 1 --2- 172.21.15.125:0/2625607559 >> v2:172.21.15.184:3300/0 conn(0x7f022815a410 0x7f022815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:04.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.755+0000 7f02267fc700 1 -- 172.21.15.125:0/2625607559 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733556961 0 0) 0x7f0228071120 con 0x7f022806d090 2023-10-17T06:08:04.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.755+0000 7f02267fc700 1 -- 172.21.15.125:0/2625607559 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02140035d0 con 0x7f022806d090 2023-10-17T06:08:04.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.755+0000 7f02277fe700 1 -- 172.21.15.125:0/2625607559 >> v1:172.21.15.184:6789/0 conn(0x7f022806d470 legacy=0x7f0228070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:04.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.755+0000 7f02277fe700 1 -- 172.21.15.125:0/2625607559 >> v1:172.21.15.125:6789/0 conn(0x7f022806d090 legacy=0x7f02280b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:04.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.755+0000 7f02277fe700 1 -- 172.21.15.125:0/2625607559 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022815ec50 con 0x7f022815a410 2023-10-17T06:08:04.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.755+0000 7f02277fe700 1 --2- 172.21.15.125:0/2625607559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f022815a410 0x7f022815a8c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0220009d90 tx=0x7f022000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c41f5ea4be821dd server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:04.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.759+0000 7f02267fc700 1 -- 172.21.15.125:0/2625607559 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022000e070 con 0x7f022815a410 2023-10-17T06:08:04.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.759+0000 7f02267fc700 1 -- 172.21.15.125:0/2625607559 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022000bb20 con 0x7f022815a410 2023-10-17T06:08:04.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.759+0000 7f02267fc700 1 -- 172.21.15.125:0/2625607559 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220012430 con 0x7f022815a410 2023-10-17T06:08:04.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.759+0000 7f022d908700 1 -- 172.21.15.125:0/2625607559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f022815a410 msgr2=0x7f022815a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:04.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.759+0000 7f022d908700 1 --2- 172.21.15.125:0/2625607559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f022815a410 0x7f022815a8c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0220009d90 tx=0x7f022000b330 comp rx=0 tx=0).stop 2023-10-17T06:08:04.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.759+0000 7f022d908700 1 -- 172.21.15.125:0/2625607559 shutdown_connections 2023-10-17T06:08:04.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.759+0000 7f022d908700 1 --2- 172.21.15.125:0/2625607559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f022815a410 0x7f022815a8c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.759+0000 7f022d908700 1 -- 172.21.15.125:0/2625607559 >> 172.21.15.125:0/2625607559 conn(0x7f02280ce5c0 msgr2=0x7f02280ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:04.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.759+0000 7f022d908700 1 -- 172.21.15.125:0/2625607559 shutdown_connections 2023-10-17T06:08:04.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.759+0000 7f022d908700 1 -- 172.21.15.125:0/2625607559 wait complete. 2023-10-17T06:08:04.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.763+0000 7f022d908700 1 Processor -- start 2023-10-17T06:08:04.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.763+0000 7f022d908700 1 -- start start 2023-10-17T06:08:04.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.763+0000 7f022d908700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f022806d090 0x7f02281f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:04.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.763+0000 7f022d908700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f022806d470 0x7f0228159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:04.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.763+0000 7f022d908700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f022815a410 0x7f02280c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:04.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.763+0000 7f022d908700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02280ce210 con 0x7f022815a410 2023-10-17T06:08:04.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.763+0000 7f022d908700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02280cc710 con 0x7f022806d470 2023-10-17T06:08:04.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.763+0000 7f022d908700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02281f3660 con 0x7f022806d090 2023-10-17T06:08:04.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.763+0000 7f02277fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f022815a410 0x7f02280c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:04.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.763+0000 7f02277fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f022815a410 0x7f02280c6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60890/0 (socket says 172.21.15.125:60890) 2023-10-17T06:08:04.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.763+0000 7f02277fe700 1 -- 172.21.15.125:0/2238274496 learned_addr learned my addr 172.21.15.125:0/2238274496 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:04.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.763+0000 7f021ffff700 1 --2- 172.21.15.125:0/2238274496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f022806d470 0x7f0228159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:04.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.763+0000 7f0226ffd700 1 --2- 172.21.15.125:0/2238274496 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f022806d090 0x7f02281f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:04.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.763+0000 7f02277fe700 1 -- 172.21.15.125:0/2238274496 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f022806d090 msgr2=0x7f02281f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:04.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.763+0000 7f02277fe700 1 --2- 172.21.15.125:0/2238274496 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f022806d090 0x7f02281f3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.763+0000 7f02277fe700 1 -- 172.21.15.125:0/2238274496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f022806d470 msgr2=0x7f0228159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:04.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.763+0000 7f02277fe700 1 --2- 172.21.15.125:0/2238274496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f022806d470 0x7f0228159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.763+0000 7f02277fe700 1 -- 172.21.15.125:0/2238274496 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0220009a70 con 0x7f022815a410 2023-10-17T06:08:04.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.763+0000 7f0226ffd700 1 --2- 172.21.15.125:0/2238274496 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f022806d090 0x7f02281f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:04.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.763+0000 7f02277fe700 1 --2- 172.21.15.125:0/2238274496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f022815a410 0x7f02280c6d90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f022000b680 tx=0x7f0220004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:04.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.767+0000 7f0224ff9700 1 -- 172.21.15.125:0/2238274496 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220012430 con 0x7f022815a410 2023-10-17T06:08:04.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.767+0000 7f022d908700 1 -- 172.21.15.125:0/2238274496 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02280cd9b0 con 0x7f022815a410 2023-10-17T06:08:04.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.767+0000 7f0224ff9700 1 -- 172.21.15.125:0/2238274496 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0220020070 con 0x7f022815a410 2023-10-17T06:08:04.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.767+0000 7f0224ff9700 1 -- 172.21.15.125:0/2238274496 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220004280 con 0x7f022815a410 2023-10-17T06:08:04.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.767+0000 7f022d908700 1 -- 172.21.15.125:0/2238274496 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02280cdf30 con 0x7f022815a410 2023-10-17T06:08:04.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.767+0000 7f022d908700 1 -- 172.21.15.125:0/2238274496 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022804e910 con 0x7f022815a410 2023-10-17T06:08:04.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.767+0000 7f0224ff9700 1 -- 172.21.15.125:0/2238274496 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f02200043e0 con 0x7f022815a410 2023-10-17T06:08:04.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.771+0000 7f0224ff9700 1 --2- 172.21.15.125:0/2238274496 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02080656f0 0x7f0208067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:04.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.771+0000 7f0224ff9700 1 -- 172.21.15.125:0/2238274496 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0220022070 con 0x7f022815a410 2023-10-17T06:08:04.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.771+0000 7f0226ffd700 1 --2- 172.21.15.125:0/2238274496 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02080656f0 0x7f0208067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:04.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.771+0000 7f0226ffd700 1 --2- 172.21.15.125:0/2238274496 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02080656f0 0x7f0208067bb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f02180011e0 tx=0x7f0218009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:04.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.775+0000 7f0224ff9700 1 -- 172.21.15.125:0/2238274496 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0220052490 con 0x7f022815a410 2023-10-17T06:08:04.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.959+0000 7f022d908700 1 -- 172.21.15.125:0/2238274496 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f022806e030 con 0x7f022815a410 2023-10-17T06:08:04.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.963+0000 7f0224ff9700 1 -- 172.21.15.125:0/2238274496 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f022002c020 con 0x7f022815a410 2023-10-17T06:08:04.965 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:04.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.963+0000 7f022d908700 1 -- 172.21.15.125:0/2238274496 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02080656f0 msgr2=0x7f0208067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:04.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.963+0000 7f022d908700 1 --2- 172.21.15.125:0/2238274496 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02080656f0 0x7f0208067bb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f02180011e0 tx=0x7f0218009040 comp rx=0 tx=0).stop 2023-10-17T06:08:04.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.963+0000 7f022d908700 1 -- 172.21.15.125:0/2238274496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f022815a410 msgr2=0x7f02280c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:04.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.963+0000 7f022d908700 1 --2- 172.21.15.125:0/2238274496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f022815a410 0x7f02280c6d90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f022000b680 tx=0x7f0220004af0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.963+0000 7f022d908700 1 -- 172.21.15.125:0/2238274496 shutdown_connections 2023-10-17T06:08:04.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.963+0000 7f022d908700 1 --2- 172.21.15.125:0/2238274496 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02080656f0 0x7f0208067bb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.963+0000 7f022d908700 1 --2- 172.21.15.125:0/2238274496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f022815a410 0x7f02280c6d90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.963+0000 7f022d908700 1 --2- 172.21.15.125:0/2238274496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f022806d470 0x7f0228159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.963+0000 7f022d908700 1 --2- 172.21.15.125:0/2238274496 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f022806d090 0x7f02281f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:04.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.963+0000 7f022d908700 1 -- 172.21.15.125:0/2238274496 >> 172.21.15.125:0/2238274496 conn(0x7f02280ce5c0 msgr2=0x7f02280b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:04.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.963+0000 7f022d908700 1 -- 172.21.15.125:0/2238274496 shutdown_connections 2023-10-17T06:08:04.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:04.963+0000 7f022d908700 1 -- 172.21.15.125:0/2238274496 wait complete. 2023-10-17T06:08:04.988 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:08:05.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.151+0000 7fdc85399700 1 Processor -- start 2023-10-17T06:08:05.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.151+0000 7fdc85399700 1 -- start start 2023-10-17T06:08:05.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc85399700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdc800c4790 0x7fdc80160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:05.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc85399700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc80070da0 con 0x7fdc8015ca80 2023-10-17T06:08:05.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc85399700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc8006f5f0 con 0x7fdc800cca70 2023-10-17T06:08:05.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc85399700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8006f8d0 con 0x7fdc800c4790 2023-10-17T06:08:05.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc7effd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdc8015ca80 0x7fdc80070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45118/0 (socket says 172.21.15.125:45118) 2023-10-17T06:08:05.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc7effd700 1 -- 172.21.15.125:0/1358443927 learned_addr learned my addr 172.21.15.125:0/1358443927 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:05.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc7f7fe700 1 --2- 172.21.15.125:0/1358443927 >> v2:172.21.15.184:3300/0 conn(0x7fdc800c4790 0x7fdc80160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:05.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc7dffb700 1 -- 172.21.15.125:0/1358443927 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874835630 0 0) 0x7fdc80070da0 con 0x7fdc8015ca80 2023-10-17T06:08:05.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc7dffb700 1 -- 172.21.15.125:0/1358443927 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc680035d0 con 0x7fdc8015ca80 2023-10-17T06:08:05.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc7dffb700 1 -- 172.21.15.125:0/1358443927 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1500251157 0 0) 0x7fdc680035d0 con 0x7fdc8015ca80 2023-10-17T06:08:05.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc7dffb700 1 -- 172.21.15.125:0/1358443927 >> v2:172.21.15.184:3300/0 conn(0x7fdc800c4790 msgr2=0x7fdc80160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:05.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc7dffb700 1 --2- 172.21.15.125:0/1358443927 >> v2:172.21.15.184:3300/0 conn(0x7fdc800c4790 0x7fdc80160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc7dffb700 1 -- 172.21.15.125:0/1358443927 >> v1:172.21.15.184:6789/0 conn(0x7fdc800cca70 legacy=0x7fdc800c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:05.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc7dffb700 1 -- 172.21.15.125:0/1358443927 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8006fbb0 con 0x7fdc8015ca80 2023-10-17T06:08:05.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc7dffb700 1 -- 172.21.15.125:0/1358443927 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7fdc70001670 con 0x7fdc8015ca80 2023-10-17T06:08:05.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc7dffb700 1 -- 172.21.15.125:0/1358443927 >> v1:172.21.15.125:6789/0 conn(0x7fdc8015ca80 legacy=0x7fdc80070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:05.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc7dffb700 1 --2- 172.21.15.125:0/1358443927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc68003a20 0x7fdc68003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:05.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc7dffb700 1 --2- 172.21.15.125:0/1358443927 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc68004870 0x7fdc68004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:05.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc7dffb700 1 --2- 172.21.15.125:0/1358443927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc68005280 0x7fdc6800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:05.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc7dffb700 1 -- 172.21.15.125:0/1358443927 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8006f8d0 con 0x7fdc68004870 2023-10-17T06:08:05.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc7dffb700 1 -- 172.21.15.125:0/1358443927 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6800c1b0 con 0x7fdc68005280 2023-10-17T06:08:05.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc7dffb700 1 -- 172.21.15.125:0/1358443927 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6800c370 con 0x7fdc68003a20 2023-10-17T06:08:05.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.155+0000 7fdc7e7fc700 1 --2- 172.21.15.125:0/1358443927 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc68004870 0x7fdc68004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:05.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.159+0000 7fdc7f7fe700 1 --2- 172.21.15.125:0/1358443927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc68005280 0x7fdc6800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:05.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.159+0000 7fdc7effd700 1 --2- 172.21.15.125:0/1358443927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc68003a20 0x7fdc68003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:05.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.159+0000 7fdc7e7fc700 1 -- 172.21.15.125:0/1358443927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc68003a20 msgr2=0x7fdc68003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:05.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.159+0000 7fdc7e7fc700 1 --2- 172.21.15.125:0/1358443927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc68003a20 0x7fdc68003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.159+0000 7fdc7e7fc700 1 -- 172.21.15.125:0/1358443927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc68005280 msgr2=0x7fdc6800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:05.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.159+0000 7fdc7e7fc700 1 --2- 172.21.15.125:0/1358443927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc68005280 0x7fdc6800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.159+0000 7fdc7e7fc700 1 -- 172.21.15.125:0/1358443927 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc680035d0 con 0x7fdc68004870 2023-10-17T06:08:05.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.159+0000 7fdc7effd700 1 --2- 172.21.15.125:0/1358443927 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc68003a20 0x7fdc68003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:05.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.159+0000 7fdc7f7fe700 1 -- 172.21.15.125:0/1358443927 reap_dead start 2023-10-17T06:08:05.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.159+0000 7fdc7e7fc700 1 --2- 172.21.15.125:0/1358443927 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc68004870 0x7fdc68004cf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdc740018f0 tx=0x7fdc680058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44f6492ff6db5c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:05.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.159+0000 7fdc7dffb700 1 -- 172.21.15.125:0/1358443927 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74001390 con 0x7fdc68004870 2023-10-17T06:08:05.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.159+0000 7fdc7dffb700 1 -- 172.21.15.125:0/1358443927 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc740052f0 con 0x7fdc68004870 2023-10-17T06:08:05.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.159+0000 7fdc7dffb700 1 -- 172.21.15.125:0/1358443927 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc740036a0 con 0x7fdc68004870 2023-10-17T06:08:05.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.159+0000 7fdc85399700 1 -- 172.21.15.125:0/1358443927 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc68004870 msgr2=0x7fdc68004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:05.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.159+0000 7fdc85399700 1 --2- 172.21.15.125:0/1358443927 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc68004870 0x7fdc68004cf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdc740018f0 tx=0x7fdc680058a0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.159+0000 7fdc85399700 1 -- 172.21.15.125:0/1358443927 shutdown_connections 2023-10-17T06:08:05.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.159+0000 7fdc85399700 1 --2- 172.21.15.125:0/1358443927 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc68004870 0x7fdc68004cf0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.159+0000 7fdc85399700 1 -- 172.21.15.125:0/1358443927 >> 172.21.15.125:0/1358443927 conn(0x7fdc800cb920 msgr2=0x7fdc800cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:05.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.159+0000 7fdc85399700 1 -- 172.21.15.125:0/1358443927 shutdown_connections 2023-10-17T06:08:05.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.159+0000 7fdc85399700 1 -- 172.21.15.125:0/1358443927 wait complete. 2023-10-17T06:08:05.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.163+0000 7fdc85399700 1 Processor -- start 2023-10-17T06:08:05.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.163+0000 7fdc85399700 1 -- start start 2023-10-17T06:08:05.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.163+0000 7fdc85399700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc68004870 0x7fdc800b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:05.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.163+0000 7fdc85399700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc8014c260 0x7fdc8014d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:05.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.163+0000 7fdc85399700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc80151dd0 0x7fdc8014b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:05.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.163+0000 7fdc85399700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc800b29a0 con 0x7fdc68004870 2023-10-17T06:08:05.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.163+0000 7fdc85399700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8014cce0 con 0x7fdc8014c260 2023-10-17T06:08:05.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.163+0000 7fdc85399700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc800b23e0 con 0x7fdc80151dd0 2023-10-17T06:08:05.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.167+0000 7fdc7effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc68004870 0x7fdc800b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:05.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.167+0000 7fdc7effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc68004870 0x7fdc800b1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60904/0 (socket says 172.21.15.125:60904) 2023-10-17T06:08:05.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.167+0000 7fdc7effd700 1 -- 172.21.15.125:0/4032770776 learned_addr learned my addr 172.21.15.125:0/4032770776 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:05.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.167+0000 7fdc7e7fc700 1 --2- 172.21.15.125:0/4032770776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc8014c260 0x7fdc8014d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:05.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.167+0000 7fdc7f7fe700 1 --2- 172.21.15.125:0/4032770776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc80151dd0 0x7fdc8014b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:05.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.167+0000 7fdc7effd700 1 -- 172.21.15.125:0/4032770776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc80151dd0 msgr2=0x7fdc8014b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:05.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.167+0000 7fdc7effd700 1 --2- 172.21.15.125:0/4032770776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc80151dd0 0x7fdc8014b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.167+0000 7fdc7effd700 1 -- 172.21.15.125:0/4032770776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc8014c260 msgr2=0x7fdc8014d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:05.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.167+0000 7fdc7effd700 1 --2- 172.21.15.125:0/4032770776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc8014c260 0x7fdc8014d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.167+0000 7fdc7effd700 1 -- 172.21.15.125:0/4032770776 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc800b26c0 con 0x7fdc68004870 2023-10-17T06:08:05.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.167+0000 7fdc7effd700 1 --2- 172.21.15.125:0/4032770776 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc68004870 0x7fdc800b1e00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdc7000e730 tx=0x7fdc7000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:05.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.167+0000 7fdc677fe700 1 -- 172.21.15.125:0/4032770776 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc70012590 con 0x7fdc68004870 2023-10-17T06:08:05.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.167+0000 7fdc677fe700 1 -- 172.21.15.125:0/4032770776 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc700126f0 con 0x7fdc68004870 2023-10-17T06:08:05.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.167+0000 7fdc85399700 1 -- 172.21.15.125:0/4032770776 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc8014c900 con 0x7fdc68004870 2023-10-17T06:08:05.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.167+0000 7fdc677fe700 1 -- 172.21.15.125:0/4032770776 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc70012a60 con 0x7fdc68004870 2023-10-17T06:08:05.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.167+0000 7fdc85399700 1 -- 172.21.15.125:0/4032770776 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8014e3b0 con 0x7fdc68004870 2023-10-17T06:08:05.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.167+0000 7fdc85399700 1 -- 172.21.15.125:0/4032770776 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8014c760 con 0x7fdc68004870 2023-10-17T06:08:05.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.171+0000 7fdc677fe700 1 -- 172.21.15.125:0/4032770776 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fdc70012bc0 con 0x7fdc68004870 2023-10-17T06:08:05.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.171+0000 7fdc677fe700 1 --2- 172.21.15.125:0/4032770776 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdc6c0656f0 0x7fdc6c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:05.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.171+0000 7fdc677fe700 1 -- 172.21.15.125:0/4032770776 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdc70082ed0 con 0x7fdc68004870 2023-10-17T06:08:05.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.171+0000 7fdc7e7fc700 1 --2- 172.21.15.125:0/4032770776 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdc6c0656f0 0x7fdc6c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:05.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.171+0000 7fdc7e7fc700 1 --2- 172.21.15.125:0/4032770776 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdc6c0656f0 0x7fdc6c067bb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdc800cb740 tx=0x7fdc74005000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:05.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.179+0000 7fdc677fe700 1 -- 172.21.15.125:0/4032770776 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fdc8014c760 con 0x7fdc68004870 2023-10-17T06:08:05.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.351+0000 7fdc85399700 1 -- 172.21.15.125:0/4032770776 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc8014c760 con 0x7fdc68004870 2023-10-17T06:08:05.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.355+0000 7fdc677fe700 1 -- 172.21.15.125:0/4032770776 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20252 (secure 0 0 0) 0x7fdc8014c760 con 0x7fdc68004870 2023-10-17T06:08:05.359 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:05.359 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":30,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:49.710984+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:08:05.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.359+0000 7fdc85399700 1 -- 172.21.15.125:0/4032770776 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdc6c0656f0 msgr2=0x7fdc6c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:05.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.359+0000 7fdc85399700 1 --2- 172.21.15.125:0/4032770776 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdc6c0656f0 0x7fdc6c067bb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdc800cb740 tx=0x7fdc74005000 comp rx=0 tx=0).stop 2023-10-17T06:08:05.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.359+0000 7fdc85399700 1 -- 172.21.15.125:0/4032770776 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc68004870 msgr2=0x7fdc800b1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:05.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.359+0000 7fdc85399700 1 --2- 172.21.15.125:0/4032770776 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc68004870 0x7fdc800b1e00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdc7000e730 tx=0x7fdc7000eaf0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.359+0000 7fdc85399700 1 -- 172.21.15.125:0/4032770776 shutdown_connections 2023-10-17T06:08:05.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.359+0000 7fdc85399700 1 --2- 172.21.15.125:0/4032770776 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdc6c0656f0 0x7fdc6c067bb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.359+0000 7fdc85399700 1 --2- 172.21.15.125:0/4032770776 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc80151dd0 0x7fdc8014b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.359+0000 7fdc85399700 1 --2- 172.21.15.125:0/4032770776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc8014c260 0x7fdc8014d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.359+0000 7fdc85399700 1 --2- 172.21.15.125:0/4032770776 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc68004870 0x7fdc800b1e00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.359+0000 7fdc85399700 1 -- 172.21.15.125:0/4032770776 >> 172.21.15.125:0/4032770776 conn(0x7fdc800cb920 msgr2=0x7fdc800c4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:05.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.359+0000 7fdc85399700 1 -- 172.21.15.125:0/4032770776 shutdown_connections 2023-10-17T06:08:05.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.359+0000 7fdc85399700 1 -- 172.21.15.125:0/4032770776 wait complete. 2023-10-17T06:08:05.383 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-17T06:07:06.629169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-17T06:07:08.148117+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-17T06:07:11.895112+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-17T06:08:05.385 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:08:05.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.551+0000 7f01d43ba700 1 Processor -- start 2023-10-17T06:08:05.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.555+0000 7f01d43ba700 1 -- start start 2023-10-17T06:08:05.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.555+0000 7f01d43ba700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f01cc06ff50 0x7f01cc06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:05.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.555+0000 7f01d43ba700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f01cc070330 0x7f01cc0cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:05.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.555+0000 7f01d43ba700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01cc06ec70 con 0x7f01cc06dea0 2023-10-17T06:08:05.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.555+0000 7f01d43ba700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01cc06ef50 con 0x7f01cc070330 2023-10-17T06:08:05.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.555+0000 7f01d43ba700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc0c9b10 con 0x7f01cc06ff50 2023-10-17T06:08:05.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.555+0000 7f01d2957700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f01cc06dea0 0x7f01cc15c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45126/0 (socket says 172.21.15.125:45126) 2023-10-17T06:08:05.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.555+0000 7f01d2957700 1 -- 172.21.15.125:0/2370056946 learned_addr learned my addr 172.21.15.125:0/2370056946 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:05.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.559+0000 7f01d1955700 1 --2- 172.21.15.125:0/2370056946 >> v2:172.21.15.184:3300/0 conn(0x7f01cc070330 0x7f01cc0cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:05.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.559+0000 7f01d2156700 1 --2- 172.21.15.125:0/2370056946 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f01cc06ff50 0x7f01cc06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:05.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.559+0000 7f01d1154700 1 -- 172.21.15.125:0/2370056946 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1709445925 0 0) 0x7f01cc06ec70 con 0x7f01cc06dea0 2023-10-17T06:08:05.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.559+0000 7f01d1154700 1 -- 172.21.15.125:0/2370056946 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01b80057e0 con 0x7f01cc06dea0 2023-10-17T06:08:05.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.559+0000 7f01d1955700 1 -- 172.21.15.125:0/2370056946 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f01cc06ff50 msgr2=0x7f01cc06e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:05.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.559+0000 7f01d1955700 1 --2- 172.21.15.125:0/2370056946 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f01cc06ff50 0x7f01cc06e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.559+0000 7f01d1955700 1 -- 172.21.15.125:0/2370056946 >> v1:172.21.15.125:6789/0 conn(0x7f01cc06dea0 legacy=0x7f01cc15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:05.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.559+0000 7f01d1955700 1 -- 172.21.15.125:0/2370056946 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc0c9df0 con 0x7f01cc070330 2023-10-17T06:08:05.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.559+0000 7f01d1955700 1 --2- 172.21.15.125:0/2370056946 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01cc070330 0x7f01cc0cc3f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009850 tx=0x7f01bc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bd886e959a1e0ce server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:05.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.559+0000 7f01d1154700 1 -- 172.21.15.125:0/2370056946 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc011830 con 0x7f01cc070330 2023-10-17T06:08:05.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.559+0000 7f01d1154700 1 -- 172.21.15.125:0/2370056946 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01bc011990 con 0x7f01cc070330 2023-10-17T06:08:05.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.559+0000 7f01d1154700 1 -- 172.21.15.125:0/2370056946 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc011d40 con 0x7f01cc070330 2023-10-17T06:08:05.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.559+0000 7f01d43ba700 1 -- 172.21.15.125:0/2370056946 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01cc070330 msgr2=0x7f01cc0cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:05.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.559+0000 7f01d43ba700 1 --2- 172.21.15.125:0/2370056946 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01cc070330 0x7f01cc0cc3f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009850 tx=0x7f01bc009b60 comp rx=0 tx=0).stop 2023-10-17T06:08:05.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.559+0000 7f01d43ba700 1 -- 172.21.15.125:0/2370056946 shutdown_connections 2023-10-17T06:08:05.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.559+0000 7f01d43ba700 1 --2- 172.21.15.125:0/2370056946 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01cc070330 0x7f01cc0cc3f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.559+0000 7f01d43ba700 1 --2- 172.21.15.125:0/2370056946 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f01cc06ff50 0x7f01cc06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.559+0000 7f01d43ba700 1 -- 172.21.15.125:0/2370056946 >> 172.21.15.125:0/2370056946 conn(0x7f01cc0ce820 msgr2=0x7f01cc0cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:05.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.559+0000 7f01d43ba700 1 -- 172.21.15.125:0/2370056946 shutdown_connections 2023-10-17T06:08:05.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.559+0000 7f01d43ba700 1 -- 172.21.15.125:0/2370056946 wait complete. 2023-10-17T06:08:05.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.563+0000 7f01d43ba700 1 Processor -- start 2023-10-17T06:08:05.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.563+0000 7f01d43ba700 1 -- start start 2023-10-17T06:08:05.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01d43ba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01cc06dea0 0x7f01cc156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:05.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01d43ba700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01cc06ff50 0x7f01cc1551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:05.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01d43ba700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f01cc070330 0x7f01cc0c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:05.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01d43ba700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc0c3700 con 0x7f01cc06dea0 2023-10-17T06:08:05.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01d43ba700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc157b90 con 0x7f01cc06ff50 2023-10-17T06:08:05.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01d43ba700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc0c2dd0 con 0x7f01cc070330 2023-10-17T06:08:05.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01d2156700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01cc06dea0 0x7f01cc156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:05.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01d2156700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01cc06dea0 0x7f01cc156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60908/0 (socket says 172.21.15.125:60908) 2023-10-17T06:08:05.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01d2156700 1 -- 172.21.15.125:0/2176838069 learned_addr learned my addr 172.21.15.125:0/2176838069 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:05.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01d1955700 1 --2- 172.21.15.125:0/2176838069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01cc06ff50 0x7f01cc1551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:05.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01d2957700 1 --2- 172.21.15.125:0/2176838069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f01cc070330 0x7f01cc0c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:05.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01d2156700 1 -- 172.21.15.125:0/2176838069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f01cc070330 msgr2=0x7f01cc0c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:05.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01d2156700 1 --2- 172.21.15.125:0/2176838069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f01cc070330 0x7f01cc0c3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01d2156700 1 -- 172.21.15.125:0/2176838069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01cc06ff50 msgr2=0x7f01cc1551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:05.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01d2156700 1 --2- 172.21.15.125:0/2176838069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01cc06ff50 0x7f01cc1551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01d2156700 1 -- 172.21.15.125:0/2176838069 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc0094b0 con 0x7f01cc06dea0 2023-10-17T06:08:05.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01d2156700 1 --2- 172.21.15.125:0/2176838069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01cc06dea0 0x7f01cc156700 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f01c800e9d0 tx=0x7f01c800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:05.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01c2ffd700 1 -- 172.21.15.125:0/2176838069 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8009720 con 0x7f01cc06dea0 2023-10-17T06:08:05.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01c2ffd700 1 -- 172.21.15.125:0/2176838069 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c800ee70 con 0x7f01cc06dea0 2023-10-17T06:08:05.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01d43ba700 1 -- 172.21.15.125:0/2176838069 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01cc0c30b0 con 0x7f01cc06dea0 2023-10-17T06:08:05.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01c2ffd700 1 -- 172.21.15.125:0/2176838069 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c800ca50 con 0x7f01cc06dea0 2023-10-17T06:08:05.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.567+0000 7f01d43ba700 1 -- 172.21.15.125:0/2176838069 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01cc155fc0 con 0x7f01cc06dea0 2023-10-17T06:08:05.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.571+0000 7f01d43ba700 1 -- 172.21.15.125:0/2176838069 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01cc072e60 con 0x7f01cc06dea0 2023-10-17T06:08:05.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.571+0000 7f01c2ffd700 1 -- 172.21.15.125:0/2176838069 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f01c800cbb0 con 0x7f01cc06dea0 2023-10-17T06:08:05.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.571+0000 7f01c2ffd700 1 --2- 172.21.15.125:0/2176838069 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f01b00656f0 0x7f01b0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:05.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.571+0000 7f01c2ffd700 1 -- 172.21.15.125:0/2176838069 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f01c8083150 con 0x7f01cc06dea0 2023-10-17T06:08:05.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.571+0000 7f01d1955700 1 --2- 172.21.15.125:0/2176838069 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f01b00656f0 0x7f01b0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:05.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.575+0000 7f01d1955700 1 --2- 172.21.15.125:0/2176838069 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f01b00656f0 0x7f01b0067bb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0090b0 tx=0x7f01bc01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:05.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.575+0000 7f01c2ffd700 1 -- 172.21.15.125:0/2176838069 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f01c8054360 con 0x7f01cc06dea0 2023-10-17T06:08:05.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.759+0000 7f01d43ba700 1 -- 172.21.15.125:0/2176838069 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f01cc1587b0 con 0x7f01cc06dea0 2023-10-17T06:08:05.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.759+0000 7f01c2ffd700 1 -- 172.21.15.125:0/2176838069 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f01c800ce60 con 0x7f01cc06dea0 2023-10-17T06:08:05.764 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:08:05.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.767+0000 7f01d43ba700 1 -- 172.21.15.125:0/2176838069 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f01b00656f0 msgr2=0x7f01b0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:05.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.767+0000 7f01d43ba700 1 --2- 172.21.15.125:0/2176838069 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f01b00656f0 0x7f01b0067bb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0090b0 tx=0x7f01bc01c040 comp rx=0 tx=0).stop 2023-10-17T06:08:05.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.767+0000 7f01d43ba700 1 -- 172.21.15.125:0/2176838069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01cc06dea0 msgr2=0x7f01cc156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:05.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.767+0000 7f01d43ba700 1 --2- 172.21.15.125:0/2176838069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01cc06dea0 0x7f01cc156700 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f01c800e9d0 tx=0x7f01c800ece0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.767+0000 7f01d43ba700 1 -- 172.21.15.125:0/2176838069 shutdown_connections 2023-10-17T06:08:05.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.767+0000 7f01d43ba700 1 --2- 172.21.15.125:0/2176838069 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f01b00656f0 0x7f01b0067bb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.767+0000 7f01d43ba700 1 --2- 172.21.15.125:0/2176838069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f01cc070330 0x7f01cc0c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.767+0000 7f01d43ba700 1 --2- 172.21.15.125:0/2176838069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01cc06ff50 0x7f01cc1551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.767+0000 7f01d43ba700 1 --2- 172.21.15.125:0/2176838069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f01cc06dea0 0x7f01cc156700 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.767+0000 7f01d43ba700 1 -- 172.21.15.125:0/2176838069 >> 172.21.15.125:0/2176838069 conn(0x7f01cc0ce820 msgr2=0x7f01cc0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:05.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.767+0000 7f01d43ba700 1 -- 172.21.15.125:0/2176838069 shutdown_connections 2023-10-17T06:08:05.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.767+0000 7f01d43ba700 1 -- 172.21.15.125:0/2176838069 wait complete. 2023-10-17T06:08:05.792 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:08:05.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.967+0000 7f13db154700 1 Processor -- start 2023-10-17T06:08:05.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.967+0000 7f13db154700 1 -- start start 2023-10-17T06:08:05.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.971+0000 7f13db154700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13d415e7d0 0x7f13d406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:05.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.971+0000 7f13db154700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d40d29f0 con 0x7f13d40d36b0 2023-10-17T06:08:05.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.971+0000 7f13db154700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d40b64b0 con 0x7f13d40d2610 2023-10-17T06:08:05.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.971+0000 7f13db154700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d40b6750 con 0x7f13d415e7d0 2023-10-17T06:08:05.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.971+0000 7f13d3fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f13d40d36b0 0x7f13d415d5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45142/0 (socket says 172.21.15.125:45142) 2023-10-17T06:08:05.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.971+0000 7f13d3fff700 1 -- 172.21.15.125:0/1374684499 learned_addr learned my addr 172.21.15.125:0/1374684499 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:05.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.971+0000 7f13d96f1700 1 --2- 172.21.15.125:0/1374684499 >> v2:172.21.15.125:3300/0 conn(0x7f13d415e7d0 0x7f13d406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:05.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.971+0000 7f13d37fe700 1 -- 172.21.15.125:0/1374684499 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283787792 0 0) 0x7f13d40d29f0 con 0x7f13d40d36b0 2023-10-17T06:08:05.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.971+0000 7f13d37fe700 1 -- 172.21.15.125:0/1374684499 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13c40035d0 con 0x7f13d40d36b0 2023-10-17T06:08:05.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.971+0000 7f13d96f1700 1 -- 172.21.15.125:0/1374684499 >> v1:172.21.15.184:6789/0 conn(0x7f13d40d2610 legacy=0x7f13d40d2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:05.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.971+0000 7f13d96f1700 1 -- 172.21.15.125:0/1374684499 >> v1:172.21.15.125:6789/0 conn(0x7f13d40d36b0 legacy=0x7f13d415d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:05.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.971+0000 7f13d37fe700 1 -- 172.21.15.125:0/1374684499 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 593057121 0 0) 0x7f13c40035d0 con 0x7f13d40d36b0 2023-10-17T06:08:05.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.971+0000 7f13d96f1700 1 -- 172.21.15.125:0/1374684499 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d40b6a30 con 0x7f13d415e7d0 2023-10-17T06:08:05.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.971+0000 7f13d96f1700 1 --2- 172.21.15.125:0/1374684499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d415e7d0 0x7f13d406e6f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009d90 tx=0x7f13cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a7cc4ed80e8422 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:05.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.971+0000 7f13d37fe700 1 -- 172.21.15.125:0/1374684499 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc00e070 con 0x7f13d415e7d0 2023-10-17T06:08:05.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.971+0000 7f13d37fe700 1 -- 172.21.15.125:0/1374684499 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc003a40 con 0x7f13d415e7d0 2023-10-17T06:08:05.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.971+0000 7f13d37fe700 1 -- 172.21.15.125:0/1374684499 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c0001670 con 0x7f13d415e7d0 2023-10-17T06:08:05.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.975+0000 7f13db154700 1 -- 172.21.15.125:0/1374684499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d415e7d0 msgr2=0x7f13d406e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:05.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.975+0000 7f13db154700 1 --2- 172.21.15.125:0/1374684499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d415e7d0 0x7f13d406e6f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009d90 tx=0x7f13cc00b330 comp rx=0 tx=0).stop 2023-10-17T06:08:05.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.975+0000 7f13db154700 1 -- 172.21.15.125:0/1374684499 shutdown_connections 2023-10-17T06:08:05.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.975+0000 7f13db154700 1 --2- 172.21.15.125:0/1374684499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d415e7d0 0x7f13d406e6f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.975+0000 7f13db154700 1 -- 172.21.15.125:0/1374684499 >> 172.21.15.125:0/1374684499 conn(0x7f13d4069f20 msgr2=0x7f13d406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:05.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.975+0000 7f13db154700 1 -- 172.21.15.125:0/1374684499 shutdown_connections 2023-10-17T06:08:05.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.975+0000 7f13db154700 1 -- 172.21.15.125:0/1374684499 wait complete. 2023-10-17T06:08:05.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.975+0000 7f13db154700 1 Processor -- start 2023-10-17T06:08:05.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.975+0000 7f13db154700 1 -- start start 2023-10-17T06:08:05.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.979+0000 7f13db154700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13d40d2610 0x7f13d41597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:05.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.979+0000 7f13db154700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d40d36b0 0x7f13d40ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:05.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.979+0000 7f13db154700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13d415e7d0 0x7f13d40afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:05.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.979+0000 7f13db154700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d40aceb0 con 0x7f13d40d36b0 2023-10-17T06:08:05.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.979+0000 7f13db154700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d40ad2d0 con 0x7f13d40d2610 2023-10-17T06:08:05.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.979+0000 7f13db154700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d4159d10 con 0x7f13d415e7d0 2023-10-17T06:08:05.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.979+0000 7f13d3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d40d36b0 0x7f13d40ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:05.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.979+0000 7f13d3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d40d36b0 0x7f13d40ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60930/0 (socket says 172.21.15.125:60930) 2023-10-17T06:08:05.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.979+0000 7f13d3fff700 1 -- 172.21.15.125:0/536400401 learned_addr learned my addr 172.21.15.125:0/536400401 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:05.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.979+0000 7f13d8ef0700 1 --2- 172.21.15.125:0/536400401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13d40d2610 0x7f13d41597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:05.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.979+0000 7f13d96f1700 1 --2- 172.21.15.125:0/536400401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13d415e7d0 0x7f13d40afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:05.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.979+0000 7f13d3fff700 1 -- 172.21.15.125:0/536400401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13d415e7d0 msgr2=0x7f13d40afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:05.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.979+0000 7f13d3fff700 1 --2- 172.21.15.125:0/536400401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13d415e7d0 0x7f13d40afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.979+0000 7f13d3fff700 1 -- 172.21.15.125:0/536400401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13d40d2610 msgr2=0x7f13d41597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:05.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.979+0000 7f13d3fff700 1 --2- 172.21.15.125:0/536400401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13d40d2610 0x7f13d41597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:05.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.979+0000 7f13d3fff700 1 -- 172.21.15.125:0/536400401 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13cc009a70 con 0x7f13d40d36b0 2023-10-17T06:08:05.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.979+0000 7f13d3fff700 1 --2- 172.21.15.125:0/536400401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d40d36b0 0x7f13d40ab8e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f13c000c750 tx=0x7f13c000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:05.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.983+0000 7f13d17fa700 1 -- 172.21.15.125:0/536400401 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c0005d90 con 0x7f13d40d36b0 2023-10-17T06:08:05.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.983+0000 7f13d17fa700 1 -- 172.21.15.125:0/536400401 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c00070d0 con 0x7f13d40d36b0 2023-10-17T06:08:05.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.983+0000 7f13db154700 1 -- 172.21.15.125:0/536400401 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d40ac230 con 0x7f13d40d36b0 2023-10-17T06:08:05.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.983+0000 7f13d17fa700 1 -- 172.21.15.125:0/536400401 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c0007480 con 0x7f13d40d36b0 2023-10-17T06:08:05.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.983+0000 7f13db154700 1 -- 172.21.15.125:0/536400401 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d40ac7f0 con 0x7f13d40d36b0 2023-10-17T06:08:05.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.983+0000 7f13db154700 1 -- 172.21.15.125:0/536400401 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d4072e60 con 0x7f13d40d36b0 2023-10-17T06:08:05.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.983+0000 7f13d17fa700 1 -- 172.21.15.125:0/536400401 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f13c00075e0 con 0x7f13d40d36b0 2023-10-17T06:08:05.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.987+0000 7f13d17fa700 1 --2- 172.21.15.125:0/536400401 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f13b8065720 0x7f13b8067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:05.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.987+0000 7f13d17fa700 1 -- 172.21.15.125:0/536400401 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f13c0082480 con 0x7f13d40d36b0 2023-10-17T06:08:05.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.987+0000 7f13d8ef0700 1 --2- 172.21.15.125:0/536400401 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f13b8065720 0x7f13b8067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:05.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.987+0000 7f13d8ef0700 1 --2- 172.21.15.125:0/536400401 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f13b8065720 0x7f13b8067be0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f13c8007fd0 tx=0x7f13c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:05.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:05.995+0000 7f13d17fa700 1 -- 172.21.15.125:0/536400401 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f13c004fcb0 con 0x7f13d40d36b0 2023-10-17T06:08:06.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.171+0000 7f13db154700 1 -- 172.21.15.125:0/536400401 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f13d40b78d0 con 0x7f13d40d36b0 2023-10-17T06:08:06.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.171+0000 7f13d17fa700 1 -- 172.21.15.125:0/536400401 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f13c00532d0 con 0x7f13d40d36b0 2023-10-17T06:08:06.174 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:08:06.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.171+0000 7f13db154700 1 -- 172.21.15.125:0/536400401 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f13b8065720 msgr2=0x7f13b8067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:06.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.171+0000 7f13db154700 1 --2- 172.21.15.125:0/536400401 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f13b8065720 0x7f13b8067be0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f13c8007fd0 tx=0x7f13c8009040 comp rx=0 tx=0).stop 2023-10-17T06:08:06.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.171+0000 7f13db154700 1 -- 172.21.15.125:0/536400401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d40d36b0 msgr2=0x7f13d40ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:06.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.171+0000 7f13db154700 1 --2- 172.21.15.125:0/536400401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d40d36b0 0x7f13d40ab8e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f13c000c750 tx=0x7f13c000ca60 comp rx=0 tx=0).stop 2023-10-17T06:08:06.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.175+0000 7f13db154700 1 -- 172.21.15.125:0/536400401 shutdown_connections 2023-10-17T06:08:06.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.175+0000 7f13db154700 1 --2- 172.21.15.125:0/536400401 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f13b8065720 0x7f13b8067be0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:06.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.175+0000 7f13db154700 1 --2- 172.21.15.125:0/536400401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f13d415e7d0 0x7f13d40afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:06.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.175+0000 7f13db154700 1 --2- 172.21.15.125:0/536400401 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d40d36b0 0x7f13d40ab8e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:06.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.175+0000 7f13db154700 1 --2- 172.21.15.125:0/536400401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f13d40d2610 0x7f13d41597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:06.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.175+0000 7f13db154700 1 -- 172.21.15.125:0/536400401 >> 172.21.15.125:0/536400401 conn(0x7f13d4069f20 msgr2=0x7f13d415f460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:06.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.175+0000 7f13db154700 1 -- 172.21.15.125:0/536400401 shutdown_connections 2023-10-17T06:08:06.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.175+0000 7f13db154700 1 -- 172.21.15.125:0/536400401 wait complete. 2023-10-17T06:08:06.198 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-17T06:08:06.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.371+0000 7fadc6384700 1 Processor -- start 2023-10-17T06:08:06.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.371+0000 7fadc6384700 1 -- start start 2023-10-17T06:08:06.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadc6384700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fadc0159750 0x7fadc0070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:06.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadc6384700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadc00ce040 0x7fadc006cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:06.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadc6384700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc00b14f0 con 0x7fadc0070aa0 2023-10-17T06:08:06.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadc6384700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc00c9aa0 con 0x7fadc0159750 2023-10-17T06:08:06.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadc6384700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc0070f30 con 0x7fadc00ce040 2023-10-17T06:08:06.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadc5382700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fadc0159750 0x7fadc0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:06.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadc5382700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fadc0159750 0x7fadc0070560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60936/0 (socket says 172.21.15.125:60936) 2023-10-17T06:08:06.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadc4b81700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fadc0070aa0 0x7fadc00cd930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45154/0 (socket says 172.21.15.125:45154) 2023-10-17T06:08:06.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadc5382700 1 -- 172.21.15.125:0/1085850086 learned_addr learned my addr 172.21.15.125:0/1085850086 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:06.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadc5b83700 1 --2- 172.21.15.125:0/1085850086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadc00ce040 0x7fadc006cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:06.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadc5382700 1 -- 172.21.15.125:0/1085850086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadc00ce040 msgr2=0x7fadc006cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:06.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadc5382700 1 --2- 172.21.15.125:0/1085850086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadc00ce040 0x7fadc006cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:06.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadc5382700 1 -- 172.21.15.125:0/1085850086 >> v1:172.21.15.125:6789/0 conn(0x7fadc0070aa0 legacy=0x7fadc00cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:06.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadc5382700 1 -- 172.21.15.125:0/1085850086 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc015d590 con 0x7fadc0159750 2023-10-17T06:08:06.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadc5382700 1 --2- 172.21.15.125:0/1085850086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadc0159750 0x7fadc0070560 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fadbc009910 tx=0x7fadbc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca3b6fb6df7f301 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:06.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadb7fff700 1 -- 172.21.15.125:0/1085850086 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc011830 con 0x7fadc0159750 2023-10-17T06:08:06.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadb7fff700 1 -- 172.21.15.125:0/1085850086 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadbc011990 con 0x7fadc0159750 2023-10-17T06:08:06.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadb7fff700 1 -- 172.21.15.125:0/1085850086 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc011d40 con 0x7fadc0159750 2023-10-17T06:08:06.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadc6384700 1 -- 172.21.15.125:0/1085850086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadc0159750 msgr2=0x7fadc0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:06.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadc6384700 1 --2- 172.21.15.125:0/1085850086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadc0159750 0x7fadc0070560 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fadbc009910 tx=0x7fadbc009c20 comp rx=0 tx=0).stop 2023-10-17T06:08:06.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.375+0000 7fadc6384700 1 -- 172.21.15.125:0/1085850086 shutdown_connections 2023-10-17T06:08:06.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.379+0000 7fadc6384700 1 --2- 172.21.15.125:0/1085850086 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadc00ce040 0x7fadc006cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:06.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.379+0000 7fadc6384700 1 --2- 172.21.15.125:0/1085850086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadc0159750 0x7fadc0070560 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:06.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.379+0000 7fadc6384700 1 -- 172.21.15.125:0/1085850086 >> 172.21.15.125:0/1085850086 conn(0x7fadc00ce5c0 msgr2=0x7fadc00ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:06.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.379+0000 7fadc6384700 1 -- 172.21.15.125:0/1085850086 shutdown_connections 2023-10-17T06:08:06.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.379+0000 7fadc6384700 1 -- 172.21.15.125:0/1085850086 wait complete. 2023-10-17T06:08:06.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.379+0000 7fadc6384700 1 Processor -- start 2023-10-17T06:08:06.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.379+0000 7fadc6384700 1 -- start start 2023-10-17T06:08:06.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadc6384700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadc0070aa0 0x7fadc00c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:06.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadc6384700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadc00ce040 0x7fadc00c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:06.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadc6384700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadc0159750 0x7fadc01f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:06.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadc6384700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00abaf0 con 0x7fadc0159750 2023-10-17T06:08:06.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadc6384700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc0159bc0 con 0x7fadc0070aa0 2023-10-17T06:08:06.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadc6384700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00c79d0 con 0x7fadc00ce040 2023-10-17T06:08:06.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadc5b83700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadc0159750 0x7fadc01f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:06.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadc5b83700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadc0159750 0x7fadc01f22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60948/0 (socket says 172.21.15.125:60948) 2023-10-17T06:08:06.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadc5b83700 1 -- 172.21.15.125:0/3288831090 learned_addr learned my addr 172.21.15.125:0/3288831090 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:06.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadc5382700 1 --2- 172.21.15.125:0/3288831090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadc0070aa0 0x7fadc00c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:06.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadc4b81700 1 --2- 172.21.15.125:0/3288831090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadc00ce040 0x7fadc00c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:06.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadc5b83700 1 -- 172.21.15.125:0/3288831090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadc00ce040 msgr2=0x7fadc00c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:06.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadc5b83700 1 --2- 172.21.15.125:0/3288831090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadc00ce040 0x7fadc00c36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:06.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadc5b83700 1 -- 172.21.15.125:0/3288831090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadc0070aa0 msgr2=0x7fadc00c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:06.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadc5b83700 1 --2- 172.21.15.125:0/3288831090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadc0070aa0 0x7fadc00c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:06.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadc5b83700 1 -- 172.21.15.125:0/3288831090 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc009570 con 0x7fadc0159750 2023-10-17T06:08:06.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadc5382700 1 --2- 172.21.15.125:0/3288831090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadc0070aa0 0x7fadc00c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:06.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadc5b83700 1 --2- 172.21.15.125:0/3288831090 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadc0159750 0x7fadc01f22f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fadb800efc0 tx=0x7fadb800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:06.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadb5ffb700 1 -- 172.21.15.125:0/3288831090 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb800cd40 con 0x7fadc0159750 2023-10-17T06:08:06.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadb5ffb700 1 -- 172.21.15.125:0/3288831090 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb800f040 con 0x7fadc0159750 2023-10-17T06:08:06.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadc6384700 1 -- 172.21.15.125:0/3288831090 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc00c7cb0 con 0x7fadc0159750 2023-10-17T06:08:06.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadb5ffb700 1 -- 172.21.15.125:0/3288831090 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb80146c0 con 0x7fadc0159750 2023-10-17T06:08:06.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.383+0000 7fadc6384700 1 -- 172.21.15.125:0/3288831090 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc00c8270 con 0x7fadc0159750 2023-10-17T06:08:06.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.387+0000 7fadc6384700 1 -- 172.21.15.125:0/3288831090 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc0159d70 con 0x7fadc0159750 2023-10-17T06:08:06.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.387+0000 7fadb5ffb700 1 -- 172.21.15.125:0/3288831090 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fadb8014820 con 0x7fadc0159750 2023-10-17T06:08:06.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.387+0000 7fadb5ffb700 1 --2- 172.21.15.125:0/3288831090 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fada40656f0 0x7fada4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:06.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.387+0000 7fadb5ffb700 1 -- 172.21.15.125:0/3288831090 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fadb8083d80 con 0x7fadc0159750 2023-10-17T06:08:06.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.391+0000 7fadc5382700 1 --2- 172.21.15.125:0/3288831090 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fada40656f0 0x7fada4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:06.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.391+0000 7fadc5382700 1 --2- 172.21.15.125:0/3288831090 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fada40656f0 0x7fada4067bb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fadbc014040 tx=0x7fadbc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:06.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.391+0000 7fadb5ffb700 1 -- 172.21.15.125:0/3288831090 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fadc0159d70 con 0x7fadc0159750 2023-10-17T06:08:06.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.615+0000 7fadc6384700 1 -- 172.21.15.125:0/3288831090 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fadc0159d30 con 0x7fadc0159750 2023-10-17T06:08:06.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.615+0000 7fadb5ffb700 1 -- 172.21.15.125:0/3288831090 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fadb8018020 con 0x7fadc0159750 2023-10-17T06:08:06.619 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:06.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.619+0000 7fadc6384700 1 -- 172.21.15.125:0/3288831090 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fada40656f0 msgr2=0x7fada4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:06.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.619+0000 7fadc6384700 1 --2- 172.21.15.125:0/3288831090 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fada40656f0 0x7fada4067bb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fadbc014040 tx=0x7fadbc008030 comp rx=0 tx=0).stop 2023-10-17T06:08:06.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.619+0000 7fadc6384700 1 -- 172.21.15.125:0/3288831090 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadc0159750 msgr2=0x7fadc01f22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:06.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.619+0000 7fadc6384700 1 --2- 172.21.15.125:0/3288831090 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadc0159750 0x7fadc01f22f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fadb800efc0 tx=0x7fadb800c3a0 comp rx=0 tx=0).stop 2023-10-17T06:08:06.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.619+0000 7fadc6384700 1 -- 172.21.15.125:0/3288831090 shutdown_connections 2023-10-17T06:08:06.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.619+0000 7fadc6384700 1 --2- 172.21.15.125:0/3288831090 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fada40656f0 0x7fada4067bb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:06.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.619+0000 7fadc6384700 1 --2- 172.21.15.125:0/3288831090 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fadc0159750 0x7fadc01f22f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:06.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.619+0000 7fadc6384700 1 --2- 172.21.15.125:0/3288831090 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fadc00ce040 0x7fadc00c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:06.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.619+0000 7fadc6384700 1 --2- 172.21.15.125:0/3288831090 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadc0070aa0 0x7fadc00c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:06.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.619+0000 7fadc6384700 1 -- 172.21.15.125:0/3288831090 >> 172.21.15.125:0/3288831090 conn(0x7fadc00ce5c0 msgr2=0x7fadc00cc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:06.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.619+0000 7fadc6384700 1 -- 172.21.15.125:0/3288831090 shutdown_connections 2023-10-17T06:08:06.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.619+0000 7fadc6384700 1 -- 172.21.15.125:0/3288831090 wait complete. 2023-10-17T06:08:06.645 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-17T06:08:06.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.815+0000 7f521e777700 1 Processor -- start 2023-10-17T06:08:06.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.815+0000 7f521e777700 1 -- start start 2023-10-17T06:08:06.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.815+0000 7f521e777700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5218161080 0x7f52180ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:06.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.815+0000 7f521e777700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5218165710 0x7f521806a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:06.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.815+0000 7f521e777700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52180cdbf0 con 0x7f521806a5f0 2023-10-17T06:08:06.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.815+0000 7f521e777700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521806aa60 con 0x7f5218161080 2023-10-17T06:08:06.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.815+0000 7f521e777700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52180caa30 con 0x7f5218165710 2023-10-17T06:08:06.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.815+0000 7f521d775700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5218161080 0x7f52180ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:06.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.815+0000 7f521df76700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f521806a5f0 0x7f521806ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45162/0 (socket says 172.21.15.125:45162) 2023-10-17T06:08:06.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.815+0000 7f521df76700 1 -- 172.21.15.125:0/1641190412 learned_addr learned my addr 172.21.15.125:0/1641190412 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:06.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.815+0000 7f521cf74700 1 --2- 172.21.15.125:0/1641190412 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5218165710 0x7f521806a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:06.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.819+0000 7f520ffff700 1 -- 172.21.15.125:0/1641190412 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851113973 0 0) 0x7f52180cdbf0 con 0x7f521806a5f0 2023-10-17T06:08:06.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.819+0000 7f520ffff700 1 -- 172.21.15.125:0/1641190412 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52040035d0 con 0x7f521806a5f0 2023-10-17T06:08:06.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.819+0000 7f521cf74700 1 -- 172.21.15.125:0/1641190412 >> v2:172.21.15.125:3300/0 conn(0x7f5218161080 msgr2=0x7f52180ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:06.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.819+0000 7f521cf74700 1 --2- 172.21.15.125:0/1641190412 >> v2:172.21.15.125:3300/0 conn(0x7f5218161080 0x7f52180ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:06.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.819+0000 7f521cf74700 1 -- 172.21.15.125:0/1641190412 >> v1:172.21.15.125:6789/0 conn(0x7f521806a5f0 legacy=0x7f521806ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:06.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.819+0000 7f521cf74700 1 -- 172.21.15.125:0/1641190412 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52180cad10 con 0x7f5218165710 2023-10-17T06:08:06.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.819+0000 7f521cf74700 1 --2- 172.21.15.125:0/1641190412 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5218165710 0x7f521806a0b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5208009850 tx=0x7f5208009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e17b44f1c1ed3bbb server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:06.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.819+0000 7f520ffff700 1 -- 172.21.15.125:0/1641190412 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208011830 con 0x7f5218165710 2023-10-17T06:08:06.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.819+0000 7f520ffff700 1 -- 172.21.15.125:0/1641190412 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5208011990 con 0x7f5218165710 2023-10-17T06:08:06.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.819+0000 7f520ffff700 1 -- 172.21.15.125:0/1641190412 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208011d40 con 0x7f5218165710 2023-10-17T06:08:06.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.819+0000 7f521e777700 1 -- 172.21.15.125:0/1641190412 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5218165710 msgr2=0x7f521806a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:06.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.819+0000 7f521e777700 1 --2- 172.21.15.125:0/1641190412 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5218165710 0x7f521806a0b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5208009850 tx=0x7f5208009b60 comp rx=0 tx=0).stop 2023-10-17T06:08:06.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.819+0000 7f521e777700 1 -- 172.21.15.125:0/1641190412 shutdown_connections 2023-10-17T06:08:06.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.819+0000 7f521e777700 1 --2- 172.21.15.125:0/1641190412 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5218165710 0x7f521806a0b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:06.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.819+0000 7f521e777700 1 --2- 172.21.15.125:0/1641190412 >> v2:172.21.15.125:3300/0 conn(0x7f5218161080 0x7f52180ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:06.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.819+0000 7f521e777700 1 -- 172.21.15.125:0/1641190412 >> 172.21.15.125:0/1641190412 conn(0x7f52180cf6b0 msgr2=0x7f52180cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:06.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.819+0000 7f521e777700 1 -- 172.21.15.125:0/1641190412 shutdown_connections 2023-10-17T06:08:06.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.819+0000 7f521e777700 1 -- 172.21.15.125:0/1641190412 wait complete. 2023-10-17T06:08:06.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.823+0000 7f521e777700 1 Processor -- start 2023-10-17T06:08:06.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.823+0000 7f521e777700 1 -- start start 2023-10-17T06:08:06.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.823+0000 7f521e777700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f521806a5f0 0x7f5218070940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:06.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.823+0000 7f521e777700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5218161080 0x7f52180c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:06.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.823+0000 7f521e777700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5218165710 0x7f52181f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:06.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.823+0000 7f521e777700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5218161d70 con 0x7f521806a5f0 2023-10-17T06:08:06.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.823+0000 7f521e777700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5218161460 con 0x7f5218161080 2023-10-17T06:08:06.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.823+0000 7f521e777700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52180c4a60 con 0x7f5218165710 2023-10-17T06:08:06.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.823+0000 7f521d775700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f521806a5f0 0x7f5218070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:06.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.823+0000 7f521d775700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f521806a5f0 0x7f5218070940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60962/0 (socket says 172.21.15.125:60962) 2023-10-17T06:08:06.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.823+0000 7f521d775700 1 -- 172.21.15.125:0/471995733 learned_addr learned my addr 172.21.15.125:0/471995733 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:06.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.827+0000 7f521cf74700 1 --2- 172.21.15.125:0/471995733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5218161080 0x7f52180c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:06.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.827+0000 7f521df76700 1 --2- 172.21.15.125:0/471995733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5218165710 0x7f52181f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:06.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.827+0000 7f521d775700 1 -- 172.21.15.125:0/471995733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5218165710 msgr2=0x7f52181f6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:06.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.827+0000 7f521d775700 1 --2- 172.21.15.125:0/471995733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5218165710 0x7f52181f6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:06.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.827+0000 7f521d775700 1 -- 172.21.15.125:0/471995733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5218161080 msgr2=0x7f52180c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:06.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.827+0000 7f521d775700 1 --2- 172.21.15.125:0/471995733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5218161080 0x7f52180c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:06.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.827+0000 7f521d775700 1 -- 172.21.15.125:0/471995733 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52080094b0 con 0x7f521806a5f0 2023-10-17T06:08:06.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.827+0000 7f521df76700 1 --2- 172.21.15.125:0/471995733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5218165710 0x7f52181f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:06.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.827+0000 7f521d775700 1 --2- 172.21.15.125:0/471995733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f521806a5f0 0x7f5218070940 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5214009db0 tx=0x7f521400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:06.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.827+0000 7f520dffb700 1 -- 172.21.15.125:0/471995733 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5214009c20 con 0x7f521806a5f0 2023-10-17T06:08:06.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.827+0000 7f520dffb700 1 -- 172.21.15.125:0/471995733 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521400f040 con 0x7f521806a5f0 2023-10-17T06:08:06.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.827+0000 7f521e777700 1 -- 172.21.15.125:0/471995733 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52181616b0 con 0x7f521806a5f0 2023-10-17T06:08:06.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.827+0000 7f520dffb700 1 -- 172.21.15.125:0/471995733 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5214014480 con 0x7f521806a5f0 2023-10-17T06:08:06.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.827+0000 7f521e777700 1 -- 172.21.15.125:0/471995733 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5218070e80 con 0x7f521806a5f0 2023-10-17T06:08:06.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.827+0000 7f521e777700 1 -- 172.21.15.125:0/471995733 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52180710d0 con 0x7f521806a5f0 2023-10-17T06:08:06.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.831+0000 7f520dffb700 1 -- 172.21.15.125:0/471995733 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f52140145e0 con 0x7f521806a5f0 2023-10-17T06:08:06.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.831+0000 7f520dffb700 1 --2- 172.21.15.125:0/471995733 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f51fc0656f0 0x7f51fc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:06.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.831+0000 7f520dffb700 1 -- 172.21.15.125:0/471995733 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5214083920 con 0x7f521806a5f0 2023-10-17T06:08:06.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.831+0000 7f521cf74700 1 --2- 172.21.15.125:0/471995733 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f51fc0656f0 0x7f51fc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:06.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.831+0000 7f521cf74700 1 --2- 172.21.15.125:0/471995733 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f51fc0656f0 0x7f51fc067bb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5218165b10 tx=0x7f520801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:06.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:06.839+0000 7f520dffb700 1 -- 172.21.15.125:0/471995733 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f5214054bd0 con 0x7f521806a5f0 2023-10-17T06:08:07.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.019+0000 7f521e777700 1 -- 172.21.15.125:0/471995733 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5218161fe0 con 0x7f521806a5f0 2023-10-17T06:08:07.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.019+0000 7f520dffb700 1 -- 172.21.15.125:0/471995733 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5214054760 con 0x7f521806a5f0 2023-10-17T06:08:07.022 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-17T06:08:07.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.019+0000 7f521e777700 1 -- 172.21.15.125:0/471995733 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f51fc0656f0 msgr2=0x7f51fc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:07.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.019+0000 7f521e777700 1 --2- 172.21.15.125:0/471995733 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f51fc0656f0 0x7f51fc067bb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5218165b10 tx=0x7f520801c040 comp rx=0 tx=0).stop 2023-10-17T06:08:07.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.019+0000 7f521e777700 1 -- 172.21.15.125:0/471995733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f521806a5f0 msgr2=0x7f5218070940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:07.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.023+0000 7f521e777700 1 --2- 172.21.15.125:0/471995733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f521806a5f0 0x7f5218070940 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5214009db0 tx=0x7f521400c3a0 comp rx=0 tx=0).stop 2023-10-17T06:08:07.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.023+0000 7f521e777700 1 -- 172.21.15.125:0/471995733 shutdown_connections 2023-10-17T06:08:07.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.023+0000 7f521e777700 1 --2- 172.21.15.125:0/471995733 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f51fc0656f0 0x7f51fc067bb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:07.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.023+0000 7f521e777700 1 --2- 172.21.15.125:0/471995733 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f5218165710 0x7f52181f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:07.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.023+0000 7f521e777700 1 --2- 172.21.15.125:0/471995733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5218161080 0x7f52180c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:07.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.023+0000 7f521e777700 1 --2- 172.21.15.125:0/471995733 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f521806a5f0 0x7f5218070940 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:07.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.023+0000 7f521e777700 1 -- 172.21.15.125:0/471995733 >> 172.21.15.125:0/471995733 conn(0x7f52180cf6b0 msgr2=0x7f52180cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:07.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.023+0000 7f521e777700 1 -- 172.21.15.125:0/471995733 shutdown_connections 2023-10-17T06:08:07.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.023+0000 7f521e777700 1 -- 172.21.15.125:0/471995733 wait complete. 2023-10-17T06:08:07.049 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-17T06:08:07.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.239+0000 7fc854333700 1 Processor -- start 2023-10-17T06:08:07.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.239+0000 7fc854333700 1 -- start start 2023-10-17T06:08:07.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.239+0000 7fc854333700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84c0ccfe0 0x7fc84c06f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:07.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.239+0000 7fc854333700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84c15b1d0 con 0x7fc84c15adf0 2023-10-17T06:08:07.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.239+0000 7fc854333700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84c0ce600 con 0x7fc84c06f990 2023-10-17T06:08:07.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.239+0000 7fc854333700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c0ca590 con 0x7fc84c0ccfe0 2023-10-17T06:08:07.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.243+0000 7fc8520cf700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc84c15adf0 0x7fc84c0cc8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45166/0 (socket says 172.21.15.125:45166) 2023-10-17T06:08:07.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.243+0000 7fc8520cf700 1 -- 172.21.15.125:0/3696831390 learned_addr learned my addr 172.21.15.125:0/3696831390 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:07.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.243+0000 7fc8518ce700 1 --2- 172.21.15.125:0/3696831390 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84c0ccfe0 0x7fc84c06f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:07.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.243+0000 7fc8510cd700 1 -- 172.21.15.125:0/3696831390 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388607955 0 0) 0x7fc848001110 con 0x7fc84c15adf0 2023-10-17T06:08:07.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.243+0000 7fc8510cd700 1 -- 172.21.15.125:0/3696831390 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8380035d0 con 0x7fc84c15adf0 2023-10-17T06:08:07.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.243+0000 7fc8518ce700 1 -- 172.21.15.125:0/3696831390 >> v1:172.21.15.184:6789/0 conn(0x7fc84c06f990 legacy=0x7fc84c06fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:07.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.243+0000 7fc8518ce700 1 -- 172.21.15.125:0/3696831390 >> v1:172.21.15.125:6789/0 conn(0x7fc84c15adf0 legacy=0x7fc84c0cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:07.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.243+0000 7fc8518ce700 1 -- 172.21.15.125:0/3696831390 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84c0cd580 con 0x7fc84c0ccfe0 2023-10-17T06:08:07.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.243+0000 7fc8518ce700 1 --2- 172.21.15.125:0/3696831390 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84c0ccfe0 0x7fc84c06f450 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009880 tx=0x7fc83c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2917c59e8affe8c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:07.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.243+0000 7fc8510cd700 1 -- 172.21.15.125:0/3696831390 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c011830 con 0x7fc84c0ccfe0 2023-10-17T06:08:07.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.243+0000 7fc8510cd700 1 -- 172.21.15.125:0/3696831390 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83c011990 con 0x7fc84c0ccfe0 2023-10-17T06:08:07.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.243+0000 7fc8510cd700 1 -- 172.21.15.125:0/3696831390 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c011d20 con 0x7fc84c0ccfe0 2023-10-17T06:08:07.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.243+0000 7fc854333700 1 -- 172.21.15.125:0/3696831390 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84c0ccfe0 msgr2=0x7fc84c06f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:07.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.243+0000 7fc854333700 1 --2- 172.21.15.125:0/3696831390 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84c0ccfe0 0x7fc84c06f450 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009880 tx=0x7fc83c009b90 comp rx=0 tx=0).stop 2023-10-17T06:08:07.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.243+0000 7fc854333700 1 -- 172.21.15.125:0/3696831390 shutdown_connections 2023-10-17T06:08:07.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.243+0000 7fc854333700 1 --2- 172.21.15.125:0/3696831390 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84c0ccfe0 0x7fc84c06f450 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:07.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.243+0000 7fc854333700 1 -- 172.21.15.125:0/3696831390 >> 172.21.15.125:0/3696831390 conn(0x7fc84c0ce820 msgr2=0x7fc84c0cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:07.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.243+0000 7fc854333700 1 -- 172.21.15.125:0/3696831390 shutdown_connections 2023-10-17T06:08:07.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.243+0000 7fc854333700 1 -- 172.21.15.125:0/3696831390 wait complete. 2023-10-17T06:08:07.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.247+0000 7fc854333700 1 Processor -- start 2023-10-17T06:08:07.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.247+0000 7fc854333700 1 -- start start 2023-10-17T06:08:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc854333700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84c06f990 0x7fc84c1f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc854333700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc84c0ccfe0 0x7fc84c157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc854333700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc84c15adf0 0x7fc84c14ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc854333700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c159100 con 0x7fc84c15adf0 2023-10-17T06:08:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc854333700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c155180 con 0x7fc84c0ccfe0 2023-10-17T06:08:07.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc854333700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c1f31f0 con 0x7fc84c06f990 2023-10-17T06:08:07.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc8528d0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc84c15adf0 0x7fc84c14ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:07.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc8528d0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc84c15adf0 0x7fc84c14ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60970/0 (socket says 172.21.15.125:60970) 2023-10-17T06:08:07.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc8528d0700 1 -- 172.21.15.125:0/3214396387 learned_addr learned my addr 172.21.15.125:0/3214396387 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:07.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc8520cf700 1 --2- 172.21.15.125:0/3214396387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84c06f990 0x7fc84c1f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:07.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc8518ce700 1 --2- 172.21.15.125:0/3214396387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc84c0ccfe0 0x7fc84c157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:07.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc8528d0700 1 -- 172.21.15.125:0/3214396387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84c06f990 msgr2=0x7fc84c1f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:07.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc8528d0700 1 --2- 172.21.15.125:0/3214396387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84c06f990 0x7fc84c1f2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:07.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc8528d0700 1 -- 172.21.15.125:0/3214396387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc84c0ccfe0 msgr2=0x7fc84c157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:07.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc8528d0700 1 --2- 172.21.15.125:0/3214396387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc84c0ccfe0 0x7fc84c157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:07.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc8528d0700 1 -- 172.21.15.125:0/3214396387 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c0094b0 con 0x7fc84c15adf0 2023-10-17T06:08:07.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc8528d0700 1 --2- 172.21.15.125:0/3214396387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc84c15adf0 0x7fc84c14ff60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc84400cc50 tx=0x7fc84400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:07.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc842ffd700 1 -- 172.21.15.125:0/3214396387 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc844003c20 con 0x7fc84c15adf0 2023-10-17T06:08:07.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc842ffd700 1 -- 172.21.15.125:0/3214396387 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc844003d80 con 0x7fc84c15adf0 2023-10-17T06:08:07.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc854333700 1 -- 172.21.15.125:0/3214396387 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc84c1f34d0 con 0x7fc84c15adf0 2023-10-17T06:08:07.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc842ffd700 1 -- 172.21.15.125:0/3214396387 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84400aab0 con 0x7fc84c15adf0 2023-10-17T06:08:07.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.251+0000 7fc854333700 1 -- 172.21.15.125:0/3214396387 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84c0c66a0 con 0x7fc84c15adf0 2023-10-17T06:08:07.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.255+0000 7fc854333700 1 -- 172.21.15.125:0/3214396387 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84c155350 con 0x7fc84c15adf0 2023-10-17T06:08:07.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.255+0000 7fc842ffd700 1 -- 172.21.15.125:0/3214396387 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc84400ac10 con 0x7fc84c15adf0 2023-10-17T06:08:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.255+0000 7fc842ffd700 1 --2- 172.21.15.125:0/3214396387 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc8300656f0 0x7fc830067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.255+0000 7fc842ffd700 1 -- 172.21.15.125:0/3214396387 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc844083190 con 0x7fc84c15adf0 2023-10-17T06:08:07.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.255+0000 7fc8520cf700 1 --2- 172.21.15.125:0/3214396387 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc8300656f0 0x7fc830067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:07.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.259+0000 7fc8520cf700 1 --2- 172.21.15.125:0/3214396387 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc8300656f0 0x7fc830067bb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc848007fd0 tx=0x7fc848007c60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:07.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.263+0000 7fc842ffd700 1 -- 172.21.15.125:0/3214396387 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc84c155350 con 0x7fc84c15adf0 2023-10-17T06:08:07.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.435+0000 7fc854333700 1 -- 172.21.15.125:0/3214396387 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc84c1552f0 con 0x7fc84c15adf0 2023-10-17T06:08:07.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.435+0000 7fc842ffd700 1 -- 172.21.15.125:0/3214396387 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc844050880 con 0x7fc84c15adf0 2023-10-17T06:08:07.440 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:07.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.439+0000 7fc854333700 1 -- 172.21.15.125:0/3214396387 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc8300656f0 msgr2=0x7fc830067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:07.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.439+0000 7fc854333700 1 --2- 172.21.15.125:0/3214396387 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc8300656f0 0x7fc830067bb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc848007fd0 tx=0x7fc848007c60 comp rx=0 tx=0).stop 2023-10-17T06:08:07.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.439+0000 7fc854333700 1 -- 172.21.15.125:0/3214396387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc84c15adf0 msgr2=0x7fc84c14ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:07.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.439+0000 7fc854333700 1 --2- 172.21.15.125:0/3214396387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc84c15adf0 0x7fc84c14ff60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc84400cc50 tx=0x7fc84400cf60 comp rx=0 tx=0).stop 2023-10-17T06:08:07.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.439+0000 7fc854333700 1 -- 172.21.15.125:0/3214396387 shutdown_connections 2023-10-17T06:08:07.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.439+0000 7fc854333700 1 --2- 172.21.15.125:0/3214396387 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc8300656f0 0x7fc830067bb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:07.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.439+0000 7fc854333700 1 --2- 172.21.15.125:0/3214396387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc84c15adf0 0x7fc84c14ff60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:07.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.439+0000 7fc854333700 1 --2- 172.21.15.125:0/3214396387 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc84c0ccfe0 0x7fc84c157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:07.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.439+0000 7fc854333700 1 --2- 172.21.15.125:0/3214396387 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc84c06f990 0x7fc84c1f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:07.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.439+0000 7fc854333700 1 -- 172.21.15.125:0/3214396387 >> 172.21.15.125:0/3214396387 conn(0x7fc84c0ce820 msgr2=0x7fc84c0b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:07.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.439+0000 7fc854333700 1 -- 172.21.15.125:0/3214396387 shutdown_connections 2023-10-17T06:08:07.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.439+0000 7fc854333700 1 -- 172.21.15.125:0/3214396387 wait complete. 2023-10-17T06:08:07.467 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:08:07.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.639+0000 7fb7088fb700 1 Processor -- start 2023-10-17T06:08:07.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.639+0000 7fb7088fb700 1 -- start start 2023-10-17T06:08:07.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.639+0000 7fb7088fb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb7040cf760 0x7fb704069f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:07.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.639+0000 7fb7088fb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb704160870 con 0x7fb70406a460 2023-10-17T06:08:07.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.639+0000 7fb7088fb700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70406a890 con 0x7fb70415cd20 2023-10-17T06:08:07.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.639+0000 7fb7088fb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7040d0500 con 0x7fb7040cf760 2023-10-17T06:08:07.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.639+0000 7fb702ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb7040cf760 0x7fb704069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:07.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.639+0000 7fb703fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb70406a460 0x7fb70415d100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45174/0 (socket says 172.21.15.125:45174) 2023-10-17T06:08:07.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.639+0000 7fb703fff700 1 -- 172.21.15.125:0/2763623632 learned_addr learned my addr 172.21.15.125:0/2763623632 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:07.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.639+0000 7fb702ffd700 1 -- 172.21.15.125:0/2763623632 >> v1:172.21.15.184:6789/0 conn(0x7fb70415cd20 legacy=0x7fb7040cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:07.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.639+0000 7fb702ffd700 1 -- 172.21.15.125:0/2763623632 >> v1:172.21.15.125:6789/0 conn(0x7fb70406a460 legacy=0x7fb70415d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:07.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.639+0000 7fb702ffd700 1 -- 172.21.15.125:0/2763623632 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb704070460 con 0x7fb7040cf760 2023-10-17T06:08:07.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.639+0000 7fb7027fc700 1 -- 172.21.15.125:0/2763623632 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442089875 0 0) 0x7fb704160870 con 0x7fb70406a460 2023-10-17T06:08:07.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.643+0000 7fb702ffd700 1 --2- 172.21.15.125:0/2763623632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7040cf760 0x7fb704069f20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009850 tx=0x7fb6f8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b0bc6a57845ee4 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:07.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.643+0000 7fb7027fc700 1 -- 172.21.15.125:0/2763623632 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8011830 con 0x7fb7040cf760 2023-10-17T06:08:07.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.643+0000 7fb7027fc700 1 -- 172.21.15.125:0/2763623632 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f8011990 con 0x7fb7040cf760 2023-10-17T06:08:07.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.643+0000 7fb7027fc700 1 -- 172.21.15.125:0/2763623632 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8011d20 con 0x7fb7040cf760 2023-10-17T06:08:07.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.643+0000 7fb7088fb700 1 -- 172.21.15.125:0/2763623632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7040cf760 msgr2=0x7fb704069f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:07.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.643+0000 7fb7088fb700 1 --2- 172.21.15.125:0/2763623632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7040cf760 0x7fb704069f20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009850 tx=0x7fb6f8009b60 comp rx=0 tx=0).stop 2023-10-17T06:08:07.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.643+0000 7fb7088fb700 1 -- 172.21.15.125:0/2763623632 shutdown_connections 2023-10-17T06:08:07.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.643+0000 7fb7088fb700 1 --2- 172.21.15.125:0/2763623632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7040cf760 0x7fb704069f20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:07.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.643+0000 7fb7088fb700 1 -- 172.21.15.125:0/2763623632 >> 172.21.15.125:0/2763623632 conn(0x7fb7040b22f0 msgr2=0x7fb7040b26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:07.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.643+0000 7fb7088fb700 1 -- 172.21.15.125:0/2763623632 shutdown_connections 2023-10-17T06:08:07.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.643+0000 7fb7088fb700 1 -- 172.21.15.125:0/2763623632 wait complete. 2023-10-17T06:08:07.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.647+0000 7fb7088fb700 1 Processor -- start 2023-10-17T06:08:07.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.647+0000 7fb7088fb700 1 -- start start 2023-10-17T06:08:07.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.647+0000 7fb7088fb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb70406a460 0x7fb7040b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:07.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.647+0000 7fb7088fb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7040cf760 0x7fb7040c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:07.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.647+0000 7fb7088fb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb70415cd20 0x7fb704155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:07.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.647+0000 7fb7088fb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb704156310 con 0x7fb70415cd20 2023-10-17T06:08:07.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.647+0000 7fb7088fb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7040c5e60 con 0x7fb70406a460 2023-10-17T06:08:07.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.647+0000 7fb7088fb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7040c6be0 con 0x7fb7040cf760 2023-10-17T06:08:07.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.647+0000 7fb703fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb70415cd20 0x7fb704155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:07.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.647+0000 7fb7037fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb70406a460 0x7fb7040b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:07.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.647+0000 7fb703fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb70415cd20 0x7fb704155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60980/0 (socket says 172.21.15.125:60980) 2023-10-17T06:08:07.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.647+0000 7fb703fff700 1 -- 172.21.15.125:0/2849957165 learned_addr learned my addr 172.21.15.125:0/2849957165 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:07.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.647+0000 7fb702ffd700 1 --2- 172.21.15.125:0/2849957165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7040cf760 0x7fb7040c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:07.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.647+0000 7fb703fff700 1 -- 172.21.15.125:0/2849957165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7040cf760 msgr2=0x7fb7040c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:07.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.647+0000 7fb703fff700 1 --2- 172.21.15.125:0/2849957165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7040cf760 0x7fb7040c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:07.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.647+0000 7fb703fff700 1 -- 172.21.15.125:0/2849957165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb70406a460 msgr2=0x7fb7040b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:07.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.647+0000 7fb703fff700 1 --2- 172.21.15.125:0/2849957165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb70406a460 0x7fb7040b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:07.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.647+0000 7fb703fff700 1 -- 172.21.15.125:0/2849957165 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f80094b0 con 0x7fb70415cd20 2023-10-17T06:08:07.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.651+0000 7fb703fff700 1 --2- 172.21.15.125:0/2849957165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb70415cd20 0x7fb704155dd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00ccd0 tx=0x7fb6fc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:07.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.651+0000 7fb6ebfff700 1 -- 172.21.15.125:0/2849957165 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc00aad0 con 0x7fb70415cd20 2023-10-17T06:08:07.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.651+0000 7fb6ebfff700 1 -- 172.21.15.125:0/2849957165 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc00ac30 con 0x7fb70415cd20 2023-10-17T06:08:07.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.651+0000 7fb6ebfff700 1 -- 172.21.15.125:0/2849957165 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc0070d0 con 0x7fb70415cd20 2023-10-17T06:08:07.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.651+0000 7fb7088fb700 1 -- 172.21.15.125:0/2849957165 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7040b6730 con 0x7fb70415cd20 2023-10-17T06:08:07.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.651+0000 7fb7088fb700 1 -- 172.21.15.125:0/2849957165 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7040c6590 con 0x7fb70415cd20 2023-10-17T06:08:07.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.651+0000 7fb7088fb700 1 -- 172.21.15.125:0/2849957165 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7040c6d70 con 0x7fb70415cd20 2023-10-17T06:08:07.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.655+0000 7fb6ebfff700 1 -- 172.21.15.125:0/2849957165 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb6fc007230 con 0x7fb70415cd20 2023-10-17T06:08:07.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.655+0000 7fb6ebfff700 1 --2- 172.21.15.125:0/2849957165 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb6f00656f0 0x7fb6f0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:07.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.655+0000 7fb6ebfff700 1 -- 172.21.15.125:0/2849957165 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb6fc082c70 con 0x7fb70415cd20 2023-10-17T06:08:07.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.655+0000 7fb7037fe700 1 --2- 172.21.15.125:0/2849957165 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb6f00656f0 0x7fb6f0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:07.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.655+0000 7fb7037fe700 1 --2- 172.21.15.125:0/2849957165 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb6f00656f0 0x7fb6f0067bb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4000f60 tx=0x7fb6f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:07.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.659+0000 7fb6ebfff700 1 -- 172.21.15.125:0/2849957165 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fb6fc050250 con 0x7fb70415cd20 2023-10-17T06:08:07.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.839+0000 7fb7088fb700 1 -- 172.21.15.125:0/2849957165 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb704072e60 con 0x7fb70415cd20 2023-10-17T06:08:07.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.843+0000 7fb6ebfff700 1 -- 172.21.15.125:0/2849957165 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20252 (secure 0 0 0) 0x7fb6fc018020 con 0x7fb70415cd20 2023-10-17T06:08:07.850 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:07.850 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":30,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:49.710984+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:08:07.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.847+0000 7fb7088fb700 1 -- 172.21.15.125:0/2849957165 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb6f00656f0 msgr2=0x7fb6f0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:07.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.847+0000 7fb7088fb700 1 --2- 172.21.15.125:0/2849957165 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb6f00656f0 0x7fb6f0067bb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4000f60 tx=0x7fb6f4009040 comp rx=0 tx=0).stop 2023-10-17T06:08:07.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.847+0000 7fb7088fb700 1 -- 172.21.15.125:0/2849957165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb70415cd20 msgr2=0x7fb704155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:07.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.847+0000 7fb7088fb700 1 --2- 172.21.15.125:0/2849957165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb70415cd20 0x7fb704155dd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00ccd0 tx=0x7fb6fc00a060 comp rx=0 tx=0).stop 2023-10-17T06:08:07.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.847+0000 7fb7088fb700 1 -- 172.21.15.125:0/2849957165 shutdown_connections 2023-10-17T06:08:07.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.847+0000 7fb7088fb700 1 --2- 172.21.15.125:0/2849957165 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb6f00656f0 0x7fb6f0067bb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:07.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.847+0000 7fb7088fb700 1 --2- 172.21.15.125:0/2849957165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb70415cd20 0x7fb704155dd0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:07.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.847+0000 7fb7088fb700 1 --2- 172.21.15.125:0/2849957165 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb7040cf760 0x7fb7040c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:07.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.847+0000 7fb7088fb700 1 --2- 172.21.15.125:0/2849957165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb70406a460 0x7fb7040b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:07.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.847+0000 7fb7088fb700 1 -- 172.21.15.125:0/2849957165 >> 172.21.15.125:0/2849957165 conn(0x7fb7040b22f0 msgr2=0x7fb7040cb110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:07.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.847+0000 7fb7088fb700 1 -- 172.21.15.125:0/2849957165 shutdown_connections 2023-10-17T06:08:07.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:07.847+0000 7fb7088fb700 1 -- 172.21.15.125:0/2849957165 wait complete. 2023-10-17T06:08:07.875 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-17T06:07:06.629169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-17T06:07:08.148117+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-17T06:07:11.895112+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-17T06:08:07.876 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:08:08.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.055+0000 7f0c60733700 1 Processor -- start 2023-10-17T06:08:08.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.059+0000 7f0c60733700 1 -- start start 2023-10-17T06:08:08.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.059+0000 7f0c60733700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0c581467c0 0x7f0c580b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:08.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.063+0000 7f0c60733700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c58146ba0 con 0x7f0c5806f9a0 2023-10-17T06:08:08.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.063+0000 7f0c60733700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c580d0920 con 0x7f0c581612e0 2023-10-17T06:08:08.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.063+0000 7f0c60733700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c580b6160 con 0x7f0c581467c0 2023-10-17T06:08:08.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.063+0000 7f0c5ecd0700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0c5806f9a0 0x7f0c580d0db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45180/0 (socket says 172.21.15.125:45180) 2023-10-17T06:08:08.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.063+0000 7f0c5ecd0700 1 -- 172.21.15.125:0/37307378 learned_addr learned my addr 172.21.15.125:0/37307378 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:08.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.063+0000 7f0c5e4cf700 1 --2- 172.21.15.125:0/37307378 >> v2:172.21.15.184:3300/0 conn(0x7f0c581467c0 0x7f0c580b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:08.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.063+0000 7f0c5e4cf700 1 -- 172.21.15.125:0/37307378 >> v1:172.21.15.184:6789/0 conn(0x7f0c581612e0 legacy=0x7f0c5815d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:08.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.063+0000 7f0c5e4cf700 1 -- 172.21.15.125:0/37307378 >> v1:172.21.15.125:6789/0 conn(0x7f0c5806f9a0 legacy=0x7f0c580d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:08.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.063+0000 7f0c5e4cf700 1 -- 172.21.15.125:0/37307378 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c580b6440 con 0x7f0c581467c0 2023-10-17T06:08:08.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.063+0000 7f0c5d4cd700 1 -- 172.21.15.125:0/37307378 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055977725 0 0) 0x7f0c58146ba0 con 0x7f0c5806f9a0 2023-10-17T06:08:08.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.063+0000 7f0c5e4cf700 1 --2- 172.21.15.125:0/37307378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c581467c0 0x7f0c580b5b80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009850 tx=0x7f0c54009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25482fa5373fde3c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:08.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.063+0000 7f0c5d4cd700 1 -- 172.21.15.125:0/37307378 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c54011830 con 0x7f0c581467c0 2023-10-17T06:08:08.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.063+0000 7f0c5d4cd700 1 -- 172.21.15.125:0/37307378 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c54011990 con 0x7f0c581467c0 2023-10-17T06:08:08.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.063+0000 7f0c5d4cd700 1 -- 172.21.15.125:0/37307378 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c54011d20 con 0x7f0c581467c0 2023-10-17T06:08:08.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.063+0000 7f0c60733700 1 -- 172.21.15.125:0/37307378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c581467c0 msgr2=0x7f0c580b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:08.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.063+0000 7f0c60733700 1 --2- 172.21.15.125:0/37307378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c581467c0 0x7f0c580b5b80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009850 tx=0x7f0c54009b60 comp rx=0 tx=0).stop 2023-10-17T06:08:08.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.067+0000 7f0c60733700 1 -- 172.21.15.125:0/37307378 shutdown_connections 2023-10-17T06:08:08.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.067+0000 7f0c60733700 1 --2- 172.21.15.125:0/37307378 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c581467c0 0x7f0c580b5b80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:08.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.067+0000 7f0c60733700 1 -- 172.21.15.125:0/37307378 >> 172.21.15.125:0/37307378 conn(0x7f0c5806a130 msgr2=0x7f0c5806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:08.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.067+0000 7f0c60733700 1 -- 172.21.15.125:0/37307378 shutdown_connections 2023-10-17T06:08:08.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.067+0000 7f0c60733700 1 -- 172.21.15.125:0/37307378 wait complete. 2023-10-17T06:08:08.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.067+0000 7f0c60733700 1 Processor -- start 2023-10-17T06:08:08.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c60733700 1 -- start start 2023-10-17T06:08:08.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c60733700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c5806f9a0 0x7f0c581411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:08.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c60733700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c581467c0 0x7f0c5813fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:08.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c60733700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c581612e0 0x7f0c581f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:08.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c60733700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5813e080 con 0x7f0c5806f9a0 2023-10-17T06:08:08.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c60733700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c580c8da0 con 0x7f0c581467c0 2023-10-17T06:08:08.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c60733700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5813ff90 con 0x7f0c581612e0 2023-10-17T06:08:08.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c5e4cf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c5806f9a0 0x7f0c581411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:08.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c5e4cf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c5806f9a0 0x7f0c581411c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60986/0 (socket says 172.21.15.125:60986) 2023-10-17T06:08:08.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c5e4cf700 1 -- 172.21.15.125:0/1327867688 learned_addr learned my addr 172.21.15.125:0/1327867688 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:08.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c5dcce700 1 --2- 172.21.15.125:0/1327867688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c581467c0 0x7f0c5813fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:08.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c5ecd0700 1 --2- 172.21.15.125:0/1327867688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c581612e0 0x7f0c581f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:08.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c5e4cf700 1 -- 172.21.15.125:0/1327867688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c581612e0 msgr2=0x7f0c581f2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:08.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c5e4cf700 1 --2- 172.21.15.125:0/1327867688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c581612e0 0x7f0c581f2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:08.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c5e4cf700 1 -- 172.21.15.125:0/1327867688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c581467c0 msgr2=0x7f0c5813fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:08.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c5e4cf700 1 --2- 172.21.15.125:0/1327867688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c581467c0 0x7f0c5813fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:08.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c5e4cf700 1 -- 172.21.15.125:0/1327867688 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c540094b0 con 0x7f0c5806f9a0 2023-10-17T06:08:08.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c5e4cf700 1 --2- 172.21.15.125:0/1327867688 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c5806f9a0 0x7f0c581411c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0c58070690 tx=0x7f0c54004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:08.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c4effd700 1 -- 172.21.15.125:0/1327867688 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5400bb20 con 0x7f0c5806f9a0 2023-10-17T06:08:08.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c4effd700 1 -- 172.21.15.125:0/1327867688 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5401f070 con 0x7f0c5806f9a0 2023-10-17T06:08:08.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c60733700 1 -- 172.21.15.125:0/1327867688 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c581401e0 con 0x7f0c5806f9a0 2023-10-17T06:08:08.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c4effd700 1 -- 172.21.15.125:0/1327867688 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5400bec0 con 0x7f0c5806f9a0 2023-10-17T06:08:08.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.071+0000 7f0c60733700 1 -- 172.21.15.125:0/1327867688 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c581407a0 con 0x7f0c5806f9a0 2023-10-17T06:08:08.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.075+0000 7f0c60733700 1 -- 172.21.15.125:0/1327867688 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c58072e60 con 0x7f0c5806f9a0 2023-10-17T06:08:08.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.075+0000 7f0c4effd700 1 -- 172.21.15.125:0/1327867688 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0c5401a430 con 0x7f0c5806f9a0 2023-10-17T06:08:08.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.079+0000 7f0c4effd700 1 --2- 172.21.15.125:0/1327867688 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0c3c0656f0 0x7f0c3c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:08.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.079+0000 7f0c4effd700 1 -- 172.21.15.125:0/1327867688 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0c54021070 con 0x7f0c5806f9a0 2023-10-17T06:08:08.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.079+0000 7f0c5dcce700 1 --2- 172.21.15.125:0/1327867688 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0c3c0656f0 0x7f0c3c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:08.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.079+0000 7f0c5dcce700 1 --2- 172.21.15.125:0/1327867688 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0c3c0656f0 0x7f0c3c067bb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0c5813f010 tx=0x7f0c48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:08.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.083+0000 7f0c4effd700 1 -- 172.21.15.125:0/1327867688 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0c540520b0 con 0x7f0c5806f9a0 2023-10-17T06:08:08.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.255+0000 7f0c60733700 1 -- 172.21.15.125:0/1327867688 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c580b7200 con 0x7f0c5806f9a0 2023-10-17T06:08:08.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.255+0000 7f0c4effd700 1 -- 172.21.15.125:0/1327867688 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c540556d0 con 0x7f0c5806f9a0 2023-10-17T06:08:08.260 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:08:08.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.259+0000 7f0c60733700 1 -- 172.21.15.125:0/1327867688 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0c3c0656f0 msgr2=0x7f0c3c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:08.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.259+0000 7f0c60733700 1 --2- 172.21.15.125:0/1327867688 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0c3c0656f0 0x7f0c3c067bb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0c5813f010 tx=0x7f0c48009040 comp rx=0 tx=0).stop 2023-10-17T06:08:08.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.259+0000 7f0c60733700 1 -- 172.21.15.125:0/1327867688 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c5806f9a0 msgr2=0x7f0c581411c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:08.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.259+0000 7f0c60733700 1 --2- 172.21.15.125:0/1327867688 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c5806f9a0 0x7f0c581411c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0c58070690 tx=0x7f0c54004770 comp rx=0 tx=0).stop 2023-10-17T06:08:08.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.259+0000 7f0c60733700 1 -- 172.21.15.125:0/1327867688 shutdown_connections 2023-10-17T06:08:08.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.259+0000 7f0c60733700 1 --2- 172.21.15.125:0/1327867688 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0c3c0656f0 0x7f0c3c067bb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:08.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.259+0000 7f0c60733700 1 --2- 172.21.15.125:0/1327867688 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0c581612e0 0x7f0c581f2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:08.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.259+0000 7f0c60733700 1 --2- 172.21.15.125:0/1327867688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c581467c0 0x7f0c5813fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:08.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.259+0000 7f0c60733700 1 --2- 172.21.15.125:0/1327867688 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0c5806f9a0 0x7f0c581411c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:08.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.259+0000 7f0c60733700 1 -- 172.21.15.125:0/1327867688 >> 172.21.15.125:0/1327867688 conn(0x7f0c5806a130 msgr2=0x7f0c58060730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:08.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.259+0000 7f0c60733700 1 -- 172.21.15.125:0/1327867688 shutdown_connections 2023-10-17T06:08:08.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.259+0000 7f0c60733700 1 -- 172.21.15.125:0/1327867688 wait complete. 2023-10-17T06:08:08.283 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:08:08.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.455+0000 7f1df2997700 1 Processor -- start 2023-10-17T06:08:08.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.455+0000 7f1df2997700 1 -- start start 2023-10-17T06:08:08.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.459+0000 7f1df2997700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1dec160710 0x7f1dec0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:08.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.459+0000 7f1df2997700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dec15d0d0 con 0x7f1dec0b5ae0 2023-10-17T06:08:08.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.459+0000 7f1df2997700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dec06f0f0 con 0x7f1dec0d2e00 2023-10-17T06:08:08.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.459+0000 7f1df2997700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dec15df90 con 0x7f1dec160710 2023-10-17T06:08:08.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.459+0000 7f1df1194700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1dec160710 0x7f1dec0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:08.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.459+0000 7f1df1194700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1dec160710 0x7f1dec0b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60990/0 (socket says 172.21.15.125:60990) 2023-10-17T06:08:08.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.459+0000 7f1df1194700 1 -- 172.21.15.125:0/3668346446 learned_addr learned my addr 172.21.15.125:0/3668346446 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:08.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.463+0000 7f1df1194700 1 -- 172.21.15.125:0/3668346446 >> v1:172.21.15.184:6789/0 conn(0x7f1dec0d2e00 legacy=0x7f1dec0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:08.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.463+0000 7f1df1194700 1 -- 172.21.15.125:0/3668346446 >> v1:172.21.15.125:6789/0 conn(0x7f1dec0b5ae0 legacy=0x7f1dec06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:08.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.463+0000 7f1df1194700 1 -- 172.21.15.125:0/3668346446 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec15d310 con 0x7f1dec160710 2023-10-17T06:08:08.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.463+0000 7f1df1194700 1 --2- 172.21.15.125:0/3668346446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dec160710 0x7f1dec0b6e00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009910 tx=0x7f1ddc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc357ee44772abc server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:08.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.463+0000 7f1df0993700 1 -- 172.21.15.125:0/3668346446 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc00ba60 con 0x7f1dec160710 2023-10-17T06:08:08.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.463+0000 7f1df0993700 1 -- 172.21.15.125:0/3668346446 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ddc00bbc0 con 0x7f1dec160710 2023-10-17T06:08:08.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.463+0000 7f1df0993700 1 -- 172.21.15.125:0/3668346446 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc009e60 con 0x7f1dec160710 2023-10-17T06:08:08.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.463+0000 7f1df2997700 1 -- 172.21.15.125:0/3668346446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dec160710 msgr2=0x7f1dec0b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:08.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.463+0000 7f1df2997700 1 --2- 172.21.15.125:0/3668346446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dec160710 0x7f1dec0b6e00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009910 tx=0x7f1ddc009c20 comp rx=0 tx=0).stop 2023-10-17T06:08:08.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.463+0000 7f1df2997700 1 -- 172.21.15.125:0/3668346446 shutdown_connections 2023-10-17T06:08:08.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.463+0000 7f1df2997700 1 --2- 172.21.15.125:0/3668346446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dec160710 0x7f1dec0b6e00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:08.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.463+0000 7f1df2997700 1 -- 172.21.15.125:0/3668346446 >> 172.21.15.125:0/3668346446 conn(0x7f1dec069f20 msgr2=0x7f1dec06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:08.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.463+0000 7f1df2997700 1 -- 172.21.15.125:0/3668346446 shutdown_connections 2023-10-17T06:08:08.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.463+0000 7f1df2997700 1 -- 172.21.15.125:0/3668346446 wait complete. 2023-10-17T06:08:08.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.467+0000 7f1df2997700 1 Processor -- start 2023-10-17T06:08:08.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.467+0000 7f1df2997700 1 -- start start 2023-10-17T06:08:08.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.467+0000 7f1df2997700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dec0b5ae0 0x7f1dec157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:08.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.467+0000 7f1df2997700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1dec0d2e00 0x7f1dec0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:08.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.467+0000 7f1df2997700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dec160710 0x7f1dec0b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:08.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.467+0000 7f1df2997700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec1e7c40 con 0x7f1dec0b5ae0 2023-10-17T06:08:08.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.467+0000 7f1df2997700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec0acec0 con 0x7f1dec160710 2023-10-17T06:08:08.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.467+0000 7f1df2997700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dec0ad1a0 con 0x7f1dec0d2e00 2023-10-17T06:08:08.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.467+0000 7f1df1995700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dec0b5ae0 0x7f1dec157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:08.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.467+0000 7f1df1995700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dec0b5ae0 0x7f1dec157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32768/0 (socket says 172.21.15.125:32768) 2023-10-17T06:08:08.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.467+0000 7f1df1995700 1 -- 172.21.15.125:0/2594144111 learned_addr learned my addr 172.21.15.125:0/2594144111 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:08.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.467+0000 7f1df1194700 1 --2- 172.21.15.125:0/2594144111 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1dec0d2e00 0x7f1dec0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:08.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.467+0000 7f1df2196700 1 --2- 172.21.15.125:0/2594144111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dec160710 0x7f1dec0b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:08.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.467+0000 7f1df1995700 1 -- 172.21.15.125:0/2594144111 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1dec0d2e00 msgr2=0x7f1dec0b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:08.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.467+0000 7f1df1995700 1 --2- 172.21.15.125:0/2594144111 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1dec0d2e00 0x7f1dec0b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:08.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.467+0000 7f1df1995700 1 -- 172.21.15.125:0/2594144111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dec160710 msgr2=0x7f1dec0b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:08.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.467+0000 7f1df1995700 1 --2- 172.21.15.125:0/2594144111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dec160710 0x7f1dec0b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:08.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.467+0000 7f1df1995700 1 -- 172.21.15.125:0/2594144111 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc009570 con 0x7f1dec0b5ae0 2023-10-17T06:08:08.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.471+0000 7f1df1995700 1 --2- 172.21.15.125:0/2594144111 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dec0b5ae0 0x7f1dec157d50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1de800c500 tx=0x7f1de800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:08.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.471+0000 7f1de27fc700 1 -- 172.21.15.125:0/2594144111 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de80052d0 con 0x7f1dec0b5ae0 2023-10-17T06:08:08.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.471+0000 7f1de27fc700 1 -- 172.21.15.125:0/2594144111 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de8005430 con 0x7f1dec0b5ae0 2023-10-17T06:08:08.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.471+0000 7f1df2997700 1 -- 172.21.15.125:0/2594144111 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dec0ad480 con 0x7f1dec0b5ae0 2023-10-17T06:08:08.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.471+0000 7f1de27fc700 1 -- 172.21.15.125:0/2594144111 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de80055a0 con 0x7f1dec0b5ae0 2023-10-17T06:08:08.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.471+0000 7f1df2997700 1 -- 172.21.15.125:0/2594144111 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dec158290 con 0x7f1dec0b5ae0 2023-10-17T06:08:08.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.471+0000 7f1df2997700 1 -- 172.21.15.125:0/2594144111 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dec0ad9a0 con 0x7f1dec0b5ae0 2023-10-17T06:08:08.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.471+0000 7f1de27fc700 1 -- 172.21.15.125:0/2594144111 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1de80038e0 con 0x7f1dec0b5ae0 2023-10-17T06:08:08.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.475+0000 7f1de27fc700 1 --2- 172.21.15.125:0/2594144111 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1dd00656f0 0x7f1dd0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:08.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.475+0000 7f1de27fc700 1 -- 172.21.15.125:0/2594144111 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1de8082580 con 0x7f1dec0b5ae0 2023-10-17T06:08:08.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.475+0000 7f1df1194700 1 --2- 172.21.15.125:0/2594144111 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1dd00656f0 0x7f1dd0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:08.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.475+0000 7f1df1194700 1 --2- 172.21.15.125:0/2594144111 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1dd00656f0 0x7f1dd0067bb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009910 tx=0x7f1ddc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:08.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.479+0000 7f1de27fc700 1 -- 172.21.15.125:0/2594144111 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f1dec0ad9a0 con 0x7f1dec0b5ae0 2023-10-17T06:08:08.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.659+0000 7f1df2997700 1 -- 172.21.15.125:0/2594144111 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1dec0ad9a0 con 0x7f1dec0b5ae0 2023-10-17T06:08:08.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.663+0000 7f1de27fc700 1 -- 172.21.15.125:0/2594144111 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1dec0ad9a0 con 0x7f1dec0b5ae0 2023-10-17T06:08:08.665 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:08:08.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.663+0000 7f1df2997700 1 -- 172.21.15.125:0/2594144111 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1dd00656f0 msgr2=0x7f1dd0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:08.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.663+0000 7f1df2997700 1 --2- 172.21.15.125:0/2594144111 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1dd00656f0 0x7f1dd0067bb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009910 tx=0x7f1ddc008030 comp rx=0 tx=0).stop 2023-10-17T06:08:08.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.663+0000 7f1df2997700 1 -- 172.21.15.125:0/2594144111 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dec0b5ae0 msgr2=0x7f1dec157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:08.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.663+0000 7f1df2997700 1 --2- 172.21.15.125:0/2594144111 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dec0b5ae0 0x7f1dec157d50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1de800c500 tx=0x7f1de800c8c0 comp rx=0 tx=0).stop 2023-10-17T06:08:08.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.663+0000 7f1df2997700 1 -- 172.21.15.125:0/2594144111 shutdown_connections 2023-10-17T06:08:08.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.663+0000 7f1df2997700 1 --2- 172.21.15.125:0/2594144111 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1dd00656f0 0x7f1dd0067bb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:08.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.663+0000 7f1df2997700 1 --2- 172.21.15.125:0/2594144111 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dec160710 0x7f1dec0b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:08.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.663+0000 7f1df2997700 1 --2- 172.21.15.125:0/2594144111 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1dec0d2e00 0x7f1dec0b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:08.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.663+0000 7f1df2997700 1 --2- 172.21.15.125:0/2594144111 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1dec0b5ae0 0x7f1dec157d50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.663+0000 7f1df2997700 1 -- 172.21.15.125:0/2594144111 >> 172.21.15.125:0/2594144111 conn(0x7f1dec069f20 msgr2=0x7f1dec0b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.663+0000 7f1df2997700 1 -- 172.21.15.125:0/2594144111 shutdown_connections 2023-10-17T06:08:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.663+0000 7f1df2997700 1 -- 172.21.15.125:0/2594144111 wait complete. 2023-10-17T06:08:08.691 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-17T06:08:08.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.863+0000 7f7557ec3700 1 Processor -- start 2023-10-17T06:08:08.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.863+0000 7f7557ec3700 1 -- start start 2023-10-17T06:08:08.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.867+0000 7f7557ec3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f755015e7d0 0x7f755006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:08.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.867+0000 7f7557ec3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75500d29f0 con 0x7f75500d2610 2023-10-17T06:08:08.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.867+0000 7f7557ec3700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75500b64b0 con 0x7f75500d36b0 2023-10-17T06:08:08.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.867+0000 7f7557ec3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75500b6750 con 0x7f755015e7d0 2023-10-17T06:08:08.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.867+0000 7f755545e700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f75500d36b0 0x7f755015d5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:55620/0 (socket says 172.21.15.125:55620) 2023-10-17T06:08:08.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.867+0000 7f7555c5f700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f75500d2610 0x7f75500d2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45200/0 (socket says 172.21.15.125:45200) 2023-10-17T06:08:08.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.867+0000 7f755545e700 1 -- 172.21.15.125:0/2584602335 learned_addr learned my addr 172.21.15.125:0/2584602335 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:08.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.867+0000 7f7556460700 1 --2- 172.21.15.125:0/2584602335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f755015e7d0 0x7f755006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:08.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.867+0000 7f7556460700 1 -- 172.21.15.125:0/2584602335 >> v1:172.21.15.184:6789/0 conn(0x7f75500d36b0 legacy=0x7f755015d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:08.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.867+0000 7f7556460700 1 -- 172.21.15.125:0/2584602335 >> v1:172.21.15.125:6789/0 conn(0x7f75500d2610 legacy=0x7f75500d2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:08.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.867+0000 7f7556460700 1 -- 172.21.15.125:0/2584602335 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75500b6a30 con 0x7f755015e7d0 2023-10-17T06:08:08.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.867+0000 7f7556460700 1 --2- 172.21.15.125:0/2584602335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f755015e7d0 0x7f755006e6f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7548009dc0 tx=0x7f754800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e9efa26b3f6a556 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:08.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.871+0000 7f7554c5d700 1 -- 172.21.15.125:0/2584602335 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754800e070 con 0x7f755015e7d0 2023-10-17T06:08:08.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.871+0000 7f7554c5d700 1 -- 172.21.15.125:0/2584602335 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754800bbd0 con 0x7f755015e7d0 2023-10-17T06:08:08.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.871+0000 7f7554c5d700 1 -- 172.21.15.125:0/2584602335 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7548012430 con 0x7f755015e7d0 2023-10-17T06:08:08.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.871+0000 7f7557ec3700 1 -- 172.21.15.125:0/2584602335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f755015e7d0 msgr2=0x7f755006e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:08.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.871+0000 7f7557ec3700 1 --2- 172.21.15.125:0/2584602335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f755015e7d0 0x7f755006e6f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7548009dc0 tx=0x7f754800b330 comp rx=0 tx=0).stop 2023-10-17T06:08:08.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.871+0000 7f7557ec3700 1 -- 172.21.15.125:0/2584602335 shutdown_connections 2023-10-17T06:08:08.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.871+0000 7f7557ec3700 1 --2- 172.21.15.125:0/2584602335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f755015e7d0 0x7f755006e6f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:08.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.871+0000 7f7557ec3700 1 -- 172.21.15.125:0/2584602335 >> 172.21.15.125:0/2584602335 conn(0x7f7550069f20 msgr2=0x7f755006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:08.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.871+0000 7f7557ec3700 1 -- 172.21.15.125:0/2584602335 shutdown_connections 2023-10-17T06:08:08.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.871+0000 7f7557ec3700 1 -- 172.21.15.125:0/2584602335 wait complete. 2023-10-17T06:08:08.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f7557ec3700 1 Processor -- start 2023-10-17T06:08:08.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f7557ec3700 1 -- start start 2023-10-17T06:08:08.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f7557ec3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75500d2610 0x7f755014d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:08.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f7557ec3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75500d36b0 0x7f7550159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:08.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f7557ec3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f755015e7d0 0x7f75500ad170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:08.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f7557ec3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75500af380 con 0x7f75500d2610 2023-10-17T06:08:08.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f7557ec3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7550158be0 con 0x7f755015e7d0 2023-10-17T06:08:08.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f7557ec3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7550158060 con 0x7f75500d36b0 2023-10-17T06:08:08.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f7555c5f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75500d2610 0x7f755014d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:08.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f755545e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75500d36b0 0x7f7550159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:08.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f7555c5f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75500d2610 0x7f755014d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32772/0 (socket says 172.21.15.125:32772) 2023-10-17T06:08:08.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f7556460700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f755015e7d0 0x7f75500ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:08.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f7555c5f700 1 -- 172.21.15.125:0/1229433457 learned_addr learned my addr 172.21.15.125:0/1229433457 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:08.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f7555c5f700 1 -- 172.21.15.125:0/1229433457 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75500d36b0 msgr2=0x7f7550159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:08.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f7555c5f700 1 --2- 172.21.15.125:0/1229433457 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75500d36b0 0x7f7550159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:08.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f7555c5f700 1 -- 172.21.15.125:0/1229433457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f755015e7d0 msgr2=0x7f75500ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:08.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f7555c5f700 1 --2- 172.21.15.125:0/1229433457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f755015e7d0 0x7f75500ad170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:08.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f7555c5f700 1 -- 172.21.15.125:0/1229433457 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7548009a70 con 0x7f75500d2610 2023-10-17T06:08:08.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f7555c5f700 1 --2- 172.21.15.125:0/1229433457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75500d2610 0x7f755014d6a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f754c00c700 tx=0x7f754c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:08.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f75467fc700 1 -- 172.21.15.125:0/1229433457 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c005cd0 con 0x7f75500d2610 2023-10-17T06:08:08.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f75467fc700 1 -- 172.21.15.125:0/1229433457 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c005e30 con 0x7f75500d2610 2023-10-17T06:08:08.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f7557ec3700 1 -- 172.21.15.125:0/1229433457 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7550158340 con 0x7f75500d2610 2023-10-17T06:08:08.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.875+0000 7f75467fc700 1 -- 172.21.15.125:0/1229433457 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c0072d0 con 0x7f75500d2610 2023-10-17T06:08:08.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.879+0000 7f7557ec3700 1 -- 172.21.15.125:0/1229433457 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7550158900 con 0x7f75500d2610 2023-10-17T06:08:08.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.879+0000 7f7557ec3700 1 -- 172.21.15.125:0/1229433457 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75500af4f0 con 0x7f75500d2610 2023-10-17T06:08:08.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.879+0000 7f75467fc700 1 -- 172.21.15.125:0/1229433457 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f754c007430 con 0x7f75500d2610 2023-10-17T06:08:08.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.883+0000 7f75467fc700 1 --2- 172.21.15.125:0/1229433457 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f75340656f0 0x7f7534067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:08.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.883+0000 7f75467fc700 1 -- 172.21.15.125:0/1229433457 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f754c082560 con 0x7f75500d2610 2023-10-17T06:08:08.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.883+0000 7f755545e700 1 --2- 172.21.15.125:0/1229433457 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f75340656f0 0x7f7534067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:08.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.883+0000 7f755545e700 1 --2- 172.21.15.125:0/1229433457 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f75340656f0 0x7f7534067bb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f75501f5f70 tx=0x7f7540009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:08.887+0000 7f75467fc700 1 -- 172.21.15.125:0/1229433457 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f754c04fbf0 con 0x7f75500d2610 2023-10-17T06:08:09.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.063+0000 7f7557ec3700 1 -- 172.21.15.125:0/1229433457 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7550072e60 con 0x7f75500d2610 2023-10-17T06:08:09.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.063+0000 7f75467fc700 1 -- 172.21.15.125:0/1229433457 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f754c053210 con 0x7f75500d2610 2023-10-17T06:08:09.069 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:09.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.067+0000 7f7557ec3700 1 -- 172.21.15.125:0/1229433457 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f75340656f0 msgr2=0x7f7534067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:09.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.067+0000 7f7557ec3700 1 --2- 172.21.15.125:0/1229433457 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f75340656f0 0x7f7534067bb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f75501f5f70 tx=0x7f7540009040 comp rx=0 tx=0).stop 2023-10-17T06:08:09.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.067+0000 7f7557ec3700 1 -- 172.21.15.125:0/1229433457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75500d2610 msgr2=0x7f755014d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:09.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.067+0000 7f7557ec3700 1 --2- 172.21.15.125:0/1229433457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75500d2610 0x7f755014d6a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f754c00c700 tx=0x7f754c00ca10 comp rx=0 tx=0).stop 2023-10-17T06:08:09.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.067+0000 7f7557ec3700 1 -- 172.21.15.125:0/1229433457 shutdown_connections 2023-10-17T06:08:09.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.067+0000 7f7557ec3700 1 --2- 172.21.15.125:0/1229433457 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f75340656f0 0x7f7534067bb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.067+0000 7f7557ec3700 1 --2- 172.21.15.125:0/1229433457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f755015e7d0 0x7f75500ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.067+0000 7f7557ec3700 1 --2- 172.21.15.125:0/1229433457 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75500d36b0 0x7f7550159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.067+0000 7f7557ec3700 1 --2- 172.21.15.125:0/1229433457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75500d2610 0x7f755014d6a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.067+0000 7f7557ec3700 1 -- 172.21.15.125:0/1229433457 >> 172.21.15.125:0/1229433457 conn(0x7f7550069f20 msgr2=0x7f755015f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:09.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.067+0000 7f7557ec3700 1 -- 172.21.15.125:0/1229433457 shutdown_connections 2023-10-17T06:08:09.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.067+0000 7f7557ec3700 1 -- 172.21.15.125:0/1229433457 wait complete. 2023-10-17T06:08:09.092 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-17T06:08:09.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.275+0000 7f8a2b14f700 1 Processor -- start 2023-10-17T06:08:09.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.275+0000 7f8a2b14f700 1 -- start start 2023-10-17T06:08:09.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.275+0000 7f8a2b14f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a240d2e00 0x7f8a240b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:09.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.275+0000 7f8a2b14f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8a240b5ae0 0x7f8a2406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:09.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.275+0000 7f8a2b14f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2415d0d0 con 0x7f8a24160710 2023-10-17T06:08:09.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.275+0000 7f8a2b14f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2415df90 con 0x7f8a240b5ae0 2023-10-17T06:08:09.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.275+0000 7f8a2b14f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2406f0f0 con 0x7f8a240d2e00 2023-10-17T06:08:09.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.275+0000 7f8a2a94e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8a240b5ae0 0x7f8a2406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:09.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.275+0000 7f8a2a94e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8a240b5ae0 0x7f8a2406db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32778/0 (socket says 172.21.15.125:32778) 2023-10-17T06:08:09.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.275+0000 7f8a2a94e700 1 -- 172.21.15.125:0/1036623586 learned_addr learned my addr 172.21.15.125:0/1036623586 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:09.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.279+0000 7f8a2a14d700 1 --2- 172.21.15.125:0/1036623586 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a240d2e00 0x7f8a240b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:09.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.279+0000 7f8a2a94e700 1 -- 172.21.15.125:0/1036623586 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a240d2e00 msgr2=0x7f8a240b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:09.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.279+0000 7f8a2a94e700 1 --2- 172.21.15.125:0/1036623586 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a240d2e00 0x7f8a240b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.279+0000 7f8a2a94e700 1 -- 172.21.15.125:0/1036623586 >> v1:172.21.15.184:6789/0 conn(0x7f8a24160710 legacy=0x7f8a240d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:09.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.279+0000 7f8a2a94e700 1 -- 172.21.15.125:0/1036623586 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2415d310 con 0x7f8a240b5ae0 2023-10-17T06:08:09.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.279+0000 7f8a2a94e700 1 --2- 172.21.15.125:0/1036623586 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a240b5ae0 0x7f8a2406db60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c009e80 tx=0x7f8a1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7dff47e00fff7e server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:09.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.279+0000 7f8a2914b700 1 -- 172.21.15.125:0/1036623586 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c00e070 con 0x7f8a240b5ae0 2023-10-17T06:08:09.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.279+0000 7f8a2914b700 1 -- 172.21.15.125:0/1036623586 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c00b980 con 0x7f8a240b5ae0 2023-10-17T06:08:09.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.279+0000 7f8a2914b700 1 -- 172.21.15.125:0/1036623586 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c00bd30 con 0x7f8a240b5ae0 2023-10-17T06:08:09.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.279+0000 7f8a2b14f700 1 -- 172.21.15.125:0/1036623586 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a240b5ae0 msgr2=0x7f8a2406db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:09.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.279+0000 7f8a2b14f700 1 --2- 172.21.15.125:0/1036623586 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a240b5ae0 0x7f8a2406db60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c009e80 tx=0x7f8a1c00b330 comp rx=0 tx=0).stop 2023-10-17T06:08:09.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.279+0000 7f8a2b14f700 1 -- 172.21.15.125:0/1036623586 shutdown_connections 2023-10-17T06:08:09.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.279+0000 7f8a2b14f700 1 --2- 172.21.15.125:0/1036623586 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a240b5ae0 0x7f8a2406db60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.279+0000 7f8a2b14f700 1 --2- 172.21.15.125:0/1036623586 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a240d2e00 0x7f8a240b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.279+0000 7f8a2b14f700 1 -- 172.21.15.125:0/1036623586 >> 172.21.15.125:0/1036623586 conn(0x7f8a24069f20 msgr2=0x7f8a2406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:09.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.279+0000 7f8a2b14f700 1 -- 172.21.15.125:0/1036623586 shutdown_connections 2023-10-17T06:08:09.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.279+0000 7f8a2b14f700 1 -- 172.21.15.125:0/1036623586 wait complete. 2023-10-17T06:08:09.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.283+0000 7f8a2b14f700 1 Processor -- start 2023-10-17T06:08:09.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.283+0000 7f8a2b14f700 1 -- start start 2023-10-17T06:08:09.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.283+0000 7f8a2b14f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a240b5ae0 0x7f8a24157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:09.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.283+0000 7f8a2b14f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a240d2e00 0x7f8a240b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:09.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.283+0000 7f8a2b14f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a24160710 0x7f8a240b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:09.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.283+0000 7f8a2b14f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a240b0440 con 0x7f8a24160710 2023-10-17T06:08:09.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.283+0000 7f8a2b14f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a241584b0 con 0x7f8a240b5ae0 2023-10-17T06:08:09.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.283+0000 7f8a2b14f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a240b0860 con 0x7f8a240d2e00 2023-10-17T06:08:09.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.283+0000 7f8a2a94e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a24160710 0x7f8a240b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:09.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.283+0000 7f8a2a94e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a24160710 0x7f8a240b11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32790/0 (socket says 172.21.15.125:32790) 2023-10-17T06:08:09.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.283+0000 7f8a2a94e700 1 -- 172.21.15.125:0/2969631002 learned_addr learned my addr 172.21.15.125:0/2969631002 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:09.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.283+0000 7f8a2a14d700 1 --2- 172.21.15.125:0/2969631002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a240b5ae0 0x7f8a24157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:09.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.283+0000 7f8a2994c700 1 --2- 172.21.15.125:0/2969631002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a240d2e00 0x7f8a240b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:09.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.287+0000 7f8a2a94e700 1 -- 172.21.15.125:0/2969631002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a240d2e00 msgr2=0x7f8a240b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:09.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.287+0000 7f8a2a94e700 1 --2- 172.21.15.125:0/2969631002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a240d2e00 0x7f8a240b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.287+0000 7f8a2a94e700 1 -- 172.21.15.125:0/2969631002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a240b5ae0 msgr2=0x7f8a24157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:09.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.287+0000 7f8a2a94e700 1 --2- 172.21.15.125:0/2969631002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a240b5ae0 0x7f8a24157f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.287+0000 7f8a2a94e700 1 -- 172.21.15.125:0/2969631002 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c009b30 con 0x7f8a24160710 2023-10-17T06:08:09.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.287+0000 7f8a2a94e700 1 --2- 172.21.15.125:0/2969631002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a24160710 0x7f8a240b11b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00b730 tx=0x7f8a1c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:09.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.287+0000 7f8a1affd700 1 -- 172.21.15.125:0/2969631002 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c004990 con 0x7f8a24160710 2023-10-17T06:08:09.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.287+0000 7f8a2b14f700 1 -- 172.21.15.125:0/2969631002 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a240af7c0 con 0x7f8a24160710 2023-10-17T06:08:09.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.287+0000 7f8a2b14f700 1 -- 172.21.15.125:0/2969631002 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a240afd80 con 0x7f8a24160710 2023-10-17T06:08:09.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.287+0000 7f8a1affd700 1 -- 172.21.15.125:0/2969631002 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c0092e0 con 0x7f8a24160710 2023-10-17T06:08:09.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.287+0000 7f8a1affd700 1 -- 172.21.15.125:0/2969631002 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c024650 con 0x7f8a24160710 2023-10-17T06:08:09.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.287+0000 7f8a2b14f700 1 -- 172.21.15.125:0/2969631002 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2404e910 con 0x7f8a24160710 2023-10-17T06:08:09.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.287+0000 7f8a1affd700 1 -- 172.21.15.125:0/2969631002 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8a1c01b430 con 0x7f8a24160710 2023-10-17T06:08:09.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.291+0000 7f8a1affd700 1 --2- 172.21.15.125:0/2969631002 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8a080656f0 0x7f8a08067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:09.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.291+0000 7f8a1affd700 1 -- 172.21.15.125:0/2969631002 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8a1c006e40 con 0x7f8a24160710 2023-10-17T06:08:09.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.291+0000 7f8a2a14d700 1 --2- 172.21.15.125:0/2969631002 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8a080656f0 0x7f8a08067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:09.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.291+0000 7f8a2a14d700 1 --2- 172.21.15.125:0/2969631002 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8a080656f0 0x7f8a08067bb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8a2000b9d0 tx=0x7f8a20008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:09.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.299+0000 7f8a1affd700 1 -- 172.21.15.125:0/2969631002 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f8a1c051b00 con 0x7f8a24160710 2023-10-17T06:08:09.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.475+0000 7f8a2b14f700 1 -- 172.21.15.125:0/2969631002 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8a240b7a00 con 0x7f8a24160710 2023-10-17T06:08:09.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.475+0000 7f8a1affd700 1 -- 172.21.15.125:0/2969631002 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8a1c055120 con 0x7f8a24160710 2023-10-17T06:08:09.479 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-17T06:08:09.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.479+0000 7f8a2b14f700 1 -- 172.21.15.125:0/2969631002 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8a080656f0 msgr2=0x7f8a08067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:09.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.479+0000 7f8a2b14f700 1 --2- 172.21.15.125:0/2969631002 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8a080656f0 0x7f8a08067bb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8a2000b9d0 tx=0x7f8a20008040 comp rx=0 tx=0).stop 2023-10-17T06:08:09.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.479+0000 7f8a2b14f700 1 -- 172.21.15.125:0/2969631002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a24160710 msgr2=0x7f8a240b11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:09.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.479+0000 7f8a2b14f700 1 --2- 172.21.15.125:0/2969631002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a24160710 0x7f8a240b11b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00b730 tx=0x7f8a1c004b40 comp rx=0 tx=0).stop 2023-10-17T06:08:09.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.479+0000 7f8a2b14f700 1 -- 172.21.15.125:0/2969631002 shutdown_connections 2023-10-17T06:08:09.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.479+0000 7f8a2b14f700 1 --2- 172.21.15.125:0/2969631002 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8a080656f0 0x7f8a08067bb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.479+0000 7f8a2b14f700 1 --2- 172.21.15.125:0/2969631002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8a24160710 0x7f8a240b11b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.479+0000 7f8a2b14f700 1 --2- 172.21.15.125:0/2969631002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8a240d2e00 0x7f8a240b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.479+0000 7f8a2b14f700 1 --2- 172.21.15.125:0/2969631002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8a240b5ae0 0x7f8a24157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.479+0000 7f8a2b14f700 1 -- 172.21.15.125:0/2969631002 >> 172.21.15.125:0/2969631002 conn(0x7f8a24069f20 msgr2=0x7f8a2406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:09.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.479+0000 7f8a2b14f700 1 -- 172.21.15.125:0/2969631002 shutdown_connections 2023-10-17T06:08:09.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.479+0000 7f8a2b14f700 1 -- 172.21.15.125:0/2969631002 wait complete. 2023-10-17T06:08:09.502 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-17T06:08:09.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.683+0000 7f6416a0f700 1 Processor -- start 2023-10-17T06:08:09.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.683+0000 7f6416a0f700 1 -- start start 2023-10-17T06:08:09.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.687+0000 7f6416a0f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64100b3d40 0x7f64100cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:09.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.687+0000 7f6416a0f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f641006ce20 0x7f641006d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:09.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.687+0000 7f6416a0f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64100ca4c0 con 0x7f6410164a20 2023-10-17T06:08:09.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.687+0000 7f6416a0f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f641006e2d0 con 0x7f641006ce20 2023-10-17T06:08:09.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.687+0000 7f6416a0f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641006d7d0 con 0x7f64100b3d40 2023-10-17T06:08:09.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.687+0000 7f641620e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f641006ce20 0x7f641006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:09.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.687+0000 7f641620e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f641006ce20 0x7f641006d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32800/0 (socket says 172.21.15.125:32800) 2023-10-17T06:08:09.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.687+0000 7f641620e700 1 -- 172.21.15.125:0/3371707784 learned_addr learned my addr 172.21.15.125:0/3371707784 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:09.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.687+0000 7f6415a0d700 1 --2- 172.21.15.125:0/3371707784 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64100b3d40 0x7f64100cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:09.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.687+0000 7f641620e700 1 -- 172.21.15.125:0/3371707784 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64100b3d40 msgr2=0x7f64100cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:09.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.687+0000 7f641620e700 1 --2- 172.21.15.125:0/3371707784 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64100b3d40 0x7f64100cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.687+0000 7f641620e700 1 -- 172.21.15.125:0/3371707784 >> v1:172.21.15.184:6789/0 conn(0x7f6410164a20 legacy=0x7f64100c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:09.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.687+0000 7f641620e700 1 -- 172.21.15.125:0/3371707784 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64100ca7a0 con 0x7f641006ce20 2023-10-17T06:08:09.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.691+0000 7f641620e700 1 --2- 172.21.15.125:0/3371707784 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f641006ce20 0x7f641006d290 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6408009910 tx=0x7f6408009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b8bbe02d8a8b68 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:09.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.691+0000 7f6414a0b700 1 -- 172.21.15.125:0/3371707784 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6408011830 con 0x7f641006ce20 2023-10-17T06:08:09.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.691+0000 7f6414a0b700 1 -- 172.21.15.125:0/3371707784 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6408011990 con 0x7f641006ce20 2023-10-17T06:08:09.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.691+0000 7f6414a0b700 1 -- 172.21.15.125:0/3371707784 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6408011d40 con 0x7f641006ce20 2023-10-17T06:08:09.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.691+0000 7f6416a0f700 1 -- 172.21.15.125:0/3371707784 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f641006ce20 msgr2=0x7f641006d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:09.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.691+0000 7f6416a0f700 1 --2- 172.21.15.125:0/3371707784 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f641006ce20 0x7f641006d290 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6408009910 tx=0x7f6408009c20 comp rx=0 tx=0).stop 2023-10-17T06:08:09.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.691+0000 7f6416a0f700 1 -- 172.21.15.125:0/3371707784 shutdown_connections 2023-10-17T06:08:09.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.691+0000 7f6416a0f700 1 --2- 172.21.15.125:0/3371707784 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f641006ce20 0x7f641006d290 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.691+0000 7f6416a0f700 1 --2- 172.21.15.125:0/3371707784 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f64100b3d40 0x7f64100cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.691+0000 7f6416a0f700 1 -- 172.21.15.125:0/3371707784 >> 172.21.15.125:0/3371707784 conn(0x7f64100ce5c0 msgr2=0x7f64100ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:09.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.691+0000 7f6416a0f700 1 -- 172.21.15.125:0/3371707784 shutdown_connections 2023-10-17T06:08:09.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.691+0000 7f6416a0f700 1 -- 172.21.15.125:0/3371707784 wait complete. 2023-10-17T06:08:09.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.695+0000 7f6416a0f700 1 Processor -- start 2023-10-17T06:08:09.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.695+0000 7f6416a0f700 1 -- start start 2023-10-17T06:08:09.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.695+0000 7f6416a0f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f641006ce20 0x7f64100c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:09.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.695+0000 7f6416a0f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64100b3d40 0x7f6410156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:09.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.695+0000 7f6416a0f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6410164a20 0x7f6410163530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:09.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.695+0000 7f6416a0f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6410163110 con 0x7f641006ce20 2023-10-17T06:08:09.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.695+0000 7f6416a0f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64100c8430 con 0x7f64100b3d40 2023-10-17T06:08:09.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.695+0000 7f6416a0f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64100b1f30 con 0x7f6410164a20 2023-10-17T06:08:09.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.695+0000 7f6415a0d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f641006ce20 0x7f64100c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:09.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.695+0000 7f6415a0d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f641006ce20 0x7f64100c7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32802/0 (socket says 172.21.15.125:32802) 2023-10-17T06:08:09.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.695+0000 7f6415a0d700 1 -- 172.21.15.125:0/3679533532 learned_addr learned my addr 172.21.15.125:0/3679533532 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:09.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.695+0000 7f641620e700 1 --2- 172.21.15.125:0/3679533532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6410164a20 0x7f6410163530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:09.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.695+0000 7f641520c700 1 --2- 172.21.15.125:0/3679533532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64100b3d40 0x7f6410156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:09.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.699+0000 7f6415a0d700 1 -- 172.21.15.125:0/3679533532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6410164a20 msgr2=0x7f6410163530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:09.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.699+0000 7f6415a0d700 1 --2- 172.21.15.125:0/3679533532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6410164a20 0x7f6410163530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.699+0000 7f6415a0d700 1 -- 172.21.15.125:0/3679533532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64100b3d40 msgr2=0x7f6410156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:09.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.699+0000 7f6415a0d700 1 --2- 172.21.15.125:0/3679533532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64100b3d40 0x7f6410156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.699+0000 7f6415a0d700 1 -- 172.21.15.125:0/3679533532 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6408009570 con 0x7f641006ce20 2023-10-17T06:08:09.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.699+0000 7f641520c700 1 --2- 172.21.15.125:0/3679533532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64100b3d40 0x7f6410156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:09.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.699+0000 7f6415a0d700 1 --2- 172.21.15.125:0/3679533532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f641006ce20 0x7f64100c7ef0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f640c009db0 tx=0x7f640c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:09.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.699+0000 7f64067fc700 1 -- 172.21.15.125:0/3679533532 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c009c20 con 0x7f641006ce20 2023-10-17T06:08:09.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.699+0000 7f64067fc700 1 -- 172.21.15.125:0/3679533532 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640c00f040 con 0x7f641006ce20 2023-10-17T06:08:09.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.699+0000 7f6416a0f700 1 -- 172.21.15.125:0/3679533532 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64100b1990 con 0x7f641006ce20 2023-10-17T06:08:09.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.699+0000 7f64067fc700 1 -- 172.21.15.125:0/3679533532 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c014480 con 0x7f641006ce20 2023-10-17T06:08:09.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.699+0000 7f6416a0f700 1 -- 172.21.15.125:0/3679533532 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64100b1c50 con 0x7f641006ce20 2023-10-17T06:08:09.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.699+0000 7f6416a0f700 1 -- 172.21.15.125:0/3679533532 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64100cd2c0 con 0x7f641006ce20 2023-10-17T06:08:09.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.703+0000 7f64067fc700 1 -- 172.21.15.125:0/3679533532 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f640c0145e0 con 0x7f641006ce20 2023-10-17T06:08:09.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.703+0000 7f64067fc700 1 --2- 172.21.15.125:0/3679533532 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f63f4065720 0x7f63f4067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:09.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.703+0000 7f64067fc700 1 -- 172.21.15.125:0/3679533532 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f640c083960 con 0x7f641006ce20 2023-10-17T06:08:09.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.703+0000 7f641520c700 1 --2- 172.21.15.125:0/3679533532 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f63f4065720 0x7f63f4067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:09.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.703+0000 7f641520c700 1 --2- 172.21.15.125:0/3679533532 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f63f4065720 0x7f63f4067be0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6410159220 tx=0x7f6400009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:09.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.711+0000 7f64067fc700 1 -- 172.21.15.125:0/3679533532 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f640c054b70 con 0x7f641006ce20 2023-10-17T06:08:09.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.891+0000 7f6416a0f700 1 -- 172.21.15.125:0/3679533532 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f64100b4120 con 0x7f641006ce20 2023-10-17T06:08:09.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.891+0000 7f64067fc700 1 -- 172.21.15.125:0/3679533532 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f640c054700 con 0x7f641006ce20 2023-10-17T06:08:09.898 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:09.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.895+0000 7f6416a0f700 1 -- 172.21.15.125:0/3679533532 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f63f4065720 msgr2=0x7f63f4067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:09.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.895+0000 7f6416a0f700 1 --2- 172.21.15.125:0/3679533532 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f63f4065720 0x7f63f4067be0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6410159220 tx=0x7f6400009040 comp rx=0 tx=0).stop 2023-10-17T06:08:09.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.895+0000 7f6416a0f700 1 -- 172.21.15.125:0/3679533532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f641006ce20 msgr2=0x7f64100c7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:09.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.895+0000 7f6416a0f700 1 --2- 172.21.15.125:0/3679533532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f641006ce20 0x7f64100c7ef0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f640c009db0 tx=0x7f640c00c3a0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.895+0000 7f6416a0f700 1 -- 172.21.15.125:0/3679533532 shutdown_connections 2023-10-17T06:08:09.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.895+0000 7f6416a0f700 1 --2- 172.21.15.125:0/3679533532 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f63f4065720 0x7f63f4067be0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.895+0000 7f6416a0f700 1 --2- 172.21.15.125:0/3679533532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6410164a20 0x7f6410163530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.895+0000 7f6416a0f700 1 --2- 172.21.15.125:0/3679533532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64100b3d40 0x7f6410156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.895+0000 7f6416a0f700 1 --2- 172.21.15.125:0/3679533532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f641006ce20 0x7f64100c7ef0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:09.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.895+0000 7f6416a0f700 1 -- 172.21.15.125:0/3679533532 >> 172.21.15.125:0/3679533532 conn(0x7f64100ce5c0 msgr2=0x7f6410070b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:09.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.895+0000 7f6416a0f700 1 -- 172.21.15.125:0/3679533532 shutdown_connections 2023-10-17T06:08:09.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:09.895+0000 7f6416a0f700 1 -- 172.21.15.125:0/3679533532 wait complete. 2023-10-17T06:08:09.925 INFO:tasks.cephfs_test_runner:Starting test: test_network_death (tasks.cephfs.test_client_recovery.TestClientNetworkRecovery) Simulate software freeze or temporary network failure. 2023-10-17T06:08:09.926 INFO:tasks.cephfs_test_runner:test_network_death (tasks.cephfs.test_client_recovery.TestClientNetworkRecovery) 2023-10-17T06:08:09.926 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death' 2023-10-17T06:08:10.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.103+0000 7f49b53d2700 1 Processor -- start 2023-10-17T06:08:10.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.103+0000 7f49b53d2700 1 -- start start 2023-10-17T06:08:10.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.103+0000 7f49b53d2700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f49b0154040 0x7f49b00cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:10.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.103+0000 7f49b53d2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b015e130 con 0x7f49b00cb8a0 2023-10-17T06:08:10.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.103+0000 7f49b53d2700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b00ce1b0 con 0x7f49b006e8a0 2023-10-17T06:08:10.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.103+0000 7f49b53d2700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b00cdfa0 con 0x7f49b0154040 2023-10-17T06:08:10.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.103+0000 7f49af7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f49b00cb8a0 0x7f49b006f970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45214/0 (socket says 172.21.15.125:45214) 2023-10-17T06:08:10.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.103+0000 7f49af7fe700 1 -- 172.21.15.125:0/3309388930 learned_addr learned my addr 172.21.15.125:0/3309388930 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:10.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.103+0000 7f49aeffd700 1 --2- 172.21.15.125:0/3309388930 >> v2:172.21.15.184:3300/0 conn(0x7f49b0154040 0x7f49b00cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:10.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.103+0000 7f49ae7fc700 1 -- 172.21.15.125:0/3309388930 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846346858 0 0) 0x7f49b015e130 con 0x7f49b00cb8a0 2023-10-17T06:08:10.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.103+0000 7f49ae7fc700 1 -- 172.21.15.125:0/3309388930 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f499c0035d0 con 0x7f49b00cb8a0 2023-10-17T06:08:10.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.107+0000 7f49ae7fc700 1 -- 172.21.15.125:0/3309388930 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256361018 0 0) 0x7f49b00ce1b0 con 0x7f49b006e8a0 2023-10-17T06:08:10.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.107+0000 7f49ae7fc700 1 -- 172.21.15.125:0/3309388930 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49b015e130 con 0x7f49b006e8a0 2023-10-17T06:08:10.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.107+0000 7f49aeffd700 1 -- 172.21.15.125:0/3309388930 >> v1:172.21.15.184:6789/0 conn(0x7f49b006e8a0 legacy=0x7f49b00cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:10.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.107+0000 7f49ae7fc700 1 -- 172.21.15.125:0/3309388930 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 279430940 0 0) 0x7f499c0035d0 con 0x7f49b00cb8a0 2023-10-17T06:08:10.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.107+0000 7f49aeffd700 1 -- 172.21.15.125:0/3309388930 >> v1:172.21.15.125:6789/0 conn(0x7f49b00cb8a0 legacy=0x7f49b006f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:10.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.107+0000 7f49aeffd700 1 -- 172.21.15.125:0/3309388930 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b00ce490 con 0x7f49b0154040 2023-10-17T06:08:10.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.107+0000 7f49aeffd700 1 --2- 172.21.15.125:0/3309388930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b0154040 0x7f49b00cc680 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f49a0009850 tx=0x7f49a0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b25de24799f0c351 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:10.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.107+0000 7f49ae7fc700 1 -- 172.21.15.125:0/3309388930 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a80019f0 con 0x7f49b0154040 2023-10-17T06:08:10.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.107+0000 7f49ae7fc700 1 -- 172.21.15.125:0/3309388930 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a0004030 con 0x7f49b0154040 2023-10-17T06:08:10.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.107+0000 7f49ae7fc700 1 -- 172.21.15.125:0/3309388930 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a00043c0 con 0x7f49b0154040 2023-10-17T06:08:10.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.107+0000 7f49b53d2700 1 -- 172.21.15.125:0/3309388930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b0154040 msgr2=0x7f49b00cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:10.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.107+0000 7f49b53d2700 1 --2- 172.21.15.125:0/3309388930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b0154040 0x7f49b00cc680 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f49a0009850 tx=0x7f49a0009b60 comp rx=0 tx=0).stop 2023-10-17T06:08:10.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.107+0000 7f49b53d2700 1 -- 172.21.15.125:0/3309388930 shutdown_connections 2023-10-17T06:08:10.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.107+0000 7f49b53d2700 1 --2- 172.21.15.125:0/3309388930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b0154040 0x7f49b00cc680 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:10.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.107+0000 7f49b53d2700 1 -- 172.21.15.125:0/3309388930 >> 172.21.15.125:0/3309388930 conn(0x7f49b006a340 msgr2=0x7f49b00b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:10.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.107+0000 7f49b53d2700 1 -- 172.21.15.125:0/3309388930 shutdown_connections 2023-10-17T06:08:10.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.107+0000 7f49b53d2700 1 -- 172.21.15.125:0/3309388930 wait complete. 2023-10-17T06:08:10.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.111+0000 7f49b53d2700 1 Processor -- start 2023-10-17T06:08:10.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.111+0000 7f49b53d2700 1 -- start start 2023-10-17T06:08:10.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.111+0000 7f49b53d2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49b006e8a0 0x7f49b00ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:10.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.111+0000 7f49b53d2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b00cb8a0 0x7f49b0156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:10.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.111+0000 7f49b53d2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b0154040 0x7f49b0156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:10.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.111+0000 7f49b53d2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b0157100 con 0x7f49b006e8a0 2023-10-17T06:08:10.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.111+0000 7f49b53d2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b00b21b0 con 0x7f49b00cb8a0 2023-10-17T06:08:10.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.111+0000 7f49b53d2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b00b2490 con 0x7f49b0154040 2023-10-17T06:08:10.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.111+0000 7f49aeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49b006e8a0 0x7f49b00ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:10.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.111+0000 7f49aeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49b006e8a0 0x7f49b00ad670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32808/0 (socket says 172.21.15.125:32808) 2023-10-17T06:08:10.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.111+0000 7f49aeffd700 1 -- 172.21.15.125:0/2650507799 learned_addr learned my addr 172.21.15.125:0/2650507799 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:10.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.115+0000 7f49a67fc700 1 --2- 172.21.15.125:0/2650507799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b00cb8a0 0x7f49b0156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:10.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.115+0000 7f49af7fe700 1 --2- 172.21.15.125:0/2650507799 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b0154040 0x7f49b0156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:10.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.115+0000 7f49aeffd700 1 -- 172.21.15.125:0/2650507799 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b0154040 msgr2=0x7f49b0156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:10.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.115+0000 7f49aeffd700 1 --2- 172.21.15.125:0/2650507799 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b0154040 0x7f49b0156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:10.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.115+0000 7f49aeffd700 1 -- 172.21.15.125:0/2650507799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b00cb8a0 msgr2=0x7f49b0156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:10.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.115+0000 7f49aeffd700 1 --2- 172.21.15.125:0/2650507799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b00cb8a0 0x7f49b0156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:10.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.115+0000 7f49aeffd700 1 -- 172.21.15.125:0/2650507799 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a00094b0 con 0x7f49b006e8a0 2023-10-17T06:08:10.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.115+0000 7f49aeffd700 1 --2- 172.21.15.125:0/2650507799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49b006e8a0 0x7f49b00ad670 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f49b00b0f40 tx=0x7f49a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:10.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.115+0000 7f49a7fff700 1 -- 172.21.15.125:0/2650507799 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a0003ce0 con 0x7f49b006e8a0 2023-10-17T06:08:10.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.115+0000 7f49b53d2700 1 -- 172.21.15.125:0/2650507799 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b00b2770 con 0x7f49b006e8a0 2023-10-17T06:08:10.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.115+0000 7f49a7fff700 1 -- 172.21.15.125:0/2650507799 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a001f070 con 0x7f49b006e8a0 2023-10-17T06:08:10.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.115+0000 7f49a7fff700 1 -- 172.21.15.125:0/2650507799 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a0011870 con 0x7f49b006e8a0 2023-10-17T06:08:10.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.115+0000 7f49b53d2700 1 -- 172.21.15.125:0/2650507799 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b00b2d30 con 0x7f49b006e8a0 2023-10-17T06:08:10.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.115+0000 7f49b53d2700 1 -- 172.21.15.125:0/2650507799 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b00ab8e0 con 0x7f49b006e8a0 2023-10-17T06:08:10.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.119+0000 7f49a7fff700 1 -- 172.21.15.125:0/2650507799 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f49a0021030 con 0x7f49b006e8a0 2023-10-17T06:08:10.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.119+0000 7f49a7fff700 1 --2- 172.21.15.125:0/2650507799 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f49900656f0 0x7f4990067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:10.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.119+0000 7f49a7fff700 1 -- 172.21.15.125:0/2650507799 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f49a0084410 con 0x7f49b006e8a0 2023-10-17T06:08:10.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.119+0000 7f49a67fc700 1 --2- 172.21.15.125:0/2650507799 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f49900656f0 0x7f4990067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:10.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.119+0000 7f49a67fc700 1 --2- 172.21.15.125:0/2650507799 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f49900656f0 0x7f4990067bb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f49b0153320 tx=0x7f4998009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:10.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.127+0000 7f49a7fff700 1 -- 172.21.15.125:0/2650507799 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f49a0051b10 con 0x7f49b006e8a0 2023-10-17T06:08:10.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.359+0000 7f49b53d2700 1 -- 172.21.15.125:0/2650507799 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death"]} v 0) v1 -- 0x7f49b0072e60 con 0x7f49b006e8a0 2023-10-17T06:08:10.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.875+0000 7f49a7fff700 1 -- 172.21.15.125:0/2650507799 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death"]}]=0 v82) v1 ==== 160+0+0 (secure 0 0 0) 0x7f49a0055130 con 0x7f49b006e8a0 2023-10-17T06:08:10.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.879+0000 7f49b53d2700 1 -- 172.21.15.125:0/2650507799 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f49900656f0 msgr2=0x7f4990067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:10.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.879+0000 7f49b53d2700 1 --2- 172.21.15.125:0/2650507799 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f49900656f0 0x7f4990067bb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f49b0153320 tx=0x7f4998009040 comp rx=0 tx=0).stop 2023-10-17T06:08:10.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.879+0000 7f49b53d2700 1 -- 172.21.15.125:0/2650507799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49b006e8a0 msgr2=0x7f49b00ad670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:10.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.879+0000 7f49b53d2700 1 --2- 172.21.15.125:0/2650507799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49b006e8a0 0x7f49b00ad670 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f49b00b0f40 tx=0x7f49a0004770 comp rx=0 tx=0).stop 2023-10-17T06:08:10.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.879+0000 7f49b53d2700 1 -- 172.21.15.125:0/2650507799 shutdown_connections 2023-10-17T06:08:10.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.879+0000 7f49b53d2700 1 --2- 172.21.15.125:0/2650507799 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f49900656f0 0x7f4990067bb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:10.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.879+0000 7f49b53d2700 1 --2- 172.21.15.125:0/2650507799 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f49b0154040 0x7f49b0156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:10.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.879+0000 7f49b53d2700 1 --2- 172.21.15.125:0/2650507799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49b00cb8a0 0x7f49b0156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:10.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.879+0000 7f49b53d2700 1 --2- 172.21.15.125:0/2650507799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f49b006e8a0 0x7f49b00ad670 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:10.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.879+0000 7f49b53d2700 1 -- 172.21.15.125:0/2650507799 >> 172.21.15.125:0/2650507799 conn(0x7f49b006a340 msgr2=0x7f49b015e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:10.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.879+0000 7f49b53d2700 1 -- 172.21.15.125:0/2650507799 shutdown_connections 2023-10-17T06:08:10.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:10.879+0000 7f49b53d2700 1 -- 172.21.15.125:0/2650507799 wait complete. 2023-10-17T06:08:10.910 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:08:11.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.087+0000 7f60ad06b700 1 Processor -- start 2023-10-17T06:08:11.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.087+0000 7f60ad06b700 1 -- start start 2023-10-17T06:08:11.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60ad06b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f60a8160710 0x7f60a80b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:11.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60ad06b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a815d0d0 con 0x7f60a80b5ae0 2023-10-17T06:08:11.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60ad06b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a806f0f0 con 0x7f60a80d2e00 2023-10-17T06:08:11.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60ad06b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a815df90 con 0x7f60a8160710 2023-10-17T06:08:11.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60ac86a700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f60a80b5ae0 0x7f60a806db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45226/0 (socket says 172.21.15.125:45226) 2023-10-17T06:08:11.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60ac86a700 1 -- 172.21.15.125:0/179679874 learned_addr learned my addr 172.21.15.125:0/179679874 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:11.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60a77fe700 1 --2- 172.21.15.125:0/179679874 >> v2:172.21.15.125:3300/0 conn(0x7f60a8160710 0x7f60a80b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:11.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60a6ffd700 1 -- 172.21.15.125:0/179679874 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099319556 0 0) 0x7f60a00014e0 con 0x7f60a80b5ae0 2023-10-17T06:08:11.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60a6ffd700 1 -- 172.21.15.125:0/179679874 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60900035d0 con 0x7f60a80b5ae0 2023-10-17T06:08:11.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60a6ffd700 1 -- 172.21.15.125:0/179679874 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2058769984 0 0) 0x7f60900035d0 con 0x7f60a80b5ae0 2023-10-17T06:08:11.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60a6ffd700 1 -- 172.21.15.125:0/179679874 >> v2:172.21.15.125:3300/0 conn(0x7f60a8160710 msgr2=0x7f60a80b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:11.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60a6ffd700 1 --2- 172.21.15.125:0/179679874 >> v2:172.21.15.125:3300/0 conn(0x7f60a8160710 0x7f60a80b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60a6ffd700 1 -- 172.21.15.125:0/179679874 >> v1:172.21.15.184:6789/0 conn(0x7f60a80d2e00 legacy=0x7f60a80d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:11.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60a6ffd700 1 -- 172.21.15.125:0/179679874 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a815d310 con 0x7f60a80b5ae0 2023-10-17T06:08:11.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60a6ffd700 1 -- 172.21.15.125:0/179679874 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7f60a0001bd0 con 0x7f60a80b5ae0 2023-10-17T06:08:11.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60a6ffd700 1 -- 172.21.15.125:0/179679874 >> v1:172.21.15.125:6789/0 conn(0x7f60a80b5ae0 legacy=0x7f60a806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:11.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60a6ffd700 1 --2- 172.21.15.125:0/179679874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6090003a20 0x7f6090003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:11.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60a6ffd700 1 --2- 172.21.15.125:0/179679874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6090004870 0x7f6090004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:11.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60a6ffd700 1 --2- 172.21.15.125:0/179679874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6090005230 0x7f609000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:11.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60a6ffd700 1 -- 172.21.15.125:0/179679874 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a815df90 con 0x7f6090005230 2023-10-17T06:08:11.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60a6ffd700 1 -- 172.21.15.125:0/179679874 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609000c0d0 con 0x7f6090003a20 2023-10-17T06:08:11.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60a6ffd700 1 -- 172.21.15.125:0/179679874 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609000c290 con 0x7f6090004870 2023-10-17T06:08:11.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60a7fff700 1 --2- 172.21.15.125:0/179679874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6090003a20 0x7f6090003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:11.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60a77fe700 1 --2- 172.21.15.125:0/179679874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6090004870 0x7f6090004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:11.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.091+0000 7f60ac86a700 1 --2- 172.21.15.125:0/179679874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6090005230 0x7f609000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:11.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.095+0000 7f60a7fff700 1 -- 172.21.15.125:0/179679874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6090004870 msgr2=0x7f6090004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:11.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.095+0000 7f60a7fff700 1 --2- 172.21.15.125:0/179679874 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6090004870 0x7f6090004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.095+0000 7f60a7fff700 1 -- 172.21.15.125:0/179679874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6090005230 msgr2=0x7f609000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:11.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.095+0000 7f60a7fff700 1 --2- 172.21.15.125:0/179679874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6090005230 0x7f609000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.095+0000 7f60a7fff700 1 -- 172.21.15.125:0/179679874 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60900035d0 con 0x7f6090003a20 2023-10-17T06:08:11.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.095+0000 7f60ac86a700 1 -- 172.21.15.125:0/179679874 reap_dead start 2023-10-17T06:08:11.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.095+0000 7f60a7fff700 1 --2- 172.21.15.125:0/179679874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6090003a20 0x7f6090003e40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f60980017e0 tx=0x7f60900058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41149af6db42381b server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:11.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.095+0000 7f60a6ffd700 1 -- 172.21.15.125:0/179679874 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60980052d0 con 0x7f6090003a20 2023-10-17T06:08:11.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.095+0000 7f60a6ffd700 1 -- 172.21.15.125:0/179679874 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6098005450 con 0x7f6090003a20 2023-10-17T06:08:11.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.095+0000 7f60a6ffd700 1 -- 172.21.15.125:0/179679874 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60980038e0 con 0x7f6090003a20 2023-10-17T06:08:11.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.095+0000 7f60ad06b700 1 -- 172.21.15.125:0/179679874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6090003a20 msgr2=0x7f6090003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:11.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.095+0000 7f60ad06b700 1 --2- 172.21.15.125:0/179679874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6090003a20 0x7f6090003e40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f60980017e0 tx=0x7f60900058a0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.095+0000 7f60ad06b700 1 -- 172.21.15.125:0/179679874 shutdown_connections 2023-10-17T06:08:11.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.095+0000 7f60ad06b700 1 --2- 172.21.15.125:0/179679874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6090003a20 0x7f6090003e40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.095+0000 7f60ad06b700 1 -- 172.21.15.125:0/179679874 >> 172.21.15.125:0/179679874 conn(0x7f60a8069f20 msgr2=0x7f60a806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:11.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.095+0000 7f60ad06b700 1 -- 172.21.15.125:0/179679874 shutdown_connections 2023-10-17T06:08:11.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.095+0000 7f60ad06b700 1 -- 172.21.15.125:0/179679874 wait complete. 2023-10-17T06:08:11.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.099+0000 7f60ad06b700 1 Processor -- start 2023-10-17T06:08:11.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.099+0000 7f60ad06b700 1 -- start start 2023-10-17T06:08:11.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.099+0000 7f60ad06b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6090003a20 0x7f60a8155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:11.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.099+0000 7f60ad06b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60a8157490 0x7f60a8157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:11.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.099+0000 7f60ad06b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60a80ad010 0x7f60a80ad490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:11.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.099+0000 7f60ad06b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a81563f0 con 0x7f6090003a20 2023-10-17T06:08:11.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.099+0000 7f60ad06b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a81566d0 con 0x7f60a80ad010 2023-10-17T06:08:11.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.099+0000 7f60ad06b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a81569b0 con 0x7f60a8157490 2023-10-17T06:08:11.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.103+0000 7f60a7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6090003a20 0x7f60a8155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:11.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.103+0000 7f60a7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6090003a20 0x7f60a8155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32834/0 (socket says 172.21.15.125:32834) 2023-10-17T06:08:11.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.103+0000 7f60a7fff700 1 -- 172.21.15.125:0/1089329264 learned_addr learned my addr 172.21.15.125:0/1089329264 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:11.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.103+0000 7f60a77fe700 1 --2- 172.21.15.125:0/1089329264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60a8157490 0x7f60a8157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:11.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.103+0000 7f60ac86a700 1 --2- 172.21.15.125:0/1089329264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60a80ad010 0x7f60a80ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:11.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.103+0000 7f60a7fff700 1 -- 172.21.15.125:0/1089329264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60a8157490 msgr2=0x7f60a8157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:11.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.103+0000 7f60a7fff700 1 --2- 172.21.15.125:0/1089329264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60a8157490 0x7f60a8157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.103+0000 7f60a7fff700 1 -- 172.21.15.125:0/1089329264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60a80ad010 msgr2=0x7f60a80ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:11.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.103+0000 7f60a7fff700 1 --2- 172.21.15.125:0/1089329264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60a80ad010 0x7f60a80ad490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.103+0000 7f60a7fff700 1 -- 172.21.15.125:0/1089329264 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a8156c90 con 0x7f6090003a20 2023-10-17T06:08:11.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.103+0000 7f60a7fff700 1 --2- 172.21.15.125:0/1089329264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6090003a20 0x7f60a8155930 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6098005040 tx=0x7f6098001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:11.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.103+0000 7f60a4ff9700 1 -- 172.21.15.125:0/1089329264 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6098001290 con 0x7f6090003a20 2023-10-17T06:08:11.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.103+0000 7f60a4ff9700 1 -- 172.21.15.125:0/1089329264 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6098007040 con 0x7f6090003a20 2023-10-17T06:08:11.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.103+0000 7f60ad06b700 1 -- 172.21.15.125:0/1089329264 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a8156f70 con 0x7f6090003a20 2023-10-17T06:08:11.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.103+0000 7f60a4ff9700 1 -- 172.21.15.125:0/1089329264 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60980073d0 con 0x7f6090003a20 2023-10-17T06:08:11.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.103+0000 7f60ad06b700 1 -- 172.21.15.125:0/1089329264 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a80b27e0 con 0x7f6090003a20 2023-10-17T06:08:11.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.103+0000 7f60ad06b700 1 -- 172.21.15.125:0/1089329264 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a80d0100 con 0x7f6090003a20 2023-10-17T06:08:11.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.107+0000 7f60a4ff9700 1 -- 172.21.15.125:0/1089329264 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6098007530 con 0x7f6090003a20 2023-10-17T06:08:11.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.107+0000 7f60a4ff9700 1 --2- 172.21.15.125:0/1089329264 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f60940656f0 0x7f6094067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:11.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.107+0000 7f60a4ff9700 1 -- 172.21.15.125:0/1089329264 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6098083970 con 0x7f6090003a20 2023-10-17T06:08:11.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.107+0000 7f60a77fe700 1 --2- 172.21.15.125:0/1089329264 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f60940656f0 0x7f6094067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:11.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.111+0000 7f60a77fe700 1 --2- 172.21.15.125:0/1089329264 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f60940656f0 0x7f6094067bb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f60a8070c20 tx=0x7f609c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:11.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.115+0000 7f60a4ff9700 1 -- 172.21.15.125:0/1089329264 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f6098051210 con 0x7f6090003a20 2023-10-17T06:08:11.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.295+0000 7f60ad06b700 1 -- 172.21.15.125:0/1089329264 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60a8157130 con 0x7f6090003a20 2023-10-17T06:08:11.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.299+0000 7f60a4ff9700 1 -- 172.21.15.125:0/1089329264 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20252 (secure 0 0 0) 0x7f6098054830 con 0x7f6090003a20 2023-10-17T06:08:11.302 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:11.303 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":30,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:49.710984+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:08:11.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.299+0000 7f60ad06b700 1 -- 172.21.15.125:0/1089329264 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f60940656f0 msgr2=0x7f6094067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:11.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.303+0000 7f60ad06b700 1 --2- 172.21.15.125:0/1089329264 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f60940656f0 0x7f6094067bb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f60a8070c20 tx=0x7f609c009240 comp rx=0 tx=0).stop 2023-10-17T06:08:11.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.303+0000 7f60ad06b700 1 -- 172.21.15.125:0/1089329264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6090003a20 msgr2=0x7f60a8155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:11.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.303+0000 7f60ad06b700 1 --2- 172.21.15.125:0/1089329264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6090003a20 0x7f60a8155930 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6098005040 tx=0x7f6098001120 comp rx=0 tx=0).stop 2023-10-17T06:08:11.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.303+0000 7f60ad06b700 1 -- 172.21.15.125:0/1089329264 shutdown_connections 2023-10-17T06:08:11.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.303+0000 7f60ad06b700 1 --2- 172.21.15.125:0/1089329264 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f60940656f0 0x7f6094067bb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.303+0000 7f60ad06b700 1 --2- 172.21.15.125:0/1089329264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f60a80ad010 0x7f60a80ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.303+0000 7f60ad06b700 1 --2- 172.21.15.125:0/1089329264 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f60a8157490 0x7f60a8157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.303+0000 7f60ad06b700 1 --2- 172.21.15.125:0/1089329264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6090003a20 0x7f60a8155930 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.303+0000 7f60ad06b700 1 -- 172.21.15.125:0/1089329264 >> 172.21.15.125:0/1089329264 conn(0x7f60a8069f20 msgr2=0x7f60a80cf9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:11.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.303+0000 7f60ad06b700 1 -- 172.21.15.125:0/1089329264 shutdown_connections 2023-10-17T06:08:11.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.303+0000 7f60ad06b700 1 -- 172.21.15.125:0/1089329264 wait complete. 2023-10-17T06:08:11.326 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-17T06:07:06.629169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-17T06:07:08.148117+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-17T06:07:11.895112+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-17T06:08:11.327 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:08:11.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.511+0000 7f84b8c47700 1 Processor -- start 2023-10-17T06:08:11.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.511+0000 7f84b8c47700 1 -- start start 2023-10-17T06:08:11.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.515+0000 7f84b8c47700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84b4164a20 0x7f84b40cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:11.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.515+0000 7f84b8c47700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b40ca4c0 con 0x7f84b406ce20 2023-10-17T06:08:11.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.515+0000 7f84b8c47700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b40ca7a0 con 0x7f84b40b3d40 2023-10-17T06:08:11.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.515+0000 7f84b8c47700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b406e2d0 con 0x7f84b4164a20 2023-10-17T06:08:11.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.515+0000 7f84b3fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f84b406ce20 0x7f84b406f970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45232/0 (socket says 172.21.15.125:45232) 2023-10-17T06:08:11.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.515+0000 7f84b3fff700 1 -- 172.21.15.125:0/2105276517 learned_addr learned my addr 172.21.15.125:0/2105276517 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:11.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.515+0000 7f84b2ffd700 1 --2- 172.21.15.125:0/2105276517 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84b4164a20 0x7f84b40cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:11.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.515+0000 7f84b27fc700 1 -- 172.21.15.125:0/2105276517 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566045773 0 0) 0x7f84b40ca4c0 con 0x7f84b406ce20 2023-10-17T06:08:11.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.515+0000 7f84b27fc700 1 -- 172.21.15.125:0/2105276517 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f849c0035d0 con 0x7f84b406ce20 2023-10-17T06:08:11.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.515+0000 7f84b27fc700 1 -- 172.21.15.125:0/2105276517 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970602177 0 0) 0x7f84b40ca7a0 con 0x7f84b40b3d40 2023-10-17T06:08:11.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.515+0000 7f84b27fc700 1 -- 172.21.15.125:0/2105276517 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84b40ca4c0 con 0x7f84b40b3d40 2023-10-17T06:08:11.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.515+0000 7f84b2ffd700 1 -- 172.21.15.125:0/2105276517 >> v1:172.21.15.184:6789/0 conn(0x7f84b40b3d40 legacy=0x7f84b40c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:11.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.515+0000 7f84b2ffd700 1 -- 172.21.15.125:0/2105276517 >> v1:172.21.15.125:6789/0 conn(0x7f84b406ce20 legacy=0x7f84b406f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:11.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.515+0000 7f84b2ffd700 1 -- 172.21.15.125:0/2105276517 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b40caa80 con 0x7f84b4164a20 2023-10-17T06:08:11.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.515+0000 7f84b2ffd700 1 --2- 172.21.15.125:0/2105276517 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84b4164a20 0x7f84b40cc190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009880 tx=0x7f84a8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24c351d713575628 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:11.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.515+0000 7f84b27fc700 1 -- 172.21.15.125:0/2105276517 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a8011830 con 0x7f84b4164a20 2023-10-17T06:08:11.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.515+0000 7f84b27fc700 1 -- 172.21.15.125:0/2105276517 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a8011990 con 0x7f84b4164a20 2023-10-17T06:08:11.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.515+0000 7f84b27fc700 1 -- 172.21.15.125:0/2105276517 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a8011d20 con 0x7f84b4164a20 2023-10-17T06:08:11.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.519+0000 7f84b8c47700 1 -- 172.21.15.125:0/2105276517 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84b4164a20 msgr2=0x7f84b40cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:11.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.519+0000 7f84b8c47700 1 --2- 172.21.15.125:0/2105276517 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84b4164a20 0x7f84b40cc190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009880 tx=0x7f84a8009b90 comp rx=0 tx=0).stop 2023-10-17T06:08:11.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.519+0000 7f84b8c47700 1 -- 172.21.15.125:0/2105276517 shutdown_connections 2023-10-17T06:08:11.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.519+0000 7f84b8c47700 1 --2- 172.21.15.125:0/2105276517 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84b4164a20 0x7f84b40cc190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.519+0000 7f84b8c47700 1 -- 172.21.15.125:0/2105276517 >> 172.21.15.125:0/2105276517 conn(0x7f84b40ce5c0 msgr2=0x7f84b40ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:11.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.519+0000 7f84b8c47700 1 -- 172.21.15.125:0/2105276517 shutdown_connections 2023-10-17T06:08:11.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.519+0000 7f84b8c47700 1 -- 172.21.15.125:0/2105276517 wait complete. 2023-10-17T06:08:11.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.519+0000 7f84b8c47700 1 Processor -- start 2023-10-17T06:08:11.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f84b8c47700 1 -- start start 2023-10-17T06:08:11.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f84b8c47700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84b406ce20 0x7f84b4155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:11.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f84b8c47700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84b40b3d40 0x7f84b40c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:11.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f84b8c47700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84b4164a20 0x7f84b40c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:11.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f84b8c47700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b4163c20 con 0x7f84b40b3d40 2023-10-17T06:08:11.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f84b8c47700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b4163010 con 0x7f84b406ce20 2023-10-17T06:08:11.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f84b8c47700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b41632f0 con 0x7f84b4164a20 2023-10-17T06:08:11.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f84b2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84b40b3d40 0x7f84b40c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:11.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f84b2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84b40b3d40 0x7f84b40c60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32838/0 (socket says 172.21.15.125:32838) 2023-10-17T06:08:11.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f84b2ffd700 1 -- 172.21.15.125:0/3062766319 learned_addr learned my addr 172.21.15.125:0/3062766319 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:11.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f84b37fe700 1 --2- 172.21.15.125:0/3062766319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84b406ce20 0x7f84b4155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:11.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f84b3fff700 1 --2- 172.21.15.125:0/3062766319 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84b4164a20 0x7f84b40c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:11.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f84b2ffd700 1 -- 172.21.15.125:0/3062766319 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84b4164a20 msgr2=0x7f84b40c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:11.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f84b2ffd700 1 --2- 172.21.15.125:0/3062766319 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84b4164a20 0x7f84b40c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f84b2ffd700 1 -- 172.21.15.125:0/3062766319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84b406ce20 msgr2=0x7f84b4155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:11.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f84b2ffd700 1 --2- 172.21.15.125:0/3062766319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84b406ce20 0x7f84b4155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f84b2ffd700 1 -- 172.21.15.125:0/3062766319 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a80094b0 con 0x7f84b40b3d40 2023-10-17T06:08:11.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f84b2ffd700 1 --2- 172.21.15.125:0/3062766319 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84b40b3d40 0x7f84b40c60a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f84a8013040 tx=0x7f84a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:11.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f849bfff700 1 -- 172.21.15.125:0/3062766319 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a801a8c0 con 0x7f84b40b3d40 2023-10-17T06:08:11.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f849bfff700 1 -- 172.21.15.125:0/3062766319 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a801e070 con 0x7f84b40b3d40 2023-10-17T06:08:11.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f84b8c47700 1 -- 172.21.15.125:0/3062766319 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b41635d0 con 0x7f84b40b3d40 2023-10-17T06:08:11.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.523+0000 7f849bfff700 1 -- 172.21.15.125:0/3062766319 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a801ac60 con 0x7f84b40b3d40 2023-10-17T06:08:11.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.527+0000 7f84b8c47700 1 -- 172.21.15.125:0/3062766319 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b40c8240 con 0x7f84b40b3d40 2023-10-17T06:08:11.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.527+0000 7f84b8c47700 1 -- 172.21.15.125:0/3062766319 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b4163d90 con 0x7f84b40b3d40 2023-10-17T06:08:11.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.527+0000 7f849bfff700 1 -- 172.21.15.125:0/3062766319 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f84a802d450 con 0x7f84b40b3d40 2023-10-17T06:08:11.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.527+0000 7f849bfff700 1 --2- 172.21.15.125:0/3062766319 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f84a00656f0 0x7f84a0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:11.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.531+0000 7f849bfff700 1 -- 172.21.15.125:0/3062766319 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f84a8083eb0 con 0x7f84b40b3d40 2023-10-17T06:08:11.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.531+0000 7f84b37fe700 1 --2- 172.21.15.125:0/3062766319 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f84a00656f0 0x7f84a0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:11.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.531+0000 7f84b37fe700 1 --2- 172.21.15.125:0/3062766319 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f84a00656f0 0x7f84a0067bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f84a40011e0 tx=0x7f84a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:11.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.535+0000 7f849bfff700 1 -- 172.21.15.125:0/3062766319 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f84a80516d0 con 0x7f84b40b3d40 2023-10-17T06:08:11.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.715+0000 7f84b8c47700 1 -- 172.21.15.125:0/3062766319 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f84b404e910 con 0x7f84b40b3d40 2023-10-17T06:08:11.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.715+0000 7f849bfff700 1 -- 172.21.15.125:0/3062766319 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f84a8020020 con 0x7f84b40b3d40 2023-10-17T06:08:11.718 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:08:11.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.719+0000 7f84b8c47700 1 -- 172.21.15.125:0/3062766319 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f84a00656f0 msgr2=0x7f84a0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:11.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.719+0000 7f84b8c47700 1 --2- 172.21.15.125:0/3062766319 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f84a00656f0 0x7f84a0067bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f84a40011e0 tx=0x7f84a4009040 comp rx=0 tx=0).stop 2023-10-17T06:08:11.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.719+0000 7f84b8c47700 1 -- 172.21.15.125:0/3062766319 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84b40b3d40 msgr2=0x7f84b40c60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:11.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.719+0000 7f84b8c47700 1 --2- 172.21.15.125:0/3062766319 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84b40b3d40 0x7f84b40c60a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f84a8013040 tx=0x7f84a8004770 comp rx=0 tx=0).stop 2023-10-17T06:08:11.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.719+0000 7f84b8c47700 1 -- 172.21.15.125:0/3062766319 shutdown_connections 2023-10-17T06:08:11.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.719+0000 7f84b8c47700 1 --2- 172.21.15.125:0/3062766319 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f84a00656f0 0x7f84a0067bb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.719+0000 7f84b8c47700 1 --2- 172.21.15.125:0/3062766319 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84b4164a20 0x7f84b40c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.719+0000 7f84b8c47700 1 --2- 172.21.15.125:0/3062766319 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f84b40b3d40 0x7f84b40c60a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.719+0000 7f84b8c47700 1 --2- 172.21.15.125:0/3062766319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84b406ce20 0x7f84b4155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.719+0000 7f84b8c47700 1 -- 172.21.15.125:0/3062766319 >> 172.21.15.125:0/3062766319 conn(0x7f84b40ce5c0 msgr2=0x7f84b40c9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:11.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.719+0000 7f84b8c47700 1 -- 172.21.15.125:0/3062766319 shutdown_connections 2023-10-17T06:08:11.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.719+0000 7f84b8c47700 1 -- 172.21.15.125:0/3062766319 wait complete. 2023-10-17T06:08:11.742 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:08:11.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.919+0000 7f18b8bd2700 1 Processor -- start 2023-10-17T06:08:11.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.919+0000 7f18b8bd2700 1 -- start start 2023-10-17T06:08:11.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.923+0000 7f18b8bd2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f18b40d2e00 0x7f18b40b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:11.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.923+0000 7f18b8bd2700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f18b4160710 0x7f18b40d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:11.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.923+0000 7f18b8bd2700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b415d0d0 con 0x7f18b40b5ae0 2023-10-17T06:08:11.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.923+0000 7f18b8bd2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b415df90 con 0x7f18b40d2e00 2023-10-17T06:08:11.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.923+0000 7f18b8bd2700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b406f0f0 con 0x7f18b4160710 2023-10-17T06:08:11.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.923+0000 7f18b37fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f18b40d2e00 0x7f18b40b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:11.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.923+0000 7f18b37fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f18b40d2e00 0x7f18b40b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32840/0 (socket says 172.21.15.125:32840) 2023-10-17T06:08:11.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.923+0000 7f18b37fe700 1 -- 172.21.15.125:0/667151337 learned_addr learned my addr 172.21.15.125:0/667151337 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:11.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.923+0000 7f18b2ffd700 1 --2- 172.21.15.125:0/667151337 >> v2:172.21.15.184:3300/0 conn(0x7f18b4160710 0x7f18b40d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:11.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.923+0000 7f18b37fe700 1 -- 172.21.15.125:0/667151337 >> v2:172.21.15.184:3300/0 conn(0x7f18b4160710 msgr2=0x7f18b40d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:11.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.923+0000 7f18b37fe700 1 --2- 172.21.15.125:0/667151337 >> v2:172.21.15.184:3300/0 conn(0x7f18b4160710 0x7f18b40d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.923+0000 7f18b37fe700 1 -- 172.21.15.125:0/667151337 >> v1:172.21.15.184:6789/0 conn(0x7f18b40b5ae0 legacy=0x7f18b406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:11.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.923+0000 7f18b37fe700 1 -- 172.21.15.125:0/667151337 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b40d3720 con 0x7f18b40d2e00 2023-10-17T06:08:11.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.923+0000 7f18b27fc700 1 -- 172.21.15.125:0/667151337 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166232968 0 0) 0x7f18ac0014e0 con 0x7f18b40b5ae0 2023-10-17T06:08:11.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.923+0000 7f18b37fe700 1 --2- 172.21.15.125:0/667151337 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18b40d2e00 0x7f18b40b6e00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f18b40d2420 tx=0x7f18a4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9758788c0581a9f server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:11.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.923+0000 7f18b27fc700 1 -- 172.21.15.125:0/667151337 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4011830 con 0x7f18b40d2e00 2023-10-17T06:08:11.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.923+0000 7f18b27fc700 1 -- 172.21.15.125:0/667151337 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a4011990 con 0x7f18b40d2e00 2023-10-17T06:08:11.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.923+0000 7f18b27fc700 1 -- 172.21.15.125:0/667151337 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4011d20 con 0x7f18b40d2e00 2023-10-17T06:08:11.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.927+0000 7f18b8bd2700 1 -- 172.21.15.125:0/667151337 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18b40d2e00 msgr2=0x7f18b40b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:11.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.927+0000 7f18b8bd2700 1 --2- 172.21.15.125:0/667151337 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18b40d2e00 0x7f18b40b6e00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f18b40d2420 tx=0x7f18a4009bf0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.927+0000 7f18b8bd2700 1 -- 172.21.15.125:0/667151337 shutdown_connections 2023-10-17T06:08:11.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.927+0000 7f18b8bd2700 1 --2- 172.21.15.125:0/667151337 >> v2:172.21.15.184:3300/0 conn(0x7f18b4160710 0x7f18b40d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.927+0000 7f18b8bd2700 1 --2- 172.21.15.125:0/667151337 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18b40d2e00 0x7f18b40b6e00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.927+0000 7f18b8bd2700 1 -- 172.21.15.125:0/667151337 >> 172.21.15.125:0/667151337 conn(0x7f18b4069f20 msgr2=0x7f18b406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:11.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.927+0000 7f18b8bd2700 1 -- 172.21.15.125:0/667151337 shutdown_connections 2023-10-17T06:08:11.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.927+0000 7f18b8bd2700 1 -- 172.21.15.125:0/667151337 wait complete. 2023-10-17T06:08:11.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.927+0000 7f18b8bd2700 1 Processor -- start 2023-10-17T06:08:11.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.927+0000 7f18b8bd2700 1 -- start start 2023-10-17T06:08:11.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f18b8bd2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18b40b5ae0 0x7f18b40ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:11.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f18b8bd2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18b40d2e00 0x7f18b40b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:11.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f18b8bd2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18b4160710 0x7f18b40ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:11.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f18b8bd2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b40abe20 con 0x7f18b40b5ae0 2023-10-17T06:08:11.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f18b8bd2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b40b70b0 con 0x7f18b4160710 2023-10-17T06:08:11.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f18b8bd2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b40adac0 con 0x7f18b40d2e00 2023-10-17T06:08:11.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f18b37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18b40b5ae0 0x7f18b40ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:11.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f18b37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18b40b5ae0 0x7f18b40ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32850/0 (socket says 172.21.15.125:32850) 2023-10-17T06:08:11.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f18b37fe700 1 -- 172.21.15.125:0/3559443283 learned_addr learned my addr 172.21.15.125:0/3559443283 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:11.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f18b2ffd700 1 --2- 172.21.15.125:0/3559443283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18b40d2e00 0x7f18b40b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:11.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f18b3fff700 1 --2- 172.21.15.125:0/3559443283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18b4160710 0x7f18b40ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:11.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f18b37fe700 1 -- 172.21.15.125:0/3559443283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18b40d2e00 msgr2=0x7f18b40b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:11.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f18b37fe700 1 --2- 172.21.15.125:0/3559443283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18b40d2e00 0x7f18b40b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f18b37fe700 1 -- 172.21.15.125:0/3559443283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18b4160710 msgr2=0x7f18b40ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:11.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f18b37fe700 1 --2- 172.21.15.125:0/3559443283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18b4160710 0x7f18b40ac7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:11.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f18b37fe700 1 -- 172.21.15.125:0/3559443283 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a4009570 con 0x7f18b40b5ae0 2023-10-17T06:08:11.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f18b37fe700 1 --2- 172.21.15.125:0/3559443283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18b40b5ae0 0x7f18b40ab8e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f18a4014040 tx=0x7f18a4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:11.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f189bfff700 1 -- 172.21.15.125:0/3559443283 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4004450 con 0x7f18b40b5ae0 2023-10-17T06:08:11.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f189bfff700 1 -- 172.21.15.125:0/3559443283 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a401e070 con 0x7f18b40b5ae0 2023-10-17T06:08:11.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f18b8bd2700 1 -- 172.21.15.125:0/3559443283 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b40adda0 con 0x7f18b40b5ae0 2023-10-17T06:08:11.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f189bfff700 1 -- 172.21.15.125:0/3559443283 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a40038e0 con 0x7f18b40b5ae0 2023-10-17T06:08:11.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.931+0000 7f18b8bd2700 1 -- 172.21.15.125:0/3559443283 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b40afa60 con 0x7f18b40b5ae0 2023-10-17T06:08:11.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.935+0000 7f18b8bd2700 1 -- 172.21.15.125:0/3559443283 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b40af5e0 con 0x7f18b40b5ae0 2023-10-17T06:08:11.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.935+0000 7f189bfff700 1 -- 172.21.15.125:0/3559443283 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f18a4003a40 con 0x7f18b40b5ae0 2023-10-17T06:08:11.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.935+0000 7f189bfff700 1 --2- 172.21.15.125:0/3559443283 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f18a0065720 0x7f18a0067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:11.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.935+0000 7f189bfff700 1 -- 172.21.15.125:0/3559443283 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f18a4083ed0 con 0x7f18b40b5ae0 2023-10-17T06:08:11.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.935+0000 7f18b2ffd700 1 --2- 172.21.15.125:0/3559443283 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f18a0065720 0x7f18a0067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:11.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.939+0000 7f18b2ffd700 1 --2- 172.21.15.125:0/3559443283 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f18a0065720 0x7f18a0067be0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f18b415b1e0 tx=0x7f18a8009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:11.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:11.939+0000 7f189bfff700 1 -- 172.21.15.125:0/3559443283 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f18b40af5e0 con 0x7f18b40b5ae0 2023-10-17T06:08:12.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.119+0000 7f18b8bd2700 1 -- 172.21.15.125:0/3559443283 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f18b40af5e0 con 0x7f18b40b5ae0 2023-10-17T06:08:12.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.119+0000 7f189bfff700 1 -- 172.21.15.125:0/3559443283 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f18b40af5e0 con 0x7f18b40b5ae0 2023-10-17T06:08:12.125 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:08:12.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.123+0000 7f18b8bd2700 1 -- 172.21.15.125:0/3559443283 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f18a0065720 msgr2=0x7f18a0067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:12.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.123+0000 7f18b8bd2700 1 --2- 172.21.15.125:0/3559443283 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f18a0065720 0x7f18a0067be0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f18b415b1e0 tx=0x7f18a8009240 comp rx=0 tx=0).stop 2023-10-17T06:08:12.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.123+0000 7f18b8bd2700 1 -- 172.21.15.125:0/3559443283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18b40b5ae0 msgr2=0x7f18b40ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:12.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.123+0000 7f18b8bd2700 1 --2- 172.21.15.125:0/3559443283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18b40b5ae0 0x7f18b40ab8e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f18a4014040 tx=0x7f18a4004770 comp rx=0 tx=0).stop 2023-10-17T06:08:12.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.123+0000 7f18b8bd2700 1 -- 172.21.15.125:0/3559443283 shutdown_connections 2023-10-17T06:08:12.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.123+0000 7f18b8bd2700 1 --2- 172.21.15.125:0/3559443283 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f18a0065720 0x7f18a0067be0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.123+0000 7f18b8bd2700 1 --2- 172.21.15.125:0/3559443283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18b4160710 0x7f18b40ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.123+0000 7f18b8bd2700 1 --2- 172.21.15.125:0/3559443283 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18b40d2e00 0x7f18b40b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.123+0000 7f18b8bd2700 1 --2- 172.21.15.125:0/3559443283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18b40b5ae0 0x7f18b40ab8e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.123+0000 7f18b8bd2700 1 -- 172.21.15.125:0/3559443283 >> 172.21.15.125:0/3559443283 conn(0x7f18b4069f20 msgr2=0x7f18b406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:12.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.123+0000 7f18b8bd2700 1 -- 172.21.15.125:0/3559443283 shutdown_connections 2023-10-17T06:08:12.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.123+0000 7f18b8bd2700 1 -- 172.21.15.125:0/3559443283 wait complete. 2023-10-17T06:08:12.146 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-17T06:08:12.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.323+0000 7f2ff0992700 1 Processor -- start 2023-10-17T06:08:12.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.323+0000 7f2ff0992700 1 -- start start 2023-10-17T06:08:12.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.323+0000 7f2ff0992700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2fec15cbb0 0x7f2fec071700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:12.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.323+0000 7f2ff0992700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fec0cff80 0x7f2fec06ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:12.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.323+0000 7f2ff0992700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fec0cc080 con 0x7f2fec0ca6a0 2023-10-17T06:08:12.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.323+0000 7f2ff0992700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fec0cc2c0 con 0x7f2fec15cbb0 2023-10-17T06:08:12.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.323+0000 7f2ff0992700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec0cc5a0 con 0x7f2fec0cff80 2023-10-17T06:08:12.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.323+0000 7f2fea59c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2fec15cbb0 0x7f2fec071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:12.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.323+0000 7f2fe3fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2fec0ca6a0 0x7f2fec0cf870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45238/0 (socket says 172.21.15.125:45238) 2023-10-17T06:08:12.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.323+0000 7f2fe3fff700 1 -- 172.21.15.125:0/2515799988 learned_addr learned my addr 172.21.15.125:0/2515799988 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:12.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.323+0000 7f2fead9d700 1 --2- 172.21.15.125:0/2515799988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fec0cff80 0x7f2fec06ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:12.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.323+0000 7f2fea59c700 1 -- 172.21.15.125:0/2515799988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fec0cff80 msgr2=0x7f2fec06ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:12.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.323+0000 7f2fea59c700 1 --2- 172.21.15.125:0/2515799988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fec0cff80 0x7f2fec06ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.323+0000 7f2fea59c700 1 -- 172.21.15.125:0/2515799988 >> v1:172.21.15.125:6789/0 conn(0x7f2fec0ca6a0 legacy=0x7f2fec0cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:12.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.323+0000 7f2fea59c700 1 -- 172.21.15.125:0/2515799988 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec0cc880 con 0x7f2fec15cbb0 2023-10-17T06:08:12.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.327+0000 7f2fea59c700 1 --2- 172.21.15.125:0/2515799988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fec15cbb0 0x7f2fec071700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009880 tx=0x7f2fdc009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d253653f78f0fd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:12.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.327+0000 7f2fe9d9b700 1 -- 172.21.15.125:0/2515799988 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc011830 con 0x7f2fec15cbb0 2023-10-17T06:08:12.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.327+0000 7f2fe9d9b700 1 -- 172.21.15.125:0/2515799988 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc011990 con 0x7f2fec15cbb0 2023-10-17T06:08:12.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.327+0000 7f2fe9d9b700 1 -- 172.21.15.125:0/2515799988 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc011d20 con 0x7f2fec15cbb0 2023-10-17T06:08:12.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.327+0000 7f2ff0992700 1 -- 172.21.15.125:0/2515799988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fec15cbb0 msgr2=0x7f2fec071700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:12.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.327+0000 7f2ff0992700 1 --2- 172.21.15.125:0/2515799988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fec15cbb0 0x7f2fec071700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009880 tx=0x7f2fdc009b90 comp rx=0 tx=0).stop 2023-10-17T06:08:12.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.327+0000 7f2ff0992700 1 -- 172.21.15.125:0/2515799988 shutdown_connections 2023-10-17T06:08:12.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.327+0000 7f2ff0992700 1 --2- 172.21.15.125:0/2515799988 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fec0cff80 0x7f2fec06ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.327+0000 7f2ff0992700 1 --2- 172.21.15.125:0/2515799988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fec15cbb0 0x7f2fec071700 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.327+0000 7f2ff0992700 1 -- 172.21.15.125:0/2515799988 >> 172.21.15.125:0/2515799988 conn(0x7f2fec06a220 msgr2=0x7f2fec06a600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:12.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.327+0000 7f2ff0992700 1 -- 172.21.15.125:0/2515799988 shutdown_connections 2023-10-17T06:08:12.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.327+0000 7f2ff0992700 1 -- 172.21.15.125:0/2515799988 wait complete. 2023-10-17T06:08:12.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.331+0000 7f2ff0992700 1 Processor -- start 2023-10-17T06:08:12.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.331+0000 7f2ff0992700 1 -- start start 2023-10-17T06:08:12.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.331+0000 7f2ff0992700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fec0ca6a0 0x7f2fec1f3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:12.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.331+0000 7f2ff0992700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fec0cff80 0x7f2fec15f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:12.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.331+0000 7f2ff0992700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fec15cbb0 0x7f2fec15fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:12.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.331+0000 7f2ff0992700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec15dfe0 con 0x7f2fec15cbb0 2023-10-17T06:08:12.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.331+0000 7f2ff0992700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec0c7d50 con 0x7f2fec0cff80 2023-10-17T06:08:12.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.331+0000 7f2ff0992700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec15d410 con 0x7f2fec0ca6a0 2023-10-17T06:08:12.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.331+0000 7f2fead9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fec15cbb0 0x7f2fec15fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:12.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.331+0000 7f2fead9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fec15cbb0 0x7f2fec15fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32864/0 (socket says 172.21.15.125:32864) 2023-10-17T06:08:12.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.331+0000 7f2fead9d700 1 -- 172.21.15.125:0/2623717077 learned_addr learned my addr 172.21.15.125:0/2623717077 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:12.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.331+0000 7f2fe3fff700 1 --2- 172.21.15.125:0/2623717077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fec0cff80 0x7f2fec15f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:12.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.331+0000 7f2fea59c700 1 --2- 172.21.15.125:0/2623717077 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fec0ca6a0 0x7f2fec1f3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:12.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.335+0000 7f2fead9d700 1 -- 172.21.15.125:0/2623717077 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fec0ca6a0 msgr2=0x7f2fec1f3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:12.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.335+0000 7f2fead9d700 1 --2- 172.21.15.125:0/2623717077 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fec0ca6a0 0x7f2fec1f3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.335+0000 7f2fead9d700 1 -- 172.21.15.125:0/2623717077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fec0cff80 msgr2=0x7f2fec15f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:12.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.335+0000 7f2fead9d700 1 --2- 172.21.15.125:0/2623717077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fec0cff80 0x7f2fec15f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.335+0000 7f2fead9d700 1 -- 172.21.15.125:0/2623717077 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc0094b0 con 0x7f2fec15cbb0 2023-10-17T06:08:12.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.335+0000 7f2fe3fff700 1 --2- 172.21.15.125:0/2623717077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fec0cff80 0x7f2fec15f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:08:12.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.335+0000 7f2fead9d700 1 --2- 172.21.15.125:0/2623717077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fec15cbb0 0x7f2fec15fee0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4007de0 tx=0x7f2fe400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:12.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.335+0000 7f2fe2ffd700 1 -- 172.21.15.125:0/2623717077 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe400ed30 con 0x7f2fec15cbb0 2023-10-17T06:08:12.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.335+0000 7f2fe2ffd700 1 -- 172.21.15.125:0/2623717077 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe4014420 con 0x7f2fec15cbb0 2023-10-17T06:08:12.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.335+0000 7f2fe2ffd700 1 -- 172.21.15.125:0/2623717077 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe40147d0 con 0x7f2fec15cbb0 2023-10-17T06:08:12.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.335+0000 7f2ff0992700 1 -- 172.21.15.125:0/2623717077 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fec15d6b0 con 0x7f2fec15cbb0 2023-10-17T06:08:12.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.335+0000 7f2ff0992700 1 -- 172.21.15.125:0/2623717077 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fec15dc70 con 0x7f2fec15cbb0 2023-10-17T06:08:12.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.335+0000 7f2ff0992700 1 -- 172.21.15.125:0/2623717077 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fec15e190 con 0x7f2fec15cbb0 2023-10-17T06:08:12.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.339+0000 7f2fe2ffd700 1 -- 172.21.15.125:0/2623717077 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2fe4014930 con 0x7f2fec15cbb0 2023-10-17T06:08:12.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.339+0000 7f2fe2ffd700 1 --2- 172.21.15.125:0/2623717077 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2fcc0656f0 0x7f2fcc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:12.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.339+0000 7f2fe2ffd700 1 -- 172.21.15.125:0/2623717077 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2fe40838e0 con 0x7f2fec15cbb0 2023-10-17T06:08:12.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.339+0000 7f2fea59c700 1 --2- 172.21.15.125:0/2623717077 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2fcc0656f0 0x7f2fcc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:12.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.343+0000 7f2fea59c700 1 --2- 172.21.15.125:0/2623717077 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2fcc0656f0 0x7f2fcc067bb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc000c00 tx=0x7f2fdc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:12.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.347+0000 7f2fe2ffd700 1 -- 172.21.15.125:0/2623717077 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2fec15e190 con 0x7f2fec15cbb0 2023-10-17T06:08:12.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.523+0000 7f2ff0992700 1 -- 172.21.15.125:0/2623717077 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2fec072e60 con 0x7f2fec15cbb0 2023-10-17T06:08:12.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.523+0000 7f2fe2ffd700 1 -- 172.21.15.125:0/2623717077 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2fe4050fe0 con 0x7f2fec15cbb0 2023-10-17T06:08:12.527 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:12.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.527+0000 7f2ff0992700 1 -- 172.21.15.125:0/2623717077 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2fcc0656f0 msgr2=0x7f2fcc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:12.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.527+0000 7f2ff0992700 1 --2- 172.21.15.125:0/2623717077 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2fcc0656f0 0x7f2fcc067bb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc000c00 tx=0x7f2fdc008030 comp rx=0 tx=0).stop 2023-10-17T06:08:12.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.527+0000 7f2ff0992700 1 -- 172.21.15.125:0/2623717077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fec15cbb0 msgr2=0x7f2fec15fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:12.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.527+0000 7f2ff0992700 1 --2- 172.21.15.125:0/2623717077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fec15cbb0 0x7f2fec15fee0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4007de0 tx=0x7f2fe400e3c0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.527+0000 7f2ff0992700 1 -- 172.21.15.125:0/2623717077 shutdown_connections 2023-10-17T06:08:12.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.527+0000 7f2ff0992700 1 --2- 172.21.15.125:0/2623717077 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2fcc0656f0 0x7f2fcc067bb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.527+0000 7f2ff0992700 1 --2- 172.21.15.125:0/2623717077 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fec15cbb0 0x7f2fec15fee0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.527+0000 7f2ff0992700 1 --2- 172.21.15.125:0/2623717077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fec0cff80 0x7f2fec15f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.527+0000 7f2ff0992700 1 --2- 172.21.15.125:0/2623717077 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fec0ca6a0 0x7f2fec1f3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.527+0000 7f2ff0992700 1 -- 172.21.15.125:0/2623717077 >> 172.21.15.125:0/2623717077 conn(0x7f2fec06a220 msgr2=0x7f2fec0ab980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:12.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.527+0000 7f2ff0992700 1 -- 172.21.15.125:0/2623717077 shutdown_connections 2023-10-17T06:08:12.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.527+0000 7f2ff0992700 1 -- 172.21.15.125:0/2623717077 wait complete. 2023-10-17T06:08:12.550 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-17T06:08:12.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.727+0000 7eff5aa7d700 1 Processor -- start 2023-10-17T06:08:12.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.727+0000 7eff5aa7d700 1 -- start start 2023-10-17T06:08:12.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.731+0000 7eff5aa7d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7eff54160710 0x7eff540b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:12.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.731+0000 7eff5aa7d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff540b5ae0 0x7eff5406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:12.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.731+0000 7eff5aa7d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5415d0d0 con 0x7eff540d2e00 2023-10-17T06:08:12.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.731+0000 7eff5aa7d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff5415df90 con 0x7eff54160710 2023-10-17T06:08:12.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.731+0000 7eff5aa7d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5406f0f0 con 0x7eff540b5ae0 2023-10-17T06:08:12.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.731+0000 7eff59a7b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7eff540d2e00 0x7eff540d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:55686/0 (socket says 172.21.15.125:55686) 2023-10-17T06:08:12.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.731+0000 7eff59a7b700 1 -- 172.21.15.125:0/4138786635 learned_addr learned my addr 172.21.15.125:0/4138786635 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:12.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.731+0000 7eff5a27c700 1 --2- 172.21.15.125:0/4138786635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff540b5ae0 0x7eff5406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:12.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.731+0000 7eff5927a700 1 --2- 172.21.15.125:0/4138786635 >> v2:172.21.15.125:3300/0 conn(0x7eff54160710 0x7eff540b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:12.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.735+0000 7eff58a79700 1 -- 172.21.15.125:0/4138786635 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414325606 0 0) 0x7eff50001110 con 0x7eff540d2e00 2023-10-17T06:08:12.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.735+0000 7eff58a79700 1 -- 172.21.15.125:0/4138786635 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff400035d0 con 0x7eff540d2e00 2023-10-17T06:08:12.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.735+0000 7eff5927a700 1 -- 172.21.15.125:0/4138786635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff540b5ae0 msgr2=0x7eff5406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:12.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.735+0000 7eff5927a700 1 --2- 172.21.15.125:0/4138786635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff540b5ae0 0x7eff5406db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.735+0000 7eff5927a700 1 -- 172.21.15.125:0/4138786635 >> v1:172.21.15.184:6789/0 conn(0x7eff540d2e00 legacy=0x7eff540d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:12.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.735+0000 7eff5927a700 1 -- 172.21.15.125:0/4138786635 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5415d310 con 0x7eff54160710 2023-10-17T06:08:12.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.735+0000 7eff5a27c700 1 --2- 172.21.15.125:0/4138786635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff540b5ae0 0x7eff5406db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:08:12.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.735+0000 7eff5927a700 1 --2- 172.21.15.125:0/4138786635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff54160710 0x7eff540b6e00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7eff44009850 tx=0x7eff44009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fb037f3b5b4f8e server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:12.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.735+0000 7eff58a79700 1 -- 172.21.15.125:0/4138786635 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44011830 con 0x7eff54160710 2023-10-17T06:08:12.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.735+0000 7eff58a79700 1 -- 172.21.15.125:0/4138786635 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff44011990 con 0x7eff54160710 2023-10-17T06:08:12.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.735+0000 7eff58a79700 1 -- 172.21.15.125:0/4138786635 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44011d40 con 0x7eff54160710 2023-10-17T06:08:12.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.735+0000 7eff5aa7d700 1 -- 172.21.15.125:0/4138786635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff54160710 msgr2=0x7eff540b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:12.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.735+0000 7eff5aa7d700 1 --2- 172.21.15.125:0/4138786635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff54160710 0x7eff540b6e00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7eff44009850 tx=0x7eff44009b60 comp rx=0 tx=0).stop 2023-10-17T06:08:12.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.735+0000 7eff5aa7d700 1 -- 172.21.15.125:0/4138786635 shutdown_connections 2023-10-17T06:08:12.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.735+0000 7eff5aa7d700 1 --2- 172.21.15.125:0/4138786635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff540b5ae0 0x7eff5406db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.735+0000 7eff5aa7d700 1 --2- 172.21.15.125:0/4138786635 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff54160710 0x7eff540b6e00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.735+0000 7eff5aa7d700 1 -- 172.21.15.125:0/4138786635 >> 172.21.15.125:0/4138786635 conn(0x7eff54069f20 msgr2=0x7eff5406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:12.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.735+0000 7eff5aa7d700 1 -- 172.21.15.125:0/4138786635 shutdown_connections 2023-10-17T06:08:12.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.735+0000 7eff5aa7d700 1 -- 172.21.15.125:0/4138786635 wait complete. 2023-10-17T06:08:12.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.739+0000 7eff5aa7d700 1 Processor -- start 2023-10-17T06:08:12.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.739+0000 7eff5aa7d700 1 -- start start 2023-10-17T06:08:12.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.739+0000 7eff5aa7d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff540b5ae0 0x7eff541560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:12.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.739+0000 7eff5aa7d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff540d2e00 0x7eff541502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:12.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.739+0000 7eff5aa7d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff54160710 0x7eff54159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:12.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.739+0000 7eff5aa7d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff540b4bc0 con 0x7eff540d2e00 2023-10-17T06:08:12.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.739+0000 7eff5aa7d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff54150d40 con 0x7eff540b5ae0 2023-10-17T06:08:12.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.739+0000 7eff5aa7d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff54151020 con 0x7eff54160710 2023-10-17T06:08:12.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.739+0000 7eff5927a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff540d2e00 0x7eff541502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:12.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.739+0000 7eff5927a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff540d2e00 0x7eff541502f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32878/0 (socket says 172.21.15.125:32878) 2023-10-17T06:08:12.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.739+0000 7eff5927a700 1 -- 172.21.15.125:0/3320944164 learned_addr learned my addr 172.21.15.125:0/3320944164 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:12.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.739+0000 7eff59a7b700 1 --2- 172.21.15.125:0/3320944164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff540b5ae0 0x7eff541560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:12.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.739+0000 7eff5a27c700 1 --2- 172.21.15.125:0/3320944164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff54160710 0x7eff54159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:12.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.739+0000 7eff5927a700 1 -- 172.21.15.125:0/3320944164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff54160710 msgr2=0x7eff54159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:12.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.739+0000 7eff5927a700 1 --2- 172.21.15.125:0/3320944164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff54160710 0x7eff54159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.743+0000 7eff5927a700 1 -- 172.21.15.125:0/3320944164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff540b5ae0 msgr2=0x7eff541560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:12.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.743+0000 7eff5927a700 1 --2- 172.21.15.125:0/3320944164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff540b5ae0 0x7eff541560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.743+0000 7eff5927a700 1 -- 172.21.15.125:0/3320944164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c009a70 con 0x7eff540d2e00 2023-10-17T06:08:12.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.743+0000 7eff5a27c700 1 --2- 172.21.15.125:0/3320944164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff54160710 0x7eff54159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:12.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.743+0000 7eff5927a700 1 --2- 172.21.15.125:0/3320944164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff540d2e00 0x7eff541502f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7eff440090b0 tx=0x7eff44004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:12.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.743+0000 7eff4a7fc700 1 -- 172.21.15.125:0/3320944164 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44004520 con 0x7eff540d2e00 2023-10-17T06:08:12.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.743+0000 7eff4a7fc700 1 -- 172.21.15.125:0/3320944164 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4401f070 con 0x7eff540d2e00 2023-10-17T06:08:12.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.743+0000 7eff4a7fc700 1 -- 172.21.15.125:0/3320944164 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44003900 con 0x7eff540d2e00 2023-10-17T06:08:12.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.743+0000 7eff5aa7d700 1 -- 172.21.15.125:0/3320944164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff440094b0 con 0x7eff540d2e00 2023-10-17T06:08:12.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.743+0000 7eff5aa7d700 1 -- 172.21.15.125:0/3320944164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff541515e0 con 0x7eff540d2e00 2023-10-17T06:08:12.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.743+0000 7eff5aa7d700 1 -- 172.21.15.125:0/3320944164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff5404e910 con 0x7eff540d2e00 2023-10-17T06:08:12.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.747+0000 7eff4a7fc700 1 -- 172.21.15.125:0/3320944164 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7eff44003a60 con 0x7eff540d2e00 2023-10-17T06:08:12.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.747+0000 7eff4a7fc700 1 --2- 172.21.15.125:0/3320944164 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7eff380656f0 0x7eff38067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:12.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.747+0000 7eff4a7fc700 1 -- 172.21.15.125:0/3320944164 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7eff44021070 con 0x7eff540d2e00 2023-10-17T06:08:12.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.747+0000 7eff59a7b700 1 --2- 172.21.15.125:0/3320944164 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7eff380656f0 0x7eff38067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:12.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.747+0000 7eff59a7b700 1 --2- 172.21.15.125:0/3320944164 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7eff380656f0 0x7eff38067bb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7eff50001270 tx=0x7eff50009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:12.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.751+0000 7eff4a7fc700 1 -- 172.21.15.125:0/3320944164 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7eff44051e60 con 0x7eff540d2e00 2023-10-17T06:08:12.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.931+0000 7eff5aa7d700 1 -- 172.21.15.125:0/3320944164 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff5406d3e0 con 0x7eff540d2e00 2023-10-17T06:08:12.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.931+0000 7eff4a7fc700 1 -- 172.21.15.125:0/3320944164 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff44006ce0 con 0x7eff540d2e00 2023-10-17T06:08:12.934 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-17T06:08:12.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.935+0000 7eff5aa7d700 1 -- 172.21.15.125:0/3320944164 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7eff380656f0 msgr2=0x7eff38067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:12.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.935+0000 7eff5aa7d700 1 --2- 172.21.15.125:0/3320944164 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7eff380656f0 0x7eff38067bb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7eff50001270 tx=0x7eff50009040 comp rx=0 tx=0).stop 2023-10-17T06:08:12.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.935+0000 7eff5aa7d700 1 -- 172.21.15.125:0/3320944164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff540d2e00 msgr2=0x7eff541502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:12.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.935+0000 7eff5aa7d700 1 --2- 172.21.15.125:0/3320944164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff540d2e00 0x7eff541502f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7eff440090b0 tx=0x7eff44004770 comp rx=0 tx=0).stop 2023-10-17T06:08:12.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.935+0000 7eff5aa7d700 1 -- 172.21.15.125:0/3320944164 shutdown_connections 2023-10-17T06:08:12.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.935+0000 7eff5aa7d700 1 --2- 172.21.15.125:0/3320944164 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7eff380656f0 0x7eff38067bb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.935+0000 7eff5aa7d700 1 --2- 172.21.15.125:0/3320944164 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7eff54160710 0x7eff54159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.935+0000 7eff5aa7d700 1 --2- 172.21.15.125:0/3320944164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff540d2e00 0x7eff541502f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.935+0000 7eff5aa7d700 1 --2- 172.21.15.125:0/3320944164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7eff540b5ae0 0x7eff541560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:12.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.935+0000 7eff5aa7d700 1 -- 172.21.15.125:0/3320944164 >> 172.21.15.125:0/3320944164 conn(0x7eff54069f20 msgr2=0x7eff5415e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:12.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.935+0000 7eff5aa7d700 1 -- 172.21.15.125:0/3320944164 shutdown_connections 2023-10-17T06:08:12.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:12.935+0000 7eff5aa7d700 1 -- 172.21.15.125:0/3320944164 wait complete. 2023-10-17T06:08:12.956 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-17T06:08:13.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.131+0000 7f2485586700 1 Processor -- start 2023-10-17T06:08:13.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.131+0000 7f2485586700 1 -- start start 2023-10-17T06:08:13.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.135+0000 7f2485586700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2480070c70 0x7f24800cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:13.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.135+0000 7f2485586700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f24800cde70 0x7f248006cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:13.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.135+0000 7f2485586700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24800b14f0 con 0x7f2480159750 2023-10-17T06:08:13.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.135+0000 7f2485586700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24800c9aa0 con 0x7f24800cde70 2023-10-17T06:08:13.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.135+0000 7f2485586700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248015d590 con 0x7f2480070c70 2023-10-17T06:08:13.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.135+0000 7f247f7fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f24800cde70 0x7f248006cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:13.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.135+0000 7f247f7fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f24800cde70 0x7f248006cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:45504/0 (socket says 172.21.15.125:45504) 2023-10-17T06:08:13.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.135+0000 7f247f7fe700 1 -- 172.21.15.125:0/543362268 learned_addr learned my addr 172.21.15.125:0/543362268 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:13.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.135+0000 7f247e7fc700 1 --2- 172.21.15.125:0/543362268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2480070c70 0x7f24800cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:13.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.135+0000 7f247f7fe700 1 -- 172.21.15.125:0/543362268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2480070c70 msgr2=0x7f24800cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:13.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.135+0000 7f247f7fe700 1 --2- 172.21.15.125:0/543362268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2480070c70 0x7f24800cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.135+0000 7f247f7fe700 1 -- 172.21.15.125:0/543362268 >> v1:172.21.15.184:6789/0 conn(0x7f2480159750 legacy=0x7f2480070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:13.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.135+0000 7f247f7fe700 1 -- 172.21.15.125:0/543362268 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248015d870 con 0x7f24800cde70 2023-10-17T06:08:13.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.135+0000 7f247e7fc700 1 --2- 172.21.15.125:0/543362268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2480070c70 0x7f24800cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:13.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.135+0000 7f247f7fe700 1 --2- 172.21.15.125:0/543362268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24800cde70 0x7f248006cf20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2478009e50 tx=0x7f247800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=413ce21b034e7652 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:13.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.135+0000 7f247dffb700 1 -- 172.21.15.125:0/543362268 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247800e070 con 0x7f24800cde70 2023-10-17T06:08:13.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.135+0000 7f247dffb700 1 -- 172.21.15.125:0/543362268 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247800b9c0 con 0x7f24800cde70 2023-10-17T06:08:13.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.135+0000 7f247dffb700 1 -- 172.21.15.125:0/543362268 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247800bd70 con 0x7f24800cde70 2023-10-17T06:08:13.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.139+0000 7f2485586700 1 -- 172.21.15.125:0/543362268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24800cde70 msgr2=0x7f248006cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:13.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.139+0000 7f2485586700 1 --2- 172.21.15.125:0/543362268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24800cde70 0x7f248006cf20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2478009e50 tx=0x7f247800b330 comp rx=0 tx=0).stop 2023-10-17T06:08:13.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.139+0000 7f2485586700 1 -- 172.21.15.125:0/543362268 shutdown_connections 2023-10-17T06:08:13.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.139+0000 7f2485586700 1 --2- 172.21.15.125:0/543362268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24800cde70 0x7f248006cf20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.139+0000 7f2485586700 1 --2- 172.21.15.125:0/543362268 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2480070c70 0x7f24800cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.139+0000 7f2485586700 1 -- 172.21.15.125:0/543362268 >> 172.21.15.125:0/543362268 conn(0x7f24800ce5c0 msgr2=0x7f24800ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:13.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.139+0000 7f2485586700 1 -- 172.21.15.125:0/543362268 shutdown_connections 2023-10-17T06:08:13.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.139+0000 7f2485586700 1 -- 172.21.15.125:0/543362268 wait complete. 2023-10-17T06:08:13.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.143+0000 7f2485586700 1 Processor -- start 2023-10-17T06:08:13.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.143+0000 7f2485586700 1 -- start start 2023-10-17T06:08:13.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.143+0000 7f2485586700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2480070c70 0x7f2480149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:13.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.143+0000 7f2485586700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24800cde70 0x7f2480147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:13.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.143+0000 7f2485586700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2480159750 0x7f2480157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:13.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.143+0000 7f2485586700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2480158af0 con 0x7f24800cde70 2023-10-17T06:08:13.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.143+0000 7f2485586700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24800b1a60 con 0x7f2480070c70 2023-10-17T06:08:13.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.143+0000 7f2485586700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24800b1d40 con 0x7f2480159750 2023-10-17T06:08:13.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.143+0000 7f247e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24800cde70 0x7f2480147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:13.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.143+0000 7f247e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24800cde70 0x7f2480147e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:32892/0 (socket says 172.21.15.125:32892) 2023-10-17T06:08:13.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.143+0000 7f247e7fc700 1 -- 172.21.15.125:0/2152400279 learned_addr learned my addr 172.21.15.125:0/2152400279 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:13.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.143+0000 7f247f7fe700 1 --2- 172.21.15.125:0/2152400279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2480159750 0x7f2480157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:13.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.143+0000 7f247effd700 1 --2- 172.21.15.125:0/2152400279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2480070c70 0x7f2480149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:13.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.143+0000 7f247e7fc700 1 -- 172.21.15.125:0/2152400279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2480159750 msgr2=0x7f2480157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:13.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.143+0000 7f247e7fc700 1 --2- 172.21.15.125:0/2152400279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2480159750 0x7f2480157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.143+0000 7f247e7fc700 1 -- 172.21.15.125:0/2152400279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2480070c70 msgr2=0x7f2480149bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:13.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.143+0000 7f247e7fc700 1 --2- 172.21.15.125:0/2152400279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2480070c70 0x7f2480149bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.143+0000 7f247e7fc700 1 -- 172.21.15.125:0/2152400279 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2478009b30 con 0x7f24800cde70 2023-10-17T06:08:13.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.143+0000 7f247f7fe700 1 --2- 172.21.15.125:0/2152400279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2480159750 0x7f2480157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:08:13.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.143+0000 7f247effd700 1 --2- 172.21.15.125:0/2152400279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2480070c70 0x7f2480149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:08:13.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.147+0000 7f247e7fc700 1 --2- 172.21.15.125:0/2152400279 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24800cde70 0x7f2480147e60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f247400e880 tx=0x7f247400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:13.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.147+0000 7f24677fe700 1 -- 172.21.15.125:0/2152400279 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474013610 con 0x7f24800cde70 2023-10-17T06:08:13.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.147+0000 7f24677fe700 1 -- 172.21.15.125:0/2152400279 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2474013770 con 0x7f24800cde70 2023-10-17T06:08:13.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.147+0000 7f2485586700 1 -- 172.21.15.125:0/2152400279 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24800b2020 con 0x7f24800cde70 2023-10-17T06:08:13.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.147+0000 7f24677fe700 1 -- 172.21.15.125:0/2152400279 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2474013b00 con 0x7f24800cde70 2023-10-17T06:08:13.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.147+0000 7f2485586700 1 -- 172.21.15.125:0/2152400279 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24800b25e0 con 0x7f24800cde70 2023-10-17T06:08:13.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.147+0000 7f2485586700 1 -- 172.21.15.125:0/2152400279 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f248004e910 con 0x7f24800cde70 2023-10-17T06:08:13.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.151+0000 7f24677fe700 1 -- 172.21.15.125:0/2152400279 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2474013c60 con 0x7f24800cde70 2023-10-17T06:08:13.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.151+0000 7f24677fe700 1 --2- 172.21.15.125:0/2152400279 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f246c0656f0 0x7f246c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:13.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.151+0000 7f24677fe700 1 -- 172.21.15.125:0/2152400279 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2474082d20 con 0x7f24800cde70 2023-10-17T06:08:13.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.151+0000 7f247effd700 1 --2- 172.21.15.125:0/2152400279 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f246c0656f0 0x7f246c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:13.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.151+0000 7f247effd700 1 --2- 172.21.15.125:0/2152400279 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f246c0656f0 0x7f246c067bb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2480159160 tx=0x7f2470009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:13.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.155+0000 7f24677fe700 1 -- 172.21.15.125:0/2152400279 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2474050410 con 0x7f24800cde70 2023-10-17T06:08:13.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.335+0000 7f2485586700 1 -- 172.21.15.125:0/2152400279 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f248006fbb0 con 0x7f24800cde70 2023-10-17T06:08:13.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.335+0000 7f24677fe700 1 -- 172.21.15.125:0/2152400279 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2474053a30 con 0x7f24800cde70 2023-10-17T06:08:13.338 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:13.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.339+0000 7f2485586700 1 -- 172.21.15.125:0/2152400279 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f246c0656f0 msgr2=0x7f246c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:13.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.339+0000 7f2485586700 1 --2- 172.21.15.125:0/2152400279 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f246c0656f0 0x7f246c067bb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2480159160 tx=0x7f2470009040 comp rx=0 tx=0).stop 2023-10-17T06:08:13.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.339+0000 7f2485586700 1 -- 172.21.15.125:0/2152400279 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24800cde70 msgr2=0x7f2480147e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:13.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.339+0000 7f2485586700 1 --2- 172.21.15.125:0/2152400279 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24800cde70 0x7f2480147e60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f247400e880 tx=0x7f247400eb90 comp rx=0 tx=0).stop 2023-10-17T06:08:13.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.339+0000 7f2485586700 1 -- 172.21.15.125:0/2152400279 shutdown_connections 2023-10-17T06:08:13.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.339+0000 7f2485586700 1 --2- 172.21.15.125:0/2152400279 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f246c0656f0 0x7f246c067bb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.339+0000 7f2485586700 1 --2- 172.21.15.125:0/2152400279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2480159750 0x7f2480157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.339+0000 7f2485586700 1 --2- 172.21.15.125:0/2152400279 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24800cde70 0x7f2480147e60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.339+0000 7f2485586700 1 --2- 172.21.15.125:0/2152400279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2480070c70 0x7f2480149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.339+0000 7f2485586700 1 -- 172.21.15.125:0/2152400279 >> 172.21.15.125:0/2152400279 conn(0x7f24800ce5c0 msgr2=0x7f2480151180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:13.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.339+0000 7f2485586700 1 -- 172.21.15.125:0/2152400279 shutdown_connections 2023-10-17T06:08:13.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.339+0000 7f2485586700 1 -- 172.21.15.125:0/2152400279 wait complete. 2023-10-17T06:08:13.365 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-17T06:08:13.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.555+0000 7fe72759e700 1 Processor -- start 2023-10-17T06:08:13.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.555+0000 7fe72759e700 1 -- start start 2023-10-17T06:08:13.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.555+0000 7fe72759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe728160710 0x7fe7280b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:13.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.555+0000 7fe72759e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72815d0d0 con 0x7fe7280b5ae0 2023-10-17T06:08:13.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.555+0000 7fe72759e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72806f0f0 con 0x7fe7280d2e00 2023-10-17T06:08:13.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.555+0000 7fe72759e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72815df90 con 0x7fe728160710 2023-10-17T06:08:13.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.555+0000 7fe726d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe7280b5ae0 0x7fe72806db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48240/0 (socket says 172.21.15.125:48240) 2023-10-17T06:08:13.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.555+0000 7fe726d9d700 1 -- 172.21.15.125:0/3811241132 learned_addr learned my addr 172.21.15.125:0/3811241132 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:13.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.559+0000 7fe725d9b700 1 --2- 172.21.15.125:0/3811241132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe728160710 0x7fe7280b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:13.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.559+0000 7fe72559a700 1 -- 172.21.15.125:0/3811241132 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472962272 0 0) 0x7fe7200014e0 con 0x7fe7280b5ae0 2023-10-17T06:08:13.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.559+0000 7fe72559a700 1 -- 172.21.15.125:0/3811241132 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7100035d0 con 0x7fe7280b5ae0 2023-10-17T06:08:13.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.559+0000 7fe725d9b700 1 -- 172.21.15.125:0/3811241132 >> v1:172.21.15.184:6789/0 conn(0x7fe7280d2e00 legacy=0x7fe7280d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:13.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.559+0000 7fe72559a700 1 -- 172.21.15.125:0/3811241132 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967339614 0 0) 0x7fe72806f0f0 con 0x7fe7280d2e00 2023-10-17T06:08:13.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.559+0000 7fe725d9b700 1 -- 172.21.15.125:0/3811241132 >> v1:172.21.15.125:6789/0 conn(0x7fe7280b5ae0 legacy=0x7fe72806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:13.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.559+0000 7fe725d9b700 1 -- 172.21.15.125:0/3811241132 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72815d310 con 0x7fe728160710 2023-10-17T06:08:13.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.559+0000 7fe725d9b700 1 --2- 172.21.15.125:0/3811241132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe728160710 0x7fe7280b6e00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0098b0 tx=0x7fe71c009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=370b0bfe10552d2e server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:13.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.559+0000 7fe72559a700 1 -- 172.21.15.125:0/3811241132 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c011830 con 0x7fe728160710 2023-10-17T06:08:13.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.559+0000 7fe72559a700 1 -- 172.21.15.125:0/3811241132 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c011990 con 0x7fe728160710 2023-10-17T06:08:13.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.559+0000 7fe72559a700 1 -- 172.21.15.125:0/3811241132 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c011d20 con 0x7fe728160710 2023-10-17T06:08:13.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.559+0000 7fe72759e700 1 -- 172.21.15.125:0/3811241132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe728160710 msgr2=0x7fe7280b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:13.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.559+0000 7fe72759e700 1 --2- 172.21.15.125:0/3811241132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe728160710 0x7fe7280b6e00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0098b0 tx=0x7fe71c009bc0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.559+0000 7fe72759e700 1 -- 172.21.15.125:0/3811241132 shutdown_connections 2023-10-17T06:08:13.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.559+0000 7fe72759e700 1 --2- 172.21.15.125:0/3811241132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe728160710 0x7fe7280b6e00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.559+0000 7fe72759e700 1 -- 172.21.15.125:0/3811241132 >> 172.21.15.125:0/3811241132 conn(0x7fe728069f20 msgr2=0x7fe72806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:13.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.559+0000 7fe72759e700 1 -- 172.21.15.125:0/3811241132 shutdown_connections 2023-10-17T06:08:13.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.559+0000 7fe72759e700 1 -- 172.21.15.125:0/3811241132 wait complete. 2023-10-17T06:08:13.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.563+0000 7fe72759e700 1 Processor -- start 2023-10-17T06:08:13.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.563+0000 7fe72759e700 1 -- start start 2023-10-17T06:08:13.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe72759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7280b5ae0 0x7fe7281f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:13.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe72759e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7280d2e00 0x7fe7280b2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:13.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe72759e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe728160710 0x7fe7280b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:13.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe72759e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7281f2800 con 0x7fe7280d2e00 2023-10-17T06:08:13.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe72759e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7281f21d0 con 0x7fe728160710 2023-10-17T06:08:13.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe72759e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7280b3050 con 0x7fe7280b5ae0 2023-10-17T06:08:13.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe725d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7280d2e00 0x7fe7280b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:13.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe725d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7280d2e00 0x7fe7280b2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48470/0 (socket says 172.21.15.125:48470) 2023-10-17T06:08:13.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe725d9b700 1 -- 172.21.15.125:0/3045428182 learned_addr learned my addr 172.21.15.125:0/3045428182 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:13.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe726d9d700 1 --2- 172.21.15.125:0/3045428182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe728160710 0x7fe7280b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:13.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe725d9b700 1 -- 172.21.15.125:0/3045428182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7280b5ae0 msgr2=0x7fe7281f2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:13.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe72659c700 1 --2- 172.21.15.125:0/3045428182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7280b5ae0 0x7fe7281f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:13.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe725d9b700 1 --2- 172.21.15.125:0/3045428182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7280b5ae0 0x7fe7281f2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe725d9b700 1 -- 172.21.15.125:0/3045428182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe728160710 msgr2=0x7fe7280b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:13.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe725d9b700 1 --2- 172.21.15.125:0/3045428182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe728160710 0x7fe7280b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe725d9b700 1 -- 172.21.15.125:0/3045428182 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c0094b0 con 0x7fe7280d2e00 2023-10-17T06:08:13.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe726d9d700 1 --2- 172.21.15.125:0/3045428182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe728160710 0x7fe7280b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:13.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe72659c700 1 --2- 172.21.15.125:0/3045428182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7280b5ae0 0x7fe7281f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:13.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe725d9b700 1 --2- 172.21.15.125:0/3045428182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7280d2e00 0x7fe7280b2800 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe71c000c00 tx=0x7fe71c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:13.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe716ffd700 1 -- 172.21.15.125:0/3045428182 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c01ab70 con 0x7fe7280d2e00 2023-10-17T06:08:13.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe716ffd700 1 -- 172.21.15.125:0/3045428182 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c01f070 con 0x7fe7280d2e00 2023-10-17T06:08:13.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe72759e700 1 -- 172.21.15.125:0/3045428182 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7280b3330 con 0x7fe7280d2e00 2023-10-17T06:08:13.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe716ffd700 1 -- 172.21.15.125:0/3045428182 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c01b430 con 0x7fe7280d2e00 2023-10-17T06:08:13.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe72759e700 1 -- 172.21.15.125:0/3045428182 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7280b2d40 con 0x7fe7280d2e00 2023-10-17T06:08:13.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.567+0000 7fe72759e700 1 -- 172.21.15.125:0/3045428182 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7281f2970 con 0x7fe7280d2e00 2023-10-17T06:08:13.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.571+0000 7fe716ffd700 1 -- 172.21.15.125:0/3045428182 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe71c01b590 con 0x7fe7280d2e00 2023-10-17T06:08:13.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.571+0000 7fe716ffd700 1 --2- 172.21.15.125:0/3045428182 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe7080656f0 0x7fe708067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:13.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.571+0000 7fe716ffd700 1 -- 172.21.15.125:0/3045428182 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe71c084210 con 0x7fe7280d2e00 2023-10-17T06:08:13.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.571+0000 7fe72659c700 1 --2- 172.21.15.125:0/3045428182 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe7080656f0 0x7fe708067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:13.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.575+0000 7fe72659c700 1 --2- 172.21.15.125:0/3045428182 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe7080656f0 0x7fe708067bb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe718000f60 tx=0x7fe718009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:13.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.579+0000 7fe716ffd700 1 -- 172.21.15.125:0/3045428182 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe71c051a30 con 0x7fe7280d2e00 2023-10-17T06:08:13.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.767+0000 7fe72759e700 1 -- 172.21.15.125:0/3045428182 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe72804e910 con 0x7fe7280d2e00 2023-10-17T06:08:13.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.779+0000 7fe716ffd700 1 -- 172.21.15.125:0/3045428182 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe71c055050 con 0x7fe7280d2e00 2023-10-17T06:08:13.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.783+0000 7fe72759e700 1 -- 172.21.15.125:0/3045428182 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe7080656f0 msgr2=0x7fe708067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:13.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.783+0000 7fe72759e700 1 --2- 172.21.15.125:0/3045428182 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe7080656f0 0x7fe708067bb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe718000f60 tx=0x7fe718009040 comp rx=0 tx=0).stop 2023-10-17T06:08:13.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.783+0000 7fe72759e700 1 -- 172.21.15.125:0/3045428182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7280d2e00 msgr2=0x7fe7280b2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:13.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.783+0000 7fe72759e700 1 --2- 172.21.15.125:0/3045428182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7280d2e00 0x7fe7280b2800 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe71c000c00 tx=0x7fe71c004770 comp rx=0 tx=0).stop 2023-10-17T06:08:13.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.783+0000 7fe72759e700 1 -- 172.21.15.125:0/3045428182 shutdown_connections 2023-10-17T06:08:13.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.783+0000 7fe72759e700 1 --2- 172.21.15.125:0/3045428182 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe7080656f0 0x7fe708067bb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.783+0000 7fe72759e700 1 --2- 172.21.15.125:0/3045428182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe728160710 0x7fe7280b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.783+0000 7fe72759e700 1 --2- 172.21.15.125:0/3045428182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7280d2e00 0x7fe7280b2800 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.783+0000 7fe72759e700 1 --2- 172.21.15.125:0/3045428182 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe7280b5ae0 0x7fe7281f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.783+0000 7fe72759e700 1 -- 172.21.15.125:0/3045428182 >> 172.21.15.125:0/3045428182 conn(0x7fe728069f20 msgr2=0x7fe7280b6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:13.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.783+0000 7fe72759e700 1 -- 172.21.15.125:0/3045428182 shutdown_connections 2023-10-17T06:08:13.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.783+0000 7fe72759e700 1 -- 172.21.15.125:0/3045428182 wait complete. 2023-10-17T06:08:13.810 INFO:tasks.cephfs_test_runner:Simulate software freeze or temporary network failure. ... skipped 'Require first client to be on separate server from MDSs' 2023-10-17T06:08:13.811 INFO:tasks.cephfs_test_runner:Starting test: test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD) If any client gets unresponsive/it's session get idle due to lagginess 2023-10-17T06:08:13.811 INFO:tasks.cephfs_test_runner:test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD) 2023-10-17T06:08:13.812 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD.test_client_eviction_if_config_is_set' 2023-10-17T06:08:13.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.979+0000 7f2e42334700 1 Processor -- start 2023-10-17T06:08:13.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.979+0000 7f2e42334700 1 -- start start 2023-10-17T06:08:13.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.983+0000 7f2e42334700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2e3c160710 0x7f2e3c0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:13.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.983+0000 7f2e42334700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2e3c0b5ae0 0x7f2e3c06db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:13.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.983+0000 7f2e42334700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3c15d0d0 con 0x7f2e3c0d2e00 2023-10-17T06:08:13.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.983+0000 7f2e42334700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3c15df90 con 0x7f2e3c0b5ae0 2023-10-17T06:08:13.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.983+0000 7f2e42334700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3c06f0f0 con 0x7f2e3c160710 2023-10-17T06:08:13.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.983+0000 7f2e41332700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2e3c0d2e00 0x7f2e3c0d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48248/0 (socket says 172.21.15.125:48248) 2023-10-17T06:08:13.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.983+0000 7f2e41b33700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2e3c0b5ae0 0x7f2e3c06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:13.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.983+0000 7f2e41332700 1 -- 172.21.15.125:0/372064301 learned_addr learned my addr 172.21.15.125:0/372064301 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:13.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.983+0000 7f2e40b31700 1 --2- 172.21.15.125:0/372064301 >> v2:172.21.15.184:3300/0 conn(0x7f2e3c160710 0x7f2e3c0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:13.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.983+0000 7f2e33fff700 1 -- 172.21.15.125:0/372064301 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402787536 0 0) 0x7f2e38001490 con 0x7f2e3c0d2e00 2023-10-17T06:08:13.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.983+0000 7f2e33fff700 1 -- 172.21.15.125:0/372064301 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e280035d0 con 0x7f2e3c0d2e00 2023-10-17T06:08:13.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.983+0000 7f2e41b33700 1 -- 172.21.15.125:0/372064301 >> v2:172.21.15.184:3300/0 conn(0x7f2e3c160710 msgr2=0x7f2e3c0b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:13.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.983+0000 7f2e41b33700 1 --2- 172.21.15.125:0/372064301 >> v2:172.21.15.184:3300/0 conn(0x7f2e3c160710 0x7f2e3c0b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.983+0000 7f2e41b33700 1 -- 172.21.15.125:0/372064301 >> v1:172.21.15.125:6789/0 conn(0x7f2e3c0d2e00 legacy=0x7f2e3c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:13.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.983+0000 7f2e33fff700 1 -- 172.21.15.125:0/372064301 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2205633245 0 0) 0x7f2e280035d0 con 0x7f2e3c0d2e00 2023-10-17T06:08:13.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.983+0000 7f2e41b33700 1 -- 172.21.15.125:0/372064301 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c15d310 con 0x7f2e3c0b5ae0 2023-10-17T06:08:13.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.983+0000 7f2e41b33700 1 --2- 172.21.15.125:0/372064301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e3c0b5ae0 0x7f2e3c06db60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0d2420 tx=0x7f2e34009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db070b99eb18cf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:13.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.983+0000 7f2e33fff700 1 -- 172.21.15.125:0/372064301 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38001b80 con 0x7f2e3c0b5ae0 2023-10-17T06:08:13.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.983+0000 7f2e33fff700 1 -- 172.21.15.125:0/372064301 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e34004030 con 0x7f2e3c0b5ae0 2023-10-17T06:08:13.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.983+0000 7f2e33fff700 1 -- 172.21.15.125:0/372064301 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e340043a0 con 0x7f2e3c0b5ae0 2023-10-17T06:08:13.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.987+0000 7f2e42334700 1 -- 172.21.15.125:0/372064301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e3c0b5ae0 msgr2=0x7f2e3c06db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:13.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.987+0000 7f2e42334700 1 --2- 172.21.15.125:0/372064301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e3c0b5ae0 0x7f2e3c06db60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0d2420 tx=0x7f2e34009b20 comp rx=0 tx=0).stop 2023-10-17T06:08:13.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.987+0000 7f2e42334700 1 -- 172.21.15.125:0/372064301 shutdown_connections 2023-10-17T06:08:13.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.987+0000 7f2e42334700 1 --2- 172.21.15.125:0/372064301 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e3c0b5ae0 0x7f2e3c06db60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.987+0000 7f2e42334700 1 --2- 172.21.15.125:0/372064301 >> v2:172.21.15.184:3300/0 conn(0x7f2e3c160710 0x7f2e3c0b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.987+0000 7f2e42334700 1 -- 172.21.15.125:0/372064301 >> 172.21.15.125:0/372064301 conn(0x7f2e3c069f20 msgr2=0x7f2e3c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:13.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.987+0000 7f2e42334700 1 -- 172.21.15.125:0/372064301 shutdown_connections 2023-10-17T06:08:13.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.987+0000 7f2e42334700 1 -- 172.21.15.125:0/372064301 wait complete. 2023-10-17T06:08:13.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e42334700 1 Processor -- start 2023-10-17T06:08:13.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e42334700 1 -- start start 2023-10-17T06:08:13.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e42334700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e3c0b5ae0 0x7f2e3c153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:13.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e42334700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e3c0d2e00 0x7f2e3c1e58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:13.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e42334700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e3c160710 0x7f2e3c0b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:13.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e42334700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c153b70 con 0x7f2e3c0b5ae0 2023-10-17T06:08:13.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e42334700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c1e6130 con 0x7f2e3c160710 2023-10-17T06:08:13.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e42334700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c1e6410 con 0x7f2e3c0d2e00 2023-10-17T06:08:13.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e41332700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e3c0b5ae0 0x7f2e3c153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:13.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e41332700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e3c0b5ae0 0x7f2e3c153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48482/0 (socket says 172.21.15.125:48482) 2023-10-17T06:08:13.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e41332700 1 -- 172.21.15.125:0/2649837902 learned_addr learned my addr 172.21.15.125:0/2649837902 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:13.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e41b33700 1 --2- 172.21.15.125:0/2649837902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e3c160710 0x7f2e3c0b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:13.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e40b31700 1 --2- 172.21.15.125:0/2649837902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e3c0d2e00 0x7f2e3c1e58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:13.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e41332700 1 -- 172.21.15.125:0/2649837902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e3c0d2e00 msgr2=0x7f2e3c1e58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:13.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e41332700 1 --2- 172.21.15.125:0/2649837902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e3c0d2e00 0x7f2e3c1e58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e41332700 1 -- 172.21.15.125:0/2649837902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e3c160710 msgr2=0x7f2e3c0b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:13.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e41332700 1 --2- 172.21.15.125:0/2649837902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e3c160710 0x7f2e3c0b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:13.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e41332700 1 -- 172.21.15.125:0/2649837902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e340094a0 con 0x7f2e3c0b5ae0 2023-10-17T06:08:13.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e41b33700 1 --2- 172.21.15.125:0/2649837902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e3c160710 0x7f2e3c0b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:14.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e41332700 1 --2- 172.21.15.125:0/2649837902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e3c0b5ae0 0x7f2e3c153630 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2e38001a70 tx=0x7f2e3800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:14.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e31ffb700 1 -- 172.21.15.125:0/2649837902 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3800ada0 con 0x7f2e3c0b5ae0 2023-10-17T06:08:14.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e31ffb700 1 -- 172.21.15.125:0/2649837902 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e380070d0 con 0x7f2e3c0b5ae0 2023-10-17T06:08:14.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e42334700 1 -- 172.21.15.125:0/2649837902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e3c1e66f0 con 0x7f2e3c0b5ae0 2023-10-17T06:08:14.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.991+0000 7f2e31ffb700 1 -- 172.21.15.125:0/2649837902 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38007460 con 0x7f2e3c0b5ae0 2023-10-17T06:08:14.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.995+0000 7f2e42334700 1 -- 172.21.15.125:0/2649837902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3c1e6cb0 con 0x7f2e3c0b5ae0 2023-10-17T06:08:14.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.995+0000 7f2e42334700 1 -- 172.21.15.125:0/2649837902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3c072e60 con 0x7f2e3c0b5ae0 2023-10-17T06:08:14.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.995+0000 7f2e31ffb700 1 -- 172.21.15.125:0/2649837902 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2e380075c0 con 0x7f2e3c0b5ae0 2023-10-17T06:08:14.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.999+0000 7f2e31ffb700 1 --2- 172.21.15.125:0/2649837902 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2e200656f0 0x7f2e20067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:14.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.999+0000 7f2e31ffb700 1 -- 172.21.15.125:0/2649837902 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2e38082b60 con 0x7f2e3c0b5ae0 2023-10-17T06:08:14.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.999+0000 7f2e40b31700 1 --2- 172.21.15.125:0/2649837902 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2e200656f0 0x7f2e20067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:14.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:13.999+0000 7f2e40b31700 1 --2- 172.21.15.125:0/2649837902 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2e200656f0 0x7f2e20067bb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0d1760 tx=0x7f2e2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:14.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:14.003+0000 7f2e31ffb700 1 -- 172.21.15.125:0/2649837902 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2e38050380 con 0x7f2e3c0b5ae0 2023-10-17T06:08:14.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:14.243+0000 7f2e42334700 1 -- 172.21.15.125:0/2649837902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD.test_client_eviction_if_config_is_set"]} v 0) v1 -- 0x7f2e3c15d0d0 con 0x7f2e3c0b5ae0 2023-10-17T06:08:14.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:14.903+0000 7f2e31ffb700 1 -- 172.21.15.125:0/2649837902 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD.test_client_eviction_if_config_is_set"]}]=0 v86) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2e3c15d0d0 con 0x7f2e3c0b5ae0 2023-10-17T06:08:14.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:14.907+0000 7f2e42334700 1 -- 172.21.15.125:0/2649837902 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2e200656f0 msgr2=0x7f2e20067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:14.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:14.907+0000 7f2e42334700 1 --2- 172.21.15.125:0/2649837902 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2e200656f0 0x7f2e20067bb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0d1760 tx=0x7f2e2c008040 comp rx=0 tx=0).stop 2023-10-17T06:08:14.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:14.907+0000 7f2e42334700 1 -- 172.21.15.125:0/2649837902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e3c0b5ae0 msgr2=0x7f2e3c153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:14.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:14.907+0000 7f2e42334700 1 --2- 172.21.15.125:0/2649837902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e3c0b5ae0 0x7f2e3c153630 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2e38001a70 tx=0x7f2e3800a340 comp rx=0 tx=0).stop 2023-10-17T06:08:14.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:14.907+0000 7f2e42334700 1 -- 172.21.15.125:0/2649837902 shutdown_connections 2023-10-17T06:08:14.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:14.907+0000 7f2e42334700 1 --2- 172.21.15.125:0/2649837902 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2e200656f0 0x7f2e20067bb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:14.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:14.907+0000 7f2e42334700 1 --2- 172.21.15.125:0/2649837902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e3c160710 0x7f2e3c0b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:14.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:14.907+0000 7f2e42334700 1 --2- 172.21.15.125:0/2649837902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e3c0d2e00 0x7f2e3c1e58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:14.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:14.907+0000 7f2e42334700 1 --2- 172.21.15.125:0/2649837902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e3c0b5ae0 0x7f2e3c153630 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:14.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:14.907+0000 7f2e42334700 1 -- 172.21.15.125:0/2649837902 >> 172.21.15.125:0/2649837902 conn(0x7f2e3c069f20 msgr2=0x7f2e3c155900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:14.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:14.907+0000 7f2e42334700 1 -- 172.21.15.125:0/2649837902 shutdown_connections 2023-10-17T06:08:14.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:14.907+0000 7f2e42334700 1 -- 172.21.15.125:0/2649837902 wait complete. 2023-10-17T06:08:14.934 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:08:15.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.103+0000 7fe722f54700 1 Processor -- start 2023-10-17T06:08:15.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.103+0000 7fe722f54700 1 -- start start 2023-10-17T06:08:15.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.103+0000 7fe722f54700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe71c154040 0x7fe71c0cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:15.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.103+0000 7fe722f54700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe71c0cb8a0 0x7fe71c06f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:15.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.103+0000 7fe722f54700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71c15e130 con 0x7fe71c06e8a0 2023-10-17T06:08:15.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.103+0000 7fe722f54700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe71c0cdfa0 con 0x7fe71c0cb8a0 2023-10-17T06:08:15.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.103+0000 7fe722f54700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c0ce1b0 con 0x7fe71c154040 2023-10-17T06:08:15.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.103+0000 7fe7214f1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe71c0cb8a0 0x7fe71c06f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:15.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.103+0000 7fe7214f1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe71c0cb8a0 0x7fe71c06f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48496/0 (socket says 172.21.15.125:48496) 2023-10-17T06:08:15.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.103+0000 7fe7214f1700 1 -- 172.21.15.125:0/1346575348 learned_addr learned my addr 172.21.15.125:0/1346575348 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.103+0000 7fe720cf0700 1 --2- 172.21.15.125:0/1346575348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe71c154040 0x7fe71c0cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.107+0000 7fe7214f1700 1 -- 172.21.15.125:0/1346575348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe71c154040 msgr2=0x7fe71c0cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.107+0000 7fe7214f1700 1 --2- 172.21.15.125:0/1346575348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe71c154040 0x7fe71c0cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.107+0000 7fe7214f1700 1 -- 172.21.15.125:0/1346575348 >> v1:172.21.15.184:6789/0 conn(0x7fe71c06e8a0 legacy=0x7fe71c0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.107+0000 7fe7214f1700 1 -- 172.21.15.125:0/1346575348 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71c0ce490 con 0x7fe71c0cb8a0 2023-10-17T06:08:15.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.107+0000 7fe7214f1700 1 --2- 172.21.15.125:0/1346575348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c0cb8a0 0x7fe71c06f970 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe714009e50 tx=0x7fe71400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8c77a54bd59c7c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.107+0000 7fe7137fe700 1 -- 172.21.15.125:0/1346575348 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71400e070 con 0x7fe71c0cb8a0 2023-10-17T06:08:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.107+0000 7fe7137fe700 1 -- 172.21.15.125:0/1346575348 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71400b9c0 con 0x7fe71c0cb8a0 2023-10-17T06:08:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.107+0000 7fe7137fe700 1 -- 172.21.15.125:0/1346575348 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71400bd70 con 0x7fe71c0cb8a0 2023-10-17T06:08:15.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.107+0000 7fe722f54700 1 -- 172.21.15.125:0/1346575348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c0cb8a0 msgr2=0x7fe71c06f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:15.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.107+0000 7fe722f54700 1 --2- 172.21.15.125:0/1346575348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c0cb8a0 0x7fe71c06f970 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe714009e50 tx=0x7fe71400b330 comp rx=0 tx=0).stop 2023-10-17T06:08:15.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.107+0000 7fe722f54700 1 -- 172.21.15.125:0/1346575348 shutdown_connections 2023-10-17T06:08:15.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.107+0000 7fe722f54700 1 --2- 172.21.15.125:0/1346575348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c0cb8a0 0x7fe71c06f970 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.107+0000 7fe722f54700 1 --2- 172.21.15.125:0/1346575348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe71c154040 0x7fe71c0cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.107+0000 7fe722f54700 1 -- 172.21.15.125:0/1346575348 >> 172.21.15.125:0/1346575348 conn(0x7fe71c06a340 msgr2=0x7fe71c0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:15.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.107+0000 7fe722f54700 1 -- 172.21.15.125:0/1346575348 shutdown_connections 2023-10-17T06:08:15.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.107+0000 7fe722f54700 1 -- 172.21.15.125:0/1346575348 wait complete. 2023-10-17T06:08:15.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.111+0000 7fe722f54700 1 Processor -- start 2023-10-17T06:08:15.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.111+0000 7fe722f54700 1 -- start start 2023-10-17T06:08:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.111+0000 7fe722f54700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c06e8a0 0x7fe71c142290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:15.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.111+0000 7fe722f54700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe71c0cb8a0 0x7fe71c13ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:15.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.111+0000 7fe722f54700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe71c154040 0x7fe71c0b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:15.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.111+0000 7fe722f54700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c1427d0 con 0x7fe71c06e8a0 2023-10-17T06:08:15.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.111+0000 7fe722f54700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c145c60 con 0x7fe71c0cb8a0 2023-10-17T06:08:15.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.111+0000 7fe722f54700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71c13f840 con 0x7fe71c154040 2023-10-17T06:08:15.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.111+0000 7fe720cf0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c06e8a0 0x7fe71c142290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:15.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.115+0000 7fe720cf0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c06e8a0 0x7fe71c142290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48506/0 (socket says 172.21.15.125:48506) 2023-10-17T06:08:15.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.115+0000 7fe720cf0700 1 -- 172.21.15.125:0/325981707 learned_addr learned my addr 172.21.15.125:0/325981707 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:15.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.115+0000 7fe7214f1700 1 --2- 172.21.15.125:0/325981707 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe71c154040 0x7fe71c0b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:15.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.115+0000 7fe713fff700 1 --2- 172.21.15.125:0/325981707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe71c0cb8a0 0x7fe71c13ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:15.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.115+0000 7fe720cf0700 1 -- 172.21.15.125:0/325981707 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe71c154040 msgr2=0x7fe71c0b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:15.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.115+0000 7fe720cf0700 1 --2- 172.21.15.125:0/325981707 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe71c154040 0x7fe71c0b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.115+0000 7fe720cf0700 1 -- 172.21.15.125:0/325981707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe71c0cb8a0 msgr2=0x7fe71c13ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:15.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.115+0000 7fe720cf0700 1 --2- 172.21.15.125:0/325981707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe71c0cb8a0 0x7fe71c13ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.115+0000 7fe720cf0700 1 -- 172.21.15.125:0/325981707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe714009b30 con 0x7fe71c06e8a0 2023-10-17T06:08:15.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.115+0000 7fe720cf0700 1 --2- 172.21.15.125:0/325981707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c06e8a0 0x7fe71c142290 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe71800d800 tx=0x7fe71800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:15.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.115+0000 7fe7117fa700 1 -- 172.21.15.125:0/325981707 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7180125f0 con 0x7fe71c06e8a0 2023-10-17T06:08:15.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.115+0000 7fe7117fa700 1 -- 172.21.15.125:0/325981707 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe718012750 con 0x7fe71c06e8a0 2023-10-17T06:08:15.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.115+0000 7fe722f54700 1 -- 172.21.15.125:0/325981707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71c13fae0 con 0x7fe71c06e8a0 2023-10-17T06:08:15.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.115+0000 7fe7117fa700 1 -- 172.21.15.125:0/325981707 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe718012ac0 con 0x7fe71c06e8a0 2023-10-17T06:08:15.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.115+0000 7fe722f54700 1 -- 172.21.15.125:0/325981707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71c1400a0 con 0x7fe71c06e8a0 2023-10-17T06:08:15.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.115+0000 7fe722f54700 1 -- 172.21.15.125:0/325981707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71c0ccb40 con 0x7fe71c06e8a0 2023-10-17T06:08:15.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.119+0000 7fe7117fa700 1 -- 172.21.15.125:0/325981707 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe718012c20 con 0x7fe71c06e8a0 2023-10-17T06:08:15.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.119+0000 7fe7117fa700 1 --2- 172.21.15.125:0/325981707 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe7080656f0 0x7fe708067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:15.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.119+0000 7fe7117fa700 1 -- 172.21.15.125:0/325981707 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe718083200 con 0x7fe71c06e8a0 2023-10-17T06:08:15.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.119+0000 7fe713fff700 1 --2- 172.21.15.125:0/325981707 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe7080656f0 0x7fe708067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:15.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.119+0000 7fe713fff700 1 --2- 172.21.15.125:0/325981707 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe7080656f0 0x7fe708067bb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe71c145f50 tx=0x7fe70c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:15.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.127+0000 7fe7117fa700 1 -- 172.21.15.125:0/325981707 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe718050870 con 0x7fe71c06e8a0 2023-10-17T06:08:15.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.306+0000 7fe722f54700 1 -- 172.21.15.125:0/325981707 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe71c072e60 con 0x7fe71c06e8a0 2023-10-17T06:08:15.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.310+0000 7fe7117fa700 1 -- 172.21.15.125:0/325981707 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20252 (secure 0 0 0) 0x7fe718053e90 con 0x7fe71c06e8a0 2023-10-17T06:08:15.315 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:15.315 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":30,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:49.710984+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:08:15.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.314+0000 7fe722f54700 1 -- 172.21.15.125:0/325981707 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe7080656f0 msgr2=0x7fe708067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:15.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.314+0000 7fe722f54700 1 --2- 172.21.15.125:0/325981707 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe7080656f0 0x7fe708067bb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe71c145f50 tx=0x7fe70c009040 comp rx=0 tx=0).stop 2023-10-17T06:08:15.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.314+0000 7fe722f54700 1 -- 172.21.15.125:0/325981707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c06e8a0 msgr2=0x7fe71c142290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:15.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.314+0000 7fe722f54700 1 --2- 172.21.15.125:0/325981707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c06e8a0 0x7fe71c142290 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe71800d800 tx=0x7fe71800db10 comp rx=0 tx=0).stop 2023-10-17T06:08:15.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.314+0000 7fe722f54700 1 -- 172.21.15.125:0/325981707 shutdown_connections 2023-10-17T06:08:15.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.314+0000 7fe722f54700 1 --2- 172.21.15.125:0/325981707 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe7080656f0 0x7fe708067bb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.314+0000 7fe722f54700 1 --2- 172.21.15.125:0/325981707 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe71c154040 0x7fe71c0b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.314+0000 7fe722f54700 1 --2- 172.21.15.125:0/325981707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe71c0cb8a0 0x7fe71c13ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.314+0000 7fe722f54700 1 --2- 172.21.15.125:0/325981707 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe71c06e8a0 0x7fe71c142290 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.314+0000 7fe722f54700 1 -- 172.21.15.125:0/325981707 >> 172.21.15.125:0/325981707 conn(0x7fe71c06a340 msgr2=0x7fe71c0ac5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:15.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.314+0000 7fe722f54700 1 -- 172.21.15.125:0/325981707 shutdown_connections 2023-10-17T06:08:15.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.314+0000 7fe722f54700 1 -- 172.21.15.125:0/325981707 wait complete. 2023-10-17T06:08:15.342 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-17T06:07:06.629169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-17T06:07:08.148117+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-17T06:07:11.895112+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-17T06:08:15.343 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:08:15.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.526+0000 7f02f0810700 1 Processor -- start 2023-10-17T06:08:15.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.526+0000 7f02f0810700 1 -- start start 2023-10-17T06:08:15.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.530+0000 7f02f0810700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f02ec06fb60 0x7f02ec06b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:15.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.530+0000 7f02f0810700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02ec070010 0x7f02ec0cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:15.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.530+0000 7f02f0810700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02ec06b3d0 con 0x7f02ec15cd20 2023-10-17T06:08:15.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.530+0000 7f02f0810700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02ec06bda0 con 0x7f02ec06fb60 2023-10-17T06:08:15.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.530+0000 7f02f0810700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec15d100 con 0x7f02ec070010 2023-10-17T06:08:15.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.530+0000 7f02ead9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f02ec15cd20 0x7f02ec06f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48258/0 (socket says 172.21.15.125:48258) 2023-10-17T06:08:15.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.530+0000 7f02ead9d700 1 -- 172.21.15.125:0/3293092251 learned_addr learned my addr 172.21.15.125:0/3293092251 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:15.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.530+0000 7f02ea59c700 1 --2- 172.21.15.125:0/3293092251 >> v2:172.21.15.184:3300/0 conn(0x7f02ec06fb60 0x7f02ec06b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:15.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.530+0000 7f02eb59e700 1 --2- 172.21.15.125:0/3293092251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02ec070010 0x7f02ec0cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:15.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.530+0000 7f02e9d9b700 1 -- 172.21.15.125:0/3293092251 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036726998 0 0) 0x7f02ec06b3d0 con 0x7f02ec15cd20 2023-10-17T06:08:15.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.530+0000 7f02e9d9b700 1 -- 172.21.15.125:0/3293092251 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02d40035d0 con 0x7f02ec15cd20 2023-10-17T06:08:15.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.530+0000 7f02ea59c700 1 -- 172.21.15.125:0/3293092251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02ec070010 msgr2=0x7f02ec0cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:15.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.530+0000 7f02ea59c700 1 --2- 172.21.15.125:0/3293092251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02ec070010 0x7f02ec0cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.530+0000 7f02ea59c700 1 -- 172.21.15.125:0/3293092251 >> v1:172.21.15.125:6789/0 conn(0x7f02ec15cd20 legacy=0x7f02ec06f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:15.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.530+0000 7f02ea59c700 1 -- 172.21.15.125:0/3293092251 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ec0ce930 con 0x7f02ec06fb60 2023-10-17T06:08:15.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.530+0000 7f02eb59e700 1 --2- 172.21.15.125:0/3293092251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02ec070010 0x7f02ec0cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:08:15.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.530+0000 7f02ea59c700 1 --2- 172.21.15.125:0/3293092251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02ec06fb60 0x7f02ec06b860 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009850 tx=0x7f02e0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eccdebdfd33d93ca server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:15.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.534+0000 7f02e9d9b700 1 -- 172.21.15.125:0/3293092251 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0011830 con 0x7f02ec06fb60 2023-10-17T06:08:15.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.534+0000 7f02e9d9b700 1 -- 172.21.15.125:0/3293092251 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e0011990 con 0x7f02ec06fb60 2023-10-17T06:08:15.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.534+0000 7f02e9d9b700 1 -- 172.21.15.125:0/3293092251 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0011d40 con 0x7f02ec06fb60 2023-10-17T06:08:15.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.534+0000 7f02f0810700 1 -- 172.21.15.125:0/3293092251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02ec06fb60 msgr2=0x7f02ec06b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:15.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.534+0000 7f02f0810700 1 --2- 172.21.15.125:0/3293092251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02ec06fb60 0x7f02ec06b860 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009850 tx=0x7f02e0009b60 comp rx=0 tx=0).stop 2023-10-17T06:08:15.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.534+0000 7f02f0810700 1 -- 172.21.15.125:0/3293092251 shutdown_connections 2023-10-17T06:08:15.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.534+0000 7f02f0810700 1 --2- 172.21.15.125:0/3293092251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02ec070010 0x7f02ec0cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.534+0000 7f02f0810700 1 --2- 172.21.15.125:0/3293092251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02ec06fb60 0x7f02ec06b860 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.534+0000 7f02f0810700 1 -- 172.21.15.125:0/3293092251 >> 172.21.15.125:0/3293092251 conn(0x7f02ec06caf0 msgr2=0x7f02ec0b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:15.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.534+0000 7f02f0810700 1 -- 172.21.15.125:0/3293092251 shutdown_connections 2023-10-17T06:08:15.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.534+0000 7f02f0810700 1 -- 172.21.15.125:0/3293092251 wait complete. 2023-10-17T06:08:15.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.538+0000 7f02f0810700 1 Processor -- start 2023-10-17T06:08:15.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.538+0000 7f02f0810700 1 -- start start 2023-10-17T06:08:15.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.538+0000 7f02f0810700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02ec06fb60 0x7f02ec1f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:15.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.538+0000 7f02f0810700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02ec070010 0x7f02ec0c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:15.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.538+0000 7f02f0810700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02ec15cd20 0x7f02ec156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:15.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.538+0000 7f02f0810700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec0c6410 con 0x7f02ec070010 2023-10-17T06:08:15.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.538+0000 7f02f0810700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec0c9aa0 con 0x7f02ec06fb60 2023-10-17T06:08:15.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.538+0000 7f02f0810700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec0c94f0 con 0x7f02ec15cd20 2023-10-17T06:08:15.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.538+0000 7f02ea59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02ec070010 0x7f02ec0c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:15.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.538+0000 7f02ea59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02ec070010 0x7f02ec0c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48512/0 (socket says 172.21.15.125:48512) 2023-10-17T06:08:15.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.538+0000 7f02ea59c700 1 -- 172.21.15.125:0/574577218 learned_addr learned my addr 172.21.15.125:0/574577218 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:15.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.538+0000 7f02ead9d700 1 --2- 172.21.15.125:0/574577218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02ec06fb60 0x7f02ec1f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:15.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.538+0000 7f02eb59e700 1 --2- 172.21.15.125:0/574577218 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02ec15cd20 0x7f02ec156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:15.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.538+0000 7f02ea59c700 1 -- 172.21.15.125:0/574577218 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02ec15cd20 msgr2=0x7f02ec156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:15.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.538+0000 7f02ea59c700 1 --2- 172.21.15.125:0/574577218 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02ec15cd20 0x7f02ec156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.538+0000 7f02ea59c700 1 -- 172.21.15.125:0/574577218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02ec06fb60 msgr2=0x7f02ec1f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:15.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.538+0000 7f02ea59c700 1 --2- 172.21.15.125:0/574577218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02ec06fb60 0x7f02ec1f3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.538+0000 7f02ea59c700 1 -- 172.21.15.125:0/574577218 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e4009a70 con 0x7f02ec070010 2023-10-17T06:08:15.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.542+0000 7f02ea59c700 1 --2- 172.21.15.125:0/574577218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02ec070010 0x7f02ec0c8fb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f02e00090b0 tx=0x7f02e0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:15.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.542+0000 7f02d37fe700 1 -- 172.21.15.125:0/574577218 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0004480 con 0x7f02ec070010 2023-10-17T06:08:15.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.542+0000 7f02d37fe700 1 -- 172.21.15.125:0/574577218 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e001f070 con 0x7f02ec070010 2023-10-17T06:08:15.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.542+0000 7f02f0810700 1 -- 172.21.15.125:0/574577218 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e00094b0 con 0x7f02ec070010 2023-10-17T06:08:15.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.542+0000 7f02d37fe700 1 -- 172.21.15.125:0/574577218 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0003900 con 0x7f02ec070010 2023-10-17T06:08:15.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.542+0000 7f02f0810700 1 -- 172.21.15.125:0/574577218 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02ec0c6640 con 0x7f02ec070010 2023-10-17T06:08:15.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.542+0000 7f02f0810700 1 -- 172.21.15.125:0/574577218 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02ec0709e0 con 0x7f02ec070010 2023-10-17T06:08:15.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.542+0000 7f02d37fe700 1 -- 172.21.15.125:0/574577218 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f02e0021030 con 0x7f02ec070010 2023-10-17T06:08:15.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.546+0000 7f02d37fe700 1 --2- 172.21.15.125:0/574577218 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02d80656f0 0x7f02d8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:15.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.546+0000 7f02d37fe700 1 -- 172.21.15.125:0/574577218 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f02e00844d0 con 0x7f02ec070010 2023-10-17T06:08:15.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.546+0000 7f02ead9d700 1 --2- 172.21.15.125:0/574577218 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02d80656f0 0x7f02d8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:15.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.546+0000 7f02ead9d700 1 --2- 172.21.15.125:0/574577218 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02d80656f0 0x7f02d8067bb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0011e0 tx=0x7f02dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:15.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.554+0000 7f02d37fe700 1 -- 172.21.15.125:0/574577218 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f02e0051c50 con 0x7f02ec070010 2023-10-17T06:08:15.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.734+0000 7f02f0810700 1 -- 172.21.15.125:0/574577218 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f02ec04e910 con 0x7f02ec070010 2023-10-17T06:08:15.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.734+0000 7f02d37fe700 1 -- 172.21.15.125:0/574577218 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f02e0006ce0 con 0x7f02ec070010 2023-10-17T06:08:15.741 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:08:15.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.742+0000 7f02f0810700 1 -- 172.21.15.125:0/574577218 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02d80656f0 msgr2=0x7f02d8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:15.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.742+0000 7f02f0810700 1 --2- 172.21.15.125:0/574577218 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02d80656f0 0x7f02d8067bb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0011e0 tx=0x7f02dc009040 comp rx=0 tx=0).stop 2023-10-17T06:08:15.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.742+0000 7f02f0810700 1 -- 172.21.15.125:0/574577218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02ec070010 msgr2=0x7f02ec0c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:15.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.742+0000 7f02f0810700 1 --2- 172.21.15.125:0/574577218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02ec070010 0x7f02ec0c8fb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f02e00090b0 tx=0x7f02e0004770 comp rx=0 tx=0).stop 2023-10-17T06:08:15.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.742+0000 7f02f0810700 1 -- 172.21.15.125:0/574577218 shutdown_connections 2023-10-17T06:08:15.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.742+0000 7f02f0810700 1 --2- 172.21.15.125:0/574577218 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02d80656f0 0x7f02d8067bb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.742+0000 7f02f0810700 1 --2- 172.21.15.125:0/574577218 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f02ec15cd20 0x7f02ec156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.742+0000 7f02f0810700 1 --2- 172.21.15.125:0/574577218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02ec070010 0x7f02ec0c8fb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.742+0000 7f02f0810700 1 --2- 172.21.15.125:0/574577218 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02ec06fb60 0x7f02ec1f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.742+0000 7f02f0810700 1 -- 172.21.15.125:0/574577218 >> 172.21.15.125:0/574577218 conn(0x7f02ec06caf0 msgr2=0x7f02ec15ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:15.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.742+0000 7f02f0810700 1 -- 172.21.15.125:0/574577218 shutdown_connections 2023-10-17T06:08:15.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.742+0000 7f02f0810700 1 -- 172.21.15.125:0/574577218 wait complete. 2023-10-17T06:08:15.766 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:08:15.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.938+0000 7f43b6887700 1 Processor -- start 2023-10-17T06:08:15.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.938+0000 7f43b6887700 1 -- start start 2023-10-17T06:08:15.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.942+0000 7f43b6887700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43b00b5b80 0x7f43b015d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:15.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.942+0000 7f43b6887700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f43b006f9a0 0x7f43b006fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:15.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.942+0000 7f43b6887700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b0146ba0 con 0x7f43b01467c0 2023-10-17T06:08:15.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.942+0000 7f43b6887700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b0070350 con 0x7f43b006f9a0 2023-10-17T06:08:15.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.942+0000 7f43b6887700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b00d0920 con 0x7f43b00b5b80 2023-10-17T06:08:15.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.942+0000 7f43a77fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43b00b5b80 0x7f43b015d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:15.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.942+0000 7f43b4e24700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f43b006f9a0 0x7f43b006fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:15.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.942+0000 7f43b4e24700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f43b006f9a0 0x7f43b006fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:48980/0 (socket says 172.21.15.125:48980) 2023-10-17T06:08:15.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.942+0000 7f43b4e24700 1 -- 172.21.15.125:0/1541868782 learned_addr learned my addr 172.21.15.125:0/1541868782 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:15.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.942+0000 7f43affff700 1 --1- 172.21.15.125:0/1541868782 >> v1:172.21.15.184:6789/0 conn(0x7f43b01467c0 0x7f43b01612e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:58362/0 (socket says 172.21.15.125:58362) 2023-10-17T06:08:15.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.942+0000 7f43b4e24700 1 -- 172.21.15.125:0/1541868782 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43b00b5b80 msgr2=0x7f43b015d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:15.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.942+0000 7f43b4e24700 1 --2- 172.21.15.125:0/1541868782 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43b00b5b80 0x7f43b015d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.942+0000 7f43b4e24700 1 -- 172.21.15.125:0/1541868782 >> v1:172.21.15.184:6789/0 conn(0x7f43b01467c0 legacy=0x7f43b01612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:15.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.942+0000 7f43b4e24700 1 -- 172.21.15.125:0/1541868782 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b00b6160 con 0x7f43b006f9a0 2023-10-17T06:08:15.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.942+0000 7f43b4e24700 1 --2- 172.21.15.125:0/1541868782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43b006f9a0 0x7f43b006fe10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009910 tx=0x7f43a8009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8962c008bed2346c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:15.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.942+0000 7f43af7fe700 1 -- 172.21.15.125:0/1541868782 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a8011830 con 0x7f43b006f9a0 2023-10-17T06:08:15.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.942+0000 7f43af7fe700 1 -- 172.21.15.125:0/1541868782 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a8011990 con 0x7f43b006f9a0 2023-10-17T06:08:15.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.942+0000 7f43af7fe700 1 -- 172.21.15.125:0/1541868782 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a8011d40 con 0x7f43b006f9a0 2023-10-17T06:08:15.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.946+0000 7f43b6887700 1 -- 172.21.15.125:0/1541868782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43b006f9a0 msgr2=0x7f43b006fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:15.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.946+0000 7f43b6887700 1 --2- 172.21.15.125:0/1541868782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43b006f9a0 0x7f43b006fe10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009910 tx=0x7f43a8009c20 comp rx=0 tx=0).stop 2023-10-17T06:08:15.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.946+0000 7f43b6887700 1 -- 172.21.15.125:0/1541868782 shutdown_connections 2023-10-17T06:08:15.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.946+0000 7f43b6887700 1 --2- 172.21.15.125:0/1541868782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43b006f9a0 0x7f43b006fe10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.946+0000 7f43b6887700 1 --2- 172.21.15.125:0/1541868782 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43b00b5b80 0x7f43b015d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.946+0000 7f43b6887700 1 -- 172.21.15.125:0/1541868782 >> 172.21.15.125:0/1541868782 conn(0x7f43b006a130 msgr2=0x7f43b006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:15.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.946+0000 7f43b6887700 1 -- 172.21.15.125:0/1541868782 shutdown_connections 2023-10-17T06:08:15.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.946+0000 7f43b6887700 1 -- 172.21.15.125:0/1541868782 wait complete. 2023-10-17T06:08:15.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.950+0000 7f43b6887700 1 Processor -- start 2023-10-17T06:08:15.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.950+0000 7f43b6887700 1 -- start start 2023-10-17T06:08:15.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.950+0000 7f43b6887700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43b006f9a0 0x7f43b015c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:15.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.950+0000 7f43b6887700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43b00b5b80 0x7f43b013cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:15.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.950+0000 7f43b6887700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43b01467c0 0x7f43b0160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:15.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.950+0000 7f43b6887700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b015cd40 con 0x7f43b006f9a0 2023-10-17T06:08:15.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.950+0000 7f43b6887700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b015db60 con 0x7f43b01467c0 2023-10-17T06:08:15.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.950+0000 7f43b6887700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b015de40 con 0x7f43b00b5b80 2023-10-17T06:08:15.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.950+0000 7f43affff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43b006f9a0 0x7f43b015c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:15.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.950+0000 7f43affff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43b006f9a0 0x7f43b015c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48522/0 (socket says 172.21.15.125:48522) 2023-10-17T06:08:15.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.950+0000 7f43affff700 1 -- 172.21.15.125:0/1156972888 learned_addr learned my addr 172.21.15.125:0/1156972888 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:15.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.950+0000 7f43a77fe700 1 --2- 172.21.15.125:0/1156972888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43b00b5b80 0x7f43b013cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:15.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.950+0000 7f43b4e24700 1 --2- 172.21.15.125:0/1156972888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43b01467c0 0x7f43b0160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:15.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.950+0000 7f43affff700 1 -- 172.21.15.125:0/1156972888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43b00b5b80 msgr2=0x7f43b013cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:15.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.950+0000 7f43affff700 1 --2- 172.21.15.125:0/1156972888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43b00b5b80 0x7f43b013cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.950+0000 7f43affff700 1 -- 172.21.15.125:0/1156972888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43b01467c0 msgr2=0x7f43b0160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:15.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.950+0000 7f43affff700 1 --2- 172.21.15.125:0/1156972888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43b01467c0 0x7f43b0160ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:15.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.950+0000 7f43affff700 1 -- 172.21.15.125:0/1156972888 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a8009570 con 0x7f43b006f9a0 2023-10-17T06:08:15.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.950+0000 7f43affff700 1 --2- 172.21.15.125:0/1156972888 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43b006f9a0 0x7f43b015c800 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f43a000cc50 tx=0x7f43a000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:15.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.954+0000 7f43ad7fa700 1 -- 172.21.15.125:0/1156972888 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a000aad0 con 0x7f43b006f9a0 2023-10-17T06:08:15.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.954+0000 7f43ad7fa700 1 -- 172.21.15.125:0/1156972888 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a000ac30 con 0x7f43b006f9a0 2023-10-17T06:08:15.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.954+0000 7f43b6887700 1 -- 172.21.15.125:0/1156972888 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b015e120 con 0x7f43b006f9a0 2023-10-17T06:08:15.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.954+0000 7f43ad7fa700 1 -- 172.21.15.125:0/1156972888 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a0007070 con 0x7f43b006f9a0 2023-10-17T06:08:15.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.954+0000 7f43b6887700 1 -- 172.21.15.125:0/1156972888 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b015e6e0 con 0x7f43b006f9a0 2023-10-17T06:08:15.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.954+0000 7f43b6887700 1 -- 172.21.15.125:0/1156972888 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b0072e60 con 0x7f43b006f9a0 2023-10-17T06:08:15.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.954+0000 7f43ad7fa700 1 -- 172.21.15.125:0/1156972888 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f43a00071d0 con 0x7f43b006f9a0 2023-10-17T06:08:15.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.958+0000 7f43ad7fa700 1 --2- 172.21.15.125:0/1156972888 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f43900656f0 0x7f4390067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:15.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.958+0000 7f43ad7fa700 1 -- 172.21.15.125:0/1156972888 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f43a0082d10 con 0x7f43b006f9a0 2023-10-17T06:08:15.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.958+0000 7f43a77fe700 1 --2- 172.21.15.125:0/1156972888 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f43900656f0 0x7f4390067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:15.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.958+0000 7f43a77fe700 1 --2- 172.21.15.125:0/1156972888 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f43900656f0 0x7f4390067bb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f43b0160710 tx=0x7f4398009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:15.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:15.962+0000 7f43ad7fa700 1 -- 172.21.15.125:0/1156972888 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f43a0050560 con 0x7f43b006f9a0 2023-10-17T06:08:16.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.138+0000 7f43b6887700 1 -- 172.21.15.125:0/1156972888 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f43b00b7200 con 0x7f43b006f9a0 2023-10-17T06:08:16.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.138+0000 7f43ad7fa700 1 -- 172.21.15.125:0/1156972888 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f43a0017020 con 0x7f43b006f9a0 2023-10-17T06:08:16.145 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:08:16.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.142+0000 7f43b6887700 1 -- 172.21.15.125:0/1156972888 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f43900656f0 msgr2=0x7f4390067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:16.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.142+0000 7f43b6887700 1 --2- 172.21.15.125:0/1156972888 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f43900656f0 0x7f4390067bb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f43b0160710 tx=0x7f4398009240 comp rx=0 tx=0).stop 2023-10-17T06:08:16.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.142+0000 7f43b6887700 1 -- 172.21.15.125:0/1156972888 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43b006f9a0 msgr2=0x7f43b015c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:16.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.142+0000 7f43b6887700 1 --2- 172.21.15.125:0/1156972888 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43b006f9a0 0x7f43b015c800 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f43a000cc50 tx=0x7f43a000cf60 comp rx=0 tx=0).stop 2023-10-17T06:08:16.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.142+0000 7f43b6887700 1 -- 172.21.15.125:0/1156972888 shutdown_connections 2023-10-17T06:08:16.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.142+0000 7f43b6887700 1 --2- 172.21.15.125:0/1156972888 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f43900656f0 0x7f4390067bb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:16.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.142+0000 7f43b6887700 1 --2- 172.21.15.125:0/1156972888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43b01467c0 0x7f43b0160ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:16.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.142+0000 7f43b6887700 1 --2- 172.21.15.125:0/1156972888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f43b00b5b80 0x7f43b013cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:16.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.142+0000 7f43b6887700 1 --2- 172.21.15.125:0/1156972888 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43b006f9a0 0x7f43b015c800 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:16.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.142+0000 7f43b6887700 1 -- 172.21.15.125:0/1156972888 >> 172.21.15.125:0/1156972888 conn(0x7f43b006a130 msgr2=0x7f43b006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:16.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.142+0000 7f43b6887700 1 -- 172.21.15.125:0/1156972888 shutdown_connections 2023-10-17T06:08:16.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.142+0000 7f43b6887700 1 -- 172.21.15.125:0/1156972888 wait complete. 2023-10-17T06:08:16.169 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-17T06:08:16.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.342+0000 7f227c65e700 1 Processor -- start 2023-10-17T06:08:16.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.342+0000 7f227c65e700 1 -- start start 2023-10-17T06:08:16.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.346+0000 7f227c65e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f22740cdb10 0x7f22740cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:16.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.346+0000 7f227c65e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2274159e70 0x7f22740ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:16.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.346+0000 7f227c65e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22740add20 con 0x7f22740cae50 2023-10-17T06:08:16.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.346+0000 7f227c65e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22740cd930 con 0x7f22740cdb10 2023-10-17T06:08:16.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.346+0000 7f227c65e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22740ce430 con 0x7f2274159e70 2023-10-17T06:08:16.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.346+0000 7f227abfb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2274159e70 0x7f22740ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:16.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.346+0000 7f2279bf9700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f22740cae50 0x7f22740cc3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:58376/0 (socket says 172.21.15.125:58376) 2023-10-17T06:08:16.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.346+0000 7f2279bf9700 1 -- 172.21.15.125:0/227955189 learned_addr learned my addr 172.21.15.125:0/227955189 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:16.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.346+0000 7f227a3fa700 1 --2- 172.21.15.125:0/227955189 >> v2:172.21.15.184:3300/0 conn(0x7f22740cdb10 0x7f22740cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:16.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.346+0000 7f227abfb700 1 -- 172.21.15.125:0/227955189 >> v2:172.21.15.184:3300/0 conn(0x7f22740cdb10 msgr2=0x7f22740cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:16.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.346+0000 7f227abfb700 1 --2- 172.21.15.125:0/227955189 >> v2:172.21.15.184:3300/0 conn(0x7f22740cdb10 0x7f22740cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:16.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.346+0000 7f227abfb700 1 -- 172.21.15.125:0/227955189 >> v1:172.21.15.184:6789/0 conn(0x7f22740cae50 legacy=0x7f22740cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:16.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.346+0000 7f227abfb700 1 -- 172.21.15.125:0/227955189 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22740adf70 con 0x7f2274159e70 2023-10-17T06:08:16.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.346+0000 7f227a3fa700 1 --2- 172.21.15.125:0/227955189 >> v2:172.21.15.184:3300/0 conn(0x7f22740cdb10 0x7f22740cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:16.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.350+0000 7f227abfb700 1 --2- 172.21.15.125:0/227955189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2274159e70 0x7f22740ccb00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f226c009d90 tx=0x7f226c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a7ebf4c8487ce71 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:16.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.350+0000 7f22793f8700 1 -- 172.21.15.125:0/227955189 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c00e070 con 0x7f2274159e70 2023-10-17T06:08:16.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.350+0000 7f22793f8700 1 -- 172.21.15.125:0/227955189 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c00bbd0 con 0x7f2274159e70 2023-10-17T06:08:16.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.350+0000 7f22793f8700 1 -- 172.21.15.125:0/227955189 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c012430 con 0x7f2274159e70 2023-10-17T06:08:16.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.350+0000 7f227c65e700 1 -- 172.21.15.125:0/227955189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2274159e70 msgr2=0x7f22740ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:16.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.350+0000 7f227c65e700 1 --2- 172.21.15.125:0/227955189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2274159e70 0x7f22740ccb00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f226c009d90 tx=0x7f226c00b330 comp rx=0 tx=0).stop 2023-10-17T06:08:16.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.350+0000 7f227c65e700 1 -- 172.21.15.125:0/227955189 shutdown_connections 2023-10-17T06:08:16.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.350+0000 7f227c65e700 1 --2- 172.21.15.125:0/227955189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2274159e70 0x7f22740ccb00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:16.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.350+0000 7f227c65e700 1 --2- 172.21.15.125:0/227955189 >> v2:172.21.15.184:3300/0 conn(0x7f22740cdb10 0x7f22740cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:16.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.350+0000 7f227c65e700 1 -- 172.21.15.125:0/227955189 >> 172.21.15.125:0/227955189 conn(0x7f22740ce820 msgr2=0x7f22740cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:16.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.350+0000 7f227c65e700 1 -- 172.21.15.125:0/227955189 shutdown_connections 2023-10-17T06:08:16.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.350+0000 7f227c65e700 1 -- 172.21.15.125:0/227955189 wait complete. 2023-10-17T06:08:16.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.354+0000 7f227c65e700 1 Processor -- start 2023-10-17T06:08:16.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.354+0000 7f227c65e700 1 -- start start 2023-10-17T06:08:16.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.354+0000 7f227c65e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22740cae50 0x7f227406e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:16.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.354+0000 7f227c65e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22740cdb10 0x7f227415c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:16.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.354+0000 7f227c65e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2274159e70 0x7f22740cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:16.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.354+0000 7f227c65e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227406e690 con 0x7f22740cae50 2023-10-17T06:08:16.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.354+0000 7f227c65e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227415c630 con 0x7f2274159e70 2023-10-17T06:08:16.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.354+0000 7f227c65e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227415c8f0 con 0x7f22740cdb10 2023-10-17T06:08:16.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.358+0000 7f227a3fa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22740cae50 0x7f227406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:16.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.358+0000 7f227a3fa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22740cae50 0x7f227406e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48528/0 (socket says 172.21.15.125:48528) 2023-10-17T06:08:16.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.358+0000 7f227a3fa700 1 -- 172.21.15.125:0/493764040 learned_addr learned my addr 172.21.15.125:0/493764040 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:16.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.358+0000 7f2279bf9700 1 --2- 172.21.15.125:0/493764040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22740cdb10 0x7f227415c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:16.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.358+0000 7f227abfb700 1 --2- 172.21.15.125:0/493764040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2274159e70 0x7f22740cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:16.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.358+0000 7f227a3fa700 1 -- 172.21.15.125:0/493764040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22740cdb10 msgr2=0x7f227415c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:16.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.358+0000 7f227a3fa700 1 --2- 172.21.15.125:0/493764040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22740cdb10 0x7f227415c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:16.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.358+0000 7f227a3fa700 1 -- 172.21.15.125:0/493764040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2274159e70 msgr2=0x7f22740cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:16.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.358+0000 7f227a3fa700 1 --2- 172.21.15.125:0/493764040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2274159e70 0x7f22740cc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:16.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.358+0000 7f227a3fa700 1 -- 172.21.15.125:0/493764040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c009a70 con 0x7f22740cae50 2023-10-17T06:08:16.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.358+0000 7f227a3fa700 1 --2- 172.21.15.125:0/493764040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22740cae50 0x7f227406e150 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f227000e760 tx=0x7f227000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:16.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.358+0000 7f226affd700 1 -- 172.21.15.125:0/493764040 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227000c070 con 0x7f22740cae50 2023-10-17T06:08:16.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.358+0000 7f226affd700 1 -- 172.21.15.125:0/493764040 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2270004250 con 0x7f22740cae50 2023-10-17T06:08:16.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.358+0000 7f227c65e700 1 -- 172.21.15.125:0/493764040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227415cbd0 con 0x7f22740cae50 2023-10-17T06:08:16.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.358+0000 7f226affd700 1 -- 172.21.15.125:0/493764040 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22700036c0 con 0x7f22740cae50 2023-10-17T06:08:16.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.358+0000 7f227c65e700 1 -- 172.21.15.125:0/493764040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227415d190 con 0x7f22740cae50 2023-10-17T06:08:16.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.362+0000 7f227c65e700 1 -- 172.21.15.125:0/493764040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2274072e60 con 0x7f22740cae50 2023-10-17T06:08:16.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.362+0000 7f226affd700 1 -- 172.21.15.125:0/493764040 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2270003820 con 0x7f22740cae50 2023-10-17T06:08:16.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.366+0000 7f226affd700 1 --2- 172.21.15.125:0/493764040 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f22580656f0 0x7f2258067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:16.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.366+0000 7f226affd700 1 -- 172.21.15.125:0/493764040 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2270082eb0 con 0x7f22740cae50 2023-10-17T06:08:16.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.366+0000 7f2279bf9700 1 --2- 172.21.15.125:0/493764040 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f22580656f0 0x7f2258067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:16.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.366+0000 7f2279bf9700 1 --2- 172.21.15.125:0/493764040 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f22580656f0 0x7f2258067bb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f22740ad400 tx=0x7f2264007f30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:16.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.370+0000 7f226affd700 1 -- 172.21.15.125:0/493764040 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f22700505a0 con 0x7f22740cae50 2023-10-17T06:08:16.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.618+0000 7f227c65e700 1 -- 172.21.15.125:0/493764040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f22740cdef0 con 0x7f22740cae50 2023-10-17T06:08:16.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.622+0000 7f226affd700 1 -- 172.21.15.125:0/493764040 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f22700094e0 con 0x7f22740cae50 2023-10-17T06:08:16.625 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:16.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.622+0000 7f227c65e700 1 -- 172.21.15.125:0/493764040 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f22580656f0 msgr2=0x7f2258067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:16.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.622+0000 7f227c65e700 1 --2- 172.21.15.125:0/493764040 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f22580656f0 0x7f2258067bb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f22740ad400 tx=0x7f2264007f30 comp rx=0 tx=0).stop 2023-10-17T06:08:16.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.622+0000 7f227c65e700 1 -- 172.21.15.125:0/493764040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22740cae50 msgr2=0x7f227406e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:16.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.622+0000 7f227c65e700 1 --2- 172.21.15.125:0/493764040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22740cae50 0x7f227406e150 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f227000e760 tx=0x7f227000ea70 comp rx=0 tx=0).stop 2023-10-17T06:08:16.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.622+0000 7f227c65e700 1 -- 172.21.15.125:0/493764040 shutdown_connections 2023-10-17T06:08:16.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.622+0000 7f227c65e700 1 --2- 172.21.15.125:0/493764040 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f22580656f0 0x7f2258067bb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:16.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.622+0000 7f227c65e700 1 --2- 172.21.15.125:0/493764040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2274159e70 0x7f22740cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:16.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.622+0000 7f227c65e700 1 --2- 172.21.15.125:0/493764040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22740cdb10 0x7f227415c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:16.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.622+0000 7f227c65e700 1 --2- 172.21.15.125:0/493764040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22740cae50 0x7f227406e150 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:16.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.622+0000 7f227c65e700 1 -- 172.21.15.125:0/493764040 >> 172.21.15.125:0/493764040 conn(0x7f22740ce820 msgr2=0x7f2274070570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:16.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.622+0000 7f227c65e700 1 -- 172.21.15.125:0/493764040 shutdown_connections 2023-10-17T06:08:16.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.622+0000 7f227c65e700 1 -- 172.21.15.125:0/493764040 wait complete. 2023-10-17T06:08:16.651 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-17T06:08:16.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.822+0000 7f3ddd6fa700 1 Processor -- start 2023-10-17T06:08:16.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.822+0000 7f3ddd6fa700 1 -- start start 2023-10-17T06:08:16.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.826+0000 7f3ddd6fa700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3dd815adf0 0x7f3dd80cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:16.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.826+0000 7f3ddd6fa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3dd80cce10 0x7f3dd80b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:16.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.826+0000 7f3ddd6fa700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd815b1d0 con 0x7f3dd80b1e80 2023-10-17T06:08:16.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.826+0000 7f3ddd6fa700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd80ca590 con 0x7f3dd815adf0 2023-10-17T06:08:16.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.826+0000 7f3ddd6fa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80ce600 con 0x7f3dd80cce10 2023-10-17T06:08:16.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.826+0000 7f3dd6ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3dd815adf0 0x7f3dd80cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:16.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.826+0000 7f3dd6ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3dd815adf0 0x7f3dd80cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48530/0 (socket says 172.21.15.125:48530) 2023-10-17T06:08:16.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.826+0000 7f3dd6ffd700 1 -- 172.21.15.125:0/3609537296 learned_addr learned my addr 172.21.15.125:0/3609537296 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:16.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.826+0000 7f3dd67fc700 1 --2- 172.21.15.125:0/3609537296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3dd80cce10 0x7f3dd80b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:16.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.826+0000 7f3dd6ffd700 1 -- 172.21.15.125:0/3609537296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3dd80cce10 msgr2=0x7f3dd80b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:16.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.826+0000 7f3dd6ffd700 1 --2- 172.21.15.125:0/3609537296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3dd80cce10 0x7f3dd80b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:16.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.826+0000 7f3dd6ffd700 1 -- 172.21.15.125:0/3609537296 >> v1:172.21.15.125:6789/0 conn(0x7f3dd80b1e80 legacy=0x7f3dd80b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:16.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.826+0000 7f3dd6ffd700 1 -- 172.21.15.125:0/3609537296 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd80cd580 con 0x7f3dd815adf0 2023-10-17T06:08:16.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.826+0000 7f3dd6ffd700 1 --2- 172.21.15.125:0/3609537296 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dd815adf0 0x7f3dd80cc8d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009e50 tx=0x7f3dc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec34122bec5d8924 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:16.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.830+0000 7f3dd5ffb700 1 -- 172.21.15.125:0/3609537296 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc800e070 con 0x7f3dd815adf0 2023-10-17T06:08:16.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.830+0000 7f3dd5ffb700 1 -- 172.21.15.125:0/3609537296 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc800b9c0 con 0x7f3dd815adf0 2023-10-17T06:08:16.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.830+0000 7f3dd5ffb700 1 -- 172.21.15.125:0/3609537296 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc800bd70 con 0x7f3dd815adf0 2023-10-17T06:08:16.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.830+0000 7f3ddd6fa700 1 -- 172.21.15.125:0/3609537296 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dd815adf0 msgr2=0x7f3dd80cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:16.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.830+0000 7f3ddd6fa700 1 --2- 172.21.15.125:0/3609537296 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dd815adf0 0x7f3dd80cc8d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009e50 tx=0x7f3dc800b330 comp rx=0 tx=0).stop 2023-10-17T06:08:16.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.830+0000 7f3ddd6fa700 1 -- 172.21.15.125:0/3609537296 shutdown_connections 2023-10-17T06:08:16.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.830+0000 7f3ddd6fa700 1 --2- 172.21.15.125:0/3609537296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3dd80cce10 0x7f3dd80b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:16.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.830+0000 7f3ddd6fa700 1 --2- 172.21.15.125:0/3609537296 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dd815adf0 0x7f3dd80cc8d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:16.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.830+0000 7f3ddd6fa700 1 -- 172.21.15.125:0/3609537296 >> 172.21.15.125:0/3609537296 conn(0x7f3dd80ce820 msgr2=0x7f3dd80cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:16.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.830+0000 7f3ddd6fa700 1 -- 172.21.15.125:0/3609537296 shutdown_connections 2023-10-17T06:08:16.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.830+0000 7f3ddd6fa700 1 -- 172.21.15.125:0/3609537296 wait complete. 2023-10-17T06:08:16.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.834+0000 7f3ddd6fa700 1 Processor -- start 2023-10-17T06:08:16.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.834+0000 7f3ddd6fa700 1 -- start start 2023-10-17T06:08:16.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.834+0000 7f3ddd6fa700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dd80b1e80 0x7f3dd8156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:16.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.834+0000 7f3ddd6fa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dd80cce10 0x7f3dd806e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:16.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3ddd6fa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3dd815adf0 0x7f3dd80b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:16.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3ddd6fa700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd81f32b0 con 0x7f3dd80cce10 2023-10-17T06:08:16.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3ddd6fa700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd81f2630 con 0x7f3dd80b1e80 2023-10-17T06:08:16.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3ddd6fa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd81f2910 con 0x7f3dd815adf0 2023-10-17T06:08:16.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3dd67fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dd80cce10 0x7f3dd806e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:16.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3dd67fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dd80cce10 0x7f3dd806e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48538/0 (socket says 172.21.15.125:48538) 2023-10-17T06:08:16.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3dd67fc700 1 -- 172.21.15.125:0/1429519127 learned_addr learned my addr 172.21.15.125:0/1429519127 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:16.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3dd6ffd700 1 --2- 172.21.15.125:0/1429519127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dd80b1e80 0x7f3dd8156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:16.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3dd77fe700 1 --2- 172.21.15.125:0/1429519127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3dd815adf0 0x7f3dd80b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:16.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3dd67fc700 1 -- 172.21.15.125:0/1429519127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3dd815adf0 msgr2=0x7f3dd80b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:16.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3dd67fc700 1 --2- 172.21.15.125:0/1429519127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3dd815adf0 0x7f3dd80b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:16.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3dd67fc700 1 -- 172.21.15.125:0/1429519127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dd80b1e80 msgr2=0x7f3dd8156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:16.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3dd67fc700 1 --2- 172.21.15.125:0/1429519127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dd80b1e80 0x7f3dd8156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:16.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3dd67fc700 1 -- 172.21.15.125:0/1429519127 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc8009b30 con 0x7f3dd80cce10 2023-10-17T06:08:16.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3dd77fe700 1 --2- 172.21.15.125:0/1429519127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3dd815adf0 0x7f3dd80b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:16.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3dd67fc700 1 --2- 172.21.15.125:0/1429519127 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dd80cce10 0x7f3dd806e7f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00e760 tx=0x7f3dcc00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:16.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3dbf7fe700 1 -- 172.21.15.125:0/1429519127 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc013610 con 0x7f3dd80cce10 2023-10-17T06:08:16.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3ddd6fa700 1 -- 172.21.15.125:0/1429519127 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd81f2bf0 con 0x7f3dd80cce10 2023-10-17T06:08:16.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3dbf7fe700 1 -- 172.21.15.125:0/1429519127 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc013770 con 0x7f3dd80cce10 2023-10-17T06:08:16.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3dbf7fe700 1 -- 172.21.15.125:0/1429519127 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc013ae0 con 0x7f3dd80cce10 2023-10-17T06:08:16.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3ddd6fa700 1 -- 172.21.15.125:0/1429519127 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd806cf40 con 0x7f3dd80cce10 2023-10-17T06:08:16.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.838+0000 7f3ddd6fa700 1 -- 172.21.15.125:0/1429519127 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd8072e60 con 0x7f3dd80cce10 2023-10-17T06:08:16.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.842+0000 7f3dbf7fe700 1 -- 172.21.15.125:0/1429519127 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f3dcc013c40 con 0x7f3dd80cce10 2023-10-17T06:08:16.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.842+0000 7f3dbf7fe700 1 --2- 172.21.15.125:0/1429519127 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3dc40656f0 0x7f3dc4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:16.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.842+0000 7f3dbf7fe700 1 -- 172.21.15.125:0/1429519127 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3dcc082de0 con 0x7f3dd80cce10 2023-10-17T06:08:16.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.842+0000 7f3dd6ffd700 1 --2- 172.21.15.125:0/1429519127 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3dc40656f0 0x7f3dc4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:16.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.842+0000 7f3dd6ffd700 1 --2- 172.21.15.125:0/1429519127 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3dc40656f0 0x7f3dc4067bb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800b370 tx=0x7f3dc8009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:16.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:16.850+0000 7f3dbf7fe700 1 -- 172.21.15.125:0/1429519127 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f3dcc053f80 con 0x7f3dd80cce10 2023-10-17T06:08:17.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.034+0000 7f3ddd6fa700 1 -- 172.21.15.125:0/1429519127 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3dd80cb1b0 con 0x7f3dd80cce10 2023-10-17T06:08:17.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.034+0000 7f3dbf7fe700 1 -- 172.21.15.125:0/1429519127 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3dcc053b10 con 0x7f3dd80cce10 2023-10-17T06:08:17.041 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-17T06:08:17.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.038+0000 7f3ddd6fa700 1 -- 172.21.15.125:0/1429519127 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3dc40656f0 msgr2=0x7f3dc4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:17.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.038+0000 7f3ddd6fa700 1 --2- 172.21.15.125:0/1429519127 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3dc40656f0 0x7f3dc4067bb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800b370 tx=0x7f3dc8009000 comp rx=0 tx=0).stop 2023-10-17T06:08:17.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.042+0000 7f3ddd6fa700 1 -- 172.21.15.125:0/1429519127 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dd80cce10 msgr2=0x7f3dd806e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:17.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.042+0000 7f3ddd6fa700 1 --2- 172.21.15.125:0/1429519127 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dd80cce10 0x7f3dd806e7f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00e760 tx=0x7f3dcc00ea70 comp rx=0 tx=0).stop 2023-10-17T06:08:17.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.042+0000 7f3ddd6fa700 1 -- 172.21.15.125:0/1429519127 shutdown_connections 2023-10-17T06:08:17.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.042+0000 7f3ddd6fa700 1 --2- 172.21.15.125:0/1429519127 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3dc40656f0 0x7f3dc4067bb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.042+0000 7f3ddd6fa700 1 --2- 172.21.15.125:0/1429519127 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3dd815adf0 0x7f3dd80b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.042+0000 7f3ddd6fa700 1 --2- 172.21.15.125:0/1429519127 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dd80cce10 0x7f3dd806e7f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.042+0000 7f3ddd6fa700 1 --2- 172.21.15.125:0/1429519127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dd80b1e80 0x7f3dd8156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.042+0000 7f3ddd6fa700 1 -- 172.21.15.125:0/1429519127 >> 172.21.15.125:0/1429519127 conn(0x7f3dd80ce820 msgr2=0x7f3dd8159030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:17.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.042+0000 7f3ddd6fa700 1 -- 172.21.15.125:0/1429519127 shutdown_connections 2023-10-17T06:08:17.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.042+0000 7f3ddd6fa700 1 -- 172.21.15.125:0/1429519127 wait complete. 2023-10-17T06:08:17.072 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-17T06:08:17.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.246+0000 7f057494c700 1 Processor -- start 2023-10-17T06:08:17.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.246+0000 7f057494c700 1 -- start start 2023-10-17T06:08:17.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.246+0000 7f057494c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f05700d2e00 0x7f05700b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:17.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.246+0000 7f057494c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0570160710 0x7f05700d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:17.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.246+0000 7f057494c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f05700b5ae0 0x7f057006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:17.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.246+0000 7f057494c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057015df90 con 0x7f05700b5ae0 2023-10-17T06:08:17.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.246+0000 7f057494c700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057015d0d0 con 0x7f05700d2e00 2023-10-17T06:08:17.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.246+0000 7f057494c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057006f0f0 con 0x7f0570160710 2023-10-17T06:08:17.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.246+0000 7f056ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f05700b5ae0 0x7f057006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:17.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.246+0000 7f056ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f05700b5ae0 0x7f057006db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48544/0 (socket says 172.21.15.125:48544) 2023-10-17T06:08:17.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.246+0000 7f056ffff700 1 -- 172.21.15.125:0/1934046781 learned_addr learned my addr 172.21.15.125:0/1934046781 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:17.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.246+0000 7f056f7fe700 1 --2- 172.21.15.125:0/1934046781 >> v2:172.21.15.184:3300/0 conn(0x7f05700d2e00 0x7f05700b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:17.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.246+0000 7f056effd700 1 --2- 172.21.15.125:0/1934046781 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0570160710 0x7f05700d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:17.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.246+0000 7f056ffff700 1 -- 172.21.15.125:0/1934046781 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0570160710 msgr2=0x7f05700d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:17.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.246+0000 7f056ffff700 1 --2- 172.21.15.125:0/1934046781 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0570160710 0x7f05700d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.246+0000 7f056ffff700 1 -- 172.21.15.125:0/1934046781 >> v2:172.21.15.184:3300/0 conn(0x7f05700d2e00 msgr2=0x7f05700b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:17.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.246+0000 7f056ffff700 1 --2- 172.21.15.125:0/1934046781 >> v2:172.21.15.184:3300/0 conn(0x7f05700d2e00 0x7f05700b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.246+0000 7f056ffff700 1 -- 172.21.15.125:0/1934046781 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05700d3720 con 0x7f05700b5ae0 2023-10-17T06:08:17.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.246+0000 7f056effd700 1 --2- 172.21.15.125:0/1934046781 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0570160710 0x7f05700d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:17.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.246+0000 7f056f7fe700 1 --2- 172.21.15.125:0/1934046781 >> v2:172.21.15.184:3300/0 conn(0x7f05700d2e00 0x7f05700b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:17.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.250+0000 7f056ffff700 1 --2- 172.21.15.125:0/1934046781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05700b5ae0 0x7f057006db60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0568009e50 tx=0x7f056800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83151a3f308a2536 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:17.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.250+0000 7f056e7fc700 1 -- 172.21.15.125:0/1934046781 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056800e070 con 0x7f05700b5ae0 2023-10-17T06:08:17.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.250+0000 7f056e7fc700 1 -- 172.21.15.125:0/1934046781 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056800b980 con 0x7f05700b5ae0 2023-10-17T06:08:17.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.250+0000 7f056e7fc700 1 -- 172.21.15.125:0/1934046781 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056800bd30 con 0x7f05700b5ae0 2023-10-17T06:08:17.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.250+0000 7f057494c700 1 -- 172.21.15.125:0/1934046781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05700b5ae0 msgr2=0x7f057006db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:17.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.250+0000 7f057494c700 1 --2- 172.21.15.125:0/1934046781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05700b5ae0 0x7f057006db60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0568009e50 tx=0x7f056800b330 comp rx=0 tx=0).stop 2023-10-17T06:08:17.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.250+0000 7f057494c700 1 -- 172.21.15.125:0/1934046781 shutdown_connections 2023-10-17T06:08:17.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.250+0000 7f057494c700 1 --2- 172.21.15.125:0/1934046781 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0570160710 0x7f05700d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.250+0000 7f057494c700 1 --2- 172.21.15.125:0/1934046781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05700b5ae0 0x7f057006db60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.250+0000 7f057494c700 1 --2- 172.21.15.125:0/1934046781 >> v2:172.21.15.184:3300/0 conn(0x7f05700d2e00 0x7f05700b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.250+0000 7f057494c700 1 -- 172.21.15.125:0/1934046781 >> 172.21.15.125:0/1934046781 conn(0x7f0570069f20 msgr2=0x7f057006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:17.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.250+0000 7f057494c700 1 -- 172.21.15.125:0/1934046781 shutdown_connections 2023-10-17T06:08:17.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.250+0000 7f057494c700 1 -- 172.21.15.125:0/1934046781 wait complete. 2023-10-17T06:08:17.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.254+0000 7f057494c700 1 Processor -- start 2023-10-17T06:08:17.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.254+0000 7f057494c700 1 -- start start 2023-10-17T06:08:17.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.254+0000 7f057494c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05700b5ae0 0x7f0570156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:17.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.254+0000 7f057494c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05700d2e00 0x7f05700b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:17.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.254+0000 7f057494c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0570160710 0x7f057015a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:17.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.254+0000 7f057494c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05700b36d0 con 0x7f05700b5ae0 2023-10-17T06:08:17.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.254+0000 7f057494c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0570159580 con 0x7f05700d2e00 2023-10-17T06:08:17.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.254+0000 7f057494c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05700b2ac0 con 0x7f0570160710 2023-10-17T06:08:17.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.254+0000 7f056f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05700b5ae0 0x7f0570156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:17.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.254+0000 7f056f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05700b5ae0 0x7f0570156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48558/0 (socket says 172.21.15.125:48558) 2023-10-17T06:08:17.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.254+0000 7f056f7fe700 1 -- 172.21.15.125:0/1640016161 learned_addr learned my addr 172.21.15.125:0/1640016161 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:17.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.254+0000 7f056ffff700 1 --2- 172.21.15.125:0/1640016161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0570160710 0x7f057015a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:17.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.254+0000 7f056effd700 1 --2- 172.21.15.125:0/1640016161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05700d2e00 0x7f05700b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:17.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.254+0000 7f056f7fe700 1 -- 172.21.15.125:0/1640016161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0570160710 msgr2=0x7f057015a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:17.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.254+0000 7f056f7fe700 1 --2- 172.21.15.125:0/1640016161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0570160710 0x7f057015a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.254+0000 7f056f7fe700 1 -- 172.21.15.125:0/1640016161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05700d2e00 msgr2=0x7f05700b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:17.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.254+0000 7f056f7fe700 1 --2- 172.21.15.125:0/1640016161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05700d2e00 0x7f05700b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.254+0000 7f056f7fe700 1 -- 172.21.15.125:0/1640016161 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0568009b30 con 0x7f05700b5ae0 2023-10-17T06:08:17.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.258+0000 7f056f7fe700 1 --2- 172.21.15.125:0/1640016161 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05700b5ae0 0x7f0570156230 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f056000d800 tx=0x7f056000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:17.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.258+0000 7f0557fff700 1 -- 172.21.15.125:0/1640016161 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560004030 con 0x7f05700b5ae0 2023-10-17T06:08:17.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.258+0000 7f0557fff700 1 -- 172.21.15.125:0/1640016161 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0560004190 con 0x7f05700b5ae0 2023-10-17T06:08:17.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.258+0000 7f0557fff700 1 -- 172.21.15.125:0/1640016161 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560004520 con 0x7f05700b5ae0 2023-10-17T06:08:17.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.258+0000 7f057494c700 1 -- 172.21.15.125:0/1640016161 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05700b2da0 con 0x7f05700b5ae0 2023-10-17T06:08:17.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.258+0000 7f057494c700 1 -- 172.21.15.125:0/1640016161 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05700b3360 con 0x7f05700b5ae0 2023-10-17T06:08:17.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.258+0000 7f057494c700 1 -- 172.21.15.125:0/1640016161 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057004e910 con 0x7f05700b5ae0 2023-10-17T06:08:17.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.262+0000 7f0557fff700 1 -- 172.21.15.125:0/1640016161 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f05600036c0 con 0x7f05700b5ae0 2023-10-17T06:08:17.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.262+0000 7f0557fff700 1 --2- 172.21.15.125:0/1640016161 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f055c0656f0 0x7f055c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:17.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.262+0000 7f0557fff700 1 -- 172.21.15.125:0/1640016161 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f05600836b0 con 0x7f05700b5ae0 2023-10-17T06:08:17.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.262+0000 7f056effd700 1 --2- 172.21.15.125:0/1640016161 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f055c0656f0 0x7f055c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:17.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.262+0000 7f056effd700 1 --2- 172.21.15.125:0/1640016161 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f055c0656f0 0x7f055c067bb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0570155580 tx=0x7f0564008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:17.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.266+0000 7f0557fff700 1 -- 172.21.15.125:0/1640016161 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0560050da0 con 0x7f05700b5ae0 2023-10-17T06:08:17.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.442+0000 7f057494c700 1 -- 172.21.15.125:0/1640016161 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f057015dba0 con 0x7f05700b5ae0 2023-10-17T06:08:17.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.442+0000 7f0557fff700 1 -- 172.21.15.125:0/1640016161 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f05600543c0 con 0x7f05700b5ae0 2023-10-17T06:08:17.448 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:17.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.446+0000 7f057494c700 1 -- 172.21.15.125:0/1640016161 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f055c0656f0 msgr2=0x7f055c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:17.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.446+0000 7f057494c700 1 --2- 172.21.15.125:0/1640016161 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f055c0656f0 0x7f055c067bb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0570155580 tx=0x7f0564008040 comp rx=0 tx=0).stop 2023-10-17T06:08:17.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.446+0000 7f057494c700 1 -- 172.21.15.125:0/1640016161 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05700b5ae0 msgr2=0x7f0570156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:17.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.446+0000 7f057494c700 1 --2- 172.21.15.125:0/1640016161 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05700b5ae0 0x7f0570156230 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f056000d800 tx=0x7f056000dbc0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.446+0000 7f057494c700 1 -- 172.21.15.125:0/1640016161 shutdown_connections 2023-10-17T06:08:17.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.446+0000 7f057494c700 1 --2- 172.21.15.125:0/1640016161 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f055c0656f0 0x7f055c067bb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.446+0000 7f057494c700 1 --2- 172.21.15.125:0/1640016161 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0570160710 0x7f057015a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.446+0000 7f057494c700 1 --2- 172.21.15.125:0/1640016161 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05700d2e00 0x7f05700b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.446+0000 7f057494c700 1 --2- 172.21.15.125:0/1640016161 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05700b5ae0 0x7f0570156230 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.446+0000 7f057494c700 1 -- 172.21.15.125:0/1640016161 >> 172.21.15.125:0/1640016161 conn(0x7f0570069f20 msgr2=0x7f0570155a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:17.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.446+0000 7f057494c700 1 -- 172.21.15.125:0/1640016161 shutdown_connections 2023-10-17T06:08:17.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.446+0000 7f057494c700 1 -- 172.21.15.125:0/1640016161 wait complete. 2023-10-17T06:08:17.476 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-17T06:08:17.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.654+0000 7f6ec0741700 1 Processor -- start 2023-10-17T06:08:17.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.654+0000 7f6ec0741700 1 -- start start 2023-10-17T06:08:17.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.658+0000 7f6ec0741700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6eb80b5b80 0x7f6eb815d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:17.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.658+0000 7f6ec0741700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb8146ba0 con 0x7f6eb806f9a0 2023-10-17T06:08:17.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.658+0000 7f6ec0741700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb80d0920 con 0x7f6eb81467c0 2023-10-17T06:08:17.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.658+0000 7f6ec0741700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb80b6160 con 0x7f6eb80b5b80 2023-10-17T06:08:17.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.658+0000 7f6ebecde700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6eb806f9a0 0x7f6eb80d0db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48276/0 (socket says 172.21.15.125:48276) 2023-10-17T06:08:17.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.658+0000 7f6ebecde700 1 -- 172.21.15.125:0/3863240989 learned_addr learned my addr 172.21.15.125:0/3863240989 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:17.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.658+0000 7f6ebdcdc700 1 --2- 172.21.15.125:0/3863240989 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6eb80b5b80 0x7f6eb815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:17.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.658+0000 7f6ebd4db700 1 -- 172.21.15.125:0/3863240989 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040003868 0 0) 0x7f6eb8146ba0 con 0x7f6eb806f9a0 2023-10-17T06:08:17.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.658+0000 7f6ebd4db700 1 -- 172.21.15.125:0/3863240989 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ea40035d0 con 0x7f6eb806f9a0 2023-10-17T06:08:17.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.658+0000 7f6ebd4db700 1 -- 172.21.15.125:0/3863240989 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515269346 0 0) 0x7f6eb80d0920 con 0x7f6eb81467c0 2023-10-17T06:08:17.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.658+0000 7f6ebd4db700 1 -- 172.21.15.125:0/3863240989 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eb8146ba0 con 0x7f6eb81467c0 2023-10-17T06:08:17.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.658+0000 7f6ebdcdc700 1 -- 172.21.15.125:0/3863240989 >> v1:172.21.15.184:6789/0 conn(0x7f6eb81467c0 legacy=0x7f6eb81612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:17.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.658+0000 7f6ebdcdc700 1 -- 172.21.15.125:0/3863240989 >> v1:172.21.15.125:6789/0 conn(0x7f6eb806f9a0 legacy=0x7f6eb80d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:17.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.658+0000 7f6ebdcdc700 1 -- 172.21.15.125:0/3863240989 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb80b6440 con 0x7f6eb80b5b80 2023-10-17T06:08:17.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.658+0000 7f6ebdcdc700 1 --2- 172.21.15.125:0/3863240989 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6eb80b5b80 0x7f6eb815d310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8009880 tx=0x7f6ea8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7090acb192327b84 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:17.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.662+0000 7f6ebd4db700 1 -- 172.21.15.125:0/3863240989 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8011830 con 0x7f6eb80b5b80 2023-10-17T06:08:17.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.662+0000 7f6ebd4db700 1 -- 172.21.15.125:0/3863240989 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea8011990 con 0x7f6eb80b5b80 2023-10-17T06:08:17.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.662+0000 7f6ebd4db700 1 -- 172.21.15.125:0/3863240989 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8011d00 con 0x7f6eb80b5b80 2023-10-17T06:08:17.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.662+0000 7f6ec0741700 1 -- 172.21.15.125:0/3863240989 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6eb80b5b80 msgr2=0x7f6eb815d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:17.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.662+0000 7f6ec0741700 1 --2- 172.21.15.125:0/3863240989 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6eb80b5b80 0x7f6eb815d310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8009880 tx=0x7f6ea8009b90 comp rx=0 tx=0).stop 2023-10-17T06:08:17.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.662+0000 7f6ec0741700 1 -- 172.21.15.125:0/3863240989 shutdown_connections 2023-10-17T06:08:17.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.662+0000 7f6ec0741700 1 --2- 172.21.15.125:0/3863240989 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6eb80b5b80 0x7f6eb815d310 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.662+0000 7f6ec0741700 1 -- 172.21.15.125:0/3863240989 >> 172.21.15.125:0/3863240989 conn(0x7f6eb806a130 msgr2=0x7f6eb806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:17.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.662+0000 7f6ec0741700 1 -- 172.21.15.125:0/3863240989 shutdown_connections 2023-10-17T06:08:17.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.662+0000 7f6ec0741700 1 -- 172.21.15.125:0/3863240989 wait complete. 2023-10-17T06:08:17.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.666+0000 7f6ec0741700 1 Processor -- start 2023-10-17T06:08:17.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.666+0000 7f6ec0741700 1 -- start start 2023-10-17T06:08:17.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.666+0000 7f6ec0741700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6eb806f9a0 0x7f6eb813daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:17.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.666+0000 7f6ec0741700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6eb80b5b80 0x7f6eb815f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:17.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.666+0000 7f6ec0741700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb81467c0 0x7f6eb81f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:17.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.666+0000 7f6ec0741700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb81f38d0 con 0x7f6eb806f9a0 2023-10-17T06:08:17.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.666+0000 7f6ec0741700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8160420 con 0x7f6eb81467c0 2023-10-17T06:08:17.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.666+0000 7f6ec0741700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb815fb80 con 0x7f6eb80b5b80 2023-10-17T06:08:17.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.666+0000 7f6ebe4dd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6eb806f9a0 0x7f6eb813daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:17.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.666+0000 7f6ebe4dd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6eb806f9a0 0x7f6eb813daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48568/0 (socket says 172.21.15.125:48568) 2023-10-17T06:08:17.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.666+0000 7f6ebe4dd700 1 -- 172.21.15.125:0/1930040780 learned_addr learned my addr 172.21.15.125:0/1930040780 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:17.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.666+0000 7f6ebecde700 1 --2- 172.21.15.125:0/1930040780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb81467c0 0x7f6eb81f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:17.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.666+0000 7f6ebdcdc700 1 --2- 172.21.15.125:0/1930040780 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6eb80b5b80 0x7f6eb815f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:17.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.666+0000 7f6ebe4dd700 1 -- 172.21.15.125:0/1930040780 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6eb80b5b80 msgr2=0x7f6eb815f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:17.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.666+0000 7f6ebe4dd700 1 --2- 172.21.15.125:0/1930040780 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6eb80b5b80 0x7f6eb815f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.666+0000 7f6ebe4dd700 1 -- 172.21.15.125:0/1930040780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb81467c0 msgr2=0x7f6eb81f3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:17.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.666+0000 7f6ebe4dd700 1 --2- 172.21.15.125:0/1930040780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb81467c0 0x7f6eb81f3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.666+0000 7f6ebe4dd700 1 -- 172.21.15.125:0/1930040780 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea80094b0 con 0x7f6eb806f9a0 2023-10-17T06:08:17.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.666+0000 7f6ebe4dd700 1 --2- 172.21.15.125:0/1930040780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6eb806f9a0 0x7f6eb813daf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6eb400c530 tx=0x7f6eb400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:17.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.670+0000 7f6eaeffd700 1 -- 172.21.15.125:0/1930040780 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb40052d0 con 0x7f6eb806f9a0 2023-10-17T06:08:17.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.670+0000 7f6eaeffd700 1 -- 172.21.15.125:0/1930040780 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb4005450 con 0x7f6eb806f9a0 2023-10-17T06:08:17.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.670+0000 7f6ec0741700 1 -- 172.21.15.125:0/1930040780 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb815fe60 con 0x7f6eb806f9a0 2023-10-17T06:08:17.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.670+0000 7f6eaeffd700 1 -- 172.21.15.125:0/1930040780 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb40038e0 con 0x7f6eb806f9a0 2023-10-17T06:08:17.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.670+0000 7f6ec0741700 1 -- 172.21.15.125:0/1930040780 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb814c290 con 0x7f6eb806f9a0 2023-10-17T06:08:17.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.670+0000 7f6ec0741700 1 -- 172.21.15.125:0/1930040780 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb8072e60 con 0x7f6eb806f9a0 2023-10-17T06:08:17.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.674+0000 7f6eaeffd700 1 -- 172.21.15.125:0/1930040780 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6eb4003a40 con 0x7f6eb806f9a0 2023-10-17T06:08:17.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.674+0000 7f6eaeffd700 1 --2- 172.21.15.125:0/1930040780 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6e9c0656f0 0x7f6e9c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:17.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.674+0000 7f6eaeffd700 1 -- 172.21.15.125:0/1930040780 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6eb40823a0 con 0x7f6eb806f9a0 2023-10-17T06:08:17.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.674+0000 7f6ebdcdc700 1 --2- 172.21.15.125:0/1930040780 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6e9c0656f0 0x7f6e9c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:17.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.674+0000 7f6ebdcdc700 1 --2- 172.21.15.125:0/1930040780 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6e9c0656f0 0x7f6e9c067bb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6ea80090b0 tx=0x7f6ea8010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:17.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.678+0000 7f6eaeffd700 1 -- 172.21.15.125:0/1930040780 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f6eb404fbc0 con 0x7f6eb806f9a0 2023-10-17T06:08:17.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.866+0000 7f6ec0741700 1 -- 172.21.15.125:0/1930040780 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6eb80b7200 con 0x7f6eb806f9a0 2023-10-17T06:08:17.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.866+0000 7f6eaeffd700 1 -- 172.21.15.125:0/1930040780 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6eb400ce60 con 0x7f6eb806f9a0 2023-10-17T06:08:17.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.870+0000 7f6ec0741700 1 -- 172.21.15.125:0/1930040780 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6e9c0656f0 msgr2=0x7f6e9c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:17.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.870+0000 7f6ec0741700 1 --2- 172.21.15.125:0/1930040780 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6e9c0656f0 0x7f6e9c067bb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6ea80090b0 tx=0x7f6ea8010000 comp rx=0 tx=0).stop 2023-10-17T06:08:17.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.870+0000 7f6ec0741700 1 -- 172.21.15.125:0/1930040780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6eb806f9a0 msgr2=0x7f6eb813daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:17.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.870+0000 7f6ec0741700 1 --2- 172.21.15.125:0/1930040780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6eb806f9a0 0x7f6eb813daf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6eb400c530 tx=0x7f6eb400c840 comp rx=0 tx=0).stop 2023-10-17T06:08:17.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.870+0000 7f6ec0741700 1 -- 172.21.15.125:0/1930040780 shutdown_connections 2023-10-17T06:08:17.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.870+0000 7f6ec0741700 1 --2- 172.21.15.125:0/1930040780 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6e9c0656f0 0x7f6e9c067bb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.870+0000 7f6ec0741700 1 --2- 172.21.15.125:0/1930040780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb81467c0 0x7f6eb81f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.870+0000 7f6ec0741700 1 --2- 172.21.15.125:0/1930040780 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6eb80b5b80 0x7f6eb815f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.870+0000 7f6ec0741700 1 --2- 172.21.15.125:0/1930040780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6eb806f9a0 0x7f6eb813daf0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:17.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.870+0000 7f6ec0741700 1 -- 172.21.15.125:0/1930040780 >> 172.21.15.125:0/1930040780 conn(0x7f6eb806a130 msgr2=0x7f6eb80d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:17.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.870+0000 7f6ec0741700 1 -- 172.21.15.125:0/1930040780 shutdown_connections 2023-10-17T06:08:17.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:17.870+0000 7f6ec0741700 1 -- 172.21.15.125:0/1930040780 wait complete. 2023-10-17T06:08:17.902 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-17T06:08:17.903 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-17T06:08:17.943 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-17T06:08:17.987 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-17T06:08:17.988 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:08:17.988 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:08:18.007 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:08:18.008 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:08:18.067 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:08:18.068 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:08:18.128 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:08:18.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.350+0000 7f6675e82700 1 Processor -- start 2023-10-17T06:08:18.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.350+0000 7f6675e82700 1 -- start start 2023-10-17T06:08:18.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.354+0000 7f6675e82700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f667006e8a0 0x7f66700cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:18.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.354+0000 7f6675e82700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667015e130 con 0x7f6670154040 2023-10-17T06:08:18.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.354+0000 7f6675e82700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66700ce1b0 con 0x7f66700cb6d0 2023-10-17T06:08:18.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.354+0000 7f6675e82700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66700cbb60 con 0x7f667006e8a0 2023-10-17T06:08:18.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.354+0000 7f666f7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6670154040 0x7f66700cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48278/0 (socket says 172.21.15.125:48278) 2023-10-17T06:08:18.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.354+0000 7f666f7fe700 1 -- 172.21.15.125:0/3732462974 learned_addr learned my addr 172.21.15.125:0/3732462974 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:18.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.354+0000 7f6666ffd700 1 --2- 172.21.15.125:0/3732462974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f667006e8a0 0x7f66700cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:18.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.354+0000 7f666effd700 1 -- 172.21.15.125:0/3732462974 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129565178 0 0) 0x7f667015e130 con 0x7f6670154040 2023-10-17T06:08:18.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.354+0000 7f666effd700 1 -- 172.21.15.125:0/3732462974 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f665c0035d0 con 0x7f6670154040 2023-10-17T06:08:18.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.354+0000 7f6666ffd700 1 -- 172.21.15.125:0/3732462974 >> v1:172.21.15.184:6789/0 conn(0x7f66700cb6d0 legacy=0x7f667006f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:18.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.354+0000 7f6666ffd700 1 -- 172.21.15.125:0/3732462974 >> v1:172.21.15.125:6789/0 conn(0x7f6670154040 legacy=0x7f66700cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:18.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.354+0000 7f6666ffd700 1 -- 172.21.15.125:0/3732462974 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66700ce490 con 0x7f667006e8a0 2023-10-17T06:08:18.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.354+0000 7f6666ffd700 1 --2- 172.21.15.125:0/3732462974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f667006e8a0 0x7f66700cb190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6658009880 tx=0x7f6658009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=686d5f07a7400207 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:18.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.354+0000 7f666effd700 1 -- 172.21.15.125:0/3732462974 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6658011830 con 0x7f667006e8a0 2023-10-17T06:08:18.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.354+0000 7f666effd700 1 -- 172.21.15.125:0/3732462974 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6658011990 con 0x7f667006e8a0 2023-10-17T06:08:18.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.354+0000 7f666effd700 1 -- 172.21.15.125:0/3732462974 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6658011d20 con 0x7f667006e8a0 2023-10-17T06:08:18.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.358+0000 7f6675e82700 1 -- 172.21.15.125:0/3732462974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f667006e8a0 msgr2=0x7f66700cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:18.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.358+0000 7f6675e82700 1 --2- 172.21.15.125:0/3732462974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f667006e8a0 0x7f66700cb190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6658009880 tx=0x7f6658009b90 comp rx=0 tx=0).stop 2023-10-17T06:08:18.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.358+0000 7f6675e82700 1 -- 172.21.15.125:0/3732462974 shutdown_connections 2023-10-17T06:08:18.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.358+0000 7f6675e82700 1 --2- 172.21.15.125:0/3732462974 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f667006e8a0 0x7f66700cb190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:18.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.358+0000 7f6675e82700 1 -- 172.21.15.125:0/3732462974 >> 172.21.15.125:0/3732462974 conn(0x7f667006a340 msgr2=0x7f66700b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:18.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.358+0000 7f6675e82700 1 -- 172.21.15.125:0/3732462974 shutdown_connections 2023-10-17T06:08:18.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.358+0000 7f6675e82700 1 -- 172.21.15.125:0/3732462974 wait complete. 2023-10-17T06:08:18.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.362+0000 7f6675e82700 1 Processor -- start 2023-10-17T06:08:18.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.362+0000 7f6675e82700 1 -- start start 2023-10-17T06:08:18.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.362+0000 7f6675e82700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f667006e8a0 0x7f66701510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:18.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.362+0000 7f6675e82700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66700cb6d0 0x7f66701f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:18.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.362+0000 7f6675e82700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6670154040 0x7f6670154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:18.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.362+0000 7f6675e82700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66701f2780 con 0x7f6670154040 2023-10-17T06:08:18.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.362+0000 7f6675e82700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66701557a0 con 0x7f66700cb6d0 2023-10-17T06:08:18.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.362+0000 7f6675e82700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66700ab980 con 0x7f667006e8a0 2023-10-17T06:08:18.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.362+0000 7f666ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6670154040 0x7f6670154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:18.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.362+0000 7f666ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6670154040 0x7f6670154e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48576/0 (socket says 172.21.15.125:48576) 2023-10-17T06:08:18.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.362+0000 7f666ffff700 1 -- 172.21.15.125:0/2159207518 learned_addr learned my addr 172.21.15.125:0/2159207518 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:18.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.362+0000 7f6666ffd700 1 --2- 172.21.15.125:0/2159207518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66700cb6d0 0x7f66701f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:18.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.362+0000 7f666f7fe700 1 --2- 172.21.15.125:0/2159207518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f667006e8a0 0x7f66701510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:18.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.362+0000 7f666ffff700 1 -- 172.21.15.125:0/2159207518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f667006e8a0 msgr2=0x7f66701510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:18.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.362+0000 7f666ffff700 1 --2- 172.21.15.125:0/2159207518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f667006e8a0 0x7f66701510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:18.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.362+0000 7f666ffff700 1 -- 172.21.15.125:0/2159207518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66700cb6d0 msgr2=0x7f66701f2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:18.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.362+0000 7f666ffff700 1 --2- 172.21.15.125:0/2159207518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66700cb6d0 0x7f66701f2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:18.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.362+0000 7f666ffff700 1 -- 172.21.15.125:0/2159207518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66580094b0 con 0x7f6670154040 2023-10-17T06:08:18.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.362+0000 7f666f7fe700 1 --2- 172.21.15.125:0/2159207518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f667006e8a0 0x7f66701510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:18.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.366+0000 7f666ffff700 1 --2- 172.21.15.125:0/2159207518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6670154040 0x7f6670154e30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f666800cc50 tx=0x7f666800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:18.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.366+0000 7f666cff9700 1 -- 172.21.15.125:0/2159207518 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668003c20 con 0x7f6670154040 2023-10-17T06:08:18.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.366+0000 7f666cff9700 1 -- 172.21.15.125:0/2159207518 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6668003d80 con 0x7f6670154040 2023-10-17T06:08:18.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.366+0000 7f666cff9700 1 -- 172.21.15.125:0/2159207518 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666800ab60 con 0x7f6670154040 2023-10-17T06:08:18.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.366+0000 7f6675e82700 1 -- 172.21.15.125:0/2159207518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66700abc60 con 0x7f6670154040 2023-10-17T06:08:18.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.366+0000 7f6675e82700 1 -- 172.21.15.125:0/2159207518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66700ac220 con 0x7f6670154040 2023-10-17T06:08:18.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.366+0000 7f6675e82700 1 -- 172.21.15.125:0/2159207518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6670072e60 con 0x7f6670154040 2023-10-17T06:08:18.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.370+0000 7f666cff9700 1 -- 172.21.15.125:0/2159207518 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f666800acc0 con 0x7f6670154040 2023-10-17T06:08:18.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.370+0000 7f666cff9700 1 --2- 172.21.15.125:0/2159207518 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f66500656f0 0x7f6650067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:18.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.370+0000 7f666cff9700 1 -- 172.21.15.125:0/2159207518 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6668083200 con 0x7f6670154040 2023-10-17T06:08:18.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.370+0000 7f666f7fe700 1 --2- 172.21.15.125:0/2159207518 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f66500656f0 0x7f6650067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:18.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.374+0000 7f666f7fe700 1 --2- 172.21.15.125:0/2159207518 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f66500656f0 0x7f6650067bb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f66600011e0 tx=0x7f6660009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:18.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.378+0000 7f666cff9700 1 -- 172.21.15.125:0/2159207518 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f66680509a0 con 0x7f6670154040 2023-10-17T06:08:18.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.558+0000 7f6675e82700 1 -- 172.21.15.125:0/2159207518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66700b1160 con 0x7f6670154040 2023-10-17T06:08:18.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.562+0000 7f666cff9700 1 -- 172.21.15.125:0/2159207518 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20252 (secure 0 0 0) 0x7f6668053fc0 con 0x7f6670154040 2023-10-17T06:08:18.566 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:18.567 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":30,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:49.710984+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:08:18.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.562+0000 7f6675e82700 1 -- 172.21.15.125:0/2159207518 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f66500656f0 msgr2=0x7f6650067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:18.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.562+0000 7f6675e82700 1 --2- 172.21.15.125:0/2159207518 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f66500656f0 0x7f6650067bb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f66600011e0 tx=0x7f6660009040 comp rx=0 tx=0).stop 2023-10-17T06:08:18.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.562+0000 7f6675e82700 1 -- 172.21.15.125:0/2159207518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6670154040 msgr2=0x7f6670154e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:18.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.562+0000 7f6675e82700 1 --2- 172.21.15.125:0/2159207518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6670154040 0x7f6670154e30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f666800cc50 tx=0x7f666800cf60 comp rx=0 tx=0).stop 2023-10-17T06:08:18.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.566+0000 7f6675e82700 1 -- 172.21.15.125:0/2159207518 shutdown_connections 2023-10-17T06:08:18.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.566+0000 7f6675e82700 1 --2- 172.21.15.125:0/2159207518 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f66500656f0 0x7f6650067bb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:18.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.566+0000 7f6675e82700 1 --2- 172.21.15.125:0/2159207518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6670154040 0x7f6670154e30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:18.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.566+0000 7f6675e82700 1 --2- 172.21.15.125:0/2159207518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66700cb6d0 0x7f66701f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:18.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.566+0000 7f6675e82700 1 --2- 172.21.15.125:0/2159207518 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f667006e8a0 0x7f66701510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:18.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.566+0000 7f6675e82700 1 -- 172.21.15.125:0/2159207518 >> 172.21.15.125:0/2159207518 conn(0x7f667006a340 msgr2=0x7f667015ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:18.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.566+0000 7f6675e82700 1 -- 172.21.15.125:0/2159207518 shutdown_connections 2023-10-17T06:08:18.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.566+0000 7f6675e82700 1 -- 172.21.15.125:0/2159207518 wait complete. 2023-10-17T06:08:18.593 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-17T06:07:06.629169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-17T06:07:08.148117+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-17T06:07:11.895112+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-17T06:08:18.594 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:08:18.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.766+0000 7f8e28adf700 1 Processor -- start 2023-10-17T06:08:18.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.770+0000 7f8e28adf700 1 -- start start 2023-10-17T06:08:18.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.770+0000 7f8e28adf700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8e2406d470 0x7f8e24070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:18.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.770+0000 7f8e28adf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2415e990 con 0x7f8e24070f50 2023-10-17T06:08:18.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.770+0000 7f8e28adf700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2415ec50 con 0x7f8e2406d090 2023-10-17T06:08:18.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.770+0000 7f8e28adf700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2415f4f0 con 0x7f8e2406d470 2023-10-17T06:08:18.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.770+0000 7f8e23fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8e24070f50 0x7f8e2415a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48294/0 (socket says 172.21.15.125:48294) 2023-10-17T06:08:18.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.770+0000 7f8e23fff700 1 -- 172.21.15.125:0/2072137321 learned_addr learned my addr 172.21.15.125:0/2072137321 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:18.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.770+0000 7f8e1affd700 1 --2- 172.21.15.125:0/2072137321 >> v2:172.21.15.184:3300/0 conn(0x7f8e2406d470 0x7f8e24070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:18.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e22ffd700 1 -- 172.21.15.125:0/2072137321 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113392481 0 0) 0x7f8e2415e990 con 0x7f8e24070f50 2023-10-17T06:08:18.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e22ffd700 1 -- 172.21.15.125:0/2072137321 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e100035d0 con 0x7f8e24070f50 2023-10-17T06:08:18.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e22ffd700 1 -- 172.21.15.125:0/2072137321 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972970050 0 0) 0x7f8e2415ec50 con 0x7f8e2406d090 2023-10-17T06:08:18.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e22ffd700 1 -- 172.21.15.125:0/2072137321 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e2415e990 con 0x7f8e2406d090 2023-10-17T06:08:18.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e22ffd700 1 -- 172.21.15.125:0/2072137321 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2661723010 0 0) 0x7f8e100035d0 con 0x7f8e24070f50 2023-10-17T06:08:18.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e22ffd700 1 -- 172.21.15.125:0/2072137321 >> v2:172.21.15.184:3300/0 conn(0x7f8e2406d470 msgr2=0x7f8e24070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:18.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e22ffd700 1 --2- 172.21.15.125:0/2072137321 >> v2:172.21.15.184:3300/0 conn(0x7f8e2406d470 0x7f8e24070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:18.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e22ffd700 1 -- 172.21.15.125:0/2072137321 >> v1:172.21.15.184:6789/0 conn(0x7f8e2406d090 legacy=0x7f8e240b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:18.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e22ffd700 1 -- 172.21.15.125:0/2072137321 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2415ef30 con 0x7f8e24070f50 2023-10-17T06:08:18.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e22ffd700 1 -- 172.21.15.125:0/2072137321 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7f8e1c0019f0 con 0x7f8e24070f50 2023-10-17T06:08:18.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e22ffd700 1 -- 172.21.15.125:0/2072137321 >> v1:172.21.15.125:6789/0 conn(0x7f8e24070f50 legacy=0x7f8e2415a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:18.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e22ffd700 1 --2- 172.21.15.125:0/2072137321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e10003c20 0x7f8e10004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:18.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e22ffd700 1 --2- 172.21.15.125:0/2072137321 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e10004870 0x7f8e10004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:18.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e22ffd700 1 --2- 172.21.15.125:0/2072137321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e10005280 0x7f8e1000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:18.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e22ffd700 1 -- 172.21.15.125:0/2072137321 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2415f4f0 con 0x7f8e10003c20 2023-10-17T06:08:18.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e22ffd700 1 -- 172.21.15.125:0/2072137321 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1000c1d0 con 0x7f8e10005280 2023-10-17T06:08:18.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e22ffd700 1 -- 172.21.15.125:0/2072137321 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1000c390 con 0x7f8e10004870 2023-10-17T06:08:18.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e237fe700 1 --2- 172.21.15.125:0/2072137321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e10003c20 0x7f8e10004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:18.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e23fff700 1 --2- 172.21.15.125:0/2072137321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e10005280 0x7f8e1000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:18.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e1affd700 1 --2- 172.21.15.125:0/2072137321 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e10004870 0x7f8e10004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:18.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e237fe700 1 -- 172.21.15.125:0/2072137321 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e10004870 msgr2=0x7f8e10004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:18.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e237fe700 1 --2- 172.21.15.125:0/2072137321 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e10004870 0x7f8e10004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:18.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e237fe700 1 -- 172.21.15.125:0/2072137321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e10005280 msgr2=0x7f8e1000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:18.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e237fe700 1 --2- 172.21.15.125:0/2072137321 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e10005280 0x7f8e1000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:18.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e23fff700 1 -- 172.21.15.125:0/2072137321 reap_dead start 2023-10-17T06:08:18.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e237fe700 1 -- 172.21.15.125:0/2072137321 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e100035d0 con 0x7f8e10003c20 2023-10-17T06:08:18.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e237fe700 1 --2- 172.21.15.125:0/2072137321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e10003c20 0x7f8e10004020 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8e14007fd0 tx=0x7f8e100058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b6e7a4df68bc9f server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:18.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e22ffd700 1 -- 172.21.15.125:0/2072137321 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e14001450 con 0x7f8e10003c20 2023-10-17T06:08:18.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e22ffd700 1 -- 172.21.15.125:0/2072137321 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e14006aa0 con 0x7f8e10003c20 2023-10-17T06:08:18.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.774+0000 7f8e22ffd700 1 -- 172.21.15.125:0/2072137321 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e14006e50 con 0x7f8e10003c20 2023-10-17T06:08:18.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.778+0000 7f8e28adf700 1 -- 172.21.15.125:0/2072137321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e10003c20 msgr2=0x7f8e10004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:18.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.778+0000 7f8e28adf700 1 --2- 172.21.15.125:0/2072137321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e10003c20 0x7f8e10004020 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8e14007fd0 tx=0x7f8e100058a0 comp rx=0 tx=0).stop 2023-10-17T06:08:18.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.778+0000 7f8e28adf700 1 -- 172.21.15.125:0/2072137321 shutdown_connections 2023-10-17T06:08:18.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.778+0000 7f8e28adf700 1 --2- 172.21.15.125:0/2072137321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e10003c20 0x7f8e10004020 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:18.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.778+0000 7f8e28adf700 1 -- 172.21.15.125:0/2072137321 >> 172.21.15.125:0/2072137321 conn(0x7f8e240ce5c0 msgr2=0x7f8e240ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:18.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.778+0000 7f8e28adf700 1 -- 172.21.15.125:0/2072137321 shutdown_connections 2023-10-17T06:08:18.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.778+0000 7f8e28adf700 1 -- 172.21.15.125:0/2072137321 wait complete. 2023-10-17T06:08:18.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.782+0000 7f8e28adf700 1 Processor -- start 2023-10-17T06:08:18.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.782+0000 7f8e28adf700 1 -- start start 2023-10-17T06:08:18.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.782+0000 7f8e28adf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e10003c20 0x7f8e24150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:18.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.782+0000 7f8e28adf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e240c60a0 0x7f8e240c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:18.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.782+0000 7f8e28adf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e240c7d50 0x7f8e2415cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:18.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.782+0000 7f8e28adf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e240c7140 con 0x7f8e240c7d50 2023-10-17T06:08:18.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.782+0000 7f8e28adf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e24150f40 con 0x7f8e10003c20 2023-10-17T06:08:18.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.782+0000 7f8e28adf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e240c6530 con 0x7f8e240c60a0 2023-10-17T06:08:18.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.782+0000 7f8e23fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e240c7d50 0x7f8e2415cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:18.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.782+0000 7f8e23fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e240c7d50 0x7f8e2415cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48594/0 (socket says 172.21.15.125:48594) 2023-10-17T06:08:18.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.782+0000 7f8e23fff700 1 -- 172.21.15.125:0/1096300653 learned_addr learned my addr 172.21.15.125:0/1096300653 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:18.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.782+0000 7f8e237fe700 1 --2- 172.21.15.125:0/1096300653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e10003c20 0x7f8e24150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:18.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.782+0000 7f8e1affd700 1 --2- 172.21.15.125:0/1096300653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e240c60a0 0x7f8e240c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:18.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.782+0000 7f8e23fff700 1 -- 172.21.15.125:0/1096300653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e240c60a0 msgr2=0x7f8e240c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:18.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.782+0000 7f8e23fff700 1 --2- 172.21.15.125:0/1096300653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e240c60a0 0x7f8e240c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:18.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.782+0000 7f8e23fff700 1 -- 172.21.15.125:0/1096300653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e10003c20 msgr2=0x7f8e24150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:18.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.782+0000 7f8e23fff700 1 --2- 172.21.15.125:0/1096300653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e10003c20 0x7f8e24150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:18.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.782+0000 7f8e23fff700 1 -- 172.21.15.125:0/1096300653 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e240c6810 con 0x7f8e240c7d50 2023-10-17T06:08:18.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.786+0000 7f8e23fff700 1 --2- 172.21.15.125:0/1096300653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e240c7d50 0x7f8e2415cf90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c001330 tx=0x7f8e1c007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:18.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.786+0000 7f8e20ff9700 1 -- 172.21.15.125:0/1096300653 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c007ba0 con 0x7f8e240c7d50 2023-10-17T06:08:18.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.786+0000 7f8e20ff9700 1 -- 172.21.15.125:0/1096300653 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1c00a8c0 con 0x7f8e240c7d50 2023-10-17T06:08:18.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.786+0000 7f8e20ff9700 1 -- 172.21.15.125:0/1096300653 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c00ac70 con 0x7f8e240c7d50 2023-10-17T06:08:18.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.786+0000 7f8e28adf700 1 -- 172.21.15.125:0/1096300653 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e240c6af0 con 0x7f8e240c7d50 2023-10-17T06:08:18.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.786+0000 7f8e28adf700 1 -- 172.21.15.125:0/1096300653 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2415d4d0 con 0x7f8e240c7d50 2023-10-17T06:08:18.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.786+0000 7f8e28adf700 1 -- 172.21.15.125:0/1096300653 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2415b2c0 con 0x7f8e240c7d50 2023-10-17T06:08:18.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.790+0000 7f8e20ff9700 1 -- 172.21.15.125:0/1096300653 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8e1c01e460 con 0x7f8e240c7d50 2023-10-17T06:08:18.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.790+0000 7f8e20ff9700 1 --2- 172.21.15.125:0/1096300653 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8e040656f0 0x7f8e04067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:18.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.790+0000 7f8e20ff9700 1 -- 172.21.15.125:0/1096300653 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8e1c0834e0 con 0x7f8e240c7d50 2023-10-17T06:08:18.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.790+0000 7f8e237fe700 1 --2- 172.21.15.125:0/1096300653 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8e040656f0 0x7f8e04067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:18.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.794+0000 7f8e237fe700 1 --2- 172.21.15.125:0/1096300653 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8e040656f0 0x7f8e04067bb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8e14015040 tx=0x7f8e14005040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:18.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.798+0000 7f8e20ff9700 1 -- 172.21.15.125:0/1096300653 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f8e2415b2c0 con 0x7f8e240c7d50 2023-10-17T06:08:18.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.982+0000 7f8e28adf700 1 -- 172.21.15.125:0/1096300653 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8e2415b2c0 con 0x7f8e240c7d50 2023-10-17T06:08:18.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.986+0000 7f8e20ff9700 1 -- 172.21.15.125:0/1096300653 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8e2415b2c0 con 0x7f8e240c7d50 2023-10-17T06:08:18.989 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:08:18.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.986+0000 7f8e28adf700 1 -- 172.21.15.125:0/1096300653 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8e040656f0 msgr2=0x7f8e04067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:18.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.986+0000 7f8e28adf700 1 --2- 172.21.15.125:0/1096300653 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8e040656f0 0x7f8e04067bb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8e14015040 tx=0x7f8e14005040 comp rx=0 tx=0).stop 2023-10-17T06:08:18.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.986+0000 7f8e28adf700 1 -- 172.21.15.125:0/1096300653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e240c7d50 msgr2=0x7f8e2415cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:18.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.986+0000 7f8e28adf700 1 --2- 172.21.15.125:0/1096300653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e240c7d50 0x7f8e2415cf90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c001330 tx=0x7f8e1c007a20 comp rx=0 tx=0).stop 2023-10-17T06:08:18.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.986+0000 7f8e28adf700 1 -- 172.21.15.125:0/1096300653 shutdown_connections 2023-10-17T06:08:18.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.986+0000 7f8e28adf700 1 --2- 172.21.15.125:0/1096300653 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8e040656f0 0x7f8e04067bb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:18.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.986+0000 7f8e28adf700 1 --2- 172.21.15.125:0/1096300653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8e240c7d50 0x7f8e2415cf90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:18.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.986+0000 7f8e28adf700 1 --2- 172.21.15.125:0/1096300653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e240c60a0 0x7f8e240c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:18.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.986+0000 7f8e28adf700 1 --2- 172.21.15.125:0/1096300653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e10003c20 0x7f8e24150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:18.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.986+0000 7f8e28adf700 1 -- 172.21.15.125:0/1096300653 >> 172.21.15.125:0/1096300653 conn(0x7f8e240ce5c0 msgr2=0x7f8e24156310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:18.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.986+0000 7f8e28adf700 1 -- 172.21.15.125:0/1096300653 shutdown_connections 2023-10-17T06:08:18.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:18.986+0000 7f8e28adf700 1 -- 172.21.15.125:0/1096300653 wait complete. 2023-10-17T06:08:19.012 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:08:19.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.186+0000 7f7c8ff13700 1 Processor -- start 2023-10-17T06:08:19.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.186+0000 7f7c8ff13700 1 -- start start 2023-10-17T06:08:19.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.186+0000 7f7c8ff13700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7c880c1e30 0x7f7c8806f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:19.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.186+0000 7f7c8ff13700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7c880cad50 0x7f7c8806e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:19.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.186+0000 7f7c8ff13700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c880cc3f0 con 0x7f7c8806ea50 2023-10-17T06:08:19.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.186+0000 7f7c8ff13700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c880c2210 con 0x7f7c880c1e30 2023-10-17T06:08:19.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.186+0000 7f7c8ff13700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8806d820 con 0x7f7c880cad50 2023-10-17T06:08:19.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8dcaf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7c880c1e30 0x7f7c8806f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:19.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8dcaf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7c880c1e30 0x7f7c8806f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48606/0 (socket says 172.21.15.125:48606) 2023-10-17T06:08:19.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8dcaf700 1 -- 172.21.15.125:0/2354615006 learned_addr learned my addr 172.21.15.125:0/2354615006 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:19.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8d4ae700 1 --2- 172.21.15.125:0/2354615006 >> v2:172.21.15.184:3300/0 conn(0x7f7c880cad50 0x7f7c8806e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:19.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8dcaf700 1 -- 172.21.15.125:0/2354615006 >> v2:172.21.15.184:3300/0 conn(0x7f7c880cad50 msgr2=0x7f7c8806e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:19.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8dcaf700 1 --2- 172.21.15.125:0/2354615006 >> v2:172.21.15.184:3300/0 conn(0x7f7c880cad50 0x7f7c8806e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:19.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8dcaf700 1 -- 172.21.15.125:0/2354615006 >> v1:172.21.15.125:6789/0 conn(0x7f7c8806ea50 legacy=0x7f7c88164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:19.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8dcaf700 1 -- 172.21.15.125:0/2354615006 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8806e080 con 0x7f7c880c1e30 2023-10-17T06:08:19.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8d4ae700 1 --2- 172.21.15.125:0/2354615006 >> v2:172.21.15.184:3300/0 conn(0x7f7c880cad50 0x7f7c8806e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:19.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8dcaf700 1 --2- 172.21.15.125:0/2354615006 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c880c1e30 0x7f7c8806f450 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7c880cf920 tx=0x7f7c84009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad30295fb5554c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:19.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8ccad700 1 -- 172.21.15.125:0/2354615006 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8400b8a0 con 0x7f7c880c1e30 2023-10-17T06:08:19.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8ccad700 1 -- 172.21.15.125:0/2354615006 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8400ba00 con 0x7f7c880c1e30 2023-10-17T06:08:19.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8ccad700 1 -- 172.21.15.125:0/2354615006 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8400bd90 con 0x7f7c880c1e30 2023-10-17T06:08:19.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8ff13700 1 -- 172.21.15.125:0/2354615006 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c880c1e30 msgr2=0x7f7c8806f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:19.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8ff13700 1 --2- 172.21.15.125:0/2354615006 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c880c1e30 0x7f7c8806f450 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7c880cf920 tx=0x7f7c84009bf0 comp rx=0 tx=0).stop 2023-10-17T06:08:19.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8ff13700 1 -- 172.21.15.125:0/2354615006 shutdown_connections 2023-10-17T06:08:19.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8ff13700 1 --2- 172.21.15.125:0/2354615006 >> v2:172.21.15.184:3300/0 conn(0x7f7c880cad50 0x7f7c8806e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:19.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8ff13700 1 --2- 172.21.15.125:0/2354615006 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c880c1e30 0x7f7c8806f450 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:19.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8ff13700 1 -- 172.21.15.125:0/2354615006 >> 172.21.15.125:0/2354615006 conn(0x7f7c880ce820 msgr2=0x7f7c880cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:19.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8ff13700 1 -- 172.21.15.125:0/2354615006 shutdown_connections 2023-10-17T06:08:19.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.190+0000 7f7c8ff13700 1 -- 172.21.15.125:0/2354615006 wait complete. 2023-10-17T06:08:19.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.194+0000 7f7c8ff13700 1 Processor -- start 2023-10-17T06:08:19.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.194+0000 7f7c8ff13700 1 -- start start 2023-10-17T06:08:19.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.194+0000 7f7c8ff13700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c8806ea50 0x7f7c880c3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:19.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.194+0000 7f7c8ff13700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c880c1e30 0x7f7c8815a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:19.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.194+0000 7f7c8ff13700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c880cad50 0x7f7c880b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:19.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.194+0000 7f7c8ff13700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c880c2d60 con 0x7f7c880cad50 2023-10-17T06:08:19.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.194+0000 7f7c8ff13700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c880c32e0 con 0x7f7c8806ea50 2023-10-17T06:08:19.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.194+0000 7f7c8ff13700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c880c3cb0 con 0x7f7c880c1e30 2023-10-17T06:08:19.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.198+0000 7f7c8e4b0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c880cad50 0x7f7c880b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:19.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.198+0000 7f7c8e4b0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c880cad50 0x7f7c880b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48610/0 (socket says 172.21.15.125:48610) 2023-10-17T06:08:19.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.198+0000 7f7c8e4b0700 1 -- 172.21.15.125:0/1594891986 learned_addr learned my addr 172.21.15.125:0/1594891986 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:19.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.198+0000 7f7c8dcaf700 1 --2- 172.21.15.125:0/1594891986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c8806ea50 0x7f7c880c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:19.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.198+0000 7f7c8d4ae700 1 --2- 172.21.15.125:0/1594891986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c880c1e30 0x7f7c8815a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:19.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.198+0000 7f7c8e4b0700 1 -- 172.21.15.125:0/1594891986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c880c1e30 msgr2=0x7f7c8815a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:19.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.198+0000 7f7c8e4b0700 1 --2- 172.21.15.125:0/1594891986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c880c1e30 0x7f7c8815a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:19.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.198+0000 7f7c8e4b0700 1 -- 172.21.15.125:0/1594891986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c8806ea50 msgr2=0x7f7c880c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:19.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.198+0000 7f7c8e4b0700 1 --2- 172.21.15.125:0/1594891986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c8806ea50 0x7f7c880c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:19.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.198+0000 7f7c8e4b0700 1 -- 172.21.15.125:0/1594891986 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c84009570 con 0x7f7c880cad50 2023-10-17T06:08:19.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.198+0000 7f7c8e4b0700 1 --2- 172.21.15.125:0/1594891986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c880cad50 0x7f7c880b3530 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000cc50 tx=0x7f7c8000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:19.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.198+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/1594891986 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c80003c20 con 0x7f7c880cad50 2023-10-17T06:08:19.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.198+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/1594891986 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c80003d80 con 0x7f7c880cad50 2023-10-17T06:08:19.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.198+0000 7f7c8ff13700 1 -- 172.21.15.125:0/1594891986 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c8815aa20 con 0x7f7c880cad50 2023-10-17T06:08:19.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.198+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/1594891986 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8000aab0 con 0x7f7c880cad50 2023-10-17T06:08:19.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.198+0000 7f7c8ff13700 1 -- 172.21.15.125:0/1594891986 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c880c50c0 con 0x7f7c880cad50 2023-10-17T06:08:19.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.198+0000 7f7c8ff13700 1 -- 172.21.15.125:0/1594891986 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c880c3470 con 0x7f7c880cad50 2023-10-17T06:08:19.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.202+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/1594891986 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7c8000ac10 con 0x7f7c880cad50 2023-10-17T06:08:19.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.202+0000 7f7c7e7fc700 1 --2- 172.21.15.125:0/1594891986 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7c6c065720 0x7f7c6c067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:19.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.202+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/1594891986 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7c80083190 con 0x7f7c880cad50 2023-10-17T06:08:19.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.202+0000 7f7c8dcaf700 1 --2- 172.21.15.125:0/1594891986 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7c6c065720 0x7f7c6c067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:19.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.206+0000 7f7c8dcaf700 1 --2- 172.21.15.125:0/1594891986 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7c6c065720 0x7f7c6c067be0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7c84000c00 tx=0x7f7c84008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:19.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.210+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/1594891986 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f7c80050880 con 0x7f7c880cad50 2023-10-17T06:08:19.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.382+0000 7f7c8ff13700 1 -- 172.21.15.125:0/1594891986 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7c880c52b0 con 0x7f7c880cad50 2023-10-17T06:08:19.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.386+0000 7f7c7e7fc700 1 -- 172.21.15.125:0/1594891986 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7c880c52b0 con 0x7f7c880cad50 2023-10-17T06:08:19.389 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:08:19.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.386+0000 7f7c8ff13700 1 -- 172.21.15.125:0/1594891986 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7c6c065720 msgr2=0x7f7c6c067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:19.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.386+0000 7f7c8ff13700 1 --2- 172.21.15.125:0/1594891986 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7c6c065720 0x7f7c6c067be0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7c84000c00 tx=0x7f7c84008030 comp rx=0 tx=0).stop 2023-10-17T06:08:19.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.386+0000 7f7c8ff13700 1 -- 172.21.15.125:0/1594891986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c880cad50 msgr2=0x7f7c880b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:19.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.386+0000 7f7c8ff13700 1 --2- 172.21.15.125:0/1594891986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c880cad50 0x7f7c880b3530 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000cc50 tx=0x7f7c8000cf60 comp rx=0 tx=0).stop 2023-10-17T06:08:19.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.386+0000 7f7c8ff13700 1 -- 172.21.15.125:0/1594891986 shutdown_connections 2023-10-17T06:08:19.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.386+0000 7f7c8ff13700 1 --2- 172.21.15.125:0/1594891986 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7c6c065720 0x7f7c6c067be0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:19.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.386+0000 7f7c8ff13700 1 --2- 172.21.15.125:0/1594891986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c880cad50 0x7f7c880b3530 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:19.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.386+0000 7f7c8ff13700 1 --2- 172.21.15.125:0/1594891986 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c880c1e30 0x7f7c8815a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:19.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.386+0000 7f7c8ff13700 1 --2- 172.21.15.125:0/1594891986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c8806ea50 0x7f7c880c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:19.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.386+0000 7f7c8ff13700 1 -- 172.21.15.125:0/1594891986 >> 172.21.15.125:0/1594891986 conn(0x7f7c880ce820 msgr2=0x7f7c880cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:19.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.386+0000 7f7c8ff13700 1 -- 172.21.15.125:0/1594891986 shutdown_connections 2023-10-17T06:08:19.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.386+0000 7f7c8ff13700 1 -- 172.21.15.125:0/1594891986 wait complete. 2023-10-17T06:08:19.415 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-17T06:08:19.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.598+0000 7fbb3bb24700 1 Processor -- start 2023-10-17T06:08:19.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.598+0000 7fbb3bb24700 1 -- start start 2023-10-17T06:08:19.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.602+0000 7fbb3bb24700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb341467c0 0x7fbb340b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:19.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.602+0000 7fbb3bb24700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbb341612e0 0x7fbb3415d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:19.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.602+0000 7fbb3bb24700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb34146ba0 con 0x7fbb3406f9a0 2023-10-17T06:08:19.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.602+0000 7fbb3bb24700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb340d0920 con 0x7fbb341612e0 2023-10-17T06:08:19.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.602+0000 7fbb3bb24700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb340b6160 con 0x7fbb341467c0 2023-10-17T06:08:19.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.602+0000 7fbb390bf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fbb341612e0 0x7fbb3415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:19.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.602+0000 7fbb3a0c1700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbb3406f9a0 0x7fbb340d0db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48312/0 (socket says 172.21.15.125:48312) 2023-10-17T06:08:19.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.602+0000 7fbb3a0c1700 1 -- 172.21.15.125:0/45627516 learned_addr learned my addr 172.21.15.125:0/45627516 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:19.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.602+0000 7fbb398c0700 1 --2- 172.21.15.125:0/45627516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb341467c0 0x7fbb340b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:19.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.602+0000 7fbb390bf700 1 -- 172.21.15.125:0/45627516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb341467c0 msgr2=0x7fbb340b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:19.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.602+0000 7fbb390bf700 1 --2- 172.21.15.125:0/45627516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb341467c0 0x7fbb340b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:19.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.602+0000 7fbb390bf700 1 -- 172.21.15.125:0/45627516 >> v1:172.21.15.125:6789/0 conn(0x7fbb3406f9a0 legacy=0x7fbb340d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:19.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.602+0000 7fbb390bf700 1 -- 172.21.15.125:0/45627516 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb340b6440 con 0x7fbb341612e0 2023-10-17T06:08:19.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.602+0000 7fbb390bf700 1 --2- 172.21.15.125:0/45627516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb341612e0 0x7fbb3415d310 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009850 tx=0x7fbb24009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838459223de07c46 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:19.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.602+0000 7fbb388be700 1 -- 172.21.15.125:0/45627516 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb24011830 con 0x7fbb341612e0 2023-10-17T06:08:19.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.602+0000 7fbb388be700 1 -- 172.21.15.125:0/45627516 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb24011990 con 0x7fbb341612e0 2023-10-17T06:08:19.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.602+0000 7fbb388be700 1 -- 172.21.15.125:0/45627516 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb24011d40 con 0x7fbb341612e0 2023-10-17T06:08:19.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.606+0000 7fbb3bb24700 1 -- 172.21.15.125:0/45627516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb341612e0 msgr2=0x7fbb3415d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:19.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.606+0000 7fbb3bb24700 1 --2- 172.21.15.125:0/45627516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb341612e0 0x7fbb3415d310 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009850 tx=0x7fbb24009b60 comp rx=0 tx=0).stop 2023-10-17T06:08:19.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.606+0000 7fbb3bb24700 1 -- 172.21.15.125:0/45627516 shutdown_connections 2023-10-17T06:08:19.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.606+0000 7fbb3bb24700 1 --2- 172.21.15.125:0/45627516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb341612e0 0x7fbb3415d310 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:19.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.606+0000 7fbb3bb24700 1 --2- 172.21.15.125:0/45627516 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb341467c0 0x7fbb340b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:19.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.606+0000 7fbb3bb24700 1 -- 172.21.15.125:0/45627516 >> 172.21.15.125:0/45627516 conn(0x7fbb3406a130 msgr2=0x7fbb3406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:19.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.606+0000 7fbb3bb24700 1 -- 172.21.15.125:0/45627516 shutdown_connections 2023-10-17T06:08:19.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.606+0000 7fbb3bb24700 1 -- 172.21.15.125:0/45627516 wait complete. 2023-10-17T06:08:19.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.610+0000 7fbb3bb24700 1 Processor -- start 2023-10-17T06:08:19.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.610+0000 7fbb3bb24700 1 -- start start 2023-10-17T06:08:19.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.610+0000 7fbb3bb24700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb3406f9a0 0x7fbb3415ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:19.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.610+0000 7fbb3bb24700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb341467c0 0x7fbb3413a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:19.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.610+0000 7fbb3bb24700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb341612e0 0x7fbb3413d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:19.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.610+0000 7fbb3bb24700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3415eeb0 con 0x7fbb341612e0 2023-10-17T06:08:19.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.610+0000 7fbb3bb24700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3415f190 con 0x7fbb341467c0 2023-10-17T06:08:19.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.610+0000 7fbb3bb24700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3415f470 con 0x7fbb3406f9a0 2023-10-17T06:08:19.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.610+0000 7fbb3a0c1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb341612e0 0x7fbb3413d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:19.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.610+0000 7fbb3a0c1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb341612e0 0x7fbb3413d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48618/0 (socket says 172.21.15.125:48618) 2023-10-17T06:08:19.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.610+0000 7fbb3a0c1700 1 -- 172.21.15.125:0/4047901663 learned_addr learned my addr 172.21.15.125:0/4047901663 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:19.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.610+0000 7fbb390bf700 1 --2- 172.21.15.125:0/4047901663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb341467c0 0x7fbb3413a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:19.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.610+0000 7fbb398c0700 1 --2- 172.21.15.125:0/4047901663 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb3406f9a0 0x7fbb3415ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:19.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.614+0000 7fbb3a0c1700 1 -- 172.21.15.125:0/4047901663 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb3406f9a0 msgr2=0x7fbb3415ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:19.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.614+0000 7fbb3a0c1700 1 --2- 172.21.15.125:0/4047901663 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb3406f9a0 0x7fbb3415ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:19.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.614+0000 7fbb3a0c1700 1 -- 172.21.15.125:0/4047901663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb341467c0 msgr2=0x7fbb3413a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:19.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.614+0000 7fbb3a0c1700 1 --2- 172.21.15.125:0/4047901663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb341467c0 0x7fbb3413a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:19.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.614+0000 7fbb3a0c1700 1 -- 172.21.15.125:0/4047901663 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb240094b0 con 0x7fbb341612e0 2023-10-17T06:08:19.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.614+0000 7fbb3a0c1700 1 --2- 172.21.15.125:0/4047901663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb341612e0 0x7fbb3413d460 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00cbc0 tx=0x7fbb2c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:19.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.614+0000 7fbb2a7fc700 1 -- 172.21.15.125:0/4047901663 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c007480 con 0x7fbb341612e0 2023-10-17T06:08:19.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.614+0000 7fbb2a7fc700 1 -- 172.21.15.125:0/4047901663 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2c0075e0 con 0x7fbb341612e0 2023-10-17T06:08:19.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.614+0000 7fbb3bb24700 1 -- 172.21.15.125:0/4047901663 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb3415f750 con 0x7fbb341612e0 2023-10-17T06:08:19.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.614+0000 7fbb2a7fc700 1 -- 172.21.15.125:0/4047901663 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c007950 con 0x7fbb341612e0 2023-10-17T06:08:19.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.614+0000 7fbb3bb24700 1 -- 172.21.15.125:0/4047901663 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3415eb40 con 0x7fbb341612e0 2023-10-17T06:08:19.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.614+0000 7fbb3bb24700 1 -- 172.21.15.125:0/4047901663 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3415fc70 con 0x7fbb341612e0 2023-10-17T06:08:19.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.618+0000 7fbb2a7fc700 1 -- 172.21.15.125:0/4047901663 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fbb2c012400 con 0x7fbb341612e0 2023-10-17T06:08:19.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.618+0000 7fbb2a7fc700 1 --2- 172.21.15.125:0/4047901663 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fbb180656f0 0x7fbb18067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:19.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.618+0000 7fbb2a7fc700 1 -- 172.21.15.125:0/4047901663 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbb2c082950 con 0x7fbb341612e0 2023-10-17T06:08:19.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.618+0000 7fbb398c0700 1 --2- 172.21.15.125:0/4047901663 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fbb180656f0 0x7fbb18067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:19.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.622+0000 7fbb398c0700 1 --2- 172.21.15.125:0/4047901663 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fbb180656f0 0x7fbb18067bb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009bf0 tx=0x7fbb30009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:19.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.626+0000 7fbb2a7fc700 1 -- 172.21.15.125:0/4047901663 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fbb3415fc70 con 0x7fbb341612e0 2023-10-17T06:08:19.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.802+0000 7fbb3bb24700 1 -- 172.21.15.125:0/4047901663 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbb3415fc70 con 0x7fbb341612e0 2023-10-17T06:08:19.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.802+0000 7fbb2a7fc700 1 -- 172.21.15.125:0/4047901663 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbb3415fc70 con 0x7fbb341612e0 2023-10-17T06:08:19.808 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:19.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.806+0000 7fbb3bb24700 1 -- 172.21.15.125:0/4047901663 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fbb180656f0 msgr2=0x7fbb18067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:19.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.806+0000 7fbb3bb24700 1 --2- 172.21.15.125:0/4047901663 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fbb180656f0 0x7fbb18067bb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009bf0 tx=0x7fbb30009240 comp rx=0 tx=0).stop 2023-10-17T06:08:19.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.806+0000 7fbb3bb24700 1 -- 172.21.15.125:0/4047901663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb341612e0 msgr2=0x7fbb3413d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:19.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.806+0000 7fbb3bb24700 1 --2- 172.21.15.125:0/4047901663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb341612e0 0x7fbb3413d460 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00cbc0 tx=0x7fbb2c00cbf0 comp rx=0 tx=0).stop 2023-10-17T06:08:19.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.806+0000 7fbb3bb24700 1 -- 172.21.15.125:0/4047901663 shutdown_connections 2023-10-17T06:08:19.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.806+0000 7fbb3bb24700 1 --2- 172.21.15.125:0/4047901663 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fbb180656f0 0x7fbb18067bb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:19.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.806+0000 7fbb3bb24700 1 --2- 172.21.15.125:0/4047901663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbb341612e0 0x7fbb3413d460 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:19.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.806+0000 7fbb3bb24700 1 --2- 172.21.15.125:0/4047901663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb341467c0 0x7fbb3413a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:19.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.806+0000 7fbb3bb24700 1 --2- 172.21.15.125:0/4047901663 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbb3406f9a0 0x7fbb3415ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:19.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.806+0000 7fbb3bb24700 1 -- 172.21.15.125:0/4047901663 >> 172.21.15.125:0/4047901663 conn(0x7fbb3406a130 msgr2=0x7fbb34160aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:19.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.806+0000 7fbb3bb24700 1 -- 172.21.15.125:0/4047901663 shutdown_connections 2023-10-17T06:08:19.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:19.806+0000 7fbb3bb24700 1 -- 172.21.15.125:0/4047901663 wait complete. 2023-10-17T06:08:19.832 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-17T06:08:20.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.038+0000 7f44734d1700 1 Processor -- start 2023-10-17T06:08:20.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.038+0000 7f44734d1700 1 -- start start 2023-10-17T06:08:20.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.038+0000 7f44734d1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0d2e00 0x7f446c0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:20.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.038+0000 7f44734d1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f446c0b5ae0 0x7f446c06db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:20.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.038+0000 7f44734d1700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446c15d0d0 con 0x7f446c160710 2023-10-17T06:08:20.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.038+0000 7f44734d1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c15df90 con 0x7f446c0b5ae0 2023-10-17T06:08:20.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.038+0000 7f44734d1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c06f0f0 con 0x7f446c0d2e00 2023-10-17T06:08:20.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.038+0000 7f4472cd0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f446c0b5ae0 0x7f446c06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:20.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.038+0000 7f4472cd0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f446c0b5ae0 0x7f446c06db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48624/0 (socket says 172.21.15.125:48624) 2023-10-17T06:08:20.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.038+0000 7f4472cd0700 1 -- 172.21.15.125:0/1879765970 learned_addr learned my addr 172.21.15.125:0/1879765970 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:20.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.038+0000 7f44724cf700 1 --2- 172.21.15.125:0/1879765970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0d2e00 0x7f446c0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:20.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.038+0000 7f4472cd0700 1 -- 172.21.15.125:0/1879765970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0d2e00 msgr2=0x7f446c0b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:20.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.038+0000 7f4472cd0700 1 --2- 172.21.15.125:0/1879765970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0d2e00 0x7f446c0b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.038+0000 7f4472cd0700 1 -- 172.21.15.125:0/1879765970 >> v1:172.21.15.184:6789/0 conn(0x7f446c160710 legacy=0x7f446c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:20.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.038+0000 7f4472cd0700 1 -- 172.21.15.125:0/1879765970 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c15d310 con 0x7f446c0b5ae0 2023-10-17T06:08:20.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.042+0000 7f4472cd0700 1 --2- 172.21.15.125:0/1879765970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f446c0b5ae0 0x7f446c06db60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4464009e80 tx=0x7f446400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d2be6f8e60e687 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:20.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.042+0000 7f44714cd700 1 -- 172.21.15.125:0/1879765970 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446400e070 con 0x7f446c0b5ae0 2023-10-17T06:08:20.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.042+0000 7f44714cd700 1 -- 172.21.15.125:0/1879765970 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446400b8d0 con 0x7f446c0b5ae0 2023-10-17T06:08:20.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.042+0000 7f44714cd700 1 -- 172.21.15.125:0/1879765970 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446400bc80 con 0x7f446c0b5ae0 2023-10-17T06:08:20.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.042+0000 7f44734d1700 1 -- 172.21.15.125:0/1879765970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f446c0b5ae0 msgr2=0x7f446c06db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:20.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.042+0000 7f44734d1700 1 --2- 172.21.15.125:0/1879765970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f446c0b5ae0 0x7f446c06db60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4464009e80 tx=0x7f446400b330 comp rx=0 tx=0).stop 2023-10-17T06:08:20.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.042+0000 7f44734d1700 1 -- 172.21.15.125:0/1879765970 shutdown_connections 2023-10-17T06:08:20.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.042+0000 7f44734d1700 1 --2- 172.21.15.125:0/1879765970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f446c0b5ae0 0x7f446c06db60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.042+0000 7f44734d1700 1 --2- 172.21.15.125:0/1879765970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0d2e00 0x7f446c0b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.042+0000 7f44734d1700 1 -- 172.21.15.125:0/1879765970 >> 172.21.15.125:0/1879765970 conn(0x7f446c069f20 msgr2=0x7f446c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:20.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.042+0000 7f44734d1700 1 -- 172.21.15.125:0/1879765970 shutdown_connections 2023-10-17T06:08:20.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.042+0000 7f44734d1700 1 -- 172.21.15.125:0/1879765970 wait complete. 2023-10-17T06:08:20.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.042+0000 7f44734d1700 1 Processor -- start 2023-10-17T06:08:20.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.042+0000 7f44734d1700 1 -- start start 2023-10-17T06:08:20.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f44734d1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f446c0b5ae0 0x7f446c157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:20.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f44734d1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0d2e00 0x7f446c1573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:20.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f44734d1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f446c160710 0x7f446c0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:20.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f44734d1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c1578f0 con 0x7f446c0b5ae0 2023-10-17T06:08:20.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f44734d1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0b3990 con 0x7f446c160710 2023-10-17T06:08:20.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f44734d1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c0b4640 con 0x7f446c0d2e00 2023-10-17T06:08:20.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f44724cf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f446c0b5ae0 0x7f446c157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:20.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f44724cf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f446c0b5ae0 0x7f446c157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48628/0 (socket says 172.21.15.125:48628) 2023-10-17T06:08:20.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f44724cf700 1 -- 172.21.15.125:0/1936812331 learned_addr learned my addr 172.21.15.125:0/1936812331 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:20.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f4471cce700 1 --2- 172.21.15.125:0/1936812331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0d2e00 0x7f446c1573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:20.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f44724cf700 1 -- 172.21.15.125:0/1936812331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0d2e00 msgr2=0x7f446c1573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:20.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f44724cf700 1 --2- 172.21.15.125:0/1936812331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0d2e00 0x7f446c1573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f44724cf700 1 -- 172.21.15.125:0/1936812331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f446c160710 msgr2=0x7f446c0b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:20.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f4472cd0700 1 --2- 172.21.15.125:0/1936812331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f446c160710 0x7f446c0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:20.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f44724cf700 1 --2- 172.21.15.125:0/1936812331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f446c160710 0x7f446c0b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f44724cf700 1 -- 172.21.15.125:0/1936812331 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4464009b30 con 0x7f446c0b5ae0 2023-10-17T06:08:20.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f4471cce700 1 --2- 172.21.15.125:0/1936812331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0d2e00 0x7f446c1573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:20.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f4472cd0700 1 --2- 172.21.15.125:0/1936812331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f446c160710 0x7f446c0b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:20.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f44724cf700 1 --2- 172.21.15.125:0/1936812331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f446c0b5ae0 0x7f446c157b10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f446800e840 tx=0x7f446800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:20.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f4462ffd700 1 -- 172.21.15.125:0/1936812331 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680095a0 con 0x7f446c0b5ae0 2023-10-17T06:08:20.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f4462ffd700 1 -- 172.21.15.125:0/1936812331 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446800c690 con 0x7f446c0b5ae0 2023-10-17T06:08:20.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f44734d1700 1 -- 172.21.15.125:0/1936812331 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446c0b4920 con 0x7f446c0b5ae0 2023-10-17T06:08:20.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f4462ffd700 1 -- 172.21.15.125:0/1936812331 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446800ca00 con 0x7f446c0b5ae0 2023-10-17T06:08:20.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.046+0000 7f44734d1700 1 -- 172.21.15.125:0/1936812331 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446c158160 con 0x7f446c0b5ae0 2023-10-17T06:08:20.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.050+0000 7f44734d1700 1 -- 172.21.15.125:0/1936812331 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446c0b44a0 con 0x7f446c0b5ae0 2023-10-17T06:08:20.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.050+0000 7f4462ffd700 1 -- 172.21.15.125:0/1936812331 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f446800cb60 con 0x7f446c0b5ae0 2023-10-17T06:08:20.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.050+0000 7f4462ffd700 1 --2- 172.21.15.125:0/1936812331 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f44500656f0 0x7f4450067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:20.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.050+0000 7f4462ffd700 1 -- 172.21.15.125:0/1936812331 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f44680830f0 con 0x7f446c0b5ae0 2023-10-17T06:08:20.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.050+0000 7f4471cce700 1 --2- 172.21.15.125:0/1936812331 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f44500656f0 0x7f4450067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:20.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.054+0000 7f4471cce700 1 --2- 172.21.15.125:0/1936812331 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f44500656f0 0x7f4450067bb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f446c158d70 tx=0x7f445c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.058+0000 7f4462ffd700 1 -- 172.21.15.125:0/1936812331 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f446c0b44a0 con 0x7f446c0b5ae0 2023-10-17T06:08:20.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.246+0000 7f44734d1700 1 -- 172.21.15.125:0/1936812331 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f446c0b44a0 con 0x7f446c0b5ae0 2023-10-17T06:08:20.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.246+0000 7f4462ffd700 1 -- 172.21.15.125:0/1936812331 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f446c0b44a0 con 0x7f446c0b5ae0 2023-10-17T06:08:20.250 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-17T06:08:20.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.246+0000 7f44734d1700 1 -- 172.21.15.125:0/1936812331 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f44500656f0 msgr2=0x7f4450067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:20.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.246+0000 7f44734d1700 1 --2- 172.21.15.125:0/1936812331 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f44500656f0 0x7f4450067bb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f446c158d70 tx=0x7f445c009040 comp rx=0 tx=0).stop 2023-10-17T06:08:20.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.246+0000 7f44734d1700 1 -- 172.21.15.125:0/1936812331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f446c0b5ae0 msgr2=0x7f446c157b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:20.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.246+0000 7f44734d1700 1 --2- 172.21.15.125:0/1936812331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f446c0b5ae0 0x7f446c157b10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f446800e840 tx=0x7f446800ec00 comp rx=0 tx=0).stop 2023-10-17T06:08:20.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.250+0000 7f44734d1700 1 -- 172.21.15.125:0/1936812331 shutdown_connections 2023-10-17T06:08:20.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.250+0000 7f44734d1700 1 --2- 172.21.15.125:0/1936812331 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f44500656f0 0x7f4450067bb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.250+0000 7f44734d1700 1 --2- 172.21.15.125:0/1936812331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f446c160710 0x7f446c0b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.250+0000 7f44734d1700 1 --2- 172.21.15.125:0/1936812331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f446c0d2e00 0x7f446c1573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.250+0000 7f44734d1700 1 --2- 172.21.15.125:0/1936812331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f446c0b5ae0 0x7f446c157b10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.250+0000 7f44734d1700 1 -- 172.21.15.125:0/1936812331 >> 172.21.15.125:0/1936812331 conn(0x7f446c069f20 msgr2=0x7f446c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:20.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.250+0000 7f44734d1700 1 -- 172.21.15.125:0/1936812331 shutdown_connections 2023-10-17T06:08:20.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.250+0000 7f44734d1700 1 -- 172.21.15.125:0/1936812331 wait complete. 2023-10-17T06:08:20.274 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-17T06:08:20.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.446+0000 7f024cf2b700 1 Processor -- start 2023-10-17T06:08:20.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.446+0000 7f024cf2b700 1 -- start start 2023-10-17T06:08:20.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.446+0000 7f024cf2b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f024806d470 0x7f0248070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:20.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.446+0000 7f024cf2b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0248070f50 0x7f024815a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:20.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.446+0000 7f024cf2b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f024815e990 con 0x7f024806d090 2023-10-17T06:08:20.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.446+0000 7f024cf2b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f024815f4f0 con 0x7f0248070f50 2023-10-17T06:08:20.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.446+0000 7f024cf2b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02480b2ca0 con 0x7f024806d470 2023-10-17T06:08:20.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.446+0000 7f02477fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f024806d090 0x7f02480b2590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48326/0 (socket says 172.21.15.125:48326) 2023-10-17T06:08:20.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.446+0000 7f02477fe700 1 -- 172.21.15.125:0/116856518 learned_addr learned my addr 172.21.15.125:0/116856518 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:20.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.446+0000 7f0247fff700 1 --2- 172.21.15.125:0/116856518 >> v2:172.21.15.125:3300/0 conn(0x7f0248070f50 0x7f024815a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:20.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.446+0000 7f0246ffd700 1 --2- 172.21.15.125:0/116856518 >> v2:172.21.15.184:3300/0 conn(0x7f024806d470 0x7f0248070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:20.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.450+0000 7f02467fc700 1 -- 172.21.15.125:0/116856518 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857248239 0 0) 0x7f024815e990 con 0x7f024806d090 2023-10-17T06:08:20.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.450+0000 7f02467fc700 1 -- 172.21.15.125:0/116856518 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02300035d0 con 0x7f024806d090 2023-10-17T06:08:20.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.450+0000 7f0247fff700 1 -- 172.21.15.125:0/116856518 >> v2:172.21.15.184:3300/0 conn(0x7f024806d470 msgr2=0x7f0248070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:20.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.450+0000 7f0247fff700 1 --2- 172.21.15.125:0/116856518 >> v2:172.21.15.184:3300/0 conn(0x7f024806d470 0x7f0248070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.450+0000 7f0247fff700 1 -- 172.21.15.125:0/116856518 >> v1:172.21.15.125:6789/0 conn(0x7f024806d090 legacy=0x7f02480b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:20.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.450+0000 7f0247fff700 1 -- 172.21.15.125:0/116856518 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024815ec50 con 0x7f0248070f50 2023-10-17T06:08:20.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.450+0000 7f0246ffd700 1 --2- 172.21.15.125:0/116856518 >> v2:172.21.15.184:3300/0 conn(0x7f024806d470 0x7f0248070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:08:20.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.450+0000 7f0247fff700 1 --2- 172.21.15.125:0/116856518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0248070f50 0x7f024815a410 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f02480b2100 tx=0x7f0240009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b7f1aac7d86f7d server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:20.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.450+0000 7f02467fc700 1 -- 172.21.15.125:0/116856518 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240011830 con 0x7f0248070f50 2023-10-17T06:08:20.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.450+0000 7f02467fc700 1 -- 172.21.15.125:0/116856518 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0240011990 con 0x7f0248070f50 2023-10-17T06:08:20.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.450+0000 7f02467fc700 1 -- 172.21.15.125:0/116856518 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240011d00 con 0x7f0248070f50 2023-10-17T06:08:20.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.450+0000 7f024cf2b700 1 -- 172.21.15.125:0/116856518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0248070f50 msgr2=0x7f024815a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:20.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.450+0000 7f024cf2b700 1 --2- 172.21.15.125:0/116856518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0248070f50 0x7f024815a410 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f02480b2100 tx=0x7f0240009b30 comp rx=0 tx=0).stop 2023-10-17T06:08:20.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.450+0000 7f024cf2b700 1 -- 172.21.15.125:0/116856518 shutdown_connections 2023-10-17T06:08:20.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.450+0000 7f024cf2b700 1 --2- 172.21.15.125:0/116856518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0248070f50 0x7f024815a410 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.450+0000 7f024cf2b700 1 --2- 172.21.15.125:0/116856518 >> v2:172.21.15.184:3300/0 conn(0x7f024806d470 0x7f0248070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.450+0000 7f024cf2b700 1 -- 172.21.15.125:0/116856518 >> 172.21.15.125:0/116856518 conn(0x7f02480ce5c0 msgr2=0x7f02480ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:20.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.450+0000 7f024cf2b700 1 -- 172.21.15.125:0/116856518 shutdown_connections 2023-10-17T06:08:20.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.450+0000 7f024cf2b700 1 -- 172.21.15.125:0/116856518 wait complete. 2023-10-17T06:08:20.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.454+0000 7f024cf2b700 1 Processor -- start 2023-10-17T06:08:20.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.454+0000 7f024cf2b700 1 -- start start 2023-10-17T06:08:20.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f024cf2b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f024806d090 0x7f024814a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:20.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f024cf2b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f024806d470 0x7f024814ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:20.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f024cf2b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0248070f50 0x7f02480b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:20.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f024cf2b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024814da20 con 0x7f024806d090 2023-10-17T06:08:20.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f024cf2b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024814dcc0 con 0x7f0248070f50 2023-10-17T06:08:20.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f024cf2b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f024814dfa0 con 0x7f024806d470 2023-10-17T06:08:20.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f02477fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f024806d090 0x7f024814a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:20.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f02477fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f024806d090 0x7f024814a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48660/0 (socket says 172.21.15.125:48660) 2023-10-17T06:08:20.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f02477fe700 1 -- 172.21.15.125:0/907889646 learned_addr learned my addr 172.21.15.125:0/907889646 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:20.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f0247fff700 1 --2- 172.21.15.125:0/907889646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0248070f50 0x7f02480b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:20.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f0246ffd700 1 --2- 172.21.15.125:0/907889646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f024806d470 0x7f024814ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:20.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f02477fe700 1 -- 172.21.15.125:0/907889646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f024806d470 msgr2=0x7f024814ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:20.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f02477fe700 1 --2- 172.21.15.125:0/907889646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f024806d470 0x7f024814ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f02477fe700 1 -- 172.21.15.125:0/907889646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0248070f50 msgr2=0x7f02480b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:20.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f02477fe700 1 --2- 172.21.15.125:0/907889646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0248070f50 0x7f02480b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f02477fe700 1 -- 172.21.15.125:0/907889646 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023c0094b0 con 0x7f024806d090 2023-10-17T06:08:20.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f02477fe700 1 --2- 172.21.15.125:0/907889646 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f024806d090 0x7f024814a7f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f023800cb40 tx=0x7f023800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:20.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f022ffff700 1 -- 172.21.15.125:0/907889646 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023800a9e0 con 0x7f024806d090 2023-10-17T06:08:20.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f022ffff700 1 -- 172.21.15.125:0/907889646 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023800ab40 con 0x7f024806d090 2023-10-17T06:08:20.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f024cf2b700 1 -- 172.21.15.125:0/907889646 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02400094b0 con 0x7f024806d090 2023-10-17T06:08:20.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f022ffff700 1 -- 172.21.15.125:0/907889646 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023800ce60 con 0x7f024806d090 2023-10-17T06:08:20.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f024cf2b700 1 -- 172.21.15.125:0/907889646 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f024814e560 con 0x7f024806d090 2023-10-17T06:08:20.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.458+0000 7f024cf2b700 1 -- 172.21.15.125:0/907889646 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02480ca330 con 0x7f024806d090 2023-10-17T06:08:20.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.462+0000 7f022ffff700 1 -- 172.21.15.125:0/907889646 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f023801b3b0 con 0x7f024806d090 2023-10-17T06:08:20.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.462+0000 7f022ffff700 1 --2- 172.21.15.125:0/907889646 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02340656f0 0x7f0234067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:20.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.462+0000 7f022ffff700 1 -- 172.21.15.125:0/907889646 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0238082c10 con 0x7f024806d090 2023-10-17T06:08:20.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.462+0000 7f0246ffd700 1 --2- 172.21.15.125:0/907889646 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02340656f0 0x7f0234067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:20.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.466+0000 7f0246ffd700 1 --2- 172.21.15.125:0/907889646 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02340656f0 0x7f0234067bb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f02480b1900 tx=0x7f023c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:20.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.470+0000 7f022ffff700 1 -- 172.21.15.125:0/907889646 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0238050390 con 0x7f024806d090 2023-10-17T06:08:20.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.646+0000 7f024cf2b700 1 -- 172.21.15.125:0/907889646 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f024815efc0 con 0x7f024806d090 2023-10-17T06:08:20.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.646+0000 7f022ffff700 1 -- 172.21.15.125:0/907889646 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f02380170a0 con 0x7f024806d090 2023-10-17T06:08:20.652 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:20.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.650+0000 7f024cf2b700 1 -- 172.21.15.125:0/907889646 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02340656f0 msgr2=0x7f0234067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:20.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.650+0000 7f024cf2b700 1 --2- 172.21.15.125:0/907889646 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02340656f0 0x7f0234067bb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f02480b1900 tx=0x7f023c008040 comp rx=0 tx=0).stop 2023-10-17T06:08:20.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.650+0000 7f024cf2b700 1 -- 172.21.15.125:0/907889646 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f024806d090 msgr2=0x7f024814a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:20.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.650+0000 7f024cf2b700 1 --2- 172.21.15.125:0/907889646 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f024806d090 0x7f024814a7f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f023800cb40 tx=0x7f023800cc20 comp rx=0 tx=0).stop 2023-10-17T06:08:20.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.650+0000 7f024cf2b700 1 -- 172.21.15.125:0/907889646 shutdown_connections 2023-10-17T06:08:20.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.650+0000 7f024cf2b700 1 --2- 172.21.15.125:0/907889646 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02340656f0 0x7f0234067bb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.650+0000 7f024cf2b700 1 --2- 172.21.15.125:0/907889646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0248070f50 0x7f02480b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.650+0000 7f024cf2b700 1 --2- 172.21.15.125:0/907889646 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f024806d470 0x7f024814ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.650+0000 7f024cf2b700 1 --2- 172.21.15.125:0/907889646 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f024806d090 0x7f024814a7f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.650+0000 7f024cf2b700 1 -- 172.21.15.125:0/907889646 >> 172.21.15.125:0/907889646 conn(0x7f02480ce5c0 msgr2=0x7f02480b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:20.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.654+0000 7f024cf2b700 1 -- 172.21.15.125:0/907889646 shutdown_connections 2023-10-17T06:08:20.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.654+0000 7f024cf2b700 1 -- 172.21.15.125:0/907889646 wait complete. 2023-10-17T06:08:20.682 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-17T06:08:20.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.854+0000 7f7f5645a700 1 Processor -- start 2023-10-17T06:08:20.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.854+0000 7f7f5645a700 1 -- start start 2023-10-17T06:08:20.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.858+0000 7f7f5645a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7f50158e70 0x7f7f500c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:20.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.858+0000 7f7f5645a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f5006ee20 0x7f7f500cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:20.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.858+0000 7f7f5645a700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5006f4f0 con 0x7f7f5006d610 2023-10-17T06:08:20.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.858+0000 7f7f5645a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f5006f790 con 0x7f7f50158e70 2023-10-17T06:08:20.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.858+0000 7f7f5645a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5006fa70 con 0x7f7f5006ee20 2023-10-17T06:08:20.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.858+0000 7f7f55458700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7f50158e70 0x7f7f500c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:20.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.858+0000 7f7f54c57700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f5006ee20 0x7f7f500cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:20.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.858+0000 7f7f54c57700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f5006ee20 0x7f7f500cd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:57590/0 (socket says 172.21.15.125:57590) 2023-10-17T06:08:20.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.858+0000 7f7f54c57700 1 -- 172.21.15.125:0/3707640208 learned_addr learned my addr 172.21.15.125:0/3707640208 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:20.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.858+0000 7f7f55c59700 1 --1- 172.21.15.125:0/3707640208 >> v1:172.21.15.184:6789/0 conn(0x7f7f5006d610 0x7f7f50070270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:58414/0 (socket says 172.21.15.125:58414) 2023-10-17T06:08:20.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.858+0000 7f7f54c57700 1 -- 172.21.15.125:0/3707640208 >> v2:172.21.15.184:3300/0 conn(0x7f7f50158e70 msgr2=0x7f7f500c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:20.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.858+0000 7f7f54c57700 1 --2- 172.21.15.125:0/3707640208 >> v2:172.21.15.184:3300/0 conn(0x7f7f50158e70 0x7f7f500c9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.858+0000 7f7f54c57700 1 -- 172.21.15.125:0/3707640208 >> v1:172.21.15.184:6789/0 conn(0x7f7f5006d610 legacy=0x7f7f50070270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:20.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.858+0000 7f7f54c57700 1 -- 172.21.15.125:0/3707640208 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5006fd50 con 0x7f7f5006ee20 2023-10-17T06:08:20.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.858+0000 7f7f47fff700 1 -- 172.21.15.125:0/3707640208 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786877119 0 0) 0x7f7f5006f4f0 con 0x7f7f5006d610 2023-10-17T06:08:20.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.862+0000 7f7f54c57700 1 --2- 172.21.15.125:0/3707640208 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f5006ee20 0x7f7f500cd480 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000bbb0 tx=0x7f7f4000bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28d536ace89d0231 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:20.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.862+0000 7f7f47fff700 1 -- 172.21.15.125:0/3707640208 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4000dd30 con 0x7f7f5006ee20 2023-10-17T06:08:20.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.862+0000 7f7f47fff700 1 -- 172.21.15.125:0/3707640208 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4000de90 con 0x7f7f5006ee20 2023-10-17T06:08:20.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.862+0000 7f7f47fff700 1 -- 172.21.15.125:0/3707640208 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f40010690 con 0x7f7f5006ee20 2023-10-17T06:08:20.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.862+0000 7f7f5645a700 1 -- 172.21.15.125:0/3707640208 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f5006ee20 msgr2=0x7f7f500cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:20.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.862+0000 7f7f5645a700 1 --2- 172.21.15.125:0/3707640208 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f5006ee20 0x7f7f500cd480 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7f4000bbb0 tx=0x7f7f4000bec0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.862+0000 7f7f5645a700 1 -- 172.21.15.125:0/3707640208 shutdown_connections 2023-10-17T06:08:20.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.862+0000 7f7f5645a700 1 --2- 172.21.15.125:0/3707640208 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f5006ee20 0x7f7f500cd480 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.862+0000 7f7f5645a700 1 --2- 172.21.15.125:0/3707640208 >> v2:172.21.15.184:3300/0 conn(0x7f7f50158e70 0x7f7f500c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.862+0000 7f7f5645a700 1 -- 172.21.15.125:0/3707640208 >> 172.21.15.125:0/3707640208 conn(0x7f7f500b09b0 msgr2=0x7f7f500b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:20.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.862+0000 7f7f5645a700 1 -- 172.21.15.125:0/3707640208 shutdown_connections 2023-10-17T06:08:20.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.862+0000 7f7f5645a700 1 -- 172.21.15.125:0/3707640208 wait complete. 2023-10-17T06:08:20.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.866+0000 7f7f5645a700 1 Processor -- start 2023-10-17T06:08:20.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.866+0000 7f7f5645a700 1 -- start start 2023-10-17T06:08:20.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.866+0000 7f7f5645a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f5006d610 0x7f7f5014c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:20.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.866+0000 7f7f5645a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f5006ee20 0x7f7f501e2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:20.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.866+0000 7f7f5645a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f50158e70 0x7f7f500c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:20.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.866+0000 7f7f5645a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f500c7760 con 0x7f7f50158e70 2023-10-17T06:08:20.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.866+0000 7f7f5645a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f500c85c0 con 0x7f7f5006d610 2023-10-17T06:08:20.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.866+0000 7f7f5645a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f500c79b0 con 0x7f7f5006ee20 2023-10-17T06:08:20.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.870+0000 7f7f55c59700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f50158e70 0x7f7f500c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:20.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.870+0000 7f7f55c59700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f50158e70 0x7f7f500c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48664/0 (socket says 172.21.15.125:48664) 2023-10-17T06:08:20.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.870+0000 7f7f55c59700 1 -- 172.21.15.125:0/4089361714 learned_addr learned my addr 172.21.15.125:0/4089361714 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:20.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.870+0000 7f7f55458700 1 --2- 172.21.15.125:0/4089361714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f5006d610 0x7f7f5014c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:20.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.870+0000 7f7f54c57700 1 --2- 172.21.15.125:0/4089361714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f5006ee20 0x7f7f501e2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:20.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.870+0000 7f7f55c59700 1 -- 172.21.15.125:0/4089361714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f5006ee20 msgr2=0x7f7f501e2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:20.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.870+0000 7f7f55c59700 1 --2- 172.21.15.125:0/4089361714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f5006ee20 0x7f7f501e2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.870+0000 7f7f55c59700 1 -- 172.21.15.125:0/4089361714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f5006d610 msgr2=0x7f7f5014c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:20.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.870+0000 7f7f55c59700 1 --2- 172.21.15.125:0/4089361714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f5006d610 0x7f7f5014c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:20.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.870+0000 7f7f55c59700 1 -- 172.21.15.125:0/4089361714 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f4000b810 con 0x7f7f50158e70 2023-10-17T06:08:20.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.870+0000 7f7f55c59700 1 --2- 172.21.15.125:0/4089361714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f50158e70 0x7f7f500c8a50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7f4800cc10 tx=0x7f7f4800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:20.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.870+0000 7f7f45ffb700 1 -- 172.21.15.125:0/4089361714 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4800aa40 con 0x7f7f50158e70 2023-10-17T06:08:20.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.870+0000 7f7f45ffb700 1 -- 172.21.15.125:0/4089361714 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4800aba0 con 0x7f7f50158e70 2023-10-17T06:08:20.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.870+0000 7f7f45ffb700 1 -- 172.21.15.125:0/4089361714 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f48007070 con 0x7f7f50158e70 2023-10-17T06:08:20.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.870+0000 7f7f5645a700 1 -- 172.21.15.125:0/4089361714 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f500c7c90 con 0x7f7f50158e70 2023-10-17T06:08:20.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.870+0000 7f7f5645a700 1 -- 172.21.15.125:0/4089361714 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f500c8250 con 0x7f7f50158e70 2023-10-17T06:08:20.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.874+0000 7f7f5645a700 1 -- 172.21.15.125:0/4089361714 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f500c8730 con 0x7f7f50158e70 2023-10-17T06:08:20.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.874+0000 7f7f45ffb700 1 -- 172.21.15.125:0/4089361714 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7f480071d0 con 0x7f7f50158e70 2023-10-17T06:08:20.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.878+0000 7f7f45ffb700 1 --2- 172.21.15.125:0/4089361714 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7f340656f0 0x7f7f34067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:20.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.878+0000 7f7f45ffb700 1 -- 172.21.15.125:0/4089361714 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7f48082f20 con 0x7f7f50158e70 2023-10-17T06:08:20.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.878+0000 7f7f55458700 1 --2- 172.21.15.125:0/4089361714 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7f340656f0 0x7f7f34067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:20.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.878+0000 7f7f55458700 1 --2- 172.21.15.125:0/4089361714 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7f340656f0 0x7f7f34067bb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7f500cb2c0 tx=0x7f7f4c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:20.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:20.882+0000 7f7f45ffb700 1 -- 172.21.15.125:0/4089361714 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f7f48050620 con 0x7f7f50158e70 2023-10-17T06:08:21.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.094+0000 7f7f5645a700 1 -- 172.21.15.125:0/4089361714 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7f50072e60 con 0x7f7f50158e70 2023-10-17T06:08:21.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.094+0000 7f7f45ffb700 1 -- 172.21.15.125:0/4089361714 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7f48017020 con 0x7f7f50158e70 2023-10-17T06:08:21.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.098+0000 7f7f5645a700 1 -- 172.21.15.125:0/4089361714 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7f340656f0 msgr2=0x7f7f34067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:21.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.098+0000 7f7f5645a700 1 --2- 172.21.15.125:0/4089361714 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7f340656f0 0x7f7f34067bb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7f500cb2c0 tx=0x7f7f4c009240 comp rx=0 tx=0).stop 2023-10-17T06:08:21.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.098+0000 7f7f5645a700 1 -- 172.21.15.125:0/4089361714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f50158e70 msgr2=0x7f7f500c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:21.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.098+0000 7f7f5645a700 1 --2- 172.21.15.125:0/4089361714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f50158e70 0x7f7f500c8a50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7f4800cc10 tx=0x7f7f4800cf20 comp rx=0 tx=0).stop 2023-10-17T06:08:21.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.098+0000 7f7f5645a700 1 -- 172.21.15.125:0/4089361714 shutdown_connections 2023-10-17T06:08:21.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.098+0000 7f7f5645a700 1 --2- 172.21.15.125:0/4089361714 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7f340656f0 0x7f7f34067bb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:21.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.098+0000 7f7f5645a700 1 --2- 172.21.15.125:0/4089361714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f50158e70 0x7f7f500c8a50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:21.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.098+0000 7f7f5645a700 1 --2- 172.21.15.125:0/4089361714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7f5006ee20 0x7f7f501e2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:21.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.098+0000 7f7f5645a700 1 --2- 172.21.15.125:0/4089361714 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7f5006d610 0x7f7f5014c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:21.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.098+0000 7f7f5645a700 1 -- 172.21.15.125:0/4089361714 >> 172.21.15.125:0/4089361714 conn(0x7f7f500b09b0 msgr2=0x7f7f500b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:21.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.098+0000 7f7f5645a700 1 -- 172.21.15.125:0/4089361714 shutdown_connections 2023-10-17T06:08:21.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.098+0000 7f7f5645a700 1 -- 172.21.15.125:0/4089361714 wait complete. 2023-10-17T06:08:21.104 INFO:teuthology.orchestra.run.smithi125.stderr:listed 0 entries 2023-10-17T06:08:21.121 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-17T06:08:21.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:08:21.122 DEBUG:teuthology.orchestra.run.smithi125:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-17T06:08:21.168 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-10-17T06:08:21.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:08:21.169 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-17T06:08:21.234 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:08:21.235 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:08:21.251 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:08:21.252 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:08:21.316 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:08:21.317 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:08:21.370 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:08:21.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.542+0000 7fface5d2700 1 Processor -- start 2023-10-17T06:08:21.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.542+0000 7fface5d2700 1 -- start start 2023-10-17T06:08:21.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.542+0000 7fface5d2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffac80b5b80 0x7ffac806f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:21.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.542+0000 7fface5d2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac815e680 con 0x7ffac8146800 2023-10-17T06:08:21.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.542+0000 7fface5d2700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac80b6180 con 0x7ffac806fee0 2023-10-17T06:08:21.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.542+0000 7fface5d2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac8070370 con 0x7ffac80b5b80 2023-10-17T06:08:21.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.542+0000 7ffac7fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ffac8146800 0x7ffac815dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48342/0 (socket says 172.21.15.125:48342) 2023-10-17T06:08:21.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.542+0000 7ffac7fff700 1 -- 172.21.15.125:0/3953746444 learned_addr learned my addr 172.21.15.125:0/3953746444 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:21.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.546+0000 7ffabffff700 1 --2- 172.21.15.125:0/3953746444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffac80b5b80 0x7ffac806f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:21.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.546+0000 7ffac77fe700 1 -- 172.21.15.125:0/3953746444 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014659620 0 0) 0x7ffac815e680 con 0x7ffac8146800 2023-10-17T06:08:21.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.546+0000 7ffac77fe700 1 -- 172.21.15.125:0/3953746444 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffab40035d0 con 0x7ffac8146800 2023-10-17T06:08:21.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.546+0000 7ffac77fe700 1 -- 172.21.15.125:0/3953746444 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594154883 0 0) 0x7ffac80b6180 con 0x7ffac806fee0 2023-10-17T06:08:21.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.546+0000 7ffac77fe700 1 -- 172.21.15.125:0/3953746444 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffac815e680 con 0x7ffac806fee0 2023-10-17T06:08:21.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.546+0000 7ffabffff700 1 -- 172.21.15.125:0/3953746444 >> v1:172.21.15.184:6789/0 conn(0x7ffac806fee0 legacy=0x7ffac815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:21.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.546+0000 7ffabffff700 1 -- 172.21.15.125:0/3953746444 >> v1:172.21.15.125:6789/0 conn(0x7ffac8146800 legacy=0x7ffac815dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:21.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.546+0000 7ffabffff700 1 -- 172.21.15.125:0/3953746444 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac80b6460 con 0x7ffac80b5b80 2023-10-17T06:08:21.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.546+0000 7ffabffff700 1 --2- 172.21.15.125:0/3953746444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffac80b5b80 0x7ffac806f9a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009880 tx=0x7ffab0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22abe9d4fe5a3d6f server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:21.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.546+0000 7ffac77fe700 1 -- 172.21.15.125:0/3953746444 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab0011830 con 0x7ffac80b5b80 2023-10-17T06:08:21.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.546+0000 7ffac77fe700 1 -- 172.21.15.125:0/3953746444 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab0011990 con 0x7ffac80b5b80 2023-10-17T06:08:21.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.546+0000 7ffac77fe700 1 -- 172.21.15.125:0/3953746444 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab0011d20 con 0x7ffac80b5b80 2023-10-17T06:08:21.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.546+0000 7fface5d2700 1 -- 172.21.15.125:0/3953746444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffac80b5b80 msgr2=0x7ffac806f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:21.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.546+0000 7fface5d2700 1 --2- 172.21.15.125:0/3953746444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffac80b5b80 0x7ffac806f9a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009880 tx=0x7ffab0009b90 comp rx=0 tx=0).stop 2023-10-17T06:08:21.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.546+0000 7fface5d2700 1 -- 172.21.15.125:0/3953746444 shutdown_connections 2023-10-17T06:08:21.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.546+0000 7fface5d2700 1 --2- 172.21.15.125:0/3953746444 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffac80b5b80 0x7ffac806f9a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:21.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.546+0000 7fface5d2700 1 -- 172.21.15.125:0/3953746444 >> 172.21.15.125:0/3953746444 conn(0x7ffac806a130 msgr2=0x7ffac806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:21.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.546+0000 7fface5d2700 1 -- 172.21.15.125:0/3953746444 shutdown_connections 2023-10-17T06:08:21.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.546+0000 7fface5d2700 1 -- 172.21.15.125:0/3953746444 wait complete. 2023-10-17T06:08:21.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.550+0000 7fface5d2700 1 Processor -- start 2023-10-17T06:08:21.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.550+0000 7fface5d2700 1 -- start start 2023-10-17T06:08:21.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.550+0000 7fface5d2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffac806fee0 0x7ffac815c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:21.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.550+0000 7fface5d2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffac80b5b80 0x7ffac81f2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:21.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.550+0000 7fface5d2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffac8146800 0x7ffac815d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:21.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.550+0000 7fface5d2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac815cb60 con 0x7ffac8146800 2023-10-17T06:08:21.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.550+0000 7fface5d2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac81f3180 con 0x7ffac806fee0 2023-10-17T06:08:21.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.550+0000 7fface5d2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac81f3460 con 0x7ffac80b5b80 2023-10-17T06:08:21.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.550+0000 7ffaccb6f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffac8146800 0x7ffac815d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:21.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.550+0000 7ffaccb6f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffac8146800 0x7ffac815d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48666/0 (socket says 172.21.15.125:48666) 2023-10-17T06:08:21.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.550+0000 7ffac7fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffac806fee0 0x7ffac815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:21.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.550+0000 7ffaccb6f700 1 -- 172.21.15.125:0/825553610 learned_addr learned my addr 172.21.15.125:0/825553610 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:21.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.550+0000 7ffabffff700 1 --2- 172.21.15.125:0/825553610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffac80b5b80 0x7ffac81f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:21.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.554+0000 7ffaccb6f700 1 -- 172.21.15.125:0/825553610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffac80b5b80 msgr2=0x7ffac81f2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:21.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.554+0000 7ffaccb6f700 1 --2- 172.21.15.125:0/825553610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffac80b5b80 0x7ffac81f2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:21.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.554+0000 7ffaccb6f700 1 -- 172.21.15.125:0/825553610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffac806fee0 msgr2=0x7ffac815c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:21.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.554+0000 7ffaccb6f700 1 --2- 172.21.15.125:0/825553610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffac806fee0 0x7ffac815c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:21.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.554+0000 7ffaccb6f700 1 -- 172.21.15.125:0/825553610 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab00094b0 con 0x7ffac8146800 2023-10-17T06:08:21.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.554+0000 7ffaccb6f700 1 --2- 172.21.15.125:0/825553610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffac8146800 0x7ffac815d320 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ffac000cc20 tx=0x7ffac000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:21.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.554+0000 7ffac57fa700 1 -- 172.21.15.125:0/825553610 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0003c20 con 0x7ffac8146800 2023-10-17T06:08:21.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.554+0000 7ffac57fa700 1 -- 172.21.15.125:0/825553610 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac0003d80 con 0x7ffac8146800 2023-10-17T06:08:21.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.554+0000 7ffac57fa700 1 -- 172.21.15.125:0/825553610 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac000aae0 con 0x7ffac8146800 2023-10-17T06:08:21.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.554+0000 7fface5d2700 1 -- 172.21.15.125:0/825553610 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac81f3740 con 0x7ffac8146800 2023-10-17T06:08:21.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.554+0000 7fface5d2700 1 -- 172.21.15.125:0/825553610 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac8131370 con 0x7ffac8146800 2023-10-17T06:08:21.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.554+0000 7fface5d2700 1 -- 172.21.15.125:0/825553610 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac8072e60 con 0x7ffac8146800 2023-10-17T06:08:21.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.558+0000 7ffac57fa700 1 -- 172.21.15.125:0/825553610 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ffac000ac40 con 0x7ffac8146800 2023-10-17T06:08:21.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.558+0000 7ffac57fa700 1 --2- 172.21.15.125:0/825553610 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ffaa80656f0 0x7ffaa8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:21.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.558+0000 7ffac57fa700 1 -- 172.21.15.125:0/825553610 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ffac0083170 con 0x7ffac8146800 2023-10-17T06:08:21.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.558+0000 7ffac7fff700 1 --2- 172.21.15.125:0/825553610 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ffaa80656f0 0x7ffaa8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:21.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.558+0000 7ffac7fff700 1 --2- 172.21.15.125:0/825553610 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ffaa80656f0 0x7ffaa8067bb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ffab8000f60 tx=0x7ffab8007e20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:21.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.566+0000 7ffac57fa700 1 -- 172.21.15.125:0/825553610 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ffac0050900 con 0x7ffac8146800 2023-10-17T06:08:21.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.746+0000 7fface5d2700 1 -- 172.21.15.125:0/825553610 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffac8131560 con 0x7ffac8146800 2023-10-17T06:08:21.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.750+0000 7ffac57fa700 1 -- 172.21.15.125:0/825553610 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20252 (secure 0 0 0) 0x7ffac0053f20 con 0x7ffac8146800 2023-10-17T06:08:21.754 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:21.755 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":30,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:49.710984+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:08:21.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.750+0000 7fface5d2700 1 -- 172.21.15.125:0/825553610 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ffaa80656f0 msgr2=0x7ffaa8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:21.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.750+0000 7fface5d2700 1 --2- 172.21.15.125:0/825553610 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ffaa80656f0 0x7ffaa8067bb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ffab8000f60 tx=0x7ffab8007e20 comp rx=0 tx=0).stop 2023-10-17T06:08:21.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.750+0000 7fface5d2700 1 -- 172.21.15.125:0/825553610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffac8146800 msgr2=0x7ffac815d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:21.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.750+0000 7fface5d2700 1 --2- 172.21.15.125:0/825553610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffac8146800 0x7ffac815d320 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ffac000cc20 tx=0x7ffac000cf30 comp rx=0 tx=0).stop 2023-10-17T06:08:21.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.754+0000 7fface5d2700 1 -- 172.21.15.125:0/825553610 shutdown_connections 2023-10-17T06:08:21.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.754+0000 7fface5d2700 1 --2- 172.21.15.125:0/825553610 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ffaa80656f0 0x7ffaa8067bb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:21.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.754+0000 7fface5d2700 1 --2- 172.21.15.125:0/825553610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffac8146800 0x7ffac815d320 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:21.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.754+0000 7fface5d2700 1 --2- 172.21.15.125:0/825553610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffac80b5b80 0x7ffac81f2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:21.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.754+0000 7fface5d2700 1 --2- 172.21.15.125:0/825553610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffac806fee0 0x7ffac815c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:21.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.754+0000 7fface5d2700 1 -- 172.21.15.125:0/825553610 >> 172.21.15.125:0/825553610 conn(0x7ffac806a130 msgr2=0x7ffac8145aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:21.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.754+0000 7fface5d2700 1 -- 172.21.15.125:0/825553610 shutdown_connections 2023-10-17T06:08:21.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.754+0000 7fface5d2700 1 -- 172.21.15.125:0/825553610 wait complete. 2023-10-17T06:08:21.781 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-17T06:07:06.629169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-17T06:07:08.148117+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-17T06:07:11.895112+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-17T06:08:21.782 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:08:21.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.958+0000 7f3d4e0c3700 1 Processor -- start 2023-10-17T06:08:21.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.958+0000 7f3d4e0c3700 1 -- start start 2023-10-17T06:08:21.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.962+0000 7f3d4e0c3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d481467c0 0x7f3d480b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:21.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.962+0000 7f3d4e0c3700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3d481612e0 0x7f3d4815d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:21.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.962+0000 7f3d4e0c3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d48146ba0 con 0x7f3d4806f9a0 2023-10-17T06:08:21.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.962+0000 7f3d4e0c3700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d480d0920 con 0x7f3d481612e0 2023-10-17T06:08:21.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.962+0000 7f3d4e0c3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d480b6160 con 0x7f3d481467c0 2023-10-17T06:08:21.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.962+0000 7f3d47fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3d4806f9a0 0x7f3d480d0db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48358/0 (socket says 172.21.15.125:48358) 2023-10-17T06:08:21.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.962+0000 7f3d47fff700 1 -- 172.21.15.125:0/358170943 learned_addr learned my addr 172.21.15.125:0/358170943 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:21.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.962+0000 7f3d477fe700 1 --2- 172.21.15.125:0/358170943 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d481467c0 0x7f3d480b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:21.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.962+0000 7f3d46ffd700 1 --2- 172.21.15.125:0/358170943 >> v2:172.21.15.184:3300/0 conn(0x7f3d481612e0 0x7f3d4815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:21.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.962+0000 7f3d467fc700 1 -- 172.21.15.125:0/358170943 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1670333063 0 0) 0x7f3d48146ba0 con 0x7f3d4806f9a0 2023-10-17T06:08:21.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.962+0000 7f3d467fc700 1 -- 172.21.15.125:0/358170943 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d300035d0 con 0x7f3d4806f9a0 2023-10-17T06:08:21.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.962+0000 7f3d477fe700 1 -- 172.21.15.125:0/358170943 >> v2:172.21.15.184:3300/0 conn(0x7f3d481612e0 msgr2=0x7f3d4815d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:21.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.962+0000 7f3d477fe700 1 --2- 172.21.15.125:0/358170943 >> v2:172.21.15.184:3300/0 conn(0x7f3d481612e0 0x7f3d4815d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:21.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.962+0000 7f3d477fe700 1 -- 172.21.15.125:0/358170943 >> v1:172.21.15.125:6789/0 conn(0x7f3d4806f9a0 legacy=0x7f3d480d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:21.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.962+0000 7f3d477fe700 1 -- 172.21.15.125:0/358170943 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d480b6440 con 0x7f3d481467c0 2023-10-17T06:08:21.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.962+0000 7f3d477fe700 1 --2- 172.21.15.125:0/358170943 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d481467c0 0x7f3d480b5b80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009850 tx=0x7f3d38009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ffb9149da133ca0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:21.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.966+0000 7f3d467fc700 1 -- 172.21.15.125:0/358170943 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38011830 con 0x7f3d481467c0 2023-10-17T06:08:21.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.966+0000 7f3d467fc700 1 -- 172.21.15.125:0/358170943 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d38011990 con 0x7f3d481467c0 2023-10-17T06:08:21.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.966+0000 7f3d467fc700 1 -- 172.21.15.125:0/358170943 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38011d40 con 0x7f3d481467c0 2023-10-17T06:08:21.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.966+0000 7f3d4e0c3700 1 -- 172.21.15.125:0/358170943 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d481467c0 msgr2=0x7f3d480b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:21.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.966+0000 7f3d4e0c3700 1 --2- 172.21.15.125:0/358170943 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d481467c0 0x7f3d480b5b80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009850 tx=0x7f3d38009b60 comp rx=0 tx=0).stop 2023-10-17T06:08:21.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.966+0000 7f3d4e0c3700 1 -- 172.21.15.125:0/358170943 shutdown_connections 2023-10-17T06:08:21.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.966+0000 7f3d4e0c3700 1 --2- 172.21.15.125:0/358170943 >> v2:172.21.15.184:3300/0 conn(0x7f3d481612e0 0x7f3d4815d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:21.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.966+0000 7f3d4e0c3700 1 --2- 172.21.15.125:0/358170943 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d481467c0 0x7f3d480b5b80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:21.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.966+0000 7f3d4e0c3700 1 -- 172.21.15.125:0/358170943 >> 172.21.15.125:0/358170943 conn(0x7f3d4806a130 msgr2=0x7f3d4806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:21.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.966+0000 7f3d4e0c3700 1 -- 172.21.15.125:0/358170943 shutdown_connections 2023-10-17T06:08:21.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.966+0000 7f3d4e0c3700 1 -- 172.21.15.125:0/358170943 wait complete. 2023-10-17T06:08:21.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d4e0c3700 1 Processor -- start 2023-10-17T06:08:21.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d4e0c3700 1 -- start start 2023-10-17T06:08:21.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d4e0c3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d4806f9a0 0x7f3d4813e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:21.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d4e0c3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d481467c0 0x7f3d48140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:21.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d4e0c3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d481612e0 0x7f3d480d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:21.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d4e0c3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4813ecd0 con 0x7f3d4806f9a0 2023-10-17T06:08:21.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d4e0c3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4813ee80 con 0x7f3d481467c0 2023-10-17T06:08:21.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d4e0c3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4813fce0 con 0x7f3d481612e0 2023-10-17T06:08:21.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d477fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d4806f9a0 0x7f3d4813e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:21.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d477fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d4806f9a0 0x7f3d4813e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48670/0 (socket says 172.21.15.125:48670) 2023-10-17T06:08:21.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d477fe700 1 -- 172.21.15.125:0/3212096857 learned_addr learned my addr 172.21.15.125:0/3212096857 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:21.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d47fff700 1 --2- 172.21.15.125:0/3212096857 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d481612e0 0x7f3d480d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:21.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d46ffd700 1 --2- 172.21.15.125:0/3212096857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d481467c0 0x7f3d48140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:21.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d477fe700 1 -- 172.21.15.125:0/3212096857 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d481612e0 msgr2=0x7f3d480d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:21.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d477fe700 1 --2- 172.21.15.125:0/3212096857 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d481612e0 0x7f3d480d0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:21.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d477fe700 1 -- 172.21.15.125:0/3212096857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d481467c0 msgr2=0x7f3d48140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:21.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d477fe700 1 --2- 172.21.15.125:0/3212096857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d481467c0 0x7f3d48140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:21.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d477fe700 1 -- 172.21.15.125:0/3212096857 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d380094b0 con 0x7f3d4806f9a0 2023-10-17T06:08:21.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d477fe700 1 --2- 172.21.15.125:0/3212096857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d4806f9a0 0x7f3d4813e790 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3d480b62a0 tx=0x7f3d38004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:21.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d2ffff700 1 -- 172.21.15.125:0/3212096857 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38004480 con 0x7f3d4806f9a0 2023-10-17T06:08:21.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.970+0000 7f3d2ffff700 1 -- 172.21.15.125:0/3212096857 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3801f070 con 0x7f3d4806f9a0 2023-10-17T06:08:21.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.974+0000 7f3d2ffff700 1 -- 172.21.15.125:0/3212096857 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d38003900 con 0x7f3d4806f9a0 2023-10-17T06:08:21.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.974+0000 7f3d4e0c3700 1 -- 172.21.15.125:0/3212096857 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d48141070 con 0x7f3d4806f9a0 2023-10-17T06:08:21.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.974+0000 7f3d4e0c3700 1 -- 172.21.15.125:0/3212096857 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4813f3b0 con 0x7f3d4806f9a0 2023-10-17T06:08:21.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.974+0000 7f3d4e0c3700 1 -- 172.21.15.125:0/3212096857 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4813fe20 con 0x7f3d4806f9a0 2023-10-17T06:08:21.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.974+0000 7f3d2ffff700 1 -- 172.21.15.125:0/3212096857 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f3d38021030 con 0x7f3d4806f9a0 2023-10-17T06:08:21.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.974+0000 7f3d2ffff700 1 --2- 172.21.15.125:0/3212096857 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3d340656f0 0x7f3d34067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:21.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.978+0000 7f3d2ffff700 1 -- 172.21.15.125:0/3212096857 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3d380843e0 con 0x7f3d4806f9a0 2023-10-17T06:08:21.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.978+0000 7f3d46ffd700 1 --2- 172.21.15.125:0/3212096857 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3d340656f0 0x7f3d34067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:21.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.978+0000 7f3d46ffd700 1 --2- 172.21.15.125:0/3212096857 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3d340656f0 0x7f3d34067bb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3d48141db0 tx=0x7f3d3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:21.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:21.982+0000 7f3d2ffff700 1 -- 172.21.15.125:0/3212096857 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f3d4813fe20 con 0x7f3d4806f9a0 2023-10-17T06:08:22.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.162+0000 7f3d4e0c3700 1 -- 172.21.15.125:0/3212096857 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d4813fe20 con 0x7f3d4806f9a0 2023-10-17T06:08:22.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.162+0000 7f3d2ffff700 1 -- 172.21.15.125:0/3212096857 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d4813fe20 con 0x7f3d4806f9a0 2023-10-17T06:08:22.167 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:08:22.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.166+0000 7f3d4e0c3700 1 -- 172.21.15.125:0/3212096857 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3d340656f0 msgr2=0x7f3d34067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:22.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.166+0000 7f3d4e0c3700 1 --2- 172.21.15.125:0/3212096857 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3d340656f0 0x7f3d34067bb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3d48141db0 tx=0x7f3d3c008040 comp rx=0 tx=0).stop 2023-10-17T06:08:22.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.166+0000 7f3d4e0c3700 1 -- 172.21.15.125:0/3212096857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d4806f9a0 msgr2=0x7f3d4813e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:22.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.166+0000 7f3d4e0c3700 1 --2- 172.21.15.125:0/3212096857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d4806f9a0 0x7f3d4813e790 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3d480b62a0 tx=0x7f3d38004770 comp rx=0 tx=0).stop 2023-10-17T06:08:22.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.166+0000 7f3d4e0c3700 1 -- 172.21.15.125:0/3212096857 shutdown_connections 2023-10-17T06:08:22.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.166+0000 7f3d4e0c3700 1 --2- 172.21.15.125:0/3212096857 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3d340656f0 0x7f3d34067bb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:22.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.166+0000 7f3d4e0c3700 1 --2- 172.21.15.125:0/3212096857 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3d481612e0 0x7f3d480d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:22.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.166+0000 7f3d4e0c3700 1 --2- 172.21.15.125:0/3212096857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d481467c0 0x7f3d48140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:22.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.166+0000 7f3d4e0c3700 1 --2- 172.21.15.125:0/3212096857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d4806f9a0 0x7f3d4813e790 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:22.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.166+0000 7f3d4e0c3700 1 -- 172.21.15.125:0/3212096857 >> 172.21.15.125:0/3212096857 conn(0x7f3d4806a130 msgr2=0x7f3d481442e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:22.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.166+0000 7f3d4e0c3700 1 -- 172.21.15.125:0/3212096857 shutdown_connections 2023-10-17T06:08:22.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.166+0000 7f3d4e0c3700 1 -- 172.21.15.125:0/3212096857 wait complete. 2023-10-17T06:08:22.191 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:08:22.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.370+0000 7fba94e35700 1 Processor -- start 2023-10-17T06:08:22.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.370+0000 7fba94e35700 1 -- start start 2023-10-17T06:08:22.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.374+0000 7fba94e35700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fba900d2e00 0x7fba900b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:22.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.374+0000 7fba94e35700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba9015d0d0 con 0x7fba90160710 2023-10-17T06:08:22.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.374+0000 7fba94e35700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba9006f0f0 con 0x7fba900b5ae0 2023-10-17T06:08:22.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.374+0000 7fba94e35700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba9015df90 con 0x7fba900d2e00 2023-10-17T06:08:22.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.374+0000 7fba8effd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fba90160710 0x7fba900d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48364/0 (socket says 172.21.15.125:48364) 2023-10-17T06:08:22.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.374+0000 7fba8effd700 1 -- 172.21.15.125:0/132366688 learned_addr learned my addr 172.21.15.125:0/132366688 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:22.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.374+0000 7fba8f7fe700 1 --2- 172.21.15.125:0/132366688 >> v2:172.21.15.184:3300/0 conn(0x7fba900d2e00 0x7fba900b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:22.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.374+0000 7fba8e7fc700 1 -- 172.21.15.125:0/132366688 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983151232 0 0) 0x7fba84001110 con 0x7fba90160710 2023-10-17T06:08:22.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.374+0000 7fba8f7fe700 1 -- 172.21.15.125:0/132366688 >> v1:172.21.15.184:6789/0 conn(0x7fba900b5ae0 legacy=0x7fba9006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:22.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.374+0000 7fba8f7fe700 1 -- 172.21.15.125:0/132366688 >> v1:172.21.15.125:6789/0 conn(0x7fba90160710 legacy=0x7fba900d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:22.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.374+0000 7fba8f7fe700 1 -- 172.21.15.125:0/132366688 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9015d310 con 0x7fba900d2e00 2023-10-17T06:08:22.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.374+0000 7fba8f7fe700 1 --2- 172.21.15.125:0/132366688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba900d2e00 0x7fba900b6e00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fba800097d0 tx=0x7fba80009ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a66012c2416169ed server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:22.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.378+0000 7fba8e7fc700 1 -- 172.21.15.125:0/132366688 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80004230 con 0x7fba900d2e00 2023-10-17T06:08:22.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.378+0000 7fba8e7fc700 1 -- 172.21.15.125:0/132366688 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba80004390 con 0x7fba900d2e00 2023-10-17T06:08:22.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.378+0000 7fba8e7fc700 1 -- 172.21.15.125:0/132366688 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba800036c0 con 0x7fba900d2e00 2023-10-17T06:08:22.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.378+0000 7fba94e35700 1 -- 172.21.15.125:0/132366688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba900d2e00 msgr2=0x7fba900b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:22.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.378+0000 7fba94e35700 1 --2- 172.21.15.125:0/132366688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba900d2e00 0x7fba900b6e00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fba800097d0 tx=0x7fba80009ae0 comp rx=0 tx=0).stop 2023-10-17T06:08:22.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.378+0000 7fba94e35700 1 -- 172.21.15.125:0/132366688 shutdown_connections 2023-10-17T06:08:22.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.378+0000 7fba94e35700 1 --2- 172.21.15.125:0/132366688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba900d2e00 0x7fba900b6e00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:22.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.378+0000 7fba94e35700 1 -- 172.21.15.125:0/132366688 >> 172.21.15.125:0/132366688 conn(0x7fba90069f20 msgr2=0x7fba9006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:22.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.378+0000 7fba94e35700 1 -- 172.21.15.125:0/132366688 shutdown_connections 2023-10-17T06:08:22.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.378+0000 7fba94e35700 1 -- 172.21.15.125:0/132366688 wait complete. 2023-10-17T06:08:22.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.378+0000 7fba94e35700 1 Processor -- start 2023-10-17T06:08:22.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.378+0000 7fba94e35700 1 -- start start 2023-10-17T06:08:22.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba94e35700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba900b5ae0 0x7fba901515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:22.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba94e35700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba900d2e00 0x7fba900cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:22.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba94e35700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba90160710 0x7fba900cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:22.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba94e35700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba90151b30 con 0x7fba90160710 2023-10-17T06:08:22.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba94e35700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba90152310 con 0x7fba900b5ae0 2023-10-17T06:08:22.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba94e35700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba901525f0 con 0x7fba900d2e00 2023-10-17T06:08:22.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba8ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba90160710 0x7fba900cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:22.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba8ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba90160710 0x7fba900cfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48680/0 (socket says 172.21.15.125:48680) 2023-10-17T06:08:22.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba8ffff700 1 -- 172.21.15.125:0/238929572 learned_addr learned my addr 172.21.15.125:0/238929572 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:22.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba8f7fe700 1 --2- 172.21.15.125:0/238929572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba900b5ae0 0x7fba901515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:22.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba8effd700 1 --2- 172.21.15.125:0/238929572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba900d2e00 0x7fba900cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:22.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba8ffff700 1 -- 172.21.15.125:0/238929572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba900d2e00 msgr2=0x7fba900cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:22.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba8ffff700 1 --2- 172.21.15.125:0/238929572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba900d2e00 0x7fba900cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:22.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba8ffff700 1 -- 172.21.15.125:0/238929572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba900b5ae0 msgr2=0x7fba901515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:22.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba8ffff700 1 --2- 172.21.15.125:0/238929572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba900b5ae0 0x7fba901515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:22.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba8ffff700 1 -- 172.21.15.125:0/238929572 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba800094b0 con 0x7fba90160710 2023-10-17T06:08:22.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba8ffff700 1 --2- 172.21.15.125:0/238929572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba90160710 0x7fba900cfef0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fba8800cca0 tx=0x7fba8800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba77fff700 1 -- 172.21.15.125:0/238929572 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88003ea0 con 0x7fba90160710 2023-10-17T06:08:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba77fff700 1 -- 172.21.15.125:0/238929572 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8800a700 con 0x7fba90160710 2023-10-17T06:08:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba94e35700 1 -- 172.21.15.125:0/238929572 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba901528d0 con 0x7fba90160710 2023-10-17T06:08:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba77fff700 1 -- 172.21.15.125:0/238929572 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8800aab0 con 0x7fba90160710 2023-10-17T06:08:22.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.382+0000 7fba94e35700 1 -- 172.21.15.125:0/238929572 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba90152e90 con 0x7fba90160710 2023-10-17T06:08:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.386+0000 7fba94e35700 1 -- 172.21.15.125:0/238929572 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba9004e910 con 0x7fba90160710 2023-10-17T06:08:22.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.386+0000 7fba77fff700 1 -- 172.21.15.125:0/238929572 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fba8800ac10 con 0x7fba90160710 2023-10-17T06:08:22.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.390+0000 7fba77fff700 1 --2- 172.21.15.125:0/238929572 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fba7c0656f0 0x7fba7c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:22.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.390+0000 7fba77fff700 1 -- 172.21.15.125:0/238929572 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fba88083210 con 0x7fba90160710 2023-10-17T06:08:22.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.390+0000 7fba8f7fe700 1 --2- 172.21.15.125:0/238929572 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fba7c0656f0 0x7fba7c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:22.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.390+0000 7fba8f7fe700 1 --2- 172.21.15.125:0/238929572 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fba7c0656f0 0x7fba7c067bb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fba800097d0 tx=0x7fba80010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:22.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.394+0000 7fba77fff700 1 -- 172.21.15.125:0/238929572 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fba88050900 con 0x7fba90160710 2023-10-17T06:08:22.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.566+0000 7fba94e35700 1 -- 172.21.15.125:0/238929572 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fba9006d3e0 con 0x7fba90160710 2023-10-17T06:08:22.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.566+0000 7fba77fff700 1 -- 172.21.15.125:0/238929572 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fba88053f20 con 0x7fba90160710 2023-10-17T06:08:22.572 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:08:22.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.570+0000 7fba94e35700 1 -- 172.21.15.125:0/238929572 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fba7c0656f0 msgr2=0x7fba7c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:22.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.570+0000 7fba94e35700 1 --2- 172.21.15.125:0/238929572 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fba7c0656f0 0x7fba7c067bb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fba800097d0 tx=0x7fba80010000 comp rx=0 tx=0).stop 2023-10-17T06:08:22.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.570+0000 7fba94e35700 1 -- 172.21.15.125:0/238929572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba90160710 msgr2=0x7fba900cfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:22.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.570+0000 7fba94e35700 1 --2- 172.21.15.125:0/238929572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba90160710 0x7fba900cfef0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fba8800cca0 tx=0x7fba8800a060 comp rx=0 tx=0).stop 2023-10-17T06:08:22.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.570+0000 7fba94e35700 1 -- 172.21.15.125:0/238929572 shutdown_connections 2023-10-17T06:08:22.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.570+0000 7fba94e35700 1 --2- 172.21.15.125:0/238929572 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fba7c0656f0 0x7fba7c067bb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:22.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.570+0000 7fba94e35700 1 --2- 172.21.15.125:0/238929572 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba90160710 0x7fba900cfef0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:22.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.570+0000 7fba94e35700 1 --2- 172.21.15.125:0/238929572 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba900d2e00 0x7fba900cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:22.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.570+0000 7fba94e35700 1 --2- 172.21.15.125:0/238929572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba900b5ae0 0x7fba901515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:22.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.570+0000 7fba94e35700 1 -- 172.21.15.125:0/238929572 >> 172.21.15.125:0/238929572 conn(0x7fba90069f20 msgr2=0x7fba9006f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:22.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.570+0000 7fba94e35700 1 -- 172.21.15.125:0/238929572 shutdown_connections 2023-10-17T06:08:22.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.570+0000 7fba94e35700 1 -- 172.21.15.125:0/238929572 wait complete. 2023-10-17T06:08:22.598 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-17T06:08:22.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.778+0000 7f9ab359e700 1 Processor -- start 2023-10-17T06:08:22.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.778+0000 7f9ab359e700 1 -- start start 2023-10-17T06:08:22.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.778+0000 7f9ab359e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9ab415dcf0 0x7f9ab406fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:22.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab359e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab40b6e40 con 0x7f9ab40d2e20 2023-10-17T06:08:22.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab359e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab40b7120 con 0x7f9ab40d23e0 2023-10-17T06:08:22.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab359e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab415e160 con 0x7f9ab415dcf0 2023-10-17T06:08:22.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab1d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9ab415dcf0 0x7f9ab406fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:22.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab1d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9ab415dcf0 0x7f9ab406fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48696/0 (socket says 172.21.15.125:48696) 2023-10-17T06:08:22.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab1d9b700 1 -- 172.21.15.125:0/3134549204 learned_addr learned my addr 172.21.15.125:0/3134549204 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:22.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab1d9b700 1 -- 172.21.15.125:0/3134549204 >> v1:172.21.15.184:6789/0 conn(0x7f9ab40d23e0 legacy=0x7f9ab40b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:22.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab1d9b700 1 -- 172.21.15.125:0/3134549204 >> v1:172.21.15.125:6789/0 conn(0x7f9ab40d2e20 legacy=0x7f9ab41607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:22.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab1d9b700 1 -- 172.21.15.125:0/3134549204 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab415d4f0 con 0x7f9ab415dcf0 2023-10-17T06:08:22.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab159a700 1 -- 172.21.15.125:0/3134549204 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096628587 0 0) 0x7f9ab40b6e40 con 0x7f9ab40d2e20 2023-10-17T06:08:22.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab1d9b700 1 --2- 172.21.15.125:0/3134549204 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ab415dcf0 0x7f9ab406fef0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009910 tx=0x7f9aa8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a77571e1845d69 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:22.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab159a700 1 -- 172.21.15.125:0/3134549204 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8004230 con 0x7f9ab415dcf0 2023-10-17T06:08:22.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab159a700 1 -- 172.21.15.125:0/3134549204 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa8004390 con 0x7f9ab415dcf0 2023-10-17T06:08:22.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab159a700 1 -- 172.21.15.125:0/3134549204 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8009e60 con 0x7f9ab415dcf0 2023-10-17T06:08:22.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab359e700 1 -- 172.21.15.125:0/3134549204 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ab415dcf0 msgr2=0x7f9ab406fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:22.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab359e700 1 --2- 172.21.15.125:0/3134549204 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ab415dcf0 0x7f9ab406fef0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009910 tx=0x7f9aa8009c20 comp rx=0 tx=0).stop 2023-10-17T06:08:22.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab359e700 1 -- 172.21.15.125:0/3134549204 shutdown_connections 2023-10-17T06:08:22.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab359e700 1 --2- 172.21.15.125:0/3134549204 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ab415dcf0 0x7f9ab406fef0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:22.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab359e700 1 -- 172.21.15.125:0/3134549204 >> 172.21.15.125:0/3134549204 conn(0x7f9ab4069f20 msgr2=0x7f9ab406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:22.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab359e700 1 -- 172.21.15.125:0/3134549204 shutdown_connections 2023-10-17T06:08:22.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.782+0000 7f9ab359e700 1 -- 172.21.15.125:0/3134549204 wait complete. 2023-10-17T06:08:22.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.786+0000 7f9ab359e700 1 Processor -- start 2023-10-17T06:08:22.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.786+0000 7f9ab359e700 1 -- start start 2023-10-17T06:08:22.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.786+0000 7f9ab359e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ab40d23e0 0x7f9ab40b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:22.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.786+0000 7f9ab359e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ab40d2e20 0x7f9ab41f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:22.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.786+0000 7f9ab359e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ab415dcf0 0x7f9ab4148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:22.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.786+0000 7f9ab359e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab4149760 con 0x7f9ab40d23e0 2023-10-17T06:08:22.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.786+0000 7f9ab359e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab41f6000 con 0x7f9ab40d2e20 2023-10-17T06:08:22.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.786+0000 7f9ab359e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab41f6280 con 0x7f9ab415dcf0 2023-10-17T06:08:22.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.786+0000 7f9ab259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ab40d23e0 0x7f9ab40b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:22.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.786+0000 7f9ab259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ab40d23e0 0x7f9ab40b1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48712/0 (socket says 172.21.15.125:48712) 2023-10-17T06:08:22.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.786+0000 7f9ab259c700 1 -- 172.21.15.125:0/1191615314 learned_addr learned my addr 172.21.15.125:0/1191615314 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:22.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.786+0000 7f9ab2d9d700 1 --2- 172.21.15.125:0/1191615314 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ab415dcf0 0x7f9ab4148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:22.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.786+0000 7f9ab1d9b700 1 --2- 172.21.15.125:0/1191615314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ab40d2e20 0x7f9ab41f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:22.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.786+0000 7f9ab259c700 1 -- 172.21.15.125:0/1191615314 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ab415dcf0 msgr2=0x7f9ab4148e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:22.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.786+0000 7f9ab259c700 1 --2- 172.21.15.125:0/1191615314 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ab415dcf0 0x7f9ab4148e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:22.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.786+0000 7f9ab259c700 1 -- 172.21.15.125:0/1191615314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ab40d2e20 msgr2=0x7f9ab41f5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:22.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.786+0000 7f9ab259c700 1 --2- 172.21.15.125:0/1191615314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ab40d2e20 0x7f9ab41f5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:22.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.786+0000 7f9ab259c700 1 -- 172.21.15.125:0/1191615314 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa8009570 con 0x7f9ab40d23e0 2023-10-17T06:08:22.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.790+0000 7f9ab259c700 1 --2- 172.21.15.125:0/1191615314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ab40d23e0 0x7f9ab40b1510 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400b4d0 tx=0x7f9aa400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:22.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.790+0000 7f9aa2ffd700 1 -- 172.21.15.125:0/1191615314 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4011830 con 0x7f9ab40d23e0 2023-10-17T06:08:22.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.790+0000 7f9ab359e700 1 -- 172.21.15.125:0/1191615314 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab41f6560 con 0x7f9ab40d23e0 2023-10-17T06:08:22.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.790+0000 7f9aa2ffd700 1 -- 172.21.15.125:0/1191615314 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa4011990 con 0x7f9ab40d23e0 2023-10-17T06:08:22.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.790+0000 7f9ab359e700 1 -- 172.21.15.125:0/1191615314 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab4149970 con 0x7f9ab40d23e0 2023-10-17T06:08:22.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.790+0000 7f9aa2ffd700 1 -- 172.21.15.125:0/1191615314 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4011d40 con 0x7f9ab40d23e0 2023-10-17T06:08:22.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.790+0000 7f9ab359e700 1 -- 172.21.15.125:0/1191615314 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab40b6460 con 0x7f9ab40d23e0 2023-10-17T06:08:22.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.794+0000 7f9aa2ffd700 1 -- 172.21.15.125:0/1191615314 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9aa401a400 con 0x7f9ab40d23e0 2023-10-17T06:08:22.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.794+0000 7f9aa2ffd700 1 --2- 172.21.15.125:0/1191615314 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9a940656f0 0x7f9a94067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:22.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.794+0000 7f9aa2ffd700 1 -- 172.21.15.125:0/1191615314 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9aa40831d0 con 0x7f9ab40d23e0 2023-10-17T06:08:22.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.794+0000 7f9ab1d9b700 1 --2- 172.21.15.125:0/1191615314 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9a940656f0 0x7f9a94067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:22.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.794+0000 7f9ab1d9b700 1 --2- 172.21.15.125:0/1191615314 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9a940656f0 0x7f9a94067bb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009910 tx=0x7f9aa8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:22.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.802+0000 7f9aa2ffd700 1 -- 172.21.15.125:0/1191615314 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f9aa4050950 con 0x7f9ab40d23e0 2023-10-17T06:08:22.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.978+0000 7f9ab359e700 1 -- 172.21.15.125:0/1191615314 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ab404e910 con 0x7f9ab40d23e0 2023-10-17T06:08:22.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.978+0000 7f9aa2ffd700 1 -- 172.21.15.125:0/1191615314 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9aa4053f70 con 0x7f9ab40d23e0 2023-10-17T06:08:22.985 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:22.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.982+0000 7f9ab359e700 1 -- 172.21.15.125:0/1191615314 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9a940656f0 msgr2=0x7f9a94067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:22.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.982+0000 7f9ab359e700 1 --2- 172.21.15.125:0/1191615314 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9a940656f0 0x7f9a94067bb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009910 tx=0x7f9aa8008030 comp rx=0 tx=0).stop 2023-10-17T06:08:22.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.982+0000 7f9ab359e700 1 -- 172.21.15.125:0/1191615314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ab40d23e0 msgr2=0x7f9ab40b1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:22.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.982+0000 7f9ab359e700 1 --2- 172.21.15.125:0/1191615314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ab40d23e0 0x7f9ab40b1510 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400b4d0 tx=0x7f9aa400b890 comp rx=0 tx=0).stop 2023-10-17T06:08:22.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.982+0000 7f9ab359e700 1 -- 172.21.15.125:0/1191615314 shutdown_connections 2023-10-17T06:08:22.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.982+0000 7f9ab359e700 1 --2- 172.21.15.125:0/1191615314 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9a940656f0 0x7f9a94067bb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:22.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.982+0000 7f9ab359e700 1 --2- 172.21.15.125:0/1191615314 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ab415dcf0 0x7f9ab4148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:22.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.982+0000 7f9ab359e700 1 --2- 172.21.15.125:0/1191615314 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ab40d2e20 0x7f9ab41f5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:22.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.982+0000 7f9ab359e700 1 --2- 172.21.15.125:0/1191615314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ab40d23e0 0x7f9ab40b1510 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:22.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.982+0000 7f9ab359e700 1 -- 172.21.15.125:0/1191615314 >> 172.21.15.125:0/1191615314 conn(0x7f9ab4069f20 msgr2=0x7f9ab415e310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:22.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.982+0000 7f9ab359e700 1 -- 172.21.15.125:0/1191615314 shutdown_connections 2023-10-17T06:08:22.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:22.982+0000 7f9ab359e700 1 -- 172.21.15.125:0/1191615314 wait complete. 2023-10-17T06:08:23.010 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-17T06:08:23.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.198+0000 7fdbcc913700 1 Processor -- start 2023-10-17T06:08:23.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.202+0000 7fdbcc913700 1 -- start start 2023-10-17T06:08:23.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.202+0000 7fdbcc913700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdbc81467c0 0x7fdbc80b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:23.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.202+0000 7fdbcc913700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbc81612e0 0x7fdbc815d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:23.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.202+0000 7fdbcc913700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdbc806f9a0 0x7fdbc806fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:23.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.202+0000 7fdbcc913700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc8070350 con 0x7fdbc806f9a0 2023-10-17T06:08:23.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.202+0000 7fdbcc913700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc8146ba0 con 0x7fdbc81467c0 2023-10-17T06:08:23.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.202+0000 7fdbcc913700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc80d0920 con 0x7fdbc81612e0 2023-10-17T06:08:23.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbc659c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdbc81467c0 0x7fdbc80b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:23.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbc6d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdbc806f9a0 0x7fdbc806fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:23.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbc659c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdbc81467c0 0x7fdbc80b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:49168/0 (socket says 172.21.15.125:49168) 2023-10-17T06:08:23.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbc659c700 1 -- 172.21.15.125:0/2593405351 learned_addr learned my addr 172.21.15.125:0/2593405351 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:23.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbc5d9b700 1 --2- 172.21.15.125:0/2593405351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbc81612e0 0x7fdbc815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:23.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbc6d9d700 1 -- 172.21.15.125:0/2593405351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbc81612e0 msgr2=0x7fdbc815d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:23.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbc6d9d700 1 --2- 172.21.15.125:0/2593405351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbc81612e0 0x7fdbc815d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbc6d9d700 1 -- 172.21.15.125:0/2593405351 >> v2:172.21.15.184:3300/0 conn(0x7fdbc81467c0 msgr2=0x7fdbc80b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:23.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbc6d9d700 1 --2- 172.21.15.125:0/2593405351 >> v2:172.21.15.184:3300/0 conn(0x7fdbc81467c0 0x7fdbc80b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbc6d9d700 1 -- 172.21.15.125:0/2593405351 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc80b6160 con 0x7fdbc806f9a0 2023-10-17T06:08:23.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbc6d9d700 1 --2- 172.21.15.125:0/2593405351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc806f9a0 0x7fdbc806fe10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80b6f30 tx=0x7fdbc000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f3f0dce0c5632a server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:23.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbc559a700 1 -- 172.21.15.125:0/2593405351 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc000e070 con 0x7fdbc806f9a0 2023-10-17T06:08:23.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbc559a700 1 -- 172.21.15.125:0/2593405351 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc000bb20 con 0x7fdbc806f9a0 2023-10-17T06:08:23.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbc559a700 1 -- 172.21.15.125:0/2593405351 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0012430 con 0x7fdbc806f9a0 2023-10-17T06:08:23.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbcc913700 1 -- 172.21.15.125:0/2593405351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc806f9a0 msgr2=0x7fdbc806fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:23.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbcc913700 1 --2- 172.21.15.125:0/2593405351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc806f9a0 0x7fdbc806fe10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80b6f30 tx=0x7fdbc000b330 comp rx=0 tx=0).stop 2023-10-17T06:08:23.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbcc913700 1 -- 172.21.15.125:0/2593405351 shutdown_connections 2023-10-17T06:08:23.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbcc913700 1 --2- 172.21.15.125:0/2593405351 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbc81612e0 0x7fdbc815d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbcc913700 1 --2- 172.21.15.125:0/2593405351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc806f9a0 0x7fdbc806fe10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbcc913700 1 --2- 172.21.15.125:0/2593405351 >> v2:172.21.15.184:3300/0 conn(0x7fdbc81467c0 0x7fdbc80b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.206+0000 7fdbcc913700 1 -- 172.21.15.125:0/2593405351 >> 172.21.15.125:0/2593405351 conn(0x7fdbc806a130 msgr2=0x7fdbc806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:23.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.210+0000 7fdbcc913700 1 -- 172.21.15.125:0/2593405351 shutdown_connections 2023-10-17T06:08:23.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.210+0000 7fdbcc913700 1 -- 172.21.15.125:0/2593405351 wait complete. 2023-10-17T06:08:23.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.210+0000 7fdbcc913700 1 Processor -- start 2023-10-17T06:08:23.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.214+0000 7fdbcc913700 1 -- start start 2023-10-17T06:08:23.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.214+0000 7fdbcc913700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbc806f9a0 0x7fdbc8140f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:23.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.214+0000 7fdbcc913700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc81467c0 0x7fdbc80cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:23.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.214+0000 7fdbcc913700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbc81612e0 0x7fdbc815e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:23.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.214+0000 7fdbcc913700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc80ced00 con 0x7fdbc81467c0 2023-10-17T06:08:23.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.214+0000 7fdbcc913700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc81414a0 con 0x7fdbc806f9a0 2023-10-17T06:08:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.214+0000 7fdbcc913700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc80ce460 con 0x7fdbc81612e0 2023-10-17T06:08:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.214+0000 7fdbc5d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc81467c0 0x7fdbc80cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.214+0000 7fdbc5d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc81467c0 0x7fdbc80cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48732/0 (socket says 172.21.15.125:48732) 2023-10-17T06:08:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.214+0000 7fdbc5d9b700 1 -- 172.21.15.125:0/3201035713 learned_addr learned my addr 172.21.15.125:0/3201035713 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:23.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.214+0000 7fdbc6d9d700 1 --2- 172.21.15.125:0/3201035713 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbc81612e0 0x7fdbc815e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:23.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.214+0000 7fdbc659c700 1 --2- 172.21.15.125:0/3201035713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbc806f9a0 0x7fdbc8140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:23.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.214+0000 7fdbc5d9b700 1 -- 172.21.15.125:0/3201035713 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbc81612e0 msgr2=0x7fdbc815e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:23.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.214+0000 7fdbc5d9b700 1 --2- 172.21.15.125:0/3201035713 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbc81612e0 0x7fdbc815e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.214+0000 7fdbc5d9b700 1 -- 172.21.15.125:0/3201035713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbc806f9a0 msgr2=0x7fdbc8140f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:23.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.214+0000 7fdbc5d9b700 1 --2- 172.21.15.125:0/3201035713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbc806f9a0 0x7fdbc8140f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.214+0000 7fdbc5d9b700 1 -- 172.21.15.125:0/3201035713 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc0009a70 con 0x7fdbc81467c0 2023-10-17T06:08:23.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.218+0000 7fdbc5d9b700 1 --2- 172.21.15.125:0/3201035713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc81467c0 0x7fdbc80cb8f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00e870 tx=0x7fdbbc00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:23.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.218+0000 7fdbb6ffd700 1 -- 172.21.15.125:0/3201035713 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc0095c0 con 0x7fdbc81467c0 2023-10-17T06:08:23.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.218+0000 7fdbcc913700 1 -- 172.21.15.125:0/3201035713 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc80ce740 con 0x7fdbc81467c0 2023-10-17T06:08:23.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.218+0000 7fdbb6ffd700 1 -- 172.21.15.125:0/3201035713 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbbc013680 con 0x7fdbc81467c0 2023-10-17T06:08:23.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.218+0000 7fdbb6ffd700 1 -- 172.21.15.125:0/3201035713 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc013a10 con 0x7fdbc81467c0 2023-10-17T06:08:23.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.218+0000 7fdbcc913700 1 -- 172.21.15.125:0/3201035713 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc81f39c0 con 0x7fdbc81467c0 2023-10-17T06:08:23.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.218+0000 7fdbcc913700 1 -- 172.21.15.125:0/3201035713 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc81f3be0 con 0x7fdbc81467c0 2023-10-17T06:08:23.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.218+0000 7fdbb6ffd700 1 -- 172.21.15.125:0/3201035713 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fdbbc013b70 con 0x7fdbc81467c0 2023-10-17T06:08:23.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.222+0000 7fdbb6ffd700 1 --2- 172.21.15.125:0/3201035713 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdba80656f0 0x7fdba8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:23.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.222+0000 7fdbb6ffd700 1 -- 172.21.15.125:0/3201035713 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdbbc082fa0 con 0x7fdbc81467c0 2023-10-17T06:08:23.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.222+0000 7fdbc659c700 1 --2- 172.21.15.125:0/3201035713 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdba80656f0 0x7fdba8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:23.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.222+0000 7fdbc659c700 1 --2- 172.21.15.125:0/3201035713 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdba80656f0 0x7fdba8067bb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdbc806ff80 tx=0x7fdbb80092e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:23.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.226+0000 7fdbb6ffd700 1 -- 172.21.15.125:0/3201035713 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fdbbc0b3d40 con 0x7fdbc81467c0 2023-10-17T06:08:23.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.410+0000 7fdbcc913700 1 -- 172.21.15.125:0/3201035713 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdbc8072e60 con 0x7fdbc81467c0 2023-10-17T06:08:23.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.410+0000 7fdbb6ffd700 1 -- 172.21.15.125:0/3201035713 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdbbc0541d0 con 0x7fdbc81467c0 2023-10-17T06:08:23.415 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-17T06:08:23.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.414+0000 7fdbcc913700 1 -- 172.21.15.125:0/3201035713 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdba80656f0 msgr2=0x7fdba8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:23.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.414+0000 7fdbcc913700 1 --2- 172.21.15.125:0/3201035713 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdba80656f0 0x7fdba8067bb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdbc806ff80 tx=0x7fdbb80092e0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.414+0000 7fdbcc913700 1 -- 172.21.15.125:0/3201035713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc81467c0 msgr2=0x7fdbc80cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:23.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.414+0000 7fdbcc913700 1 --2- 172.21.15.125:0/3201035713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc81467c0 0x7fdbc80cb8f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00e870 tx=0x7fdbbc00eb80 comp rx=0 tx=0).stop 2023-10-17T06:08:23.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.414+0000 7fdbcc913700 1 -- 172.21.15.125:0/3201035713 shutdown_connections 2023-10-17T06:08:23.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.414+0000 7fdbcc913700 1 --2- 172.21.15.125:0/3201035713 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdba80656f0 0x7fdba8067bb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.414+0000 7fdbcc913700 1 --2- 172.21.15.125:0/3201035713 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbc81612e0 0x7fdbc815e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.414+0000 7fdbcc913700 1 --2- 172.21.15.125:0/3201035713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc81467c0 0x7fdbc80cb8f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.414+0000 7fdbcc913700 1 --2- 172.21.15.125:0/3201035713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbc806f9a0 0x7fdbc8140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.414+0000 7fdbcc913700 1 -- 172.21.15.125:0/3201035713 >> 172.21.15.125:0/3201035713 conn(0x7fdbc806a130 msgr2=0x7fdbc806e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:23.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.414+0000 7fdbcc913700 1 -- 172.21.15.125:0/3201035713 shutdown_connections 2023-10-17T06:08:23.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.414+0000 7fdbcc913700 1 -- 172.21.15.125:0/3201035713 wait complete. 2023-10-17T06:08:23.444 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-17T06:08:23.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.614+0000 7f199cedf700 1 Processor -- start 2023-10-17T06:08:23.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.614+0000 7f199cedf700 1 -- start start 2023-10-17T06:08:23.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.618+0000 7f199cedf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f199815adf0 0x7f19980cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:23.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.618+0000 7f199cedf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f19980cce10 0x7f19980b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:23.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.618+0000 7f199cedf700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19980b1e80 0x7f19980b2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:23.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.618+0000 7f199cedf700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19980ca590 con 0x7f19980cce10 2023-10-17T06:08:23.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.618+0000 7f199cedf700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199815b1d0 con 0x7f19980b1e80 2023-10-17T06:08:23.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.618+0000 7f199cedf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19980ce600 con 0x7f199815adf0 2023-10-17T06:08:23.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.618+0000 7f1995d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f19980cce10 0x7f19980b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:23.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.618+0000 7f1995d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f19980cce10 0x7f19980b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35436/0 (socket says 172.21.15.125:35436) 2023-10-17T06:08:23.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.618+0000 7f1995d9b700 1 -- 172.21.15.125:0/3717687207 learned_addr learned my addr 172.21.15.125:0/3717687207 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:23.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.618+0000 7f1996d9d700 1 --2- 172.21.15.125:0/3717687207 >> v2:172.21.15.184:3300/0 conn(0x7f19980b1e80 0x7f19980b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:23.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.622+0000 7f199659c700 1 --2- 172.21.15.125:0/3717687207 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f199815adf0 0x7f19980cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:23.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.622+0000 7f1995d9b700 1 -- 172.21.15.125:0/3717687207 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f199815adf0 msgr2=0x7f19980cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:23.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.622+0000 7f1995d9b700 1 --2- 172.21.15.125:0/3717687207 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f199815adf0 0x7f19980cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.622+0000 7f1995d9b700 1 -- 172.21.15.125:0/3717687207 >> v2:172.21.15.184:3300/0 conn(0x7f19980b1e80 msgr2=0x7f19980b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:23.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.622+0000 7f1995d9b700 1 --2- 172.21.15.125:0/3717687207 >> v2:172.21.15.184:3300/0 conn(0x7f19980b1e80 0x7f19980b2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.622+0000 7f1995d9b700 1 -- 172.21.15.125:0/3717687207 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19980cd580 con 0x7f19980cce10 2023-10-17T06:08:23.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.622+0000 7f1996d9d700 1 --2- 172.21.15.125:0/3717687207 >> v2:172.21.15.184:3300/0 conn(0x7f19980b1e80 0x7f19980b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:08:23.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.622+0000 7f1995d9b700 1 --2- 172.21.15.125:0/3717687207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19980cce10 0x7f19980b1940 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f19980c8e00 tx=0x7f198c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b2c5f734fbee8a server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:23.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.622+0000 7f199559a700 1 -- 172.21.15.125:0/3717687207 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c011830 con 0x7f19980cce10 2023-10-17T06:08:23.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.622+0000 7f199559a700 1 -- 172.21.15.125:0/3717687207 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198c011990 con 0x7f19980cce10 2023-10-17T06:08:23.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.622+0000 7f199559a700 1 -- 172.21.15.125:0/3717687207 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c011d20 con 0x7f19980cce10 2023-10-17T06:08:23.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.622+0000 7f199cedf700 1 -- 172.21.15.125:0/3717687207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19980cce10 msgr2=0x7f19980b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:23.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.622+0000 7f199cedf700 1 --2- 172.21.15.125:0/3717687207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19980cce10 0x7f19980b1940 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f19980c8e00 tx=0x7f198c009bf0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.622+0000 7f199cedf700 1 -- 172.21.15.125:0/3717687207 shutdown_connections 2023-10-17T06:08:23.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.622+0000 7f199cedf700 1 --2- 172.21.15.125:0/3717687207 >> v2:172.21.15.184:3300/0 conn(0x7f19980b1e80 0x7f19980b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.622+0000 7f199cedf700 1 --2- 172.21.15.125:0/3717687207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19980cce10 0x7f19980b1940 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.622+0000 7f199cedf700 1 --2- 172.21.15.125:0/3717687207 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f199815adf0 0x7f19980cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.622+0000 7f199cedf700 1 -- 172.21.15.125:0/3717687207 >> 172.21.15.125:0/3717687207 conn(0x7f19980ce820 msgr2=0x7f19980cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:23.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.622+0000 7f199cedf700 1 -- 172.21.15.125:0/3717687207 shutdown_connections 2023-10-17T06:08:23.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.622+0000 7f199cedf700 1 -- 172.21.15.125:0/3717687207 wait complete. 2023-10-17T06:08:23.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.626+0000 7f199cedf700 1 Processor -- start 2023-10-17T06:08:23.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.626+0000 7f199cedf700 1 -- start start 2023-10-17T06:08:23.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f199cedf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19980b1e80 0x7f19981f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:23.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f199cedf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19980cce10 0x7f19980c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:23.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f199cedf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f199815adf0 0x7f1998158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:23.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f199cedf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1998158b40 con 0x7f199815adf0 2023-10-17T06:08:23.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f199cedf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19981f2940 con 0x7f19980b1e80 2023-10-17T06:08:23.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f199cedf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19981f20a0 con 0x7f19980cce10 2023-10-17T06:08:23.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f1996d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f199815adf0 0x7f1998158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:23.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f1996d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f199815adf0 0x7f1998158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35448/0 (socket says 172.21.15.125:35448) 2023-10-17T06:08:23.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f1996d9d700 1 -- 172.21.15.125:0/810056559 learned_addr learned my addr 172.21.15.125:0/810056559 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:23.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f1995d9b700 1 --2- 172.21.15.125:0/810056559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19980cce10 0x7f19980c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:23.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f199659c700 1 --2- 172.21.15.125:0/810056559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19980b1e80 0x7f19981f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:23.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f1996d9d700 1 -- 172.21.15.125:0/810056559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19980cce10 msgr2=0x7f19980c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:23.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f1996d9d700 1 --2- 172.21.15.125:0/810056559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19980cce10 0x7f19980c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f1996d9d700 1 -- 172.21.15.125:0/810056559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19980b1e80 msgr2=0x7f19981f1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:23.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f1996d9d700 1 --2- 172.21.15.125:0/810056559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19980b1e80 0x7f19981f1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f1996d9d700 1 -- 172.21.15.125:0/810056559 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1990009a70 con 0x7f199815adf0 2023-10-17T06:08:23.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f1995d9b700 1 --2- 172.21.15.125:0/810056559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19980cce10 0x7f19980c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:23.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f199659c700 1 --2- 172.21.15.125:0/810056559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19980b1e80 0x7f19981f1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:23.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f1996d9d700 1 --2- 172.21.15.125:0/810056559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f199815adf0 0x7f1998158600 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f199000eed0 tx=0x7f199000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:23.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f1986ffd700 1 -- 172.21.15.125:0/810056559 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990010040 con 0x7f199815adf0 2023-10-17T06:08:23.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f1986ffd700 1 -- 172.21.15.125:0/810056559 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199000bb30 con 0x7f199815adf0 2023-10-17T06:08:23.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f199cedf700 1 -- 172.21.15.125:0/810056559 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198c009570 con 0x7f199815adf0 2023-10-17T06:08:23.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f1986ffd700 1 -- 172.21.15.125:0/810056559 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990003a40 con 0x7f199815adf0 2023-10-17T06:08:23.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.630+0000 7f199cedf700 1 -- 172.21.15.125:0/810056559 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19981f2660 con 0x7f199815adf0 2023-10-17T06:08:23.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.634+0000 7f199cedf700 1 -- 172.21.15.125:0/810056559 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1998072e60 con 0x7f199815adf0 2023-10-17T06:08:23.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.634+0000 7f1986ffd700 1 -- 172.21.15.125:0/810056559 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f199001d410 con 0x7f199815adf0 2023-10-17T06:08:23.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.634+0000 7f1986ffd700 1 --2- 172.21.15.125:0/810056559 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1978065720 0x7f1978067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:23.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.634+0000 7f1986ffd700 1 -- 172.21.15.125:0/810056559 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f19900836c0 con 0x7f199815adf0 2023-10-17T06:08:23.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.638+0000 7f199659c700 1 --2- 172.21.15.125:0/810056559 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1978065720 0x7f1978067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:23.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.638+0000 7f199659c700 1 --2- 172.21.15.125:0/810056559 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1978065720 0x7f1978067be0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1988009ba0 tx=0x7f1988008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:23.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.638+0000 7f1986ffd700 1 -- 172.21.15.125:0/810056559 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f1990050e40 con 0x7f199815adf0 2023-10-17T06:08:23.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.826+0000 7f199cedf700 1 -- 172.21.15.125:0/810056559 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f19980b1b20 con 0x7f199815adf0 2023-10-17T06:08:23.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.826+0000 7f1986ffd700 1 -- 172.21.15.125:0/810056559 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1990009d70 con 0x7f199815adf0 2023-10-17T06:08:23.830 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:23.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.826+0000 7f199cedf700 1 -- 172.21.15.125:0/810056559 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1978065720 msgr2=0x7f1978067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:23.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.826+0000 7f199cedf700 1 --2- 172.21.15.125:0/810056559 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1978065720 0x7f1978067be0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1988009ba0 tx=0x7f1988008040 comp rx=0 tx=0).stop 2023-10-17T06:08:23.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.826+0000 7f199cedf700 1 -- 172.21.15.125:0/810056559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f199815adf0 msgr2=0x7f1998158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:23.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.826+0000 7f199cedf700 1 --2- 172.21.15.125:0/810056559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f199815adf0 0x7f1998158600 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f199000eed0 tx=0x7f199000b390 comp rx=0 tx=0).stop 2023-10-17T06:08:23.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.826+0000 7f199cedf700 1 -- 172.21.15.125:0/810056559 shutdown_connections 2023-10-17T06:08:23.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.826+0000 7f199cedf700 1 --2- 172.21.15.125:0/810056559 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1978065720 0x7f1978067be0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.826+0000 7f199cedf700 1 --2- 172.21.15.125:0/810056559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f199815adf0 0x7f1998158600 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.826+0000 7f199cedf700 1 --2- 172.21.15.125:0/810056559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19980cce10 0x7f19980c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.826+0000 7f199cedf700 1 --2- 172.21.15.125:0/810056559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19980b1e80 0x7f19981f1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:23.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.826+0000 7f199cedf700 1 -- 172.21.15.125:0/810056559 >> 172.21.15.125:0/810056559 conn(0x7f19980ce820 msgr2=0x7f1998159c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:23.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.830+0000 7f199cedf700 1 -- 172.21.15.125:0/810056559 shutdown_connections 2023-10-17T06:08:23.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:23.830+0000 7f199cedf700 1 -- 172.21.15.125:0/810056559 wait complete. 2023-10-17T06:08:23.855 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-17T06:08:24.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.026+0000 7f57d4eb1700 1 Processor -- start 2023-10-17T06:08:24.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.026+0000 7f57d4eb1700 1 -- start start 2023-10-17T06:08:24.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57d4eb1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f57d00cb8a0 0x7f57d00cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:24.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57d4eb1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f57d00b22f0 0x7f57d00b2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:24.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57d4eb1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d0070de0 con 0x7f57d0144150 2023-10-17T06:08:24.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57d4eb1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d00cc270 con 0x7f57d00cb8a0 2023-10-17T06:08:24.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57d4eb1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d00701d0 con 0x7f57d00b22f0 2023-10-17T06:08:24.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57ceffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f57d00cb8a0 0x7f57d00cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:24.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57cf7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f57d0144150 0x7f57d00cdc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55396/0 (socket says 172.21.15.125:55396) 2023-10-17T06:08:24.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57cf7fe700 1 -- 172.21.15.125:0/2392709657 learned_addr learned my addr 172.21.15.125:0/2392709657 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:24.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57cffff700 1 --2- 172.21.15.125:0/2392709657 >> v2:172.21.15.184:3300/0 conn(0x7f57d00b22f0 0x7f57d00b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:24.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57ceffd700 1 -- 172.21.15.125:0/2392709657 >> v2:172.21.15.184:3300/0 conn(0x7f57d00b22f0 msgr2=0x7f57d00b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:24.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57ceffd700 1 --2- 172.21.15.125:0/2392709657 >> v2:172.21.15.184:3300/0 conn(0x7f57d00b22f0 0x7f57d00b2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:24.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57ceffd700 1 -- 172.21.15.125:0/2392709657 >> v1:172.21.15.125:6789/0 conn(0x7f57d0144150 legacy=0x7f57d00cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:24.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57ceffd700 1 -- 172.21.15.125:0/2392709657 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d00704b0 con 0x7f57d00cb8a0 2023-10-17T06:08:24.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57ceffd700 1 --2- 172.21.15.125:0/2392709657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57d00cb8a0 0x7f57d00cbd30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f57d00b0360 tx=0x7f57c4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81aa8f5942aa4b46 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:24.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57ce7fc700 1 -- 172.21.15.125:0/2392709657 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c4011830 con 0x7f57d00cb8a0 2023-10-17T06:08:24.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57ce7fc700 1 -- 172.21.15.125:0/2392709657 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c4011990 con 0x7f57d00cb8a0 2023-10-17T06:08:24.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57ce7fc700 1 -- 172.21.15.125:0/2392709657 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c4011d20 con 0x7f57d00cb8a0 2023-10-17T06:08:24.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57d4eb1700 1 -- 172.21.15.125:0/2392709657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57d00cb8a0 msgr2=0x7f57d00cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:24.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57d4eb1700 1 --2- 172.21.15.125:0/2392709657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57d00cb8a0 0x7f57d00cbd30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f57d00b0360 tx=0x7f57c4009b30 comp rx=0 tx=0).stop 2023-10-17T06:08:24.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57d4eb1700 1 -- 172.21.15.125:0/2392709657 shutdown_connections 2023-10-17T06:08:24.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57d4eb1700 1 --2- 172.21.15.125:0/2392709657 >> v2:172.21.15.184:3300/0 conn(0x7f57d00b22f0 0x7f57d00b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:24.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57d4eb1700 1 --2- 172.21.15.125:0/2392709657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57d00cb8a0 0x7f57d00cbd30 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:24.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57d4eb1700 1 -- 172.21.15.125:0/2392709657 >> 172.21.15.125:0/2392709657 conn(0x7f57d00b0bf0 msgr2=0x7f57d00ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:24.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.030+0000 7f57d4eb1700 1 -- 172.21.15.125:0/2392709657 shutdown_connections 2023-10-17T06:08:24.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.034+0000 7f57d4eb1700 1 -- 172.21.15.125:0/2392709657 wait complete. 2023-10-17T06:08:24.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.034+0000 7f57d4eb1700 1 Processor -- start 2023-10-17T06:08:24.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.034+0000 7f57d4eb1700 1 -- start start 2023-10-17T06:08:24.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57d4eb1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57d00b22f0 0x7f57d00aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:24.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57d4eb1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57d00cb8a0 0x7f57d0137ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:24.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57d4eb1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57d0144150 0x7f57d006e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:24.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57d4eb1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d0138400 con 0x7f57d00cb8a0 2023-10-17T06:08:24.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57d4eb1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d006d390 con 0x7f57d00b22f0 2023-10-17T06:08:24.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57d4eb1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d006d670 con 0x7f57d0144150 2023-10-17T06:08:24.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57ceffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57d00cb8a0 0x7f57d0137ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:24.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57ceffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57d00cb8a0 0x7f57d0137ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35462/0 (socket says 172.21.15.125:35462) 2023-10-17T06:08:24.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57ceffd700 1 -- 172.21.15.125:0/3834207073 learned_addr learned my addr 172.21.15.125:0/3834207073 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:24.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57cffff700 1 --2- 172.21.15.125:0/3834207073 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57d0144150 0x7f57d006e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:24.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57cf7fe700 1 --2- 172.21.15.125:0/3834207073 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57d00b22f0 0x7f57d00aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:24.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57ceffd700 1 -- 172.21.15.125:0/3834207073 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57d0144150 msgr2=0x7f57d006e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:24.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57ceffd700 1 --2- 172.21.15.125:0/3834207073 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57d0144150 0x7f57d006e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:24.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57ceffd700 1 -- 172.21.15.125:0/3834207073 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57d00b22f0 msgr2=0x7f57d00aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:24.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57ceffd700 1 --2- 172.21.15.125:0/3834207073 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57d00b22f0 0x7f57d00aceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:24.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57ceffd700 1 -- 172.21.15.125:0/3834207073 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c40094b0 con 0x7f57d00cb8a0 2023-10-17T06:08:24.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57ceffd700 1 --2- 172.21.15.125:0/3834207073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57d00cb8a0 0x7f57d0137ec0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f57c4000c00 tx=0x7f57c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:24.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57b7fff700 1 -- 172.21.15.125:0/3834207073 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c40038c0 con 0x7f57d00cb8a0 2023-10-17T06:08:24.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57b7fff700 1 -- 172.21.15.125:0/3834207073 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c401e070 con 0x7f57d00cb8a0 2023-10-17T06:08:24.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57d4eb1700 1 -- 172.21.15.125:0/3834207073 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d006d950 con 0x7f57d00cb8a0 2023-10-17T06:08:24.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57b7fff700 1 -- 172.21.15.125:0/3834207073 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c4003c60 con 0x7f57d00cb8a0 2023-10-17T06:08:24.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.038+0000 7f57d4eb1700 1 -- 172.21.15.125:0/3834207073 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d006df10 con 0x7f57d00cb8a0 2023-10-17T06:08:24.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.042+0000 7f57d4eb1700 1 -- 172.21.15.125:0/3834207073 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d006e100 con 0x7f57d00cb8a0 2023-10-17T06:08:24.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.042+0000 7f57b7fff700 1 -- 172.21.15.125:0/3834207073 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f57c402d450 con 0x7f57d00cb8a0 2023-10-17T06:08:24.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.042+0000 7f57b7fff700 1 --2- 172.21.15.125:0/3834207073 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f57bc065720 0x7f57bc067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:24.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.042+0000 7f57b7fff700 1 -- 172.21.15.125:0/3834207073 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f57c4083ff0 con 0x7f57d00cb8a0 2023-10-17T06:08:24.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.042+0000 7f57cf7fe700 1 --2- 172.21.15.125:0/3834207073 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f57bc065720 0x7f57bc067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:24.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.046+0000 7f57cf7fe700 1 --2- 172.21.15.125:0/3834207073 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f57bc065720 0x7f57bc067be0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f57c0000f60 tx=0x7f57c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:24.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.050+0000 7f57b7fff700 1 -- 172.21.15.125:0/3834207073 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f57c40b4d40 con 0x7f57d00cb8a0 2023-10-17T06:08:24.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.262+0000 7f57d4eb1700 1 -- 172.21.15.125:0/3834207073 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f57d0072e60 con 0x7f57d00cb8a0 2023-10-17T06:08:24.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.262+0000 7f57b7fff700 1 -- 172.21.15.125:0/3834207073 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f57c4015080 con 0x7f57d00cb8a0 2023-10-17T06:08:24.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.266+0000 7f57d4eb1700 1 -- 172.21.15.125:0/3834207073 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f57bc065720 msgr2=0x7f57bc067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:24.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.266+0000 7f57d4eb1700 1 --2- 172.21.15.125:0/3834207073 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f57bc065720 0x7f57bc067be0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f57c0000f60 tx=0x7f57c0009040 comp rx=0 tx=0).stop 2023-10-17T06:08:24.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.266+0000 7f57d4eb1700 1 -- 172.21.15.125:0/3834207073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57d00cb8a0 msgr2=0x7f57d0137ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:24.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.266+0000 7f57d4eb1700 1 --2- 172.21.15.125:0/3834207073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57d00cb8a0 0x7f57d0137ec0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f57c4000c00 tx=0x7f57c4004770 comp rx=0 tx=0).stop 2023-10-17T06:08:24.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.266+0000 7f57d4eb1700 1 -- 172.21.15.125:0/3834207073 shutdown_connections 2023-10-17T06:08:24.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.266+0000 7f57d4eb1700 1 --2- 172.21.15.125:0/3834207073 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f57bc065720 0x7f57bc067be0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:24.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.266+0000 7f57d4eb1700 1 --2- 172.21.15.125:0/3834207073 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57d0144150 0x7f57d006e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:24.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.266+0000 7f57d4eb1700 1 --2- 172.21.15.125:0/3834207073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57d00cb8a0 0x7f57d0137ec0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:24.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.266+0000 7f57d4eb1700 1 --2- 172.21.15.125:0/3834207073 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57d00b22f0 0x7f57d00aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:24.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.266+0000 7f57d4eb1700 1 -- 172.21.15.125:0/3834207073 >> 172.21.15.125:0/3834207073 conn(0x7f57d00b0bf0 msgr2=0x7f57d015cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:24.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.266+0000 7f57d4eb1700 1 -- 172.21.15.125:0/3834207073 shutdown_connections 2023-10-17T06:08:24.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.266+0000 7f57d4eb1700 1 -- 172.21.15.125:0/3834207073 wait complete. 2023-10-17T06:08:24.274 INFO:teuthology.orchestra.run.smithi125.stderr:listed 0 entries 2023-10-17T06:08:24.296 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-17T06:08:24.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:08:24.297 DEBUG:teuthology.orchestra.run.smithi184:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-17T06:08:24.355 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-17T06:08:24.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:08:24.356 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-17T06:08:24.385 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:08:24.386 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:08:24.405 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:08:24.405 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:08:24.471 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:08:24.471 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:08:24.531 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:08:24.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.742+0000 7f63b65d5700 1 Processor -- start 2023-10-17T06:08:24.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.742+0000 7f63b65d5700 1 -- start start 2023-10-17T06:08:24.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.746+0000 7f63b65d5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f63b0160710 0x7f63b00b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:24.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.746+0000 7f63b65d5700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f63b00b5ae0 0x7f63b006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:24.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.746+0000 7f63b65d5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b015d0d0 con 0x7f63b00d2e00 2023-10-17T06:08:24.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.746+0000 7f63b65d5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b015df90 con 0x7f63b0160710 2023-10-17T06:08:24.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.746+0000 7f63b65d5700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b006f0f0 con 0x7f63b00b5ae0 2023-10-17T06:08:24.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.746+0000 7f63b55d3700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f63b00d2e00 0x7f63b00d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55398/0 (socket says 172.21.15.125:55398) 2023-10-17T06:08:24.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.746+0000 7f63b55d3700 1 -- 172.21.15.125:0/3324886869 learned_addr learned my addr 172.21.15.125:0/3324886869 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:24.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.746+0000 7f63b4dd2700 1 --2- 172.21.15.125:0/3324886869 >> v2:172.21.15.125:3300/0 conn(0x7f63b0160710 0x7f63b00b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:24.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.746+0000 7f63b5dd4700 1 --2- 172.21.15.125:0/3324886869 >> v2:172.21.15.184:3300/0 conn(0x7f63b00b5ae0 0x7f63b006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:24.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.746+0000 7f63a7fff700 1 -- 172.21.15.125:0/3324886869 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944394349 0 0) 0x7f63ac001110 con 0x7f63b00d2e00 2023-10-17T06:08:24.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.746+0000 7f63b4dd2700 1 -- 172.21.15.125:0/3324886869 >> v2:172.21.15.184:3300/0 conn(0x7f63b00b5ae0 msgr2=0x7f63b006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:24.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.746+0000 7f63b4dd2700 1 --2- 172.21.15.125:0/3324886869 >> v2:172.21.15.184:3300/0 conn(0x7f63b00b5ae0 0x7f63b006db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:24.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.746+0000 7f63b4dd2700 1 -- 172.21.15.125:0/3324886869 >> v1:172.21.15.125:6789/0 conn(0x7f63b00d2e00 legacy=0x7f63b00d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:24.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.746+0000 7f63b4dd2700 1 -- 172.21.15.125:0/3324886869 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b015d310 con 0x7f63b0160710 2023-10-17T06:08:24.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.746+0000 7f63b4dd2700 1 --2- 172.21.15.125:0/3324886869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63b0160710 0x7f63b00b6e00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f63b006d040 tx=0x7f63a0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad4570269e8d1fd server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:24.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.746+0000 7f63a7fff700 1 -- 172.21.15.125:0/3324886869 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a0011830 con 0x7f63b0160710 2023-10-17T06:08:24.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.750+0000 7f63a7fff700 1 -- 172.21.15.125:0/3324886869 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a0011990 con 0x7f63b0160710 2023-10-17T06:08:24.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.750+0000 7f63a7fff700 1 -- 172.21.15.125:0/3324886869 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a0011d40 con 0x7f63b0160710 2023-10-17T06:08:24.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.750+0000 7f63b65d5700 1 -- 172.21.15.125:0/3324886869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63b0160710 msgr2=0x7f63b00b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:24.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.750+0000 7f63b65d5700 1 --2- 172.21.15.125:0/3324886869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63b0160710 0x7f63b00b6e00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f63b006d040 tx=0x7f63a0009b30 comp rx=0 tx=0).stop 2023-10-17T06:08:24.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.750+0000 7f63b65d5700 1 -- 172.21.15.125:0/3324886869 shutdown_connections 2023-10-17T06:08:24.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.750+0000 7f63b65d5700 1 --2- 172.21.15.125:0/3324886869 >> v2:172.21.15.184:3300/0 conn(0x7f63b00b5ae0 0x7f63b006db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:24.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.750+0000 7f63b65d5700 1 --2- 172.21.15.125:0/3324886869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63b0160710 0x7f63b00b6e00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:24.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.750+0000 7f63b65d5700 1 -- 172.21.15.125:0/3324886869 >> 172.21.15.125:0/3324886869 conn(0x7f63b0069f20 msgr2=0x7f63b006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:24.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.750+0000 7f63b65d5700 1 -- 172.21.15.125:0/3324886869 shutdown_connections 2023-10-17T06:08:24.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.750+0000 7f63b65d5700 1 -- 172.21.15.125:0/3324886869 wait complete. 2023-10-17T06:08:24.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63b65d5700 1 Processor -- start 2023-10-17T06:08:24.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63b65d5700 1 -- start start 2023-10-17T06:08:24.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63b65d5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63b00b5ae0 0x7f63b01514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:24.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63b65d5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63b00d2e00 0x7f63b015f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:24.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63b65d5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63b0160710 0x7f63b015f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:24.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63b65d5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b0152160 con 0x7f63b00b5ae0 2023-10-17T06:08:24.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63b65d5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b0152440 con 0x7f63b00d2e00 2023-10-17T06:08:24.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63b65d5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b0152720 con 0x7f63b0160710 2023-10-17T06:08:24.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63b55d3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63b00b5ae0 0x7f63b01514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:24.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63b55d3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63b00b5ae0 0x7f63b01514f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35472/0 (socket says 172.21.15.125:35472) 2023-10-17T06:08:24.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63b55d3700 1 -- 172.21.15.125:0/1339048363 learned_addr learned my addr 172.21.15.125:0/1339048363 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:24.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63b5dd4700 1 --2- 172.21.15.125:0/1339048363 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63b0160710 0x7f63b015f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:24.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63b4dd2700 1 --2- 172.21.15.125:0/1339048363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63b00d2e00 0x7f63b015f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:24.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63b55d3700 1 -- 172.21.15.125:0/1339048363 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63b0160710 msgr2=0x7f63b015f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:24.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63b55d3700 1 --2- 172.21.15.125:0/1339048363 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63b0160710 0x7f63b015f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:24.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63b55d3700 1 -- 172.21.15.125:0/1339048363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63b00d2e00 msgr2=0x7f63b015f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:24.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63b55d3700 1 --2- 172.21.15.125:0/1339048363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63b00d2e00 0x7f63b015f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:24.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63b55d3700 1 -- 172.21.15.125:0/1339048363 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a00094b0 con 0x7f63b00b5ae0 2023-10-17T06:08:24.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63b55d3700 1 --2- 172.21.15.125:0/1339048363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63b00b5ae0 0x7f63b01514f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00c4e0 tx=0x7f63ac00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:24.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63a5ffb700 1 -- 172.21.15.125:0/1339048363 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac004ca0 con 0x7f63b00b5ae0 2023-10-17T06:08:24.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63a5ffb700 1 -- 172.21.15.125:0/1339048363 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ac004e20 con 0x7f63b00b5ae0 2023-10-17T06:08:24.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63b65d5700 1 -- 172.21.15.125:0/1339048363 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b0152a00 con 0x7f63b00b5ae0 2023-10-17T06:08:24.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.754+0000 7f63a5ffb700 1 -- 172.21.15.125:0/1339048363 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac007310 con 0x7f63b00b5ae0 2023-10-17T06:08:24.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.758+0000 7f63b65d5700 1 -- 172.21.15.125:0/1339048363 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b0151a30 con 0x7f63b00b5ae0 2023-10-17T06:08:24.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.758+0000 7f63b65d5700 1 -- 172.21.15.125:0/1339048363 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b0072e60 con 0x7f63b00b5ae0 2023-10-17T06:08:24.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.758+0000 7f63a5ffb700 1 -- 172.21.15.125:0/1339048363 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f63ac007470 con 0x7f63b00b5ae0 2023-10-17T06:08:24.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.762+0000 7f63a5ffb700 1 --2- 172.21.15.125:0/1339048363 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6394065720 0x7f6394067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:24.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.762+0000 7f63a5ffb700 1 -- 172.21.15.125:0/1339048363 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f63ac082e10 con 0x7f63b00b5ae0 2023-10-17T06:08:24.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.762+0000 7f63b4dd2700 1 --2- 172.21.15.125:0/1339048363 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6394065720 0x7f6394067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:24.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.762+0000 7f63b4dd2700 1 --2- 172.21.15.125:0/1339048363 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6394065720 0x7f6394067be0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f63b006d040 tx=0x7f63a0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:24.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.766+0000 7f63a5ffb700 1 -- 172.21.15.125:0/1339048363 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f63ac086030 con 0x7f63b00b5ae0 2023-10-17T06:08:24.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.946+0000 7f63b65d5700 1 -- 172.21.15.125:0/1339048363 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63b015d0d0 con 0x7f63b00b5ae0 2023-10-17T06:08:24.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.950+0000 7f63a5ffb700 1 -- 172.21.15.125:0/1339048363 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20252 (secure 0 0 0) 0x7f63b015d0d0 con 0x7f63b00b5ae0 2023-10-17T06:08:24.955 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:24.955 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":30,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:49.710984+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:08:24.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.954+0000 7f63b65d5700 1 -- 172.21.15.125:0/1339048363 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6394065720 msgr2=0x7f6394067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:24.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.954+0000 7f63b65d5700 1 --2- 172.21.15.125:0/1339048363 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6394065720 0x7f6394067be0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f63b006d040 tx=0x7f63a0008030 comp rx=0 tx=0).stop 2023-10-17T06:08:24.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.954+0000 7f63b65d5700 1 -- 172.21.15.125:0/1339048363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63b00b5ae0 msgr2=0x7f63b01514f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:24.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.954+0000 7f63b65d5700 1 --2- 172.21.15.125:0/1339048363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63b00b5ae0 0x7f63b01514f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00c4e0 tx=0x7f63ac00c8a0 comp rx=0 tx=0).stop 2023-10-17T06:08:24.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.954+0000 7f63b65d5700 1 -- 172.21.15.125:0/1339048363 shutdown_connections 2023-10-17T06:08:24.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.954+0000 7f63b65d5700 1 --2- 172.21.15.125:0/1339048363 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6394065720 0x7f6394067be0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:24.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.954+0000 7f63b65d5700 1 --2- 172.21.15.125:0/1339048363 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f63b0160710 0x7f63b015f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:24.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.954+0000 7f63b65d5700 1 --2- 172.21.15.125:0/1339048363 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63b00d2e00 0x7f63b015f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:24.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.954+0000 7f63b65d5700 1 --2- 172.21.15.125:0/1339048363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f63b00b5ae0 0x7f63b01514f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:24.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.954+0000 7f63b65d5700 1 -- 172.21.15.125:0/1339048363 >> 172.21.15.125:0/1339048363 conn(0x7f63b0069f20 msgr2=0x7f63b015b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:24.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.954+0000 7f63b65d5700 1 -- 172.21.15.125:0/1339048363 shutdown_connections 2023-10-17T06:08:24.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:24.954+0000 7f63b65d5700 1 -- 172.21.15.125:0/1339048363 wait complete. 2023-10-17T06:08:24.978 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-17T06:07:06.629169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-17T06:07:08.148117+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-17T06:07:11.895112+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-17T06:08:24.979 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:08:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.166+0000 7f144359e700 1 Processor -- start 2023-10-17T06:08:25.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.166+0000 7f144359e700 1 -- start start 2023-10-17T06:08:25.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f144359e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14440cb850 0x7f14440b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:25.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f144359e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f14440afe70 0x7f14440b4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:25.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f144359e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1444070de0 con 0x7f144415ab80 2023-10-17T06:08:25.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f144359e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14440701d0 con 0x7f14440afe70 2023-10-17T06:08:25.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f144359e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14440704b0 con 0x7f14440cb850 2023-10-17T06:08:25.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f1442d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f14440afe70 0x7f14440b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:25.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f144259c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f144415ab80 0x7f14440cb140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55404/0 (socket says 172.21.15.125:55404) 2023-10-17T06:08:25.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f1442d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f14440afe70 0x7f14440b4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35486/0 (socket says 172.21.15.125:35486) 2023-10-17T06:08:25.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f144259c700 1 -- 172.21.15.125:0/748565021 learned_addr learned my addr 172.21.15.125:0/748565021 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:25.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f1441d9b700 1 --2- 172.21.15.125:0/748565021 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14440cb850 0x7f14440b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:25.176 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f1442d9d700 1 -- 172.21.15.125:0/748565021 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14440cb850 msgr2=0x7f14440b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:25.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f1442d9d700 1 --2- 172.21.15.125:0/748565021 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14440cb850 0x7f14440b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:25.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f1442d9d700 1 -- 172.21.15.125:0/748565021 >> v1:172.21.15.125:6789/0 conn(0x7f144415ab80 legacy=0x7f14440cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:25.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f1442d9d700 1 -- 172.21.15.125:0/748565021 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1444070790 con 0x7f14440afe70 2023-10-17T06:08:25.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f144159a700 1 -- 172.21.15.125:0/748565021 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136035002 0 0) 0x7f1444070de0 con 0x7f144415ab80 2023-10-17T06:08:25.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f1442d9d700 1 --2- 172.21.15.125:0/748565021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14440afe70 0x7f14440b4200 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f143c009d90 tx=0x7f143c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5adc46f17bfb7a1b server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:25.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f144159a700 1 -- 172.21.15.125:0/748565021 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c00e070 con 0x7f14440afe70 2023-10-17T06:08:25.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f144159a700 1 -- 172.21.15.125:0/748565021 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143c00bbd0 con 0x7f14440afe70 2023-10-17T06:08:25.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f144159a700 1 -- 172.21.15.125:0/748565021 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c012430 con 0x7f14440afe70 2023-10-17T06:08:25.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f144359e700 1 -- 172.21.15.125:0/748565021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14440afe70 msgr2=0x7f14440b4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:25.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.170+0000 7f144359e700 1 --2- 172.21.15.125:0/748565021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14440afe70 0x7f14440b4200 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f143c009d90 tx=0x7f143c00b330 comp rx=0 tx=0).stop 2023-10-17T06:08:25.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.174+0000 7f144359e700 1 -- 172.21.15.125:0/748565021 shutdown_connections 2023-10-17T06:08:25.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.174+0000 7f144359e700 1 --2- 172.21.15.125:0/748565021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14440afe70 0x7f14440b4200 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:25.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.174+0000 7f144359e700 1 --2- 172.21.15.125:0/748565021 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14440cb850 0x7f14440b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:25.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.174+0000 7f144359e700 1 -- 172.21.15.125:0/748565021 >> 172.21.15.125:0/748565021 conn(0x7f14440d08e0 msgr2=0x7f14440d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:25.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.174+0000 7f144359e700 1 -- 172.21.15.125:0/748565021 shutdown_connections 2023-10-17T06:08:25.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.174+0000 7f144359e700 1 -- 172.21.15.125:0/748565021 wait complete. 2023-10-17T06:08:25.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.174+0000 7f144359e700 1 Processor -- start 2023-10-17T06:08:25.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.174+0000 7f144359e700 1 -- start start 2023-10-17T06:08:25.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f144359e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14440afe70 0x7f14440c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:25.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f144359e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14440cb850 0x7f144415d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:25.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f144359e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f144415ab80 0x7f14440c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:25.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f144359e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14440c8e30 con 0x7f14440cb850 2023-10-17T06:08:25.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f144359e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14440c82b0 con 0x7f14440afe70 2023-10-17T06:08:25.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f144359e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14440c8590 con 0x7f144415ab80 2023-10-17T06:08:25.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f1441d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14440cb850 0x7f144415d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:25.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f1441d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14440cb850 0x7f144415d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35502/0 (socket says 172.21.15.125:35502) 2023-10-17T06:08:25.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f1441d9b700 1 -- 172.21.15.125:0/3457063958 learned_addr learned my addr 172.21.15.125:0/3457063958 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:25.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f1442d9d700 1 --2- 172.21.15.125:0/3457063958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f144415ab80 0x7f14440c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:25.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f144259c700 1 --2- 172.21.15.125:0/3457063958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14440afe70 0x7f14440c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:25.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f1441d9b700 1 -- 172.21.15.125:0/3457063958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f144415ab80 msgr2=0x7f14440c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:25.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f1441d9b700 1 --2- 172.21.15.125:0/3457063958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f144415ab80 0x7f14440c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:25.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f1441d9b700 1 -- 172.21.15.125:0/3457063958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14440afe70 msgr2=0x7f14440c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:25.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f1441d9b700 1 --2- 172.21.15.125:0/3457063958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14440afe70 0x7f14440c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:25.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f1441d9b700 1 -- 172.21.15.125:0/3457063958 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143c009a70 con 0x7f14440cb850 2023-10-17T06:08:25.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f144259c700 1 --2- 172.21.15.125:0/3457063958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14440afe70 0x7f14440c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:25.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f1441d9b700 1 --2- 172.21.15.125:0/3457063958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14440cb850 0x7f144415d5f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f143800e760 tx=0x7f143800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:25.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f1432ffd700 1 -- 172.21.15.125:0/3457063958 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438013610 con 0x7f14440cb850 2023-10-17T06:08:25.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f1432ffd700 1 -- 172.21.15.125:0/3457063958 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1438013770 con 0x7f14440cb850 2023-10-17T06:08:25.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f1432ffd700 1 -- 172.21.15.125:0/3457063958 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438013ae0 con 0x7f14440cb850 2023-10-17T06:08:25.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f144359e700 1 -- 172.21.15.125:0/3457063958 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14440c8870 con 0x7f14440cb850 2023-10-17T06:08:25.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.178+0000 7f144359e700 1 -- 172.21.15.125:0/3457063958 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14440c7ef0 con 0x7f14440cb850 2023-10-17T06:08:25.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.182+0000 7f144359e700 1 -- 172.21.15.125:0/3457063958 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144404e910 con 0x7f14440cb850 2023-10-17T06:08:25.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.182+0000 7f1432ffd700 1 -- 172.21.15.125:0/3457063958 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1438013c40 con 0x7f14440cb850 2023-10-17T06:08:25.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.182+0000 7f1432ffd700 1 --2- 172.21.15.125:0/3457063958 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f14240656f0 0x7f1424067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:25.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.182+0000 7f1432ffd700 1 -- 172.21.15.125:0/3457063958 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1438082e60 con 0x7f14440cb850 2023-10-17T06:08:25.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.182+0000 7f144259c700 1 --2- 172.21.15.125:0/3457063958 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f14240656f0 0x7f1424067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:25.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.182+0000 7f144259c700 1 --2- 172.21.15.125:0/3457063958 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f14240656f0 0x7f1424067bb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1434000f60 tx=0x7f1434009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:25.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.190+0000 7f1432ffd700 1 -- 172.21.15.125:0/3457063958 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f1438053fe0 con 0x7f14440cb850 2023-10-17T06:08:25.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.366+0000 7f144359e700 1 -- 172.21.15.125:0/3457063958 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f14440af9c0 con 0x7f14440cb850 2023-10-17T06:08:25.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.366+0000 7f1432ffd700 1 -- 172.21.15.125:0/3457063958 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f14380210a0 con 0x7f14440cb850 2023-10-17T06:08:25.372 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:08:25.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.370+0000 7f144359e700 1 -- 172.21.15.125:0/3457063958 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f14240656f0 msgr2=0x7f1424067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:25.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.370+0000 7f144359e700 1 --2- 172.21.15.125:0/3457063958 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f14240656f0 0x7f1424067bb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1434000f60 tx=0x7f1434009040 comp rx=0 tx=0).stop 2023-10-17T06:08:25.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.370+0000 7f144359e700 1 -- 172.21.15.125:0/3457063958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14440cb850 msgr2=0x7f144415d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:25.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.370+0000 7f144359e700 1 --2- 172.21.15.125:0/3457063958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14440cb850 0x7f144415d5f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f143800e760 tx=0x7f143800eb20 comp rx=0 tx=0).stop 2023-10-17T06:08:25.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.370+0000 7f144359e700 1 -- 172.21.15.125:0/3457063958 shutdown_connections 2023-10-17T06:08:25.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.370+0000 7f144359e700 1 --2- 172.21.15.125:0/3457063958 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f14240656f0 0x7f1424067bb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:25.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.370+0000 7f144359e700 1 --2- 172.21.15.125:0/3457063958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f144415ab80 0x7f14440c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:25.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.370+0000 7f144359e700 1 --2- 172.21.15.125:0/3457063958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14440cb850 0x7f144415d5f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:25.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.370+0000 7f144359e700 1 --2- 172.21.15.125:0/3457063958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14440afe70 0x7f14440c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:25.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.374+0000 7f144359e700 1 -- 172.21.15.125:0/3457063958 >> 172.21.15.125:0/3457063958 conn(0x7f14440d08e0 msgr2=0x7f14440b1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:25.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.374+0000 7f144359e700 1 -- 172.21.15.125:0/3457063958 shutdown_connections 2023-10-17T06:08:25.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.374+0000 7f144359e700 1 -- 172.21.15.125:0/3457063958 wait complete. 2023-10-17T06:08:25.403 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:08:25.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.582+0000 7f198d102700 1 Processor -- start 2023-10-17T06:08:25.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.582+0000 7f198d102700 1 -- start start 2023-10-17T06:08:25.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f198d102700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f19880d2e00 0x7f19880b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:25.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f198d102700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19880b5ae0 0x7f198806db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:25.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f198d102700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198815d0d0 con 0x7f1988160710 2023-10-17T06:08:25.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f198d102700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f198815df90 con 0x7f19880d2e00 2023-10-17T06:08:25.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f198d102700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198806f0f0 con 0x7f19880b5ae0 2023-10-17T06:08:25.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f1987fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f19880d2e00 0x7f19880b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:25.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f1987fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f19880d2e00 0x7f19880b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35514/0 (socket says 172.21.15.125:35514) 2023-10-17T06:08:25.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f1987fff700 1 -- 172.21.15.125:0/4191155362 learned_addr learned my addr 172.21.15.125:0/4191155362 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:25.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f198c901700 1 --2- 172.21.15.125:0/4191155362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19880b5ae0 0x7f198806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:25.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f1987fff700 1 -- 172.21.15.125:0/4191155362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19880b5ae0 msgr2=0x7f198806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:25.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f1987fff700 1 --2- 172.21.15.125:0/4191155362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19880b5ae0 0x7f198806db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:25.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f1987fff700 1 -- 172.21.15.125:0/4191155362 >> v1:172.21.15.125:6789/0 conn(0x7f1988160710 legacy=0x7f19880d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:25.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f1987fff700 1 -- 172.21.15.125:0/4191155362 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198815d310 con 0x7f19880d2e00 2023-10-17T06:08:25.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f1987fff700 1 --2- 172.21.15.125:0/4191155362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880d2e00 0x7f19880b6e00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1978009910 tx=0x7f1978009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2426112c6dcb2318 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:25.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f19877fe700 1 -- 172.21.15.125:0/4191155362 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197800ba60 con 0x7f19880d2e00 2023-10-17T06:08:25.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f19877fe700 1 -- 172.21.15.125:0/4191155362 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197800bbc0 con 0x7f19880d2e00 2023-10-17T06:08:25.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f19877fe700 1 -- 172.21.15.125:0/4191155362 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978009e60 con 0x7f19880d2e00 2023-10-17T06:08:25.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f198d102700 1 -- 172.21.15.125:0/4191155362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880d2e00 msgr2=0x7f19880b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:25.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f198d102700 1 --2- 172.21.15.125:0/4191155362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880d2e00 0x7f19880b6e00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1978009910 tx=0x7f1978009c20 comp rx=0 tx=0).stop 2023-10-17T06:08:25.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f198d102700 1 -- 172.21.15.125:0/4191155362 shutdown_connections 2023-10-17T06:08:25.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f198d102700 1 --2- 172.21.15.125:0/4191155362 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19880b5ae0 0x7f198806db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:25.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f198d102700 1 --2- 172.21.15.125:0/4191155362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880d2e00 0x7f19880b6e00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:25.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.586+0000 7f198d102700 1 -- 172.21.15.125:0/4191155362 >> 172.21.15.125:0/4191155362 conn(0x7f1988069f20 msgr2=0x7f198806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:25.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.590+0000 7f198d102700 1 -- 172.21.15.125:0/4191155362 shutdown_connections 2023-10-17T06:08:25.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.590+0000 7f198d102700 1 -- 172.21.15.125:0/4191155362 wait complete. 2023-10-17T06:08:25.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.590+0000 7f198d102700 1 Processor -- start 2023-10-17T06:08:25.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.590+0000 7f198d102700 1 -- start start 2023-10-17T06:08:25.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f198d102700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19880b5ae0 0x7f19881f6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:25.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f198d102700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880d2e00 0x7f19880b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:25.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f198d102700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1988160710 0x7f19881f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:25.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f198d102700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19880add10 con 0x7f19880d2e00 2023-10-17T06:08:25.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f198d102700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19880b1920 con 0x7f1988160710 2023-10-17T06:08:25.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f198d102700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19880ad3e0 con 0x7f19880b5ae0 2023-10-17T06:08:25.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f197f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880d2e00 0x7f19880b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:25.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f197f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880d2e00 0x7f19880b1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35518/0 (socket says 172.21.15.125:35518) 2023-10-17T06:08:25.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f197f7fe700 1 -- 172.21.15.125:0/1253627872 learned_addr learned my addr 172.21.15.125:0/1253627872 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:25.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f1987fff700 1 --2- 172.21.15.125:0/1253627872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19880b5ae0 0x7f19881f6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:25.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f198c901700 1 --2- 172.21.15.125:0/1253627872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1988160710 0x7f19881f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:25.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f197f7fe700 1 -- 172.21.15.125:0/1253627872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19880b5ae0 msgr2=0x7f19881f6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:25.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f197f7fe700 1 --2- 172.21.15.125:0/1253627872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19880b5ae0 0x7f19881f6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:25.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f197f7fe700 1 -- 172.21.15.125:0/1253627872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1988160710 msgr2=0x7f19881f58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:25.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f197f7fe700 1 --2- 172.21.15.125:0/1253627872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1988160710 0x7f19881f58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:25.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f197f7fe700 1 -- 172.21.15.125:0/1253627872 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1978009570 con 0x7f19880d2e00 2023-10-17T06:08:25.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f197f7fe700 1 --2- 172.21.15.125:0/1253627872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880d2e00 0x7f19880b1100 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f197000c4d0 tx=0x7f197000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:25.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f19857fa700 1 -- 172.21.15.125:0/1253627872 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19700052d0 con 0x7f19880d2e00 2023-10-17T06:08:25.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f19857fa700 1 -- 172.21.15.125:0/1253627872 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1970005430 con 0x7f19880d2e00 2023-10-17T06:08:25.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f198d102700 1 -- 172.21.15.125:0/1253627872 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19880ad6c0 con 0x7f19880d2e00 2023-10-17T06:08:25.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f19857fa700 1 -- 172.21.15.125:0/1253627872 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19700055a0 con 0x7f19880d2e00 2023-10-17T06:08:25.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.594+0000 7f198d102700 1 -- 172.21.15.125:0/1253627872 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19880b1640 con 0x7f19880d2e00 2023-10-17T06:08:25.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.598+0000 7f198d102700 1 -- 172.21.15.125:0/1253627872 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198806d140 con 0x7f19880d2e00 2023-10-17T06:08:25.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.598+0000 7f19857fa700 1 -- 172.21.15.125:0/1253627872 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f19700038c0 con 0x7f19880d2e00 2023-10-17T06:08:25.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.602+0000 7f19857fa700 1 --2- 172.21.15.125:0/1253627872 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19680656f0 0x7f1968067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:25.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.602+0000 7f19857fa700 1 -- 172.21.15.125:0/1253627872 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1970082400 con 0x7f19880d2e00 2023-10-17T06:08:25.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.602+0000 7f1987fff700 1 --2- 172.21.15.125:0/1253627872 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19680656f0 0x7f1968067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:25.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.602+0000 7f1987fff700 1 --2- 172.21.15.125:0/1253627872 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19680656f0 0x7f1968067bb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1978000c00 tx=0x7f1978008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:25.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.606+0000 7f19857fa700 1 -- 172.21.15.125:0/1253627872 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f197004faf0 con 0x7f19880d2e00 2023-10-17T06:08:25.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.786+0000 7f198d102700 1 -- 172.21.15.125:0/1253627872 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f198815d0d0 con 0x7f19880d2e00 2023-10-17T06:08:25.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.790+0000 7f19857fa700 1 -- 172.21.15.125:0/1253627872 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f198815d0d0 con 0x7f19880d2e00 2023-10-17T06:08:25.794 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:08:25.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.794+0000 7f198d102700 1 -- 172.21.15.125:0/1253627872 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19680656f0 msgr2=0x7f1968067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:25.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.794+0000 7f198d102700 1 --2- 172.21.15.125:0/1253627872 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19680656f0 0x7f1968067bb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1978000c00 tx=0x7f1978008030 comp rx=0 tx=0).stop 2023-10-17T06:08:25.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.794+0000 7f198d102700 1 -- 172.21.15.125:0/1253627872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880d2e00 msgr2=0x7f19880b1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:25.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.794+0000 7f198d102700 1 --2- 172.21.15.125:0/1253627872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880d2e00 0x7f19880b1100 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f197000c4d0 tx=0x7f197000c7e0 comp rx=0 tx=0).stop 2023-10-17T06:08:25.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.794+0000 7f198d102700 1 -- 172.21.15.125:0/1253627872 shutdown_connections 2023-10-17T06:08:25.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.794+0000 7f198d102700 1 --2- 172.21.15.125:0/1253627872 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19680656f0 0x7f1968067bb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:25.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.794+0000 7f198d102700 1 --2- 172.21.15.125:0/1253627872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1988160710 0x7f19881f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:25.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.794+0000 7f198d102700 1 --2- 172.21.15.125:0/1253627872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880d2e00 0x7f19880b1100 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:25.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.794+0000 7f198d102700 1 --2- 172.21.15.125:0/1253627872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19880b5ae0 0x7f19881f6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:25.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.794+0000 7f198d102700 1 -- 172.21.15.125:0/1253627872 >> 172.21.15.125:0/1253627872 conn(0x7f1988069f20 msgr2=0x7f198815e310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:25.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.794+0000 7f198d102700 1 -- 172.21.15.125:0/1253627872 shutdown_connections 2023-10-17T06:08:25.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:25.794+0000 7f198d102700 1 -- 172.21.15.125:0/1253627872 wait complete. 2023-10-17T06:08:25.820 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-17T06:08:26.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.006+0000 7f538554c700 1 Processor -- start 2023-10-17T06:08:26.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.006+0000 7f538554c700 1 -- start start 2023-10-17T06:08:26.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.010+0000 7f538554c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53800d2e00 0x7f53800b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:26.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.010+0000 7f538554c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5380160710 0x7f53800d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:26.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.010+0000 7f538554c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538015d0d0 con 0x7f53800b5ae0 2023-10-17T06:08:26.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.010+0000 7f538554c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f538015df90 con 0x7f5380160710 2023-10-17T06:08:26.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.010+0000 7f538554c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538006f0f0 con 0x7f53800d2e00 2023-10-17T06:08:26.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.010+0000 7f537f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5380160710 0x7f53800d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:26.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.010+0000 7f537f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5380160710 0x7f53800d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35534/0 (socket says 172.21.15.125:35534) 2023-10-17T06:08:26.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.010+0000 7f537ffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53800d2e00 0x7f53800b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:26.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.010+0000 7f537f7fe700 1 -- 172.21.15.125:0/2262446132 learned_addr learned my addr 172.21.15.125:0/2262446132 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:26.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.010+0000 7f537f7fe700 1 -- 172.21.15.125:0/2262446132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53800d2e00 msgr2=0x7f53800b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:26.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.010+0000 7f537f7fe700 1 --2- 172.21.15.125:0/2262446132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53800d2e00 0x7f53800b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.010+0000 7f537f7fe700 1 -- 172.21.15.125:0/2262446132 >> v1:172.21.15.184:6789/0 conn(0x7f53800b5ae0 legacy=0x7f538006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:26.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.010+0000 7f537f7fe700 1 -- 172.21.15.125:0/2262446132 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53800d3720 con 0x7f5380160710 2023-10-17T06:08:26.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.010+0000 7f537f7fe700 1 --2- 172.21.15.125:0/2262446132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5380160710 0x7f53800d31e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5374009940 tx=0x7f5374009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e0db6a91499e7f server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:26.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.010+0000 7f537effd700 1 -- 172.21.15.125:0/2262446132 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374011830 con 0x7f5380160710 2023-10-17T06:08:26.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.010+0000 7f537effd700 1 -- 172.21.15.125:0/2262446132 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5374011990 con 0x7f5380160710 2023-10-17T06:08:26.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.010+0000 7f537effd700 1 -- 172.21.15.125:0/2262446132 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374011d20 con 0x7f5380160710 2023-10-17T06:08:26.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.014+0000 7f538554c700 1 -- 172.21.15.125:0/2262446132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5380160710 msgr2=0x7f53800d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:26.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.014+0000 7f538554c700 1 --2- 172.21.15.125:0/2262446132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5380160710 0x7f53800d31e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5374009940 tx=0x7f5374009c50 comp rx=0 tx=0).stop 2023-10-17T06:08:26.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.014+0000 7f538554c700 1 -- 172.21.15.125:0/2262446132 shutdown_connections 2023-10-17T06:08:26.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.014+0000 7f538554c700 1 --2- 172.21.15.125:0/2262446132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5380160710 0x7f53800d31e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.014+0000 7f538554c700 1 --2- 172.21.15.125:0/2262446132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53800d2e00 0x7f53800b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.014+0000 7f538554c700 1 -- 172.21.15.125:0/2262446132 >> 172.21.15.125:0/2262446132 conn(0x7f5380069f20 msgr2=0x7f538006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:26.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.014+0000 7f538554c700 1 -- 172.21.15.125:0/2262446132 shutdown_connections 2023-10-17T06:08:26.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.014+0000 7f538554c700 1 -- 172.21.15.125:0/2262446132 wait complete. 2023-10-17T06:08:26.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.014+0000 7f538554c700 1 Processor -- start 2023-10-17T06:08:26.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.014+0000 7f538554c700 1 -- start start 2023-10-17T06:08:26.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.014+0000 7f538554c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53800b5ae0 0x7f5380149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:26.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.014+0000 7f538554c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53800d2e00 0x7f538015f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:26.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.014+0000 7f538554c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5380160710 0x7f538015f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:26.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.014+0000 7f538554c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538014b0d0 con 0x7f53800d2e00 2023-10-17T06:08:26.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.014+0000 7f538554c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538014b560 con 0x7f5380160710 2023-10-17T06:08:26.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.014+0000 7f538554c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538014a4c0 con 0x7f53800b5ae0 2023-10-17T06:08:26.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.018+0000 7f537f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53800d2e00 0x7f538015f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:26.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.018+0000 7f537f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53800d2e00 0x7f538015f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35538/0 (socket says 172.21.15.125:35538) 2023-10-17T06:08:26.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.018+0000 7f537f7fe700 1 -- 172.21.15.125:0/541060030 learned_addr learned my addr 172.21.15.125:0/541060030 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:26.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.018+0000 7f5384d4b700 1 --2- 172.21.15.125:0/541060030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5380160710 0x7f538015f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:26.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.018+0000 7f537ffff700 1 --2- 172.21.15.125:0/541060030 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53800b5ae0 0x7f5380149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:26.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.018+0000 7f537f7fe700 1 -- 172.21.15.125:0/541060030 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53800b5ae0 msgr2=0x7f5380149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:26.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.018+0000 7f537f7fe700 1 --2- 172.21.15.125:0/541060030 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53800b5ae0 0x7f5380149140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.018+0000 7f537f7fe700 1 -- 172.21.15.125:0/541060030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5380160710 msgr2=0x7f538015f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:26.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.018+0000 7f537f7fe700 1 --2- 172.21.15.125:0/541060030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5380160710 0x7f538015f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.018+0000 7f537f7fe700 1 -- 172.21.15.125:0/541060030 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5374009570 con 0x7f53800d2e00 2023-10-17T06:08:26.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.018+0000 7f537f7fe700 1 --2- 172.21.15.125:0/541060030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53800d2e00 0x7f538015f310 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5374009150 tx=0x7f5374004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:26.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.018+0000 7f537cff9700 1 -- 172.21.15.125:0/541060030 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53740036c0 con 0x7f53800d2e00 2023-10-17T06:08:26.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.018+0000 7f537cff9700 1 -- 172.21.15.125:0/541060030 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5374003820 con 0x7f53800d2e00 2023-10-17T06:08:26.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.018+0000 7f538554c700 1 -- 172.21.15.125:0/541060030 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538014a7a0 con 0x7f53800d2e00 2023-10-17T06:08:26.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.018+0000 7f537cff9700 1 -- 172.21.15.125:0/541060030 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374003b90 con 0x7f53800d2e00 2023-10-17T06:08:26.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.018+0000 7f538554c700 1 -- 172.21.15.125:0/541060030 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538014ad60 con 0x7f53800d2e00 2023-10-17T06:08:26.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.018+0000 7f538554c700 1 -- 172.21.15.125:0/541060030 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538004e910 con 0x7f53800d2e00 2023-10-17T06:08:26.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.022+0000 7f537cff9700 1 -- 172.21.15.125:0/541060030 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5374003cf0 con 0x7f53800d2e00 2023-10-17T06:08:26.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.022+0000 7f537cff9700 1 --2- 172.21.15.125:0/541060030 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f536c065720 0x7f536c067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:26.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.022+0000 7f537cff9700 1 -- 172.21.15.125:0/541060030 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f53740844c0 con 0x7f53800d2e00 2023-10-17T06:08:26.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.022+0000 7f537ffff700 1 --2- 172.21.15.125:0/541060030 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f536c065720 0x7f536c067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:26.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.022+0000 7f537ffff700 1 --2- 172.21.15.125:0/541060030 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f536c065720 0x7f536c067be0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f53800cf230 tx=0x7f5370008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:26.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.030+0000 7f537cff9700 1 -- 172.21.15.125:0/541060030 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f5374051ce0 con 0x7f53800d2e00 2023-10-17T06:08:26.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.254+0000 7f538554c700 1 -- 172.21.15.125:0/541060030 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f53800d2830 con 0x7f53800d2e00 2023-10-17T06:08:26.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.254+0000 7f537cff9700 1 -- 172.21.15.125:0/541060030 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5374055300 con 0x7f53800d2e00 2023-10-17T06:08:26.259 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:26.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.258+0000 7f538554c700 1 -- 172.21.15.125:0/541060030 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f536c065720 msgr2=0x7f536c067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:26.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.258+0000 7f538554c700 1 --2- 172.21.15.125:0/541060030 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f536c065720 0x7f536c067be0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f53800cf230 tx=0x7f5370008040 comp rx=0 tx=0).stop 2023-10-17T06:08:26.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.258+0000 7f538554c700 1 -- 172.21.15.125:0/541060030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53800d2e00 msgr2=0x7f538015f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:26.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.258+0000 7f538554c700 1 --2- 172.21.15.125:0/541060030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53800d2e00 0x7f538015f310 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5374009150 tx=0x7f5374004770 comp rx=0 tx=0).stop 2023-10-17T06:08:26.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.258+0000 7f538554c700 1 -- 172.21.15.125:0/541060030 shutdown_connections 2023-10-17T06:08:26.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.258+0000 7f538554c700 1 --2- 172.21.15.125:0/541060030 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f536c065720 0x7f536c067be0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.258+0000 7f538554c700 1 --2- 172.21.15.125:0/541060030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5380160710 0x7f538015f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.258+0000 7f538554c700 1 --2- 172.21.15.125:0/541060030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53800d2e00 0x7f538015f310 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.258+0000 7f538554c700 1 --2- 172.21.15.125:0/541060030 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53800b5ae0 0x7f5380149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.258+0000 7f538554c700 1 -- 172.21.15.125:0/541060030 >> 172.21.15.125:0/541060030 conn(0x7f5380069f20 msgr2=0x7f53800b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:26.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.258+0000 7f538554c700 1 -- 172.21.15.125:0/541060030 shutdown_connections 2023-10-17T06:08:26.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.258+0000 7f538554c700 1 -- 172.21.15.125:0/541060030 wait complete. 2023-10-17T06:08:26.283 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-17T06:08:26.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.458+0000 7f265a55f700 1 Processor -- start 2023-10-17T06:08:26.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.458+0000 7f265a55f700 1 -- start start 2023-10-17T06:08:26.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.462+0000 7f265a55f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f26540b3d40 0x7f26540cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:26.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.462+0000 7f265a55f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f265406ce20 0x7f265406d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:26.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.462+0000 7f265a55f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f265406d7b0 con 0x7f2654164a20 2023-10-17T06:08:26.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.462+0000 7f265a55f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f265406e2d0 con 0x7f265406ce20 2023-10-17T06:08:26.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.462+0000 7f265a55f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26540ca4c0 con 0x7f26540b3d40 2023-10-17T06:08:26.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.462+0000 7f2658d5c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2654164a20 0x7f26540c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55418/0 (socket says 172.21.15.125:55418) 2023-10-17T06:08:26.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.462+0000 7f2658d5c700 1 -- 172.21.15.125:0/1115129384 learned_addr learned my addr 172.21.15.125:0/1115129384 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:26.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.462+0000 7f2659d5e700 1 --2- 172.21.15.125:0/1115129384 >> v2:172.21.15.125:3300/0 conn(0x7f265406ce20 0x7f265406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:26.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.462+0000 7f265955d700 1 --2- 172.21.15.125:0/1115129384 >> v2:172.21.15.184:3300/0 conn(0x7f26540b3d40 0x7f26540cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:26.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.462+0000 7f264bfff700 1 -- 172.21.15.125:0/1115129384 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3710128928 0 0) 0x7f2644001110 con 0x7f2654164a20 2023-10-17T06:08:26.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.462+0000 7f264bfff700 1 -- 172.21.15.125:0/1115129384 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26400035d0 con 0x7f2654164a20 2023-10-17T06:08:26.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.462+0000 7f2659d5e700 1 -- 172.21.15.125:0/1115129384 >> v2:172.21.15.184:3300/0 conn(0x7f26540b3d40 msgr2=0x7f26540cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:26.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.462+0000 7f2659d5e700 1 --2- 172.21.15.125:0/1115129384 >> v2:172.21.15.184:3300/0 conn(0x7f26540b3d40 0x7f26540cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.462+0000 7f2659d5e700 1 -- 172.21.15.125:0/1115129384 >> v1:172.21.15.125:6789/0 conn(0x7f2654164a20 legacy=0x7f26540c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:26.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.462+0000 7f2659d5e700 1 -- 172.21.15.125:0/1115129384 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26540ca7a0 con 0x7f265406ce20 2023-10-17T06:08:26.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.466+0000 7f2659d5e700 1 --2- 172.21.15.125:0/1115129384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f265406ce20 0x7f265406d270 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f265406e760 tx=0x7f264c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817a07b0df37dadf server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:26.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.466+0000 7f264bfff700 1 -- 172.21.15.125:0/1115129384 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c00e070 con 0x7f265406ce20 2023-10-17T06:08:26.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.466+0000 7f264bfff700 1 -- 172.21.15.125:0/1115129384 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264c00bb20 con 0x7f265406ce20 2023-10-17T06:08:26.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.466+0000 7f264bfff700 1 -- 172.21.15.125:0/1115129384 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c012430 con 0x7f265406ce20 2023-10-17T06:08:26.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.466+0000 7f265a55f700 1 -- 172.21.15.125:0/1115129384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f265406ce20 msgr2=0x7f265406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:26.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.466+0000 7f265a55f700 1 --2- 172.21.15.125:0/1115129384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f265406ce20 0x7f265406d270 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f265406e760 tx=0x7f264c00b330 comp rx=0 tx=0).stop 2023-10-17T06:08:26.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.466+0000 7f265a55f700 1 -- 172.21.15.125:0/1115129384 shutdown_connections 2023-10-17T06:08:26.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.466+0000 7f265a55f700 1 --2- 172.21.15.125:0/1115129384 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f265406ce20 0x7f265406d270 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.466+0000 7f265a55f700 1 --2- 172.21.15.125:0/1115129384 >> v2:172.21.15.184:3300/0 conn(0x7f26540b3d40 0x7f26540cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.466+0000 7f265a55f700 1 -- 172.21.15.125:0/1115129384 >> 172.21.15.125:0/1115129384 conn(0x7f26540ce5c0 msgr2=0x7f26540ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:26.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.466+0000 7f265a55f700 1 -- 172.21.15.125:0/1115129384 shutdown_connections 2023-10-17T06:08:26.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.466+0000 7f265a55f700 1 -- 172.21.15.125:0/1115129384 wait complete. 2023-10-17T06:08:26.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.470+0000 7f265a55f700 1 Processor -- start 2023-10-17T06:08:26.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.470+0000 7f265a55f700 1 -- start start 2023-10-17T06:08:26.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.470+0000 7f265a55f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f265406ce20 0x7f2654155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:26.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.470+0000 7f265a55f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f26540b3d40 0x7f26540b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:26.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.470+0000 7f265a55f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2654164a20 0x7f26541563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:26.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.470+0000 7f265a55f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26540c60a0 con 0x7f265406ce20 2023-10-17T06:08:26.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.470+0000 7f265a55f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2654155eb0 con 0x7f2654164a20 2023-10-17T06:08:26.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.470+0000 7f265a55f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26540b33e0 con 0x7f26540b3d40 2023-10-17T06:08:26.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.470+0000 7f265955d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f265406ce20 0x7f2654155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:26.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.470+0000 7f265955d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f265406ce20 0x7f2654155970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35550/0 (socket says 172.21.15.125:35550) 2023-10-17T06:08:26.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.470+0000 7f265955d700 1 -- 172.21.15.125:0/3572553243 learned_addr learned my addr 172.21.15.125:0/3572553243 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:26.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.470+0000 7f2658d5c700 1 --2- 172.21.15.125:0/3572553243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f26540b3d40 0x7f26540b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:26.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.470+0000 7f2659d5e700 1 --2- 172.21.15.125:0/3572553243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2654164a20 0x7f26541563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:26.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.470+0000 7f265955d700 1 -- 172.21.15.125:0/3572553243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f26540b3d40 msgr2=0x7f26540b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:26.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.470+0000 7f265955d700 1 --2- 172.21.15.125:0/3572553243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f26540b3d40 0x7f26540b1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.470+0000 7f265955d700 1 -- 172.21.15.125:0/3572553243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2654164a20 msgr2=0x7f26541563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:26.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.470+0000 7f265955d700 1 --2- 172.21.15.125:0/3572553243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2654164a20 0x7f26541563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.470+0000 7f265955d700 1 -- 172.21.15.125:0/3572553243 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c009a70 con 0x7f265406ce20 2023-10-17T06:08:26.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.474+0000 7f265955d700 1 --2- 172.21.15.125:0/3572553243 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f265406ce20 0x7f2654155970 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f265000e9d0 tx=0x7f265000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:26.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.474+0000 7f2649ffb700 1 -- 172.21.15.125:0/3572553243 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650009720 con 0x7f265406ce20 2023-10-17T06:08:26.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.474+0000 7f2649ffb700 1 -- 172.21.15.125:0/3572553243 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265000c850 con 0x7f265406ce20 2023-10-17T06:08:26.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.474+0000 7f2649ffb700 1 -- 172.21.15.125:0/3572553243 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265000cbc0 con 0x7f265406ce20 2023-10-17T06:08:26.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.474+0000 7f265a55f700 1 -- 172.21.15.125:0/3572553243 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26540c62b0 con 0x7f265406ce20 2023-10-17T06:08:26.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.474+0000 7f265a55f700 1 -- 172.21.15.125:0/3572553243 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26540c6870 con 0x7f265406ce20 2023-10-17T06:08:26.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.474+0000 7f265a55f700 1 -- 172.21.15.125:0/3572553243 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2654073540 con 0x7f265406ce20 2023-10-17T06:08:26.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.478+0000 7f2649ffb700 1 -- 172.21.15.125:0/3572553243 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f265000cd20 con 0x7f265406ce20 2023-10-17T06:08:26.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.478+0000 7f2649ffb700 1 --2- 172.21.15.125:0/3572553243 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2638065740 0x7f2638067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:26.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.478+0000 7f2649ffb700 1 -- 172.21.15.125:0/3572553243 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f26500831e0 con 0x7f265406ce20 2023-10-17T06:08:26.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.478+0000 7f2658d5c700 1 --2- 172.21.15.125:0/3572553243 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2638065740 0x7f2638067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:26.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.478+0000 7f2658d5c700 1 --2- 172.21.15.125:0/3572553243 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2638065740 0x7f2638067c00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f26540b2e40 tx=0x7f2644009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:26.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.486+0000 7f2649ffb700 1 -- 172.21.15.125:0/3572553243 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2650054470 con 0x7f265406ce20 2023-10-17T06:08:26.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.662+0000 7f265a55f700 1 -- 172.21.15.125:0/3572553243 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f265404e910 con 0x7f265406ce20 2023-10-17T06:08:26.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.662+0000 7f2649ffb700 1 -- 172.21.15.125:0/3572553243 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2650054000 con 0x7f265406ce20 2023-10-17T06:08:26.668 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-17T06:08:26.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.666+0000 7f265a55f700 1 -- 172.21.15.125:0/3572553243 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2638065740 msgr2=0x7f2638067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:26.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.666+0000 7f265a55f700 1 --2- 172.21.15.125:0/3572553243 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2638065740 0x7f2638067c00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f26540b2e40 tx=0x7f2644009040 comp rx=0 tx=0).stop 2023-10-17T06:08:26.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.666+0000 7f265a55f700 1 -- 172.21.15.125:0/3572553243 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f265406ce20 msgr2=0x7f2654155970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:26.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.666+0000 7f265a55f700 1 --2- 172.21.15.125:0/3572553243 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f265406ce20 0x7f2654155970 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f265000e9d0 tx=0x7f265000ed90 comp rx=0 tx=0).stop 2023-10-17T06:08:26.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.666+0000 7f265a55f700 1 -- 172.21.15.125:0/3572553243 shutdown_connections 2023-10-17T06:08:26.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.666+0000 7f265a55f700 1 --2- 172.21.15.125:0/3572553243 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2638065740 0x7f2638067c00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.666+0000 7f265a55f700 1 --2- 172.21.15.125:0/3572553243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2654164a20 0x7f26541563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.666+0000 7f265a55f700 1 --2- 172.21.15.125:0/3572553243 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f26540b3d40 0x7f26540b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.666+0000 7f265a55f700 1 --2- 172.21.15.125:0/3572553243 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f265406ce20 0x7f2654155970 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.666+0000 7f265a55f700 1 -- 172.21.15.125:0/3572553243 >> 172.21.15.125:0/3572553243 conn(0x7f26540ce5c0 msgr2=0x7f2654160990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:26.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.666+0000 7f265a55f700 1 -- 172.21.15.125:0/3572553243 shutdown_connections 2023-10-17T06:08:26.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.666+0000 7f265a55f700 1 -- 172.21.15.125:0/3572553243 wait complete. 2023-10-17T06:08:26.695 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-17T06:08:26.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.886+0000 7fee1238b700 1 Processor -- start 2023-10-17T06:08:26.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.886+0000 7fee1238b700 1 -- start start 2023-10-17T06:08:26.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee1238b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee0c0d2e00 0x7fee0c0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:26.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee1238b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fee0c160710 0x7fee0c0d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:26.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee1238b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee0c0b5ae0 0x7fee0c06db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:26.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee1238b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0c15df90 con 0x7fee0c0b5ae0 2023-10-17T06:08:26.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee1238b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0c15d0d0 con 0x7fee0c160710 2023-10-17T06:08:26.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee1238b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c06f0f0 con 0x7fee0c0d2e00 2023-10-17T06:08:26.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee11389700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee0c0d2e00 0x7fee0c0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:26.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee11b8a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee0c0b5ae0 0x7fee0c06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:26.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee11389700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee0c0d2e00 0x7fee0c0b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:54070/0 (socket says 172.21.15.125:54070) 2023-10-17T06:08:26.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee11389700 1 -- 172.21.15.125:0/3644509840 learned_addr learned my addr 172.21.15.125:0/3644509840 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:26.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee10b88700 1 --2- 172.21.15.125:0/3644509840 >> v2:172.21.15.184:3300/0 conn(0x7fee0c160710 0x7fee0c0d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:26.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee11389700 1 -- 172.21.15.125:0/3644509840 >> v2:172.21.15.184:3300/0 conn(0x7fee0c160710 msgr2=0x7fee0c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:26.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee11389700 1 --2- 172.21.15.125:0/3644509840 >> v2:172.21.15.184:3300/0 conn(0x7fee0c160710 0x7fee0c0d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee11389700 1 -- 172.21.15.125:0/3644509840 >> v2:172.21.15.125:3300/0 conn(0x7fee0c0b5ae0 msgr2=0x7fee0c06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:26.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee11389700 1 --2- 172.21.15.125:0/3644509840 >> v2:172.21.15.125:3300/0 conn(0x7fee0c0b5ae0 0x7fee0c06db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee11389700 1 -- 172.21.15.125:0/3644509840 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c0d3720 con 0x7fee0c0d2e00 2023-10-17T06:08:26.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee11b8a700 1 --2- 172.21.15.125:0/3644509840 >> v2:172.21.15.125:3300/0 conn(0x7fee0c0b5ae0 0x7fee0c06db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:08:26.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee11389700 1 --2- 172.21.15.125:0/3644509840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee0c0d2e00 0x7fee0c0b6e00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fee08009910 tx=0x7fee08009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63612a2772ad27f server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:26.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee03fff700 1 -- 172.21.15.125:0/3644509840 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08011830 con 0x7fee0c0d2e00 2023-10-17T06:08:26.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee03fff700 1 -- 172.21.15.125:0/3644509840 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee08011990 con 0x7fee0c0d2e00 2023-10-17T06:08:26.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.890+0000 7fee03fff700 1 -- 172.21.15.125:0/3644509840 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08011d40 con 0x7fee0c0d2e00 2023-10-17T06:08:26.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.894+0000 7fee1238b700 1 -- 172.21.15.125:0/3644509840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee0c0d2e00 msgr2=0x7fee0c0b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:26.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.894+0000 7fee1238b700 1 --2- 172.21.15.125:0/3644509840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee0c0d2e00 0x7fee0c0b6e00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fee08009910 tx=0x7fee08009c20 comp rx=0 tx=0).stop 2023-10-17T06:08:26.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.894+0000 7fee1238b700 1 -- 172.21.15.125:0/3644509840 shutdown_connections 2023-10-17T06:08:26.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.894+0000 7fee1238b700 1 --2- 172.21.15.125:0/3644509840 >> v2:172.21.15.125:3300/0 conn(0x7fee0c0b5ae0 0x7fee0c06db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.894+0000 7fee1238b700 1 --2- 172.21.15.125:0/3644509840 >> v2:172.21.15.184:3300/0 conn(0x7fee0c160710 0x7fee0c0d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.894+0000 7fee1238b700 1 --2- 172.21.15.125:0/3644509840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee0c0d2e00 0x7fee0c0b6e00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.894+0000 7fee1238b700 1 -- 172.21.15.125:0/3644509840 >> 172.21.15.125:0/3644509840 conn(0x7fee0c069f20 msgr2=0x7fee0c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:26.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.894+0000 7fee1238b700 1 -- 172.21.15.125:0/3644509840 shutdown_connections 2023-10-17T06:08:26.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.894+0000 7fee1238b700 1 -- 172.21.15.125:0/3644509840 wait complete. 2023-10-17T06:08:26.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.894+0000 7fee1238b700 1 Processor -- start 2023-10-17T06:08:26.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.894+0000 7fee1238b700 1 -- start start 2023-10-17T06:08:26.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee1238b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee0c0b5ae0 0x7fee0c0b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:26.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee1238b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee0c0d2e00 0x7fee0c157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:26.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee1238b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee0c160710 0x7fee0c147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:26.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee1238b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c1554c0 con 0x7fee0c0b5ae0 2023-10-17T06:08:26.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee1238b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c0b46b0 con 0x7fee0c160710 2023-10-17T06:08:26.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee1238b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c158110 con 0x7fee0c0d2e00 2023-10-17T06:08:26.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee11389700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee0c0b5ae0 0x7fee0c0b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:26.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee11389700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee0c0b5ae0 0x7fee0c0b37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35570/0 (socket says 172.21.15.125:35570) 2023-10-17T06:08:26.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee11389700 1 -- 172.21.15.125:0/318220232 learned_addr learned my addr 172.21.15.125:0/318220232 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:26.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee10b88700 1 --2- 172.21.15.125:0/318220232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee0c0d2e00 0x7fee0c157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:26.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee11b8a700 1 --2- 172.21.15.125:0/318220232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee0c160710 0x7fee0c147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:26.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee11389700 1 -- 172.21.15.125:0/318220232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee0c0d2e00 msgr2=0x7fee0c157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:26.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee11389700 1 --2- 172.21.15.125:0/318220232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee0c0d2e00 0x7fee0c157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee11389700 1 -- 172.21.15.125:0/318220232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee0c160710 msgr2=0x7fee0c147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:26.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee11389700 1 --2- 172.21.15.125:0/318220232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee0c160710 0x7fee0c147be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:26.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee11389700 1 -- 172.21.15.125:0/318220232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee04009a70 con 0x7fee0c0b5ae0 2023-10-17T06:08:26.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee11b8a700 1 --2- 172.21.15.125:0/318220232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee0c160710 0x7fee0c147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:26.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee10b88700 1 --2- 172.21.15.125:0/318220232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee0c0d2e00 0x7fee0c157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:26.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee11389700 1 --2- 172.21.15.125:0/318220232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee0c0b5ae0 0x7fee0c0b37a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fee08000c00 tx=0x7fee08004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:26.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee01ffb700 1 -- 172.21.15.125:0/318220232 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08004510 con 0x7fee0c0b5ae0 2023-10-17T06:08:26.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee01ffb700 1 -- 172.21.15.125:0/318220232 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0801e070 con 0x7fee0c0b5ae0 2023-10-17T06:08:26.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee1238b700 1 -- 172.21.15.125:0/318220232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee08009570 con 0x7fee0c0b5ae0 2023-10-17T06:08:26.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee01ffb700 1 -- 172.21.15.125:0/318220232 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08003900 con 0x7fee0c0b5ae0 2023-10-17T06:08:26.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee1238b700 1 -- 172.21.15.125:0/318220232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0c0b3ec0 con 0x7fee0c0b5ae0 2023-10-17T06:08:26.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.898+0000 7fee1238b700 1 -- 172.21.15.125:0/318220232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee0c04e910 con 0x7fee0c0b5ae0 2023-10-17T06:08:26.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.902+0000 7fee01ffb700 1 -- 172.21.15.125:0/318220232 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fee08003a60 con 0x7fee0c0b5ae0 2023-10-17T06:08:26.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.902+0000 7fee01ffb700 1 --2- 172.21.15.125:0/318220232 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fedf00656f0 0x7fedf0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:26.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.902+0000 7fee01ffb700 1 -- 172.21.15.125:0/318220232 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fee080840c0 con 0x7fee0c0b5ae0 2023-10-17T06:08:26.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.902+0000 7fee10b88700 1 --2- 172.21.15.125:0/318220232 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fedf00656f0 0x7fedf0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:26.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.906+0000 7fee10b88700 1 --2- 172.21.15.125:0/318220232 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fedf00656f0 0x7fedf0067bb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fee0c0cec00 tx=0x7fedfc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:26.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:26.910+0000 7fee01ffb700 1 -- 172.21.15.125:0/318220232 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fee08051900 con 0x7fee0c0b5ae0 2023-10-17T06:08:27.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.094+0000 7fee1238b700 1 -- 172.21.15.125:0/318220232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fee0c15d8a0 con 0x7fee0c0b5ae0 2023-10-17T06:08:27.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.094+0000 7fee01ffb700 1 -- 172.21.15.125:0/318220232 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fee08054f20 con 0x7fee0c0b5ae0 2023-10-17T06:08:27.099 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:27.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.098+0000 7fee1238b700 1 -- 172.21.15.125:0/318220232 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fedf00656f0 msgr2=0x7fedf0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:27.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.098+0000 7fee1238b700 1 --2- 172.21.15.125:0/318220232 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fedf00656f0 0x7fedf0067bb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fee0c0cec00 tx=0x7fedfc008040 comp rx=0 tx=0).stop 2023-10-17T06:08:27.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.098+0000 7fee1238b700 1 -- 172.21.15.125:0/318220232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee0c0b5ae0 msgr2=0x7fee0c0b37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:27.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.098+0000 7fee1238b700 1 --2- 172.21.15.125:0/318220232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee0c0b5ae0 0x7fee0c0b37a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fee08000c00 tx=0x7fee08004770 comp rx=0 tx=0).stop 2023-10-17T06:08:27.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.098+0000 7fee1238b700 1 -- 172.21.15.125:0/318220232 shutdown_connections 2023-10-17T06:08:27.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.098+0000 7fee1238b700 1 --2- 172.21.15.125:0/318220232 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fedf00656f0 0x7fedf0067bb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:27.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.098+0000 7fee1238b700 1 --2- 172.21.15.125:0/318220232 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee0c160710 0x7fee0c147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:27.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.098+0000 7fee1238b700 1 --2- 172.21.15.125:0/318220232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee0c0d2e00 0x7fee0c157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:27.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.098+0000 7fee1238b700 1 --2- 172.21.15.125:0/318220232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee0c0b5ae0 0x7fee0c0b37a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:27.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.098+0000 7fee1238b700 1 -- 172.21.15.125:0/318220232 >> 172.21.15.125:0/318220232 conn(0x7fee0c069f20 msgr2=0x7fee0c15c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:27.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.098+0000 7fee1238b700 1 -- 172.21.15.125:0/318220232 shutdown_connections 2023-10-17T06:08:27.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.098+0000 7fee1238b700 1 -- 172.21.15.125:0/318220232 wait complete. 2023-10-17T06:08:27.123 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-17T06:08:27.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.306+0000 7f85ca99e700 1 Processor -- start 2023-10-17T06:08:27.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.306+0000 7f85ca99e700 1 -- start start 2023-10-17T06:08:27.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.310+0000 7f85ca99e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f85c415cbd0 0x7f85c40b6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:27.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.310+0000 7f85ca99e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85c40b5ae0 0x7f85c40b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:27.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.310+0000 7f85ca99e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c406e390 con 0x7f85c40b1d10 2023-10-17T06:08:27.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.310+0000 7f85ca99e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c415cfb0 con 0x7f85c415cbd0 2023-10-17T06:08:27.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.310+0000 7f85ca99e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c40b6050 con 0x7f85c40b5ae0 2023-10-17T06:08:27.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.310+0000 7f85c999c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f85c415cbd0 0x7f85c40b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:27.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.310+0000 7f85c999c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f85c415cbd0 0x7f85c40b6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35572/0 (socket says 172.21.15.125:35572) 2023-10-17T06:08:27.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.310+0000 7f85c999c700 1 -- 172.21.15.125:0/3964009909 learned_addr learned my addr 172.21.15.125:0/3964009909 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:27.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.310+0000 7f85c919b700 1 --2- 172.21.15.125:0/3964009909 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85c40b5ae0 0x7f85c40b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:27.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.310+0000 7f85c999c700 1 -- 172.21.15.125:0/3964009909 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85c40b5ae0 msgr2=0x7f85c40b6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:27.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.310+0000 7f85c999c700 1 --2- 172.21.15.125:0/3964009909 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85c40b5ae0 0x7f85c40b6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:27.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.310+0000 7f85c999c700 1 -- 172.21.15.125:0/3964009909 >> v1:172.21.15.184:6789/0 conn(0x7f85c40b1d10 legacy=0x7f85c4160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:27.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.310+0000 7f85c999c700 1 -- 172.21.15.125:0/3964009909 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c406e5e0 con 0x7f85c415cbd0 2023-10-17T06:08:27.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.310+0000 7f85c999c700 1 --2- 172.21.15.125:0/3964009909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85c415cbd0 0x7f85c40b6560 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f85c0009910 tx=0x7f85c0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb339aa00536a8e server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:27.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.310+0000 7f85c899a700 1 -- 172.21.15.125:0/3964009909 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c0011830 con 0x7f85c415cbd0 2023-10-17T06:08:27.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.310+0000 7f85c899a700 1 -- 172.21.15.125:0/3964009909 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c0011990 con 0x7f85c415cbd0 2023-10-17T06:08:27.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.310+0000 7f85c899a700 1 -- 172.21.15.125:0/3964009909 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c0011d40 con 0x7f85c415cbd0 2023-10-17T06:08:27.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.310+0000 7f85ca99e700 1 -- 172.21.15.125:0/3964009909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85c415cbd0 msgr2=0x7f85c40b6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:27.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.310+0000 7f85ca99e700 1 --2- 172.21.15.125:0/3964009909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85c415cbd0 0x7f85c40b6560 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f85c0009910 tx=0x7f85c0009c20 comp rx=0 tx=0).stop 2023-10-17T06:08:27.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.314+0000 7f85ca99e700 1 -- 172.21.15.125:0/3964009909 shutdown_connections 2023-10-17T06:08:27.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.314+0000 7f85ca99e700 1 --2- 172.21.15.125:0/3964009909 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85c40b5ae0 0x7f85c40b6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:27.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.314+0000 7f85ca99e700 1 --2- 172.21.15.125:0/3964009909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85c415cbd0 0x7f85c40b6560 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:27.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.314+0000 7f85ca99e700 1 -- 172.21.15.125:0/3964009909 >> 172.21.15.125:0/3964009909 conn(0x7f85c406f450 msgr2=0x7f85c406f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:27.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.314+0000 7f85ca99e700 1 -- 172.21.15.125:0/3964009909 shutdown_connections 2023-10-17T06:08:27.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.314+0000 7f85ca99e700 1 -- 172.21.15.125:0/3964009909 wait complete. 2023-10-17T06:08:27.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.314+0000 7f85ca99e700 1 Processor -- start 2023-10-17T06:08:27.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.314+0000 7f85ca99e700 1 -- start start 2023-10-17T06:08:27.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85ca99e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c40b1d10 0x7f85c415db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:27.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85ca99e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85c40b5ae0 0x7f85c408a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:27.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85ca99e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85c415cbd0 0x7f85c408d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:27.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85ca99e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c408a850 con 0x7f85c415cbd0 2023-10-17T06:08:27.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85ca99e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c408c730 con 0x7f85c40b1d10 2023-10-17T06:08:27.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85ca99e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c408ca10 con 0x7f85c40b5ae0 2023-10-17T06:08:27.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85c919b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85c40b5ae0 0x7f85c408a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:27.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85c999c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c40b1d10 0x7f85c415db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:27.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85c999c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c40b1d10 0x7f85c415db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:51628/0 (socket says 172.21.15.125:51628) 2023-10-17T06:08:27.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85c919b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85c40b5ae0 0x7f85c408a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:54090/0 (socket says 172.21.15.125:54090) 2023-10-17T06:08:27.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85c999c700 1 -- 172.21.15.125:0/1923661815 learned_addr learned my addr 172.21.15.125:0/1923661815 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:27.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85ca19d700 1 --2- 172.21.15.125:0/1923661815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85c415cbd0 0x7f85c408d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:27.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85c999c700 1 -- 172.21.15.125:0/1923661815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85c40b5ae0 msgr2=0x7f85c408a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:27.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85c999c700 1 --2- 172.21.15.125:0/1923661815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85c40b5ae0 0x7f85c408a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:27.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85c999c700 1 -- 172.21.15.125:0/1923661815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85c415cbd0 msgr2=0x7f85c408d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:27.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85c999c700 1 --2- 172.21.15.125:0/1923661815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85c415cbd0 0x7f85c408d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:27.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85c999c700 1 -- 172.21.15.125:0/1923661815 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c0009570 con 0x7f85c40b1d10 2023-10-17T06:08:27.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85c919b700 1 --2- 172.21.15.125:0/1923661815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85c40b5ae0 0x7f85c408a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:08:27.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85c999c700 1 --2- 172.21.15.125:0/1923661815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c40b1d10 0x7f85c415db00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f85c0000c00 tx=0x7f85c0004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:27.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85ba7fc700 1 -- 172.21.15.125:0/1923661815 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c0004510 con 0x7f85c40b1d10 2023-10-17T06:08:27.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85ba7fc700 1 -- 172.21.15.125:0/1923661815 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c001e070 con 0x7f85c40b1d10 2023-10-17T06:08:27.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.318+0000 7f85ba7fc700 1 -- 172.21.15.125:0/1923661815 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c00038e0 con 0x7f85c40b1d10 2023-10-17T06:08:27.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.322+0000 7f85ca99e700 1 -- 172.21.15.125:0/1923661815 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c408ccf0 con 0x7f85c40b1d10 2023-10-17T06:08:27.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.322+0000 7f85ca99e700 1 -- 172.21.15.125:0/1923661815 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c408da30 con 0x7f85c40b1d10 2023-10-17T06:08:27.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.322+0000 7f85ca99e700 1 -- 172.21.15.125:0/1923661815 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c408d210 con 0x7f85c40b1d10 2023-10-17T06:08:27.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.322+0000 7f85ba7fc700 1 -- 172.21.15.125:0/1923661815 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f85c0003a40 con 0x7f85c40b1d10 2023-10-17T06:08:27.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.326+0000 7f85ba7fc700 1 --2- 172.21.15.125:0/1923661815 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f85a8065720 0x7f85a8067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:27.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.326+0000 7f85ba7fc700 1 -- 172.21.15.125:0/1923661815 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f85c0083fe0 con 0x7f85c40b1d10 2023-10-17T06:08:27.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.326+0000 7f85c919b700 1 --2- 172.21.15.125:0/1923661815 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f85a8065720 0x7f85a8067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:27.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.326+0000 7f85c919b700 1 --2- 172.21.15.125:0/1923661815 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f85a8065720 0x7f85a8067be0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f85c40d2160 tx=0x7f85b4009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:27.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.334+0000 7f85ba7fc700 1 -- 172.21.15.125:0/1923661815 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f85c408d210 con 0x7f85c40b1d10 2023-10-17T06:08:27.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.538+0000 7f85ca99e700 1 -- 172.21.15.125:0/1923661815 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f85c408d210 con 0x7f85c40b1d10 2023-10-17T06:08:27.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.538+0000 7f85ba7fc700 1 -- 172.21.15.125:0/1923661815 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f85c0051860 con 0x7f85c40b1d10 2023-10-17T06:08:27.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.542+0000 7f85ca99e700 1 -- 172.21.15.125:0/1923661815 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f85a8065720 msgr2=0x7f85a8067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:27.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.542+0000 7f85ca99e700 1 --2- 172.21.15.125:0/1923661815 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f85a8065720 0x7f85a8067be0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f85c40d2160 tx=0x7f85b4009240 comp rx=0 tx=0).stop 2023-10-17T06:08:27.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.542+0000 7f85ca99e700 1 -- 172.21.15.125:0/1923661815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c40b1d10 msgr2=0x7f85c415db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:27.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.542+0000 7f85ca99e700 1 --2- 172.21.15.125:0/1923661815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c40b1d10 0x7f85c415db00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f85c0000c00 tx=0x7f85c0004770 comp rx=0 tx=0).stop 2023-10-17T06:08:27.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.542+0000 7f85ca99e700 1 -- 172.21.15.125:0/1923661815 shutdown_connections 2023-10-17T06:08:27.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.542+0000 7f85ca99e700 1 --2- 172.21.15.125:0/1923661815 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f85a8065720 0x7f85a8067be0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:27.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.542+0000 7f85ca99e700 1 --2- 172.21.15.125:0/1923661815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f85c415cbd0 0x7f85c408d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:27.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.542+0000 7f85ca99e700 1 --2- 172.21.15.125:0/1923661815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85c40b5ae0 0x7f85c408a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:27.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.542+0000 7f85ca99e700 1 --2- 172.21.15.125:0/1923661815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c40b1d10 0x7f85c415db00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:27.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.542+0000 7f85ca99e700 1 -- 172.21.15.125:0/1923661815 >> 172.21.15.125:0/1923661815 conn(0x7f85c406f450 msgr2=0x7f85c406a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:27.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.542+0000 7f85ca99e700 1 -- 172.21.15.125:0/1923661815 shutdown_connections 2023-10-17T06:08:27.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:27.542+0000 7f85ca99e700 1 -- 172.21.15.125:0/1923661815 wait complete. 2023-10-17T06:08:27.550 INFO:teuthology.orchestra.run.smithi125.stderr:listed 0 entries 2023-10-17T06:08:27.570 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-17T06:08:27.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:08:27.571 DEBUG:teuthology.orchestra.run.smithi125:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-17T06:08:27.608 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-10-17T06:08:27.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:08:27.609 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-17T06:08:27.678 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:08:27.678 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:08:27.697 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:08:27.698 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:08:27.766 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:08:27.766 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:08:27.830 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:08:28.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.006+0000 7f234c87a700 1 Processor -- start 2023-10-17T06:08:28.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.006+0000 7f234c87a700 1 -- start start 2023-10-17T06:08:28.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.010+0000 7f234c87a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23480adb20 0x7f23480cb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:28.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.010+0000 7f234c87a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23480caef0 con 0x7f234815ceb0 2023-10-17T06:08:28.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.010+0000 7f234c87a700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23480ae3c0 con 0x7f23480cb8c0 2023-10-17T06:08:28.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.010+0000 7f234c87a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23480ca5c0 con 0x7f23480adb20 2023-10-17T06:08:28.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.010+0000 7f2346d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f234815ceb0 0x7f23480cc6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55424/0 (socket says 172.21.15.125:55424) 2023-10-17T06:08:28.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.010+0000 7f2346d9d700 1 -- 172.21.15.125:0/172524833 learned_addr learned my addr 172.21.15.125:0/172524833 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:28.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.010+0000 7f234659c700 1 --2- 172.21.15.125:0/172524833 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23480adb20 0x7f23480cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:28.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.010+0000 7f2345d9b700 1 -- 172.21.15.125:0/172524833 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486838424 0 0) 0x7f23480ae3c0 con 0x7f23480cb8c0 2023-10-17T06:08:28.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.010+0000 7f2345d9b700 1 -- 172.21.15.125:0/172524833 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23300035d0 con 0x7f23480cb8c0 2023-10-17T06:08:28.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.010+0000 7f2345d9b700 1 -- 172.21.15.125:0/172524833 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256649267 0 0) 0x7f23480caef0 con 0x7f234815ceb0 2023-10-17T06:08:28.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.010+0000 7f2345d9b700 1 -- 172.21.15.125:0/172524833 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23480ae3c0 con 0x7f234815ceb0 2023-10-17T06:08:28.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.010+0000 7f234659c700 1 -- 172.21.15.125:0/172524833 >> v1:172.21.15.184:6789/0 conn(0x7f23480cb8c0 legacy=0x7f234815d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:28.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.010+0000 7f234659c700 1 -- 172.21.15.125:0/172524833 >> v1:172.21.15.125:6789/0 conn(0x7f234815ceb0 legacy=0x7f23480cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:28.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.010+0000 7f234659c700 1 -- 172.21.15.125:0/172524833 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23480ca8a0 con 0x7f23480adb20 2023-10-17T06:08:28.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.010+0000 7f234659c700 1 --2- 172.21.15.125:0/172524833 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23480adb20 0x7f23480cb380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f233c009880 tx=0x7f233c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24a3dec2725c949b server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:28.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.010+0000 7f2345d9b700 1 -- 172.21.15.125:0/172524833 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c011830 con 0x7f23480adb20 2023-10-17T06:08:28.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.010+0000 7f2345d9b700 1 -- 172.21.15.125:0/172524833 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c011990 con 0x7f23480adb20 2023-10-17T06:08:28.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.010+0000 7f2345d9b700 1 -- 172.21.15.125:0/172524833 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c011d20 con 0x7f23480adb20 2023-10-17T06:08:28.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.014+0000 7f234c87a700 1 -- 172.21.15.125:0/172524833 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23480adb20 msgr2=0x7f23480cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:28.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.014+0000 7f234c87a700 1 --2- 172.21.15.125:0/172524833 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23480adb20 0x7f23480cb380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f233c009880 tx=0x7f233c009b90 comp rx=0 tx=0).stop 2023-10-17T06:08:28.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.014+0000 7f234c87a700 1 -- 172.21.15.125:0/172524833 shutdown_connections 2023-10-17T06:08:28.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.014+0000 7f234c87a700 1 --2- 172.21.15.125:0/172524833 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23480adb20 0x7f23480cb380 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.014+0000 7f234c87a700 1 -- 172.21.15.125:0/172524833 >> 172.21.15.125:0/172524833 conn(0x7f23480b06c0 msgr2=0x7f23480b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:28.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.014+0000 7f234c87a700 1 -- 172.21.15.125:0/172524833 shutdown_connections 2023-10-17T06:08:28.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.014+0000 7f234c87a700 1 -- 172.21.15.125:0/172524833 wait complete. 2023-10-17T06:08:28.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.018+0000 7f234c87a700 1 Processor -- start 2023-10-17T06:08:28.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.018+0000 7f234c87a700 1 -- start start 2023-10-17T06:08:28.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.018+0000 7f234c87a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23480adb20 0x7f23480c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:28.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.018+0000 7f234c87a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23480cb8c0 0x7f23480b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:28.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.018+0000 7f234c87a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f234815ceb0 0x7f23481f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:28.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.018+0000 7f234c87a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23480c7ec0 con 0x7f23480cb8c0 2023-10-17T06:08:28.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.018+0000 7f234c87a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23480b2450 con 0x7f23480adb20 2023-10-17T06:08:28.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.018+0000 7f234c87a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23480c72b0 con 0x7f234815ceb0 2023-10-17T06:08:28.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.018+0000 7f234659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23480cb8c0 0x7f23480b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:28.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.018+0000 7f234659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23480cb8c0 0x7f23480b3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35592/0 (socket says 172.21.15.125:35592) 2023-10-17T06:08:28.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.018+0000 7f234659c700 1 -- 172.21.15.125:0/2679163427 learned_addr learned my addr 172.21.15.125:0/2679163427 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:28.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.018+0000 7f2346d9d700 1 --2- 172.21.15.125:0/2679163427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23480adb20 0x7f23480c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:28.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.018+0000 7f234759e700 1 --2- 172.21.15.125:0/2679163427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f234815ceb0 0x7f23481f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:28.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.022+0000 7f234659c700 1 -- 172.21.15.125:0/2679163427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f234815ceb0 msgr2=0x7f23481f5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:28.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.022+0000 7f234659c700 1 --2- 172.21.15.125:0/2679163427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f234815ceb0 0x7f23481f5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.022+0000 7f234659c700 1 -- 172.21.15.125:0/2679163427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23480adb20 msgr2=0x7f23480c6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:28.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.022+0000 7f234659c700 1 --2- 172.21.15.125:0/2679163427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23480adb20 0x7f23480c6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.022+0000 7f234659c700 1 -- 172.21.15.125:0/2679163427 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c0094b0 con 0x7f23480cb8c0 2023-10-17T06:08:28.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.022+0000 7f234659c700 1 --2- 172.21.15.125:0/2679163427 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23480cb8c0 0x7f23480b3d10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f233c0090b0 tx=0x7f233c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:28.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.022+0000 7f232f7fe700 1 -- 172.21.15.125:0/2679163427 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c01a8c0 con 0x7f23480cb8c0 2023-10-17T06:08:28.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.022+0000 7f232f7fe700 1 -- 172.21.15.125:0/2679163427 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c01e070 con 0x7f23480cb8c0 2023-10-17T06:08:28.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.022+0000 7f232f7fe700 1 -- 172.21.15.125:0/2679163427 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c01ac60 con 0x7f23480cb8c0 2023-10-17T06:08:28.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.022+0000 7f234c87a700 1 -- 172.21.15.125:0/2679163427 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23480c7590 con 0x7f23480cb8c0 2023-10-17T06:08:28.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.022+0000 7f234c87a700 1 -- 172.21.15.125:0/2679163427 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23480c7b50 con 0x7f23480cb8c0 2023-10-17T06:08:28.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.022+0000 7f234c87a700 1 -- 172.21.15.125:0/2679163427 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23480c8070 con 0x7f23480cb8c0 2023-10-17T06:08:28.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.026+0000 7f232f7fe700 1 -- 172.21.15.125:0/2679163427 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f233c02d450 con 0x7f23480cb8c0 2023-10-17T06:08:28.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.026+0000 7f232f7fe700 1 --2- 172.21.15.125:0/2679163427 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f23340656f0 0x7f2334067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:28.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.026+0000 7f232f7fe700 1 -- 172.21.15.125:0/2679163427 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f233c083e30 con 0x7f23480cb8c0 2023-10-17T06:08:28.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.026+0000 7f2346d9d700 1 --2- 172.21.15.125:0/2679163427 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f23340656f0 0x7f2334067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:28.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.026+0000 7f2346d9d700 1 --2- 172.21.15.125:0/2679163427 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f23340656f0 0x7f2334067bb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2338007fd0 tx=0x7f2338007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:28.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.030+0000 7f232f7fe700 1 -- 172.21.15.125:0/2679163427 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f23480c8070 con 0x7f23480cb8c0 2023-10-17T06:08:28.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.218+0000 7f234c87a700 1 -- 172.21.15.125:0/2679163427 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23480c8070 con 0x7f23480cb8c0 2023-10-17T06:08:28.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.218+0000 7f232f7fe700 1 -- 172.21.15.125:0/2679163427 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20252 (secure 0 0 0) 0x7f23480c8070 con 0x7f23480cb8c0 2023-10-17T06:08:28.225 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:28.225 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":30,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:49.710984+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:08:28.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.222+0000 7f234c87a700 1 -- 172.21.15.125:0/2679163427 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f23340656f0 msgr2=0x7f2334067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:28.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.222+0000 7f234c87a700 1 --2- 172.21.15.125:0/2679163427 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f23340656f0 0x7f2334067bb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2338007fd0 tx=0x7f2338007de0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.222+0000 7f234c87a700 1 -- 172.21.15.125:0/2679163427 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23480cb8c0 msgr2=0x7f23480b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:28.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.222+0000 7f234c87a700 1 --2- 172.21.15.125:0/2679163427 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23480cb8c0 0x7f23480b3d10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f233c0090b0 tx=0x7f233c004770 comp rx=0 tx=0).stop 2023-10-17T06:08:28.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.222+0000 7f234c87a700 1 -- 172.21.15.125:0/2679163427 shutdown_connections 2023-10-17T06:08:28.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.222+0000 7f234c87a700 1 --2- 172.21.15.125:0/2679163427 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f23340656f0 0x7f2334067bb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.222+0000 7f234c87a700 1 --2- 172.21.15.125:0/2679163427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f234815ceb0 0x7f23481f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.222+0000 7f234c87a700 1 --2- 172.21.15.125:0/2679163427 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23480cb8c0 0x7f23480b3d10 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.222+0000 7f234c87a700 1 --2- 172.21.15.125:0/2679163427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23480adb20 0x7f23480c6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.222+0000 7f234c87a700 1 -- 172.21.15.125:0/2679163427 >> 172.21.15.125:0/2679163427 conn(0x7f23480b06c0 msgr2=0x7f23480cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:28.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.222+0000 7f234c87a700 1 -- 172.21.15.125:0/2679163427 shutdown_connections 2023-10-17T06:08:28.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.222+0000 7f234c87a700 1 -- 172.21.15.125:0/2679163427 wait complete. 2023-10-17T06:08:28.248 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-17T06:07:06.629169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-17T06:07:08.148117+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-17T06:07:11.895112+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-17T06:08:28.249 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:08:28.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.426+0000 7f2b9c324700 1 Processor -- start 2023-10-17T06:08:28.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.426+0000 7f2b9c324700 1 -- start start 2023-10-17T06:08:28.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.430+0000 7f2b9c324700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2b9415adf0 0x7f2b940cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:28.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.430+0000 7f2b9c324700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2b940cce10 0x7f2b940b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:28.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.430+0000 7f2b9c324700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b9415b1d0 con 0x7f2b940b1e80 2023-10-17T06:08:28.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.430+0000 7f2b9c324700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b940ca590 con 0x7f2b9415adf0 2023-10-17T06:08:28.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.430+0000 7f2b9c324700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b940ce600 con 0x7f2b940cce10 2023-10-17T06:08:28.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.430+0000 7f2b9a0c0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2b9415adf0 0x7f2b940cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:28.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.430+0000 7f2b9a0c0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2b9415adf0 0x7f2b940cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35604/0 (socket says 172.21.15.125:35604) 2023-10-17T06:08:28.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.430+0000 7f2b9a0c0700 1 -- 172.21.15.125:0/276191510 learned_addr learned my addr 172.21.15.125:0/276191510 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:28.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.430+0000 7f2b998bf700 1 --2- 172.21.15.125:0/276191510 >> v2:172.21.15.184:3300/0 conn(0x7f2b940cce10 0x7f2b940b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:28.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.430+0000 7f2b9a0c0700 1 -- 172.21.15.125:0/276191510 >> v2:172.21.15.184:3300/0 conn(0x7f2b940cce10 msgr2=0x7f2b940b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:28.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.430+0000 7f2b9a0c0700 1 --2- 172.21.15.125:0/276191510 >> v2:172.21.15.184:3300/0 conn(0x7f2b940cce10 0x7f2b940b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.430+0000 7f2b9a0c0700 1 -- 172.21.15.125:0/276191510 >> v1:172.21.15.184:6789/0 conn(0x7f2b940b1e80 legacy=0x7f2b940b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:28.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.430+0000 7f2b9a0c0700 1 -- 172.21.15.125:0/276191510 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b940cd580 con 0x7f2b9415adf0 2023-10-17T06:08:28.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.430+0000 7f2b9a0c0700 1 --2- 172.21.15.125:0/276191510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b9415adf0 0x7f2b940cc8d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2b940b1760 tx=0x7f2b9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf1306c2982a5ed server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:28.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.430+0000 7f2b990be700 1 -- 172.21.15.125:0/276191510 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9000e070 con 0x7f2b9415adf0 2023-10-17T06:08:28.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.430+0000 7f2b990be700 1 -- 172.21.15.125:0/276191510 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b90003a40 con 0x7f2b9415adf0 2023-10-17T06:08:28.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.430+0000 7f2b990be700 1 -- 172.21.15.125:0/276191510 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b90003df0 con 0x7f2b9415adf0 2023-10-17T06:08:28.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.434+0000 7f2b9c324700 1 -- 172.21.15.125:0/276191510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b9415adf0 msgr2=0x7f2b940cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:28.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.434+0000 7f2b9c324700 1 --2- 172.21.15.125:0/276191510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b9415adf0 0x7f2b940cc8d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2b940b1760 tx=0x7f2b9000b330 comp rx=0 tx=0).stop 2023-10-17T06:08:28.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.434+0000 7f2b9c324700 1 -- 172.21.15.125:0/276191510 shutdown_connections 2023-10-17T06:08:28.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.434+0000 7f2b9c324700 1 --2- 172.21.15.125:0/276191510 >> v2:172.21.15.184:3300/0 conn(0x7f2b940cce10 0x7f2b940b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.434+0000 7f2b9c324700 1 --2- 172.21.15.125:0/276191510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b9415adf0 0x7f2b940cc8d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.434+0000 7f2b9c324700 1 -- 172.21.15.125:0/276191510 >> 172.21.15.125:0/276191510 conn(0x7f2b940ce820 msgr2=0x7f2b940cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:28.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.434+0000 7f2b9c324700 1 -- 172.21.15.125:0/276191510 shutdown_connections 2023-10-17T06:08:28.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.434+0000 7f2b9c324700 1 -- 172.21.15.125:0/276191510 wait complete. 2023-10-17T06:08:28.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.438+0000 7f2b9c324700 1 Processor -- start 2023-10-17T06:08:28.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.438+0000 7f2b9c324700 1 -- start start 2023-10-17T06:08:28.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.438+0000 7f2b9c324700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b940b1e80 0x7f2b940ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:28.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.438+0000 7f2b9c324700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b940cce10 0x7f2b94152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:28.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.438+0000 7f2b9c324700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b9415adf0 0x7f2b940c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:28.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.438+0000 7f2b9c324700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b940af160 con 0x7f2b940cce10 2023-10-17T06:08:28.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.438+0000 7f2b9c324700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b940af440 con 0x7f2b9415adf0 2023-10-17T06:08:28.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.438+0000 7f2b9c324700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b940af720 con 0x7f2b940b1e80 2023-10-17T06:08:28.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.438+0000 7f2b998bf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b940cce10 0x7f2b94152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:28.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.438+0000 7f2b9a0c0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b940b1e80 0x7f2b940ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:28.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.438+0000 7f2b998bf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b940cce10 0x7f2b94152c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35610/0 (socket says 172.21.15.125:35610) 2023-10-17T06:08:28.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.438+0000 7f2b998bf700 1 -- 172.21.15.125:0/2411744679 learned_addr learned my addr 172.21.15.125:0/2411744679 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:28.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.438+0000 7f2b9a8c1700 1 --2- 172.21.15.125:0/2411744679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b9415adf0 0x7f2b940c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:28.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.442+0000 7f2b9a0c0700 1 -- 172.21.15.125:0/2411744679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b9415adf0 msgr2=0x7f2b940c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:28.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.442+0000 7f2b9a0c0700 1 --2- 172.21.15.125:0/2411744679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b9415adf0 0x7f2b940c5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.442+0000 7f2b9a0c0700 1 -- 172.21.15.125:0/2411744679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b940cce10 msgr2=0x7f2b94152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:28.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.442+0000 7f2b9a0c0700 1 --2- 172.21.15.125:0/2411744679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b940cce10 0x7f2b94152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.442+0000 7f2b9a0c0700 1 -- 172.21.15.125:0/2411744679 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b90009b30 con 0x7f2b940b1e80 2023-10-17T06:08:28.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.442+0000 7f2b998bf700 1 --2- 172.21.15.125:0/2411744679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b940cce10 0x7f2b94152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:08:28.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.442+0000 7f2b9a0c0700 1 --2- 172.21.15.125:0/2411744679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b940b1e80 0x7f2b940ae910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b90014000 tx=0x7f2b90004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:28.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.442+0000 7f2b8affd700 1 -- 172.21.15.125:0/2411744679 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b90004440 con 0x7f2b940b1e80 2023-10-17T06:08:28.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.442+0000 7f2b8affd700 1 -- 172.21.15.125:0/2411744679 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b900092e0 con 0x7f2b940b1e80 2023-10-17T06:08:28.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.442+0000 7f2b8affd700 1 -- 172.21.15.125:0/2411744679 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b90004800 con 0x7f2b940b1e80 2023-10-17T06:08:28.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.442+0000 7f2b9c324700 1 -- 172.21.15.125:0/2411744679 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b940afa00 con 0x7f2b940b1e80 2023-10-17T06:08:28.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.442+0000 7f2b9c324700 1 -- 172.21.15.125:0/2411744679 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b940aee50 con 0x7f2b940b1e80 2023-10-17T06:08:28.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.442+0000 7f2b9c324700 1 -- 172.21.15.125:0/2411744679 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b94072e60 con 0x7f2b940b1e80 2023-10-17T06:08:28.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.446+0000 7f2b8affd700 1 -- 172.21.15.125:0/2411744679 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2b90025450 con 0x7f2b940b1e80 2023-10-17T06:08:28.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.446+0000 7f2b8affd700 1 --2- 172.21.15.125:0/2411744679 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2b780656f0 0x7f2b78067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:28.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.446+0000 7f2b8affd700 1 -- 172.21.15.125:0/2411744679 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2b90084270 con 0x7f2b940b1e80 2023-10-17T06:08:28.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.446+0000 7f2b998bf700 1 --2- 172.21.15.125:0/2411744679 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2b780656f0 0x7f2b78067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:28.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.446+0000 7f2b998bf700 1 --2- 172.21.15.125:0/2411744679 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2b780656f0 0x7f2b78067bb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2b940c22a0 tx=0x7f2b84009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:28.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.454+0000 7f2b8affd700 1 -- 172.21.15.125:0/2411744679 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2b90051b70 con 0x7f2b940b1e80 2023-10-17T06:08:28.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.634+0000 7f2b9c324700 1 -- 172.21.15.125:0/2411744679 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2b9415b1d0 con 0x7f2b940b1e80 2023-10-17T06:08:28.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.638+0000 7f2b8affd700 1 -- 172.21.15.125:0/2411744679 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2b9415b1d0 con 0x7f2b940b1e80 2023-10-17T06:08:28.641 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:08:28.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.642+0000 7f2b9c324700 1 -- 172.21.15.125:0/2411744679 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2b780656f0 msgr2=0x7f2b78067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:28.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.642+0000 7f2b9c324700 1 --2- 172.21.15.125:0/2411744679 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2b780656f0 0x7f2b78067bb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2b940c22a0 tx=0x7f2b84009240 comp rx=0 tx=0).stop 2023-10-17T06:08:28.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.642+0000 7f2b9c324700 1 -- 172.21.15.125:0/2411744679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b940b1e80 msgr2=0x7f2b940ae910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:28.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.642+0000 7f2b9c324700 1 --2- 172.21.15.125:0/2411744679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b940b1e80 0x7f2b940ae910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2b90014000 tx=0x7f2b90004af0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.642+0000 7f2b9c324700 1 -- 172.21.15.125:0/2411744679 shutdown_connections 2023-10-17T06:08:28.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.642+0000 7f2b9c324700 1 --2- 172.21.15.125:0/2411744679 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2b780656f0 0x7f2b78067bb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.642+0000 7f2b9c324700 1 --2- 172.21.15.125:0/2411744679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b9415adf0 0x7f2b940c5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.642+0000 7f2b9c324700 1 --2- 172.21.15.125:0/2411744679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b940cce10 0x7f2b94152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.642+0000 7f2b9c324700 1 --2- 172.21.15.125:0/2411744679 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b940b1e80 0x7f2b940ae910 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.642+0000 7f2b9c324700 1 -- 172.21.15.125:0/2411744679 >> 172.21.15.125:0/2411744679 conn(0x7f2b940ce820 msgr2=0x7f2b94159c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:28.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.642+0000 7f2b9c324700 1 -- 172.21.15.125:0/2411744679 shutdown_connections 2023-10-17T06:08:28.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.642+0000 7f2b9c324700 1 -- 172.21.15.125:0/2411744679 wait complete. 2023-10-17T06:08:28.667 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:08:28.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.846+0000 7ff1e7fff700 1 Processor -- start 2023-10-17T06:08:28.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.846+0000 7ff1e7fff700 1 -- start start 2023-10-17T06:08:28.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.850+0000 7ff1e7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff1e80d23e0 0x7ff1e815dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:28.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.850+0000 7ff1e7fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff1e806fef0 0x7ff1e80b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:28.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.850+0000 7ff1e7fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e80b6e40 con 0x7ff1e80d2e20 2023-10-17T06:08:28.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.850+0000 7ff1e7fff700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e8070360 con 0x7ff1e80d23e0 2023-10-17T06:08:28.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.850+0000 7ff1e7fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e80b7120 con 0x7ff1e806fef0 2023-10-17T06:08:28.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.850+0000 7ff1e6ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff1e80d23e0 0x7ff1e815dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:28.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.850+0000 7ff1e6ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff1e80d23e0 0x7ff1e815dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35624/0 (socket says 172.21.15.125:35624) 2023-10-17T06:08:28.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.850+0000 7ff1e6ffd700 1 -- 172.21.15.125:0/1056553375 learned_addr learned my addr 172.21.15.125:0/1056553375 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:28.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.850+0000 7ff1de7fc700 1 --2- 172.21.15.125:0/1056553375 >> v2:172.21.15.184:3300/0 conn(0x7ff1e806fef0 0x7ff1e80b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:28.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.850+0000 7ff1e6ffd700 1 -- 172.21.15.125:0/1056553375 >> v2:172.21.15.184:3300/0 conn(0x7ff1e806fef0 msgr2=0x7ff1e80b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:28.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.850+0000 7ff1e6ffd700 1 --2- 172.21.15.125:0/1056553375 >> v2:172.21.15.184:3300/0 conn(0x7ff1e806fef0 0x7ff1e80b65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.850+0000 7ff1e6ffd700 1 -- 172.21.15.125:0/1056553375 >> v1:172.21.15.184:6789/0 conn(0x7ff1e80d2e20 legacy=0x7ff1e81607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:28.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.850+0000 7ff1e6ffd700 1 -- 172.21.15.125:0/1056553375 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e815d4f0 con 0x7ff1e80d23e0 2023-10-17T06:08:28.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.850+0000 7ff1e6ffd700 1 --2- 172.21.15.125:0/1056553375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1e80d23e0 0x7ff1e815dcf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80b2700 tx=0x7ff1d8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a71b7bbb6025bf server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:28.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.850+0000 7ff1e67fc700 1 -- 172.21.15.125:0/1056553375 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8011830 con 0x7ff1e80d23e0 2023-10-17T06:08:28.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.854+0000 7ff1e67fc700 1 -- 172.21.15.125:0/1056553375 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d8011990 con 0x7ff1e80d23e0 2023-10-17T06:08:28.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.854+0000 7ff1e67fc700 1 -- 172.21.15.125:0/1056553375 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8011d20 con 0x7ff1e80d23e0 2023-10-17T06:08:28.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.854+0000 7ff1e7fff700 1 -- 172.21.15.125:0/1056553375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1e80d23e0 msgr2=0x7ff1e815dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:28.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.854+0000 7ff1e7fff700 1 --2- 172.21.15.125:0/1056553375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1e80d23e0 0x7ff1e815dcf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80b2700 tx=0x7ff1d8009bf0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.854+0000 7ff1e7fff700 1 -- 172.21.15.125:0/1056553375 shutdown_connections 2023-10-17T06:08:28.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.854+0000 7ff1e7fff700 1 --2- 172.21.15.125:0/1056553375 >> v2:172.21.15.184:3300/0 conn(0x7ff1e806fef0 0x7ff1e80b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.854+0000 7ff1e7fff700 1 --2- 172.21.15.125:0/1056553375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1e80d23e0 0x7ff1e815dcf0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.854+0000 7ff1e7fff700 1 -- 172.21.15.125:0/1056553375 >> 172.21.15.125:0/1056553375 conn(0x7ff1e8069f20 msgr2=0x7ff1e806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:28.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.854+0000 7ff1e7fff700 1 -- 172.21.15.125:0/1056553375 shutdown_connections 2023-10-17T06:08:28.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.854+0000 7ff1e7fff700 1 -- 172.21.15.125:0/1056553375 wait complete. 2023-10-17T06:08:28.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.854+0000 7ff1e7fff700 1 Processor -- start 2023-10-17T06:08:28.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.854+0000 7ff1e7fff700 1 -- start start 2023-10-17T06:08:28.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1e7fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1e806fef0 0x7ff1e80b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:28.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1e7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1e80d23e0 0x7ff1e8154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:28.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1e7fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1e80d2e20 0x7ff1e80d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:28.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1e7fff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e8157f30 con 0x7ff1e80d23e0 2023-10-17T06:08:28.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1e7fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e80b4740 con 0x7ff1e80d2e20 2023-10-17T06:08:28.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1e7fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e81552a0 con 0x7ff1e806fef0 2023-10-17T06:08:28.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1de7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1e80d23e0 0x7ff1e8154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:28.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1de7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1e80d23e0 0x7ff1e8154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35638/0 (socket says 172.21.15.125:35638) 2023-10-17T06:08:28.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1de7fc700 1 -- 172.21.15.125:0/2145432655 learned_addr learned my addr 172.21.15.125:0/2145432655 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:28.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1e6ffd700 1 --2- 172.21.15.125:0/2145432655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1e806fef0 0x7ff1e80b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:28.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1e77fe700 1 --2- 172.21.15.125:0/2145432655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1e80d2e20 0x7ff1e80d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:28.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1de7fc700 1 -- 172.21.15.125:0/2145432655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1e806fef0 msgr2=0x7ff1e80b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:28.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1de7fc700 1 --2- 172.21.15.125:0/2145432655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1e806fef0 0x7ff1e80b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1de7fc700 1 -- 172.21.15.125:0/2145432655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1e80d2e20 msgr2=0x7ff1e80d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:28.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1de7fc700 1 --2- 172.21.15.125:0/2145432655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1e80d2e20 0x7ff1e80d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:28.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1de7fc700 1 -- 172.21.15.125:0/2145432655 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d8009570 con 0x7ff1e80d23e0 2023-10-17T06:08:28.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1e77fe700 1 --2- 172.21.15.125:0/2145432655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1e80d2e20 0x7ff1e80d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:28.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1de7fc700 1 --2- 172.21.15.125:0/2145432655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1e80d23e0 0x7ff1e8154d60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009d10 tx=0x7ff1d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:28.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1dffff700 1 -- 172.21.15.125:0/2145432655 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d000cdc0 con 0x7ff1e80d23e0 2023-10-17T06:08:28.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1dffff700 1 -- 172.21.15.125:0/2145432655 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d000f040 con 0x7ff1e80d23e0 2023-10-17T06:08:28.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1dffff700 1 -- 172.21.15.125:0/2145432655 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d00146a0 con 0x7ff1e80d23e0 2023-10-17T06:08:28.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1e7fff700 1 -- 172.21.15.125:0/2145432655 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e80b4290 con 0x7ff1e80d23e0 2023-10-17T06:08:28.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.858+0000 7ff1e7fff700 1 -- 172.21.15.125:0/2145432655 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e80b4c70 con 0x7ff1e80d23e0 2023-10-17T06:08:28.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.862+0000 7ff1e7fff700 1 -- 172.21.15.125:0/2145432655 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e804e910 con 0x7ff1e80d23e0 2023-10-17T06:08:28.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.862+0000 7ff1dffff700 1 -- 172.21.15.125:0/2145432655 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff1d0014800 con 0x7ff1e80d23e0 2023-10-17T06:08:28.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.862+0000 7ff1dffff700 1 --2- 172.21.15.125:0/2145432655 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff1c80656f0 0x7ff1c8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:28.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.862+0000 7ff1dffff700 1 -- 172.21.15.125:0/2145432655 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff1d0083910 con 0x7ff1e80d23e0 2023-10-17T06:08:28.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.866+0000 7ff1e6ffd700 1 --2- 172.21.15.125:0/2145432655 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff1c80656f0 0x7ff1c8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:28.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.866+0000 7ff1e6ffd700 1 --2- 172.21.15.125:0/2145432655 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff1c80656f0 0x7ff1c8067bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8000c00 tx=0x7ff1d8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:28.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:28.870+0000 7ff1dffff700 1 -- 172.21.15.125:0/2145432655 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff1d0051090 con 0x7ff1e80d23e0 2023-10-17T06:08:29.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.046+0000 7ff1e7fff700 1 -- 172.21.15.125:0/2145432655 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff1e806d450 con 0x7ff1e80d23e0 2023-10-17T06:08:29.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.050+0000 7ff1dffff700 1 -- 172.21.15.125:0/2145432655 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff1d0009e60 con 0x7ff1e80d23e0 2023-10-17T06:08:29.053 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:08:29.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.050+0000 7ff1e7fff700 1 -- 172.21.15.125:0/2145432655 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff1c80656f0 msgr2=0x7ff1c8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:29.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.050+0000 7ff1e7fff700 1 --2- 172.21.15.125:0/2145432655 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff1c80656f0 0x7ff1c8067bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8000c00 tx=0x7ff1d8008030 comp rx=0 tx=0).stop 2023-10-17T06:08:29.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.050+0000 7ff1e7fff700 1 -- 172.21.15.125:0/2145432655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1e80d23e0 msgr2=0x7ff1e8154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:29.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.050+0000 7ff1e7fff700 1 --2- 172.21.15.125:0/2145432655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1e80d23e0 0x7ff1e8154d60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009d10 tx=0x7ff1d000c3a0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.050+0000 7ff1e7fff700 1 -- 172.21.15.125:0/2145432655 shutdown_connections 2023-10-17T06:08:29.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.050+0000 7ff1e7fff700 1 --2- 172.21.15.125:0/2145432655 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff1c80656f0 0x7ff1c8067bb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.050+0000 7ff1e7fff700 1 --2- 172.21.15.125:0/2145432655 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1e80d2e20 0x7ff1e80d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.050+0000 7ff1e7fff700 1 --2- 172.21.15.125:0/2145432655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1e80d23e0 0x7ff1e8154d60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.050+0000 7ff1e7fff700 1 --2- 172.21.15.125:0/2145432655 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1e806fef0 0x7ff1e80b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.050+0000 7ff1e7fff700 1 -- 172.21.15.125:0/2145432655 >> 172.21.15.125:0/2145432655 conn(0x7ff1e8069f20 msgr2=0x7ff1e80cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:29.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.050+0000 7ff1e7fff700 1 -- 172.21.15.125:0/2145432655 shutdown_connections 2023-10-17T06:08:29.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.050+0000 7ff1e7fff700 1 -- 172.21.15.125:0/2145432655 wait complete. 2023-10-17T06:08:29.075 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-17T06:08:29.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.246+0000 7f087319e700 1 Processor -- start 2023-10-17T06:08:29.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.246+0000 7f087319e700 1 -- start start 2023-10-17T06:08:29.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.250+0000 7f087319e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f086c15e040 0x7f086c0cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:29.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.250+0000 7f087319e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f086c06f450 0x7f086c06f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:29.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.250+0000 7f087319e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c06fdc0 con 0x7f086c15e420 2023-10-17T06:08:29.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.250+0000 7f087319e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c070e10 con 0x7f086c15e040 2023-10-17T06:08:29.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.250+0000 7f087319e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c0b2630 con 0x7f086c06f450 2023-10-17T06:08:29.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.250+0000 7f087219c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f086c15e040 0x7f086c0cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:29.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.250+0000 7f087199b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f086c15e420 0x7f086c070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55436/0 (socket says 172.21.15.125:55436) 2023-10-17T06:08:29.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.250+0000 7f087199b700 1 -- 172.21.15.125:0/692369650 learned_addr learned my addr 172.21.15.125:0/692369650 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:29.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.250+0000 7f087299d700 1 --2- 172.21.15.125:0/692369650 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f086c06f450 0x7f086c06f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:29.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.250+0000 7f087219c700 1 -- 172.21.15.125:0/692369650 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f086c06f450 msgr2=0x7f086c06f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:29.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.250+0000 7f087219c700 1 --2- 172.21.15.125:0/692369650 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f086c06f450 0x7f086c06f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.250+0000 7f087219c700 1 -- 172.21.15.125:0/692369650 >> v1:172.21.15.125:6789/0 conn(0x7f086c15e420 legacy=0x7f086c070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:29.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.250+0000 7f087219c700 1 -- 172.21.15.125:0/692369650 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c06ded0 con 0x7f086c15e040 2023-10-17T06:08:29.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.250+0000 7f087119a700 1 -- 172.21.15.125:0/692369650 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332156905 0 0) 0x7f086c06fdc0 con 0x7f086c15e420 2023-10-17T06:08:29.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.254+0000 7f087219c700 1 --2- 172.21.15.125:0/692369650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f086c15e040 0x7f086c0cafa0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0868009d90 tx=0x7f086800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76e448d52f7b748 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:29.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.254+0000 7f087119a700 1 -- 172.21.15.125:0/692369650 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086800e070 con 0x7f086c15e040 2023-10-17T06:08:29.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.254+0000 7f087119a700 1 -- 172.21.15.125:0/692369650 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086800bb20 con 0x7f086c15e040 2023-10-17T06:08:29.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.254+0000 7f087119a700 1 -- 172.21.15.125:0/692369650 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0868012430 con 0x7f086c15e040 2023-10-17T06:08:29.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.254+0000 7f087319e700 1 -- 172.21.15.125:0/692369650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f086c15e040 msgr2=0x7f086c0cafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:29.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.254+0000 7f087319e700 1 --2- 172.21.15.125:0/692369650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f086c15e040 0x7f086c0cafa0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0868009d90 tx=0x7f086800b330 comp rx=0 tx=0).stop 2023-10-17T06:08:29.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.254+0000 7f087319e700 1 -- 172.21.15.125:0/692369650 shutdown_connections 2023-10-17T06:08:29.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.254+0000 7f087319e700 1 --2- 172.21.15.125:0/692369650 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f086c06f450 0x7f086c06f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.254+0000 7f087319e700 1 --2- 172.21.15.125:0/692369650 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f086c15e040 0x7f086c0cafa0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.254+0000 7f087319e700 1 -- 172.21.15.125:0/692369650 >> 172.21.15.125:0/692369650 conn(0x7f086c0cc1b0 msgr2=0x7f086c0cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:29.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.254+0000 7f087319e700 1 -- 172.21.15.125:0/692369650 shutdown_connections 2023-10-17T06:08:29.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.254+0000 7f087319e700 1 -- 172.21.15.125:0/692369650 wait complete. 2023-10-17T06:08:29.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.258+0000 7f087319e700 1 Processor -- start 2023-10-17T06:08:29.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.258+0000 7f087319e700 1 -- start start 2023-10-17T06:08:29.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f087319e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f086c06f450 0x7f086c0cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:29.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f087319e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f086c15e040 0x7f086c157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:29.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f087319e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f086c15e420 0x7f086c157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:29.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f087319e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c1f2640 con 0x7f086c15e420 2023-10-17T06:08:29.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f087319e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c1f2900 con 0x7f086c15e040 2023-10-17T06:08:29.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f087319e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c1f2be0 con 0x7f086c06f450 2023-10-17T06:08:29.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f087299d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f086c15e420 0x7f086c157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:29.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f087299d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f086c15e420 0x7f086c157d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35654/0 (socket says 172.21.15.125:35654) 2023-10-17T06:08:29.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f087299d700 1 -- 172.21.15.125:0/2939301358 learned_addr learned my addr 172.21.15.125:0/2939301358 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:29.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f087219c700 1 --2- 172.21.15.125:0/2939301358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f086c06f450 0x7f086c0cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:29.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f087199b700 1 --2- 172.21.15.125:0/2939301358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f086c15e040 0x7f086c157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:29.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f087299d700 1 -- 172.21.15.125:0/2939301358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f086c06f450 msgr2=0x7f086c0cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:29.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f087299d700 1 --2- 172.21.15.125:0/2939301358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f086c06f450 0x7f086c0cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f087299d700 1 -- 172.21.15.125:0/2939301358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f086c15e040 msgr2=0x7f086c157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:29.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f087299d700 1 --2- 172.21.15.125:0/2939301358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f086c15e040 0x7f086c157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f087299d700 1 -- 172.21.15.125:0/2939301358 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0868009a70 con 0x7f086c15e420 2023-10-17T06:08:29.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f087299d700 1 --2- 172.21.15.125:0/2939301358 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f086c15e420 0x7f086c157d60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f086400e7f0 tx=0x7f086400eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:29.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f0862ffd700 1 -- 172.21.15.125:0/2939301358 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0864009510 con 0x7f086c15e420 2023-10-17T06:08:29.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f0862ffd700 1 -- 172.21.15.125:0/2939301358 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0864013680 con 0x7f086c15e420 2023-10-17T06:08:29.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f0862ffd700 1 -- 172.21.15.125:0/2939301358 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0864013a10 con 0x7f086c15e420 2023-10-17T06:08:29.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f087319e700 1 -- 172.21.15.125:0/2939301358 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c1f2ec0 con 0x7f086c15e420 2023-10-17T06:08:29.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f087319e700 1 -- 172.21.15.125:0/2939301358 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c0cb750 con 0x7f086c15e420 2023-10-17T06:08:29.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.262+0000 7f087319e700 1 -- 172.21.15.125:0/2939301358 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c04e910 con 0x7f086c15e420 2023-10-17T06:08:29.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.266+0000 7f0862ffd700 1 -- 172.21.15.125:0/2939301358 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0864013b90 con 0x7f086c15e420 2023-10-17T06:08:29.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.270+0000 7f0862ffd700 1 --2- 172.21.15.125:0/2939301358 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f08500656f0 0x7f0850067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:29.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.270+0000 7f0862ffd700 1 -- 172.21.15.125:0/2939301358 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0864082ec0 con 0x7f086c15e420 2023-10-17T06:08:29.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.270+0000 7f087219c700 1 --2- 172.21.15.125:0/2939301358 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f08500656f0 0x7f0850067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:29.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.270+0000 7f087219c700 1 --2- 172.21.15.125:0/2939301358 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f08500656f0 0x7f0850067bb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0868014040 tx=0x7f0868011000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:29.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.274+0000 7f0862ffd700 1 -- 172.21.15.125:0/2939301358 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0864050640 con 0x7f086c15e420 2023-10-17T06:08:29.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.450+0000 7f087319e700 1 -- 172.21.15.125:0/2939301358 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f086c06ebb0 con 0x7f086c15e420 2023-10-17T06:08:29.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.450+0000 7f0862ffd700 1 -- 172.21.15.125:0/2939301358 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0864017020 con 0x7f086c15e420 2023-10-17T06:08:29.456 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:29.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.454+0000 7f087319e700 1 -- 172.21.15.125:0/2939301358 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f08500656f0 msgr2=0x7f0850067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:29.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.454+0000 7f087319e700 1 --2- 172.21.15.125:0/2939301358 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f08500656f0 0x7f0850067bb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0868014040 tx=0x7f0868011000 comp rx=0 tx=0).stop 2023-10-17T06:08:29.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.454+0000 7f087319e700 1 -- 172.21.15.125:0/2939301358 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f086c15e420 msgr2=0x7f086c157d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:29.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.454+0000 7f087319e700 1 --2- 172.21.15.125:0/2939301358 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f086c15e420 0x7f086c157d60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f086400e7f0 tx=0x7f086400eb00 comp rx=0 tx=0).stop 2023-10-17T06:08:29.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.454+0000 7f087319e700 1 -- 172.21.15.125:0/2939301358 shutdown_connections 2023-10-17T06:08:29.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.454+0000 7f087319e700 1 --2- 172.21.15.125:0/2939301358 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f08500656f0 0x7f0850067bb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.454+0000 7f087319e700 1 --2- 172.21.15.125:0/2939301358 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f086c15e420 0x7f086c157d60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.454+0000 7f087319e700 1 --2- 172.21.15.125:0/2939301358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f086c15e040 0x7f086c157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.454+0000 7f087319e700 1 --2- 172.21.15.125:0/2939301358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f086c06f450 0x7f086c0cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.454+0000 7f087319e700 1 -- 172.21.15.125:0/2939301358 >> 172.21.15.125:0/2939301358 conn(0x7f086c0cc1b0 msgr2=0x7f086c0b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:29.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.454+0000 7f087319e700 1 -- 172.21.15.125:0/2939301358 shutdown_connections 2023-10-17T06:08:29.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.454+0000 7f087319e700 1 -- 172.21.15.125:0/2939301358 wait complete. 2023-10-17T06:08:29.481 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-17T06:08:29.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.662+0000 7ffabee1d700 1 Processor -- start 2023-10-17T06:08:29.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.662+0000 7ffabee1d700 1 -- start start 2023-10-17T06:08:29.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.662+0000 7ffabee1d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffab806f450 0x7ffab8161120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:29.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.662+0000 7ffabee1d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffab8161660 0x7ffab80c9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:29.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.662+0000 7ffabee1d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab80ca840 con 0x7ffab815ce30 2023-10-17T06:08:29.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.662+0000 7ffabee1d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab80ca560 con 0x7ffab806f450 2023-10-17T06:08:29.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.662+0000 7ffabee1d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80ccf30 con 0x7ffab8161660 2023-10-17T06:08:29.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffab7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffab806f450 0x7ffab8161120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:29.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffab7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ffab806f450 0x7ffab8161120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35658/0 (socket says 172.21.15.125:35658) 2023-10-17T06:08:29.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffab7fff700 1 -- 172.21.15.125:0/4157360059 learned_addr learned my addr 172.21.15.125:0/4157360059 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:29.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffabd3ba700 1 --2- 172.21.15.125:0/4157360059 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffab8161660 0x7ffab80c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:29.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffab7fff700 1 -- 172.21.15.125:0/4157360059 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffab8161660 msgr2=0x7ffab80c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:29.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffab7fff700 1 --2- 172.21.15.125:0/4157360059 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffab8161660 0x7ffab80c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffab7fff700 1 -- 172.21.15.125:0/4157360059 >> v1:172.21.15.184:6789/0 conn(0x7ffab815ce30 legacy=0x7ffab8160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:29.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffab7fff700 1 -- 172.21.15.125:0/4157360059 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab80cd210 con 0x7ffab806f450 2023-10-17T06:08:29.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffabd3ba700 1 --2- 172.21.15.125:0/4157360059 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffab8161660 0x7ffab80c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:08:29.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffab7fff700 1 --2- 172.21.15.125:0/4157360059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab806f450 0x7ffab8161120 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009910 tx=0x7ffaa4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387545bcd4969cd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:29.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffab77fe700 1 -- 172.21.15.125:0/4157360059 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4011830 con 0x7ffab806f450 2023-10-17T06:08:29.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffab77fe700 1 -- 172.21.15.125:0/4157360059 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa4011990 con 0x7ffab806f450 2023-10-17T06:08:29.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffab77fe700 1 -- 172.21.15.125:0/4157360059 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4011d40 con 0x7ffab806f450 2023-10-17T06:08:29.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffabee1d700 1 -- 172.21.15.125:0/4157360059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab806f450 msgr2=0x7ffab8161120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:29.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffabee1d700 1 --2- 172.21.15.125:0/4157360059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab806f450 0x7ffab8161120 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009910 tx=0x7ffaa4009c20 comp rx=0 tx=0).stop 2023-10-17T06:08:29.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffabee1d700 1 -- 172.21.15.125:0/4157360059 shutdown_connections 2023-10-17T06:08:29.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffabee1d700 1 --2- 172.21.15.125:0/4157360059 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffab8161660 0x7ffab80c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffabee1d700 1 --2- 172.21.15.125:0/4157360059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab806f450 0x7ffab8161120 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffabee1d700 1 -- 172.21.15.125:0/4157360059 >> 172.21.15.125:0/4157360059 conn(0x7ffab80ce820 msgr2=0x7ffab80cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:29.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffabee1d700 1 -- 172.21.15.125:0/4157360059 shutdown_connections 2023-10-17T06:08:29.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.666+0000 7ffabee1d700 1 -- 172.21.15.125:0/4157360059 wait complete. 2023-10-17T06:08:29.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.670+0000 7ffabee1d700 1 Processor -- start 2023-10-17T06:08:29.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.670+0000 7ffabee1d700 1 -- start start 2023-10-17T06:08:29.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.670+0000 7ffabee1d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffab806f450 0x7ffab80cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:29.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.670+0000 7ffabee1d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab815ce30 0x7ffab8151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:29.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.670+0000 7ffabee1d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffab8161660 0x7ffab8151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:29.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.670+0000 7ffabee1d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab815e0b0 con 0x7ffab815ce30 2023-10-17T06:08:29.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.670+0000 7ffabee1d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab815d430 con 0x7ffab806f450 2023-10-17T06:08:29.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.670+0000 7ffabee1d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab815d710 con 0x7ffab8161660 2023-10-17T06:08:29.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.670+0000 7ffab7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab815ce30 0x7ffab8151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:29.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.670+0000 7ffab7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab815ce30 0x7ffab8151a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35660/0 (socket says 172.21.15.125:35660) 2023-10-17T06:08:29.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.670+0000 7ffab7fff700 1 -- 172.21.15.125:0/3901150524 learned_addr learned my addr 172.21.15.125:0/3901150524 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:29.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.670+0000 7ffabcbb9700 1 --2- 172.21.15.125:0/3901150524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffab806f450 0x7ffab80cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:29.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.670+0000 7ffabd3ba700 1 --2- 172.21.15.125:0/3901150524 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffab8161660 0x7ffab8151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:29.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.674+0000 7ffab7fff700 1 -- 172.21.15.125:0/3901150524 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffab8161660 msgr2=0x7ffab8151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:29.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.674+0000 7ffab7fff700 1 --2- 172.21.15.125:0/3901150524 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffab8161660 0x7ffab8151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.674+0000 7ffab7fff700 1 -- 172.21.15.125:0/3901150524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffab806f450 msgr2=0x7ffab80cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:29.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.674+0000 7ffab7fff700 1 --2- 172.21.15.125:0/3901150524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffab806f450 0x7ffab80cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.674+0000 7ffab7fff700 1 -- 172.21.15.125:0/3901150524 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab0009a70 con 0x7ffab815ce30 2023-10-17T06:08:29.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.674+0000 7ffabcbb9700 1 --2- 172.21.15.125:0/3901150524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffab806f450 0x7ffab80cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:29.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.674+0000 7ffab7fff700 1 --2- 172.21.15.125:0/3901150524 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab815ce30 0x7ffab8151a80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009c60 tx=0x7ffaa4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:29.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.674+0000 7ffab57fa700 1 -- 172.21.15.125:0/3901150524 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4004380 con 0x7ffab815ce30 2023-10-17T06:08:29.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.674+0000 7ffab57fa700 1 -- 172.21.15.125:0/3901150524 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa401f070 con 0x7ffab815ce30 2023-10-17T06:08:29.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.674+0000 7ffabee1d700 1 -- 172.21.15.125:0/3901150524 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa4009570 con 0x7ffab815ce30 2023-10-17T06:08:29.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.674+0000 7ffab57fa700 1 -- 172.21.15.125:0/3901150524 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa40036c0 con 0x7ffab815ce30 2023-10-17T06:08:29.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.674+0000 7ffabee1d700 1 -- 172.21.15.125:0/3901150524 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab815dcd0 con 0x7ffab815ce30 2023-10-17T06:08:29.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.674+0000 7ffabee1d700 1 -- 172.21.15.125:0/3901150524 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab815e1f0 con 0x7ffab815ce30 2023-10-17T06:08:29.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.678+0000 7ffab57fa700 1 -- 172.21.15.125:0/3901150524 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ffaa4021030 con 0x7ffab815ce30 2023-10-17T06:08:29.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.678+0000 7ffab57fa700 1 --2- 172.21.15.125:0/3901150524 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ffa9c0656f0 0x7ffa9c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:29.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.678+0000 7ffab57fa700 1 -- 172.21.15.125:0/3901150524 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ffaa4084610 con 0x7ffab815ce30 2023-10-17T06:08:29.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.678+0000 7ffabcbb9700 1 --2- 172.21.15.125:0/3901150524 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ffa9c0656f0 0x7ffa9c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:29.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.678+0000 7ffabcbb9700 1 --2- 172.21.15.125:0/3901150524 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ffa9c0656f0 0x7ffa9c067bb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0017a0 tx=0x7ffaac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:29.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.686+0000 7ffab57fa700 1 -- 172.21.15.125:0/3901150524 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ffab815e1f0 con 0x7ffab815ce30 2023-10-17T06:08:29.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.866+0000 7ffabee1d700 1 -- 172.21.15.125:0/3901150524 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffab815e1f0 con 0x7ffab815ce30 2023-10-17T06:08:29.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.866+0000 7ffab57fa700 1 -- 172.21.15.125:0/3901150524 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffab815e1f0 con 0x7ffab815ce30 2023-10-17T06:08:29.871 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-17T06:08:29.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.870+0000 7ffabee1d700 1 -- 172.21.15.125:0/3901150524 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ffa9c0656f0 msgr2=0x7ffa9c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:29.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.870+0000 7ffabee1d700 1 --2- 172.21.15.125:0/3901150524 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ffa9c0656f0 0x7ffa9c067bb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0017a0 tx=0x7ffaac009040 comp rx=0 tx=0).stop 2023-10-17T06:08:29.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.870+0000 7ffabee1d700 1 -- 172.21.15.125:0/3901150524 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab815ce30 msgr2=0x7ffab8151a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:29.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.870+0000 7ffabee1d700 1 --2- 172.21.15.125:0/3901150524 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab815ce30 0x7ffab8151a80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009c60 tx=0x7ffaa4004770 comp rx=0 tx=0).stop 2023-10-17T06:08:29.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.870+0000 7ffabee1d700 1 -- 172.21.15.125:0/3901150524 shutdown_connections 2023-10-17T06:08:29.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.870+0000 7ffabee1d700 1 --2- 172.21.15.125:0/3901150524 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ffa9c0656f0 0x7ffa9c067bb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.870+0000 7ffabee1d700 1 --2- 172.21.15.125:0/3901150524 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ffab8161660 0x7ffab8151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.870+0000 7ffabee1d700 1 --2- 172.21.15.125:0/3901150524 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab815ce30 0x7ffab8151a80 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.870+0000 7ffabee1d700 1 --2- 172.21.15.125:0/3901150524 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffab806f450 0x7ffab80cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:29.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.870+0000 7ffabee1d700 1 -- 172.21.15.125:0/3901150524 >> 172.21.15.125:0/3901150524 conn(0x7ffab80ce820 msgr2=0x7ffab815bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:29.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.870+0000 7ffabee1d700 1 -- 172.21.15.125:0/3901150524 shutdown_connections 2023-10-17T06:08:29.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:29.870+0000 7ffabee1d700 1 -- 172.21.15.125:0/3901150524 wait complete. 2023-10-17T06:08:29.896 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-17T06:08:30.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.078+0000 7febde19e700 1 Processor -- start 2023-10-17T06:08:30.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.078+0000 7febde19e700 1 -- start start 2023-10-17T06:08:30.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.082+0000 7febde19e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7febd806d530 0x7febd8167640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:30.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.082+0000 7febde19e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd80d25f0 con 0x7febd815cbc0 2023-10-17T06:08:30.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.082+0000 7febde19e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd80ceda0 con 0x7febd80b5210 2023-10-17T06:08:30.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.082+0000 7febde19e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd80cf230 con 0x7febd806d530 2023-10-17T06:08:30.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.082+0000 7febdd19c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7febd815cbc0 0x7febd80b4b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55442/0 (socket says 172.21.15.125:55442) 2023-10-17T06:08:30.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.082+0000 7febdd19c700 1 -- 172.21.15.125:0/2195478730 learned_addr learned my addr 172.21.15.125:0/2195478730 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:30.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.082+0000 7febdd99d700 1 --2- 172.21.15.125:0/2195478730 >> v2:172.21.15.125:3300/0 conn(0x7febd806d530 0x7febd8167640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:30.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.086+0000 7febcffff700 1 -- 172.21.15.125:0/2195478730 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235893421 0 0) 0x7febd4001110 con 0x7febd815cbc0 2023-10-17T06:08:30.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.086+0000 7febcffff700 1 -- 172.21.15.125:0/2195478730 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febc40035d0 con 0x7febd815cbc0 2023-10-17T06:08:30.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.086+0000 7febcffff700 1 -- 172.21.15.125:0/2195478730 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951002161 0 0) 0x7febd80ceda0 con 0x7febd80b5210 2023-10-17T06:08:30.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.086+0000 7febcffff700 1 -- 172.21.15.125:0/2195478730 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febd4001110 con 0x7febd80b5210 2023-10-17T06:08:30.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.086+0000 7febdd99d700 1 -- 172.21.15.125:0/2195478730 >> v1:172.21.15.184:6789/0 conn(0x7febd80b5210 legacy=0x7febd806ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:30.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.086+0000 7febdd99d700 1 -- 172.21.15.125:0/2195478730 >> v1:172.21.15.125:6789/0 conn(0x7febd815cbc0 legacy=0x7febd80b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:30.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.086+0000 7febdd99d700 1 -- 172.21.15.125:0/2195478730 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd80ce470 con 0x7febd806d530 2023-10-17T06:08:30.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.086+0000 7febdd99d700 1 --2- 172.21.15.125:0/2195478730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febd806d530 0x7febd8167640 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7febd0009d90 tx=0x7febd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c91f19ab0d2e93c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:30.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.086+0000 7febcffff700 1 -- 172.21.15.125:0/2195478730 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd000e070 con 0x7febd806d530 2023-10-17T06:08:30.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.086+0000 7febcffff700 1 -- 172.21.15.125:0/2195478730 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd000bb20 con 0x7febd806d530 2023-10-17T06:08:30.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.086+0000 7febcffff700 1 -- 172.21.15.125:0/2195478730 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd0012430 con 0x7febd806d530 2023-10-17T06:08:30.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.086+0000 7febde19e700 1 -- 172.21.15.125:0/2195478730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febd806d530 msgr2=0x7febd8167640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:30.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.086+0000 7febde19e700 1 --2- 172.21.15.125:0/2195478730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febd806d530 0x7febd8167640 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7febd0009d90 tx=0x7febd000b330 comp rx=0 tx=0).stop 2023-10-17T06:08:30.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.086+0000 7febde19e700 1 -- 172.21.15.125:0/2195478730 shutdown_connections 2023-10-17T06:08:30.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.086+0000 7febde19e700 1 --2- 172.21.15.125:0/2195478730 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febd806d530 0x7febd8167640 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:30.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.086+0000 7febde19e700 1 -- 172.21.15.125:0/2195478730 >> 172.21.15.125:0/2195478730 conn(0x7febd806a3f0 msgr2=0x7febd80d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:30.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.086+0000 7febde19e700 1 -- 172.21.15.125:0/2195478730 shutdown_connections 2023-10-17T06:08:30.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.086+0000 7febde19e700 1 -- 172.21.15.125:0/2195478730 wait complete. 2023-10-17T06:08:30.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.090+0000 7febde19e700 1 Processor -- start 2023-10-17T06:08:30.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.090+0000 7febde19e700 1 -- start start 2023-10-17T06:08:30.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.090+0000 7febde19e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febd806d530 0x7febd815f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:30.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.090+0000 7febde19e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febd80b5210 0x7febd814d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:30.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.090+0000 7febde19e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febd815cbc0 0x7febd814d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:30.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.090+0000 7febde19e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd814e910 con 0x7febd815cbc0 2023-10-17T06:08:30.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.090+0000 7febde19e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd815fe40 con 0x7febd80b5210 2023-10-17T06:08:30.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.090+0000 7febde19e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd814ffe0 con 0x7febd806d530 2023-10-17T06:08:30.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.094+0000 7febdd99d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febd815cbc0 0x7febd814d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:30.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.094+0000 7febdd99d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febd815cbc0 0x7febd814d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35682/0 (socket says 172.21.15.125:35682) 2023-10-17T06:08:30.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.094+0000 7febdd99d700 1 -- 172.21.15.125:0/3842860244 learned_addr learned my addr 172.21.15.125:0/3842860244 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:30.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.094+0000 7febdd19c700 1 --2- 172.21.15.125:0/3842860244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febd806d530 0x7febd815f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:30.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.094+0000 7febdc99b700 1 --2- 172.21.15.125:0/3842860244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febd80b5210 0x7febd814d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:30.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.094+0000 7febdd99d700 1 -- 172.21.15.125:0/3842860244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febd806d530 msgr2=0x7febd815f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:30.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.094+0000 7febdd99d700 1 --2- 172.21.15.125:0/3842860244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febd806d530 0x7febd815f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:30.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.094+0000 7febdd99d700 1 -- 172.21.15.125:0/3842860244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febd80b5210 msgr2=0x7febd814d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:30.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.094+0000 7febdd99d700 1 --2- 172.21.15.125:0/3842860244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febd80b5210 0x7febd814d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:30.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.094+0000 7febdd99d700 1 -- 172.21.15.125:0/3842860244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd0009a70 con 0x7febd815cbc0 2023-10-17T06:08:30.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.094+0000 7febdc99b700 1 --2- 172.21.15.125:0/3842860244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febd80b5210 0x7febd814d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:30.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.094+0000 7febdd99d700 1 --2- 172.21.15.125:0/3842860244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febd815cbc0 0x7febd814d660 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7febd80d34b0 tx=0x7febd0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:30.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.094+0000 7febcdffb700 1 -- 172.21.15.125:0/3842860244 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd001b810 con 0x7febd815cbc0 2023-10-17T06:08:30.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.094+0000 7febcdffb700 1 -- 172.21.15.125:0/3842860244 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd0020070 con 0x7febd815cbc0 2023-10-17T06:08:30.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.094+0000 7febde19e700 1 -- 172.21.15.125:0/3842860244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd814dc90 con 0x7febd815cbc0 2023-10-17T06:08:30.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.094+0000 7febcdffb700 1 -- 172.21.15.125:0/3842860244 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd001bbb0 con 0x7febd815cbc0 2023-10-17T06:08:30.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.094+0000 7febde19e700 1 -- 172.21.15.125:0/3842860244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd814e250 con 0x7febd815cbc0 2023-10-17T06:08:30.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.098+0000 7febde19e700 1 -- 172.21.15.125:0/3842860244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd814ea50 con 0x7febd815cbc0 2023-10-17T06:08:30.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.098+0000 7febcdffb700 1 -- 172.21.15.125:0/3842860244 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7febd001bd10 con 0x7febd815cbc0 2023-10-17T06:08:30.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.098+0000 7febcdffb700 1 --2- 172.21.15.125:0/3842860244 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7febbc065740 0x7febbc067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:30.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.098+0000 7febcdffb700 1 -- 172.21.15.125:0/3842860244 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7febd0022070 con 0x7febd815cbc0 2023-10-17T06:08:30.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.102+0000 7febdd19c700 1 --2- 172.21.15.125:0/3842860244 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7febbc065740 0x7febbc067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:30.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.102+0000 7febdd19c700 1 --2- 172.21.15.125:0/3842860244 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7febbc065740 0x7febbc067c00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7febd4000f60 tx=0x7febd4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:30.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.106+0000 7febcdffb700 1 -- 172.21.15.125:0/3842860244 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7febd814ea50 con 0x7febd815cbc0 2023-10-17T06:08:30.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.282+0000 7febde19e700 1 -- 172.21.15.125:0/3842860244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7febd814ea50 con 0x7febd815cbc0 2023-10-17T06:08:30.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.282+0000 7febcdffb700 1 -- 172.21.15.125:0/3842860244 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7febd814ea50 con 0x7febd815cbc0 2023-10-17T06:08:30.287 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:30.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.286+0000 7febde19e700 1 -- 172.21.15.125:0/3842860244 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7febbc065740 msgr2=0x7febbc067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:30.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.286+0000 7febde19e700 1 --2- 172.21.15.125:0/3842860244 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7febbc065740 0x7febbc067c00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7febd4000f60 tx=0x7febd4009040 comp rx=0 tx=0).stop 2023-10-17T06:08:30.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.286+0000 7febde19e700 1 -- 172.21.15.125:0/3842860244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febd815cbc0 msgr2=0x7febd814d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:30.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.286+0000 7febde19e700 1 --2- 172.21.15.125:0/3842860244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febd815cbc0 0x7febd814d660 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7febd80d34b0 tx=0x7febd0004af0 comp rx=0 tx=0).stop 2023-10-17T06:08:30.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.286+0000 7febde19e700 1 -- 172.21.15.125:0/3842860244 shutdown_connections 2023-10-17T06:08:30.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.286+0000 7febde19e700 1 --2- 172.21.15.125:0/3842860244 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7febbc065740 0x7febbc067c00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:30.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.286+0000 7febde19e700 1 --2- 172.21.15.125:0/3842860244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7febd815cbc0 0x7febd814d660 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:30.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.286+0000 7febde19e700 1 --2- 172.21.15.125:0/3842860244 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febd80b5210 0x7febd814d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:30.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.286+0000 7febde19e700 1 --2- 172.21.15.125:0/3842860244 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7febd806d530 0x7febd815f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:30.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.286+0000 7febde19e700 1 -- 172.21.15.125:0/3842860244 >> 172.21.15.125:0/3842860244 conn(0x7febd806a3f0 msgr2=0x7febd80d1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:30.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.286+0000 7febde19e700 1 -- 172.21.15.125:0/3842860244 shutdown_connections 2023-10-17T06:08:30.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.286+0000 7febde19e700 1 -- 172.21.15.125:0/3842860244 wait complete. 2023-10-17T06:08:30.314 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-17T06:08:30.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.486+0000 7faeef59e700 1 Processor -- start 2023-10-17T06:08:30.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.486+0000 7faeef59e700 1 -- start start 2023-10-17T06:08:30.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.490+0000 7faeef59e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faef00cb500 0x7faef00b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:30.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.490+0000 7faeef59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7faef00b2720 0x7faef006fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:30.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.490+0000 7faeef59e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef00b16d0 con 0x7faef0160e50 2023-10-17T06:08:30.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.490+0000 7faeef59e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef00b1ee0 con 0x7faef00cb500 2023-10-17T06:08:30.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.490+0000 7faeef59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef00b2bb0 con 0x7faef00b2720 2023-10-17T06:08:30.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.490+0000 7faeedd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faef00cb500 0x7faef00b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:30.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.490+0000 7faeedd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faef00cb500 0x7faef00b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35692/0 (socket says 172.21.15.125:35692) 2023-10-17T06:08:30.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.490+0000 7faeedd9b700 1 -- 172.21.15.125:0/583885774 learned_addr learned my addr 172.21.15.125:0/583885774 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:30.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.490+0000 7faeeed9d700 1 --2- 172.21.15.125:0/583885774 >> v2:172.21.15.184:3300/0 conn(0x7faef00b2720 0x7faef006fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:30.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.490+0000 7faeedd9b700 1 -- 172.21.15.125:0/583885774 >> v2:172.21.15.184:3300/0 conn(0x7faef00b2720 msgr2=0x7faef006fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:30.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.490+0000 7faeedd9b700 1 --2- 172.21.15.125:0/583885774 >> v2:172.21.15.184:3300/0 conn(0x7faef00b2720 0x7faef006fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:30.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.490+0000 7faeedd9b700 1 -- 172.21.15.125:0/583885774 >> v1:172.21.15.184:6789/0 conn(0x7faef0160e50 legacy=0x7faef006e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:30.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.490+0000 7faeedd9b700 1 -- 172.21.15.125:0/583885774 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef006eaf0 con 0x7faef00cb500 2023-10-17T06:08:30.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.490+0000 7faeedd9b700 1 --2- 172.21.15.125:0/583885774 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faef00cb500 0x7faef00b21e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7faee4009910 tx=0x7faee4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89213d4325f75692 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:30.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.490+0000 7faeed59a700 1 -- 172.21.15.125:0/583885774 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee400ba20 con 0x7faef00cb500 2023-10-17T06:08:30.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.490+0000 7faeed59a700 1 -- 172.21.15.125:0/583885774 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee400bb80 con 0x7faef00cb500 2023-10-17T06:08:30.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.490+0000 7faeed59a700 1 -- 172.21.15.125:0/583885774 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4009e60 con 0x7faef00cb500 2023-10-17T06:08:30.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.494+0000 7faeef59e700 1 -- 172.21.15.125:0/583885774 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faef00cb500 msgr2=0x7faef00b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:30.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.494+0000 7faeef59e700 1 --2- 172.21.15.125:0/583885774 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faef00cb500 0x7faef00b21e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7faee4009910 tx=0x7faee4009c20 comp rx=0 tx=0).stop 2023-10-17T06:08:30.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.494+0000 7faeef59e700 1 -- 172.21.15.125:0/583885774 shutdown_connections 2023-10-17T06:08:30.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.494+0000 7faeef59e700 1 --2- 172.21.15.125:0/583885774 >> v2:172.21.15.184:3300/0 conn(0x7faef00b2720 0x7faef006fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:30.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.494+0000 7faeef59e700 1 --2- 172.21.15.125:0/583885774 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faef00cb500 0x7faef00b21e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:30.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.494+0000 7faeef59e700 1 -- 172.21.15.125:0/583885774 >> 172.21.15.125:0/583885774 conn(0x7faef00b0bf0 msgr2=0x7faef00ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:30.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.494+0000 7faeef59e700 1 -- 172.21.15.125:0/583885774 shutdown_connections 2023-10-17T06:08:30.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.494+0000 7faeef59e700 1 -- 172.21.15.125:0/583885774 wait complete. 2023-10-17T06:08:30.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.494+0000 7faeef59e700 1 Processor -- start 2023-10-17T06:08:30.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.494+0000 7faeef59e700 1 -- start start 2023-10-17T06:08:30.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faeef59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faef00b2720 0x7faef0155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:30.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faeef59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faef00cb500 0x7faef0164010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:30.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faeef59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faef0160e50 0x7faef01f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:30.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faeef59e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef01f76c0 con 0x7faef00cb500 2023-10-17T06:08:30.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faeef59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef01f6b40 con 0x7faef00b2720 2023-10-17T06:08:30.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faeef59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef01f6e20 con 0x7faef0160e50 2023-10-17T06:08:30.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faeedd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faef00cb500 0x7faef0164010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:30.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faeedd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faef00cb500 0x7faef0164010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35704/0 (socket says 172.21.15.125:35704) 2023-10-17T06:08:30.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faeedd9b700 1 -- 172.21.15.125:0/1739229497 learned_addr learned my addr 172.21.15.125:0/1739229497 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:30.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faeee59c700 1 --2- 172.21.15.125:0/1739229497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faef00b2720 0x7faef0155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:30.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faeeed9d700 1 --2- 172.21.15.125:0/1739229497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faef0160e50 0x7faef01f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:30.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faeedd9b700 1 -- 172.21.15.125:0/1739229497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faef0160e50 msgr2=0x7faef01f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:30.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faeedd9b700 1 --2- 172.21.15.125:0/1739229497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faef0160e50 0x7faef01f5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:30.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faeedd9b700 1 -- 172.21.15.125:0/1739229497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faef00b2720 msgr2=0x7faef0155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:30.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faeedd9b700 1 --2- 172.21.15.125:0/1739229497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faef00b2720 0x7faef0155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:30.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faeedd9b700 1 -- 172.21.15.125:0/1739229497 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee4009570 con 0x7faef00cb500 2023-10-17T06:08:30.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faeedd9b700 1 --2- 172.21.15.125:0/1739229497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faef00cb500 0x7faef0164010 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7faee4013000 tx=0x7faee4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:30.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faedeffd700 1 -- 172.21.15.125:0/1739229497 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4004310 con 0x7faef00cb500 2023-10-17T06:08:30.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faedeffd700 1 -- 172.21.15.125:0/1739229497 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee401f070 con 0x7faef00cb500 2023-10-17T06:08:30.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faeef59e700 1 -- 172.21.15.125:0/1739229497 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef01f7100 con 0x7faef00cb500 2023-10-17T06:08:30.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faedeffd700 1 -- 172.21.15.125:0/1739229497 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee40036c0 con 0x7faef00cb500 2023-10-17T06:08:30.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.498+0000 7faeef59e700 1 -- 172.21.15.125:0/1739229497 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef0155d80 con 0x7faef00cb500 2023-10-17T06:08:30.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.502+0000 7faeef59e700 1 -- 172.21.15.125:0/1739229497 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef0155fd0 con 0x7faef00cb500 2023-10-17T06:08:30.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.502+0000 7faedeffd700 1 -- 172.21.15.125:0/1739229497 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7faee4021030 con 0x7faef00cb500 2023-10-17T06:08:30.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.502+0000 7faedeffd700 1 --2- 172.21.15.125:0/1739229497 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7faed00656f0 0x7faed0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:30.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.502+0000 7faedeffd700 1 -- 172.21.15.125:0/1739229497 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faee40843b0 con 0x7faef00cb500 2023-10-17T06:08:30.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.502+0000 7faeee59c700 1 --2- 172.21.15.125:0/1739229497 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7faed00656f0 0x7faed0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:30.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.502+0000 7faeee59c700 1 --2- 172.21.15.125:0/1739229497 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7faed00656f0 0x7faed0067bb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faef0156300 tx=0x7faee0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:30.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.506+0000 7faedeffd700 1 -- 172.21.15.125:0/1739229497 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7faee4051b30 con 0x7faef00cb500 2023-10-17T06:08:30.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.702+0000 7faeef59e700 1 -- 172.21.15.125:0/1739229497 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faef0072e60 con 0x7faef00cb500 2023-10-17T06:08:30.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.706+0000 7faedeffd700 1 -- 172.21.15.125:0/1739229497 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7faee4055150 con 0x7faef00cb500 2023-10-17T06:08:30.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.710+0000 7faeef59e700 1 -- 172.21.15.125:0/1739229497 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7faed00656f0 msgr2=0x7faed0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:30.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.710+0000 7faeef59e700 1 --2- 172.21.15.125:0/1739229497 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7faed00656f0 0x7faed0067bb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faef0156300 tx=0x7faee0009040 comp rx=0 tx=0).stop 2023-10-17T06:08:30.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.710+0000 7faeef59e700 1 -- 172.21.15.125:0/1739229497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faef00cb500 msgr2=0x7faef0164010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:30.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.710+0000 7faeef59e700 1 --2- 172.21.15.125:0/1739229497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faef00cb500 0x7faef0164010 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7faee4013000 tx=0x7faee4004770 comp rx=0 tx=0).stop 2023-10-17T06:08:30.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.710+0000 7faeef59e700 1 -- 172.21.15.125:0/1739229497 shutdown_connections 2023-10-17T06:08:30.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.710+0000 7faeef59e700 1 --2- 172.21.15.125:0/1739229497 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7faed00656f0 0x7faed0067bb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:30.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.710+0000 7faeef59e700 1 --2- 172.21.15.125:0/1739229497 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faef0160e50 0x7faef01f5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:30.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.710+0000 7faeef59e700 1 --2- 172.21.15.125:0/1739229497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faef00cb500 0x7faef0164010 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:30.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.710+0000 7faeef59e700 1 --2- 172.21.15.125:0/1739229497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faef00b2720 0x7faef0155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:30.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.710+0000 7faeef59e700 1 -- 172.21.15.125:0/1739229497 >> 172.21.15.125:0/1739229497 conn(0x7faef00b0bf0 msgr2=0x7faef015bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:30.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.710+0000 7faeef59e700 1 -- 172.21.15.125:0/1739229497 shutdown_connections 2023-10-17T06:08:30.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:30.710+0000 7faeef59e700 1 -- 172.21.15.125:0/1739229497 wait complete. 2023-10-17T06:08:30.717 INFO:teuthology.orchestra.run.smithi125.stderr:listed 0 entries 2023-10-17T06:08:30.736 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-17T06:08:30.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:08:30.737 DEBUG:teuthology.orchestra.run.smithi184:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-17T06:08:30.777 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-17T06:08:30.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:08:30.779 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-17T06:08:30.841 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-17T06:08:30.842 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:08:31.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.022+0000 7f2d6e07b700 1 Processor -- start 2023-10-17T06:08:31.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.022+0000 7f2d6e07b700 1 -- start start 2023-10-17T06:08:31.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.026+0000 7f2d6e07b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2d680d3630 0x7f2d68070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:31.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.026+0000 7f2d6e07b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d680d0460 con 0x7f2d680b1e60 2023-10-17T06:08:31.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.026+0000 7f2d6e07b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6806d220 con 0x7f2d6815cc10 2023-10-17T06:08:31.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.026+0000 7f2d6e07b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6806eef0 con 0x7f2d680d3630 2023-10-17T06:08:31.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.026+0000 7f2d677fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2d6815cc10 0x7f2d680cfd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:54896/0 (socket says 172.21.15.125:54896) 2023-10-17T06:08:31.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.026+0000 7f2d677fe700 1 -- 172.21.15.125:0/4150839734 learned_addr learned my addr 172.21.15.125:0/4150839734 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:31.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.026+0000 7f2d66ffd700 1 --1- 172.21.15.125:0/4150839734 >> v1:172.21.15.125:6789/0 conn(0x7f2d680b1e60 0x7f2d680d2f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55450/0 (socket says 172.21.15.125:55450) 2023-10-17T06:08:31.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.026+0000 7f2d67fff700 1 --2- 172.21.15.125:0/4150839734 >> v2:172.21.15.184:3300/0 conn(0x7f2d680d3630 0x7f2d68070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:31.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.026+0000 7f2d667fc700 1 -- 172.21.15.125:0/4150839734 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1957798475 0 0) 0x7f2d6806d220 con 0x7f2d6815cc10 2023-10-17T06:08:31.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.026+0000 7f2d667fc700 1 -- 172.21.15.125:0/4150839734 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d500035d0 con 0x7f2d6815cc10 2023-10-17T06:08:31.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.026+0000 7f2d667fc700 1 -- 172.21.15.125:0/4150839734 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017039660 0 0) 0x7f2d680d0460 con 0x7f2d680b1e60 2023-10-17T06:08:31.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.026+0000 7f2d667fc700 1 -- 172.21.15.125:0/4150839734 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d6806d220 con 0x7f2d680b1e60 2023-10-17T06:08:31.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.026+0000 7f2d67fff700 1 -- 172.21.15.125:0/4150839734 >> v1:172.21.15.184:6789/0 conn(0x7f2d6815cc10 legacy=0x7f2d680cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:31.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.026+0000 7f2d667fc700 1 -- 172.21.15.125:0/4150839734 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3024973464 0 0) 0x7f2d500035d0 con 0x7f2d6815cc10 2023-10-17T06:08:31.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.026+0000 7f2d67fff700 1 -- 172.21.15.125:0/4150839734 >> v1:172.21.15.125:6789/0 conn(0x7f2d680b1e60 legacy=0x7f2d680d2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:31.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.026+0000 7f2d67fff700 1 -- 172.21.15.125:0/4150839734 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6806ec10 con 0x7f2d680d3630 2023-10-17T06:08:31.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.026+0000 7f2d67fff700 1 --2- 172.21.15.125:0/4150839734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d680d3630 0x7f2d68070a00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2d60009d90 tx=0x7f2d6000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dad173dfeeda8fb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:31.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.026+0000 7f2d667fc700 1 -- 172.21.15.125:0/4150839734 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6000e070 con 0x7f2d680d3630 2023-10-17T06:08:31.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.026+0000 7f2d667fc700 1 -- 172.21.15.125:0/4150839734 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d60003a40 con 0x7f2d680d3630 2023-10-17T06:08:31.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.026+0000 7f2d667fc700 1 -- 172.21.15.125:0/4150839734 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58001670 con 0x7f2d680d3630 2023-10-17T06:08:31.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.030+0000 7f2d6e07b700 1 -- 172.21.15.125:0/4150839734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d680d3630 msgr2=0x7f2d68070a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:31.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.030+0000 7f2d6e07b700 1 --2- 172.21.15.125:0/4150839734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d680d3630 0x7f2d68070a00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2d60009d90 tx=0x7f2d6000b330 comp rx=0 tx=0).stop 2023-10-17T06:08:31.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.030+0000 7f2d6e07b700 1 -- 172.21.15.125:0/4150839734 shutdown_connections 2023-10-17T06:08:31.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.030+0000 7f2d6e07b700 1 --2- 172.21.15.125:0/4150839734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d680d3630 0x7f2d68070a00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:31.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.030+0000 7f2d6e07b700 1 -- 172.21.15.125:0/4150839734 >> 172.21.15.125:0/4150839734 conn(0x7f2d68069ef0 msgr2=0x7f2d6806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:31.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.030+0000 7f2d6e07b700 1 -- 172.21.15.125:0/4150839734 shutdown_connections 2023-10-17T06:08:31.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.030+0000 7f2d6e07b700 1 -- 172.21.15.125:0/4150839734 wait complete. 2023-10-17T06:08:31.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.030+0000 7f2d6e07b700 1 Processor -- start 2023-10-17T06:08:31.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.030+0000 7f2d6e07b700 1 -- start start 2023-10-17T06:08:31.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d6e07b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d680b1e60 0x7f2d6814ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:31.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d6e07b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d680d3630 0x7f2d6815f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:31.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d6e07b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d6815cc10 0x7f2d680b6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:31.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d6e07b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6814bfc0 con 0x7f2d680d3630 2023-10-17T06:08:31.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d6e07b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6815f850 con 0x7f2d680b1e60 2023-10-17T06:08:31.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d6e07b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6815fb20 con 0x7f2d6815cc10 2023-10-17T06:08:31.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d66ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d680d3630 0x7f2d6815f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:31.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d677fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d680b1e60 0x7f2d6814ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:31.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d66ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d680d3630 0x7f2d6815f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35712/0 (socket says 172.21.15.125:35712) 2023-10-17T06:08:31.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d66ffd700 1 -- 172.21.15.125:0/2743104298 learned_addr learned my addr 172.21.15.125:0/2743104298 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:31.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d67fff700 1 --2- 172.21.15.125:0/2743104298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d6815cc10 0x7f2d680b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:31.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d66ffd700 1 -- 172.21.15.125:0/2743104298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d6815cc10 msgr2=0x7f2d680b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:31.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d66ffd700 1 --2- 172.21.15.125:0/2743104298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d6815cc10 0x7f2d680b6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:31.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d66ffd700 1 -- 172.21.15.125:0/2743104298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d680b1e60 msgr2=0x7f2d6814ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:31.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d66ffd700 1 --2- 172.21.15.125:0/2743104298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d680b1e60 0x7f2d6814ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:31.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d66ffd700 1 -- 172.21.15.125:0/2743104298 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d60009a70 con 0x7f2d680d3630 2023-10-17T06:08:31.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d66ffd700 1 --2- 172.21.15.125:0/2743104298 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d680d3630 0x7f2d6815f310 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00c430 tx=0x7f2d5c00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:31.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d4ffff700 1 -- 172.21.15.125:0/2743104298 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c005cd0 con 0x7f2d680d3630 2023-10-17T06:08:31.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d4ffff700 1 -- 172.21.15.125:0/2743104298 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5c005e30 con 0x7f2d680d3630 2023-10-17T06:08:31.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d6e07b700 1 -- 172.21.15.125:0/2743104298 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6815fe00 con 0x7f2d680d3630 2023-10-17T06:08:31.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d4ffff700 1 -- 172.21.15.125:0/2743104298 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c0072d0 con 0x7f2d680d3630 2023-10-17T06:08:31.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.034+0000 7f2d6e07b700 1 -- 172.21.15.125:0/2743104298 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d681603c0 con 0x7f2d680d3630 2023-10-17T06:08:31.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.038+0000 7f2d6e07b700 1 -- 172.21.15.125:0/2743104298 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d68072e60 con 0x7f2d680d3630 2023-10-17T06:08:31.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.038+0000 7f2d4ffff700 1 -- 172.21.15.125:0/2743104298 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2d5c007430 con 0x7f2d680d3630 2023-10-17T06:08:31.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.038+0000 7f2d4ffff700 1 --2- 172.21.15.125:0/2743104298 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2d540656f0 0x7f2d54067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:31.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.038+0000 7f2d4ffff700 1 -- 172.21.15.125:0/2743104298 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2d5c082360 con 0x7f2d680d3630 2023-10-17T06:08:31.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.038+0000 7f2d677fe700 1 --2- 172.21.15.125:0/2743104298 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2d540656f0 0x7f2d54067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:31.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.042+0000 7f2d677fe700 1 --2- 172.21.15.125:0/2743104298 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2d540656f0 0x7f2d54067bb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2d58001380 tx=0x7f2d58000f10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:31.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.046+0000 7f2d4ffff700 1 -- 172.21.15.125:0/2743104298 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2d5c0536e0 con 0x7f2d680d3630 2023-10-17T06:08:31.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.278+0000 7f2d6e07b700 1 -- 172.21.15.125:0/2743104298 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d680d24b0 con 0x7f2d680d3630 2023-10-17T06:08:31.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.278+0000 7f2d4ffff700 1 -- 172.21.15.125:0/2743104298 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f2d5c053270 con 0x7f2d680d3630 2023-10-17T06:08:31.283 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:31.283 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/3744648044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3744648044},{"type":"v1","addr":"172.21.15.184:6833","nonce":3744648044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/181458401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181458401},{"type":"v1","addr":"172.21.15.184:6835","nonce":181458401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/908363262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":908363262},{"type":"v1","addr":"172.21.15.125:6835","nonce":908363262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:07:09.036610+0000","modified":"2023-10-17T06:07:35.578225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/3617198893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":3617198893},{"type":"v1","addr":"172.21.15.125:6837","nonce":3617198893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-17T06:08:31.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.282+0000 7f2d6e07b700 1 -- 172.21.15.125:0/2743104298 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2d540656f0 msgr2=0x7f2d54067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:31.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.282+0000 7f2d6e07b700 1 --2- 172.21.15.125:0/2743104298 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2d540656f0 0x7f2d54067bb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2d58001380 tx=0x7f2d58000f10 comp rx=0 tx=0).stop 2023-10-17T06:08:31.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.282+0000 7f2d6e07b700 1 -- 172.21.15.125:0/2743104298 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d680d3630 msgr2=0x7f2d6815f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:31.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.282+0000 7f2d6e07b700 1 --2- 172.21.15.125:0/2743104298 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d680d3630 0x7f2d6815f310 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00c430 tx=0x7f2d5c00c740 comp rx=0 tx=0).stop 2023-10-17T06:08:31.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.282+0000 7f2d6e07b700 1 -- 172.21.15.125:0/2743104298 shutdown_connections 2023-10-17T06:08:31.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.282+0000 7f2d6e07b700 1 --2- 172.21.15.125:0/2743104298 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2d540656f0 0x7f2d54067bb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:31.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.282+0000 7f2d6e07b700 1 --2- 172.21.15.125:0/2743104298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2d6815cc10 0x7f2d680b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:31.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.282+0000 7f2d6e07b700 1 --2- 172.21.15.125:0/2743104298 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d680d3630 0x7f2d6815f310 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:31.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.282+0000 7f2d6e07b700 1 --2- 172.21.15.125:0/2743104298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2d680b1e60 0x7f2d6814ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:31.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.282+0000 7f2d6e07b700 1 -- 172.21.15.125:0/2743104298 >> 172.21.15.125:0/2743104298 conn(0x7f2d68069ef0 msgr2=0x7f2d68161240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:31.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.282+0000 7f2d6e07b700 1 -- 172.21.15.125:0/2743104298 shutdown_connections 2023-10-17T06:08:31.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.282+0000 7f2d6e07b700 1 -- 172.21.15.125:0/2743104298 wait complete. 2023-10-17T06:08:31.289 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 9 2023-10-17T06:08:31.309 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:08:31.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.486+0000 7fbe8174c700 1 Processor -- start 2023-10-17T06:08:31.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.486+0000 7fbe8174c700 1 -- start start 2023-10-17T06:08:31.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.490+0000 7fbe8174c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbe7c0d2e00 0x7fbe7c0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:31.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.490+0000 7fbe8174c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7c15d0d0 con 0x7fbe7c160710 2023-10-17T06:08:31.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.490+0000 7fbe8174c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7c06f0f0 con 0x7fbe7c0b5ae0 2023-10-17T06:08:31.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.490+0000 7fbe8174c700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7c15df90 con 0x7fbe7c0d2e00 2023-10-17T06:08:31.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.490+0000 7fbe7b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fbe7c160710 0x7fbe7c0d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55462/0 (socket says 172.21.15.125:55462) 2023-10-17T06:08:31.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.490+0000 7fbe7b7fe700 1 -- 172.21.15.125:0/3957734739 learned_addr learned my addr 172.21.15.125:0/3957734739 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:31.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.490+0000 7fbe7bfff700 1 --2- 172.21.15.125:0/3957734739 >> v2:172.21.15.184:3300/0 conn(0x7fbe7c0d2e00 0x7fbe7c0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:31.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.490+0000 7fbe7affd700 1 -- 172.21.15.125:0/3957734739 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962457066 0 0) 0x7fbe70001110 con 0x7fbe7c160710 2023-10-17T06:08:31.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.490+0000 7fbe7affd700 1 -- 172.21.15.125:0/3957734739 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe640035d0 con 0x7fbe7c160710 2023-10-17T06:08:31.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.490+0000 7fbe7bfff700 1 -- 172.21.15.125:0/3957734739 >> v1:172.21.15.184:6789/0 conn(0x7fbe7c0b5ae0 legacy=0x7fbe7c06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:31.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.490+0000 7fbe7bfff700 1 -- 172.21.15.125:0/3957734739 >> v1:172.21.15.125:6789/0 conn(0x7fbe7c160710 legacy=0x7fbe7c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:31.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.490+0000 7fbe7bfff700 1 -- 172.21.15.125:0/3957734739 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c15d310 con 0x7fbe7c0d2e00 2023-10-17T06:08:31.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.490+0000 7fbe7bfff700 1 --2- 172.21.15.125:0/3957734739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe7c0d2e00 0x7fbe7c0b6e00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c009d90 tx=0x7fbe6c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c6545a147e8866f server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:31.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.490+0000 7fbe7affd700 1 -- 172.21.15.125:0/3957734739 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c00e070 con 0x7fbe7c0d2e00 2023-10-17T06:08:31.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.490+0000 7fbe7affd700 1 -- 172.21.15.125:0/3957734739 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c00bb20 con 0x7fbe7c0d2e00 2023-10-17T06:08:31.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.490+0000 7fbe7affd700 1 -- 172.21.15.125:0/3957734739 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c012430 con 0x7fbe7c0d2e00 2023-10-17T06:08:31.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.494+0000 7fbe8174c700 1 -- 172.21.15.125:0/3957734739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe7c0d2e00 msgr2=0x7fbe7c0b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:31.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.494+0000 7fbe8174c700 1 --2- 172.21.15.125:0/3957734739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe7c0d2e00 0x7fbe7c0b6e00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c009d90 tx=0x7fbe6c00b330 comp rx=0 tx=0).stop 2023-10-17T06:08:31.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.494+0000 7fbe8174c700 1 -- 172.21.15.125:0/3957734739 shutdown_connections 2023-10-17T06:08:31.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.494+0000 7fbe8174c700 1 --2- 172.21.15.125:0/3957734739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe7c0d2e00 0x7fbe7c0b6e00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:31.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.494+0000 7fbe8174c700 1 -- 172.21.15.125:0/3957734739 >> 172.21.15.125:0/3957734739 conn(0x7fbe7c069f20 msgr2=0x7fbe7c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:31.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.494+0000 7fbe8174c700 1 -- 172.21.15.125:0/3957734739 shutdown_connections 2023-10-17T06:08:31.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.494+0000 7fbe8174c700 1 -- 172.21.15.125:0/3957734739 wait complete. 2023-10-17T06:08:31.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.494+0000 7fbe8174c700 1 Processor -- start 2023-10-17T06:08:31.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.494+0000 7fbe8174c700 1 -- start start 2023-10-17T06:08:31.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe8174c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe7c0b5ae0 0x7fbe7c1f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:31.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe8174c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe7c0d2e00 0x7fbe7c154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:31.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe8174c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe7c160710 0x7fbe7c0cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:31.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe8174c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c153ff0 con 0x7fbe7c0b5ae0 2023-10-17T06:08:31.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe8174c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c1f6210 con 0x7fbe7c0d2e00 2023-10-17T06:08:31.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe8174c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c1f64f0 con 0x7fbe7c160710 2023-10-17T06:08:31.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe7bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe7c0b5ae0 0x7fbe7c1f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:31.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe7bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe7c0b5ae0 0x7fbe7c1f5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35724/0 (socket says 172.21.15.125:35724) 2023-10-17T06:08:31.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe7bfff700 1 -- 172.21.15.125:0/195289602 learned_addr learned my addr 172.21.15.125:0/195289602 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:31.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe7b7fe700 1 --2- 172.21.15.125:0/195289602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe7c0d2e00 0x7fbe7c154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:31.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe80f4b700 1 --2- 172.21.15.125:0/195289602 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe7c160710 0x7fbe7c0cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:31.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe7bfff700 1 -- 172.21.15.125:0/195289602 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe7c160710 msgr2=0x7fbe7c0cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:31.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe7bfff700 1 --2- 172.21.15.125:0/195289602 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe7c160710 0x7fbe7c0cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:31.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe7bfff700 1 -- 172.21.15.125:0/195289602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe7c0d2e00 msgr2=0x7fbe7c154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:31.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe7bfff700 1 --2- 172.21.15.125:0/195289602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe7c0d2e00 0x7fbe7c154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:31.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe7bfff700 1 -- 172.21.15.125:0/195289602 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c009a70 con 0x7fbe7c0b5ae0 2023-10-17T06:08:31.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe7b7fe700 1 --2- 172.21.15.125:0/195289602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe7c0d2e00 0x7fbe7c154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:31.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe80f4b700 1 --2- 172.21.15.125:0/195289602 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe7c160710 0x7fbe7c0cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:31.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe7bfff700 1 --2- 172.21.15.125:0/195289602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe7c0b5ae0 0x7fbe7c1f5bc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c014040 tx=0x7fbe6c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:31.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe78ff9700 1 -- 172.21.15.125:0/195289602 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c012430 con 0x7fbe7c0b5ae0 2023-10-17T06:08:31.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe78ff9700 1 -- 172.21.15.125:0/195289602 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c020070 con 0x7fbe7c0b5ae0 2023-10-17T06:08:31.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe78ff9700 1 -- 172.21.15.125:0/195289602 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c004260 con 0x7fbe7c0b5ae0 2023-10-17T06:08:31.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe8174c700 1 -- 172.21.15.125:0/195289602 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7c1f67d0 con 0x7fbe7c0b5ae0 2023-10-17T06:08:31.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.498+0000 7fbe8174c700 1 -- 172.21.15.125:0/195289602 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7c1523b0 con 0x7fbe7c0b5ae0 2023-10-17T06:08:31.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.502+0000 7fbe8174c700 1 -- 172.21.15.125:0/195289602 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7c072e60 con 0x7fbe7c0b5ae0 2023-10-17T06:08:31.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.502+0000 7fbe78ff9700 1 -- 172.21.15.125:0/195289602 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fbe6c0043c0 con 0x7fbe7c0b5ae0 2023-10-17T06:08:31.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.502+0000 7fbe78ff9700 1 --2- 172.21.15.125:0/195289602 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fbe68065720 0x7fbe68067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:31.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.502+0000 7fbe78ff9700 1 -- 172.21.15.125:0/195289602 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbe6c022070 con 0x7fbe7c0b5ae0 2023-10-17T06:08:31.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.502+0000 7fbe7b7fe700 1 --2- 172.21.15.125:0/195289602 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fbe68065720 0x7fbe68067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:31.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.506+0000 7fbe7b7fe700 1 --2- 172.21.15.125:0/195289602 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fbe68065720 0x7fbe68067be0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c15b1c0 tx=0x7fbe70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:31.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.510+0000 7fbe78ff9700 1 -- 172.21.15.125:0/195289602 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fbe6c08a020 con 0x7fbe7c0b5ae0 2023-10-17T06:08:31.539 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:08:31.546 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:08:31.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.686+0000 7fbe8174c700 1 -- 172.21.15.125:0/195289602 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe7c06d3e0 con 0x7fbe7c0b5ae0 2023-10-17T06:08:31.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.690+0000 7fbe78ff9700 1 -- 172.21.15.125:0/195289602 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20252 (secure 0 0 0) 0x7fbe6c02c090 con 0x7fbe7c0b5ae0 2023-10-17T06:08:31.694 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:31.695 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":30,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:49.710984+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:08:31.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.694+0000 7fbe8174c700 1 -- 172.21.15.125:0/195289602 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fbe68065720 msgr2=0x7fbe68067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:31.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.694+0000 7fbe8174c700 1 --2- 172.21.15.125:0/195289602 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fbe68065720 0x7fbe68067be0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c15b1c0 tx=0x7fbe70009040 comp rx=0 tx=0).stop 2023-10-17T06:08:31.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.694+0000 7fbe8174c700 1 -- 172.21.15.125:0/195289602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe7c0b5ae0 msgr2=0x7fbe7c1f5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:31.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.694+0000 7fbe8174c700 1 --2- 172.21.15.125:0/195289602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe7c0b5ae0 0x7fbe7c1f5bc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c014040 tx=0x7fbe6c004af0 comp rx=0 tx=0).stop 2023-10-17T06:08:31.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.694+0000 7fbe8174c700 1 -- 172.21.15.125:0/195289602 shutdown_connections 2023-10-17T06:08:31.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.694+0000 7fbe8174c700 1 --2- 172.21.15.125:0/195289602 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fbe68065720 0x7fbe68067be0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:31.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.694+0000 7fbe8174c700 1 --2- 172.21.15.125:0/195289602 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbe7c160710 0x7fbe7c0cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:31.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.694+0000 7fbe8174c700 1 --2- 172.21.15.125:0/195289602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe7c0d2e00 0x7fbe7c154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:31.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.694+0000 7fbe8174c700 1 --2- 172.21.15.125:0/195289602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbe7c0b5ae0 0x7fbe7c1f5bc0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:31.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.694+0000 7fbe8174c700 1 -- 172.21.15.125:0/195289602 >> 172.21.15.125:0/195289602 conn(0x7fbe7c069f20 msgr2=0x7fbe7c06f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:31.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.694+0000 7fbe8174c700 1 -- 172.21.15.125:0/195289602 shutdown_connections 2023-10-17T06:08:31.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.694+0000 7fbe8174c700 1 -- 172.21.15.125:0/195289602 wait complete. 2023-10-17T06:08:31.719 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-17T06:07:06.629169+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-17T06:07:08.148117+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-17T06:07:11.895112+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-17T06:08:31.720 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:08:31.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.894+0000 7f107759e700 1 Processor -- start 2023-10-17T06:08:31.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.894+0000 7f107759e700 1 -- start start 2023-10-17T06:08:31.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.898+0000 7f107759e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f10781599e0 0x7f1078070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:31.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.898+0000 7f107759e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f107815dfd0 0x7f10780709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:31.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.898+0000 7f107759e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10780b1060 con 0x7f1078159600 2023-10-17T06:08:31.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.898+0000 7f107759e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107815d4f0 con 0x7f107815dfd0 2023-10-17T06:08:31.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.898+0000 7f107759e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107815d7d0 con 0x7f10781599e0 2023-10-17T06:08:31.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.898+0000 7f1076d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f107815dfd0 0x7f10780709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:31.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.898+0000 7f1076d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f107815dfd0 0x7f10780709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35728/0 (socket says 172.21.15.125:35728) 2023-10-17T06:08:31.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.898+0000 7f1076d9d700 1 -- 172.21.15.125:0/18380125 learned_addr learned my addr 172.21.15.125:0/18380125 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:31.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.898+0000 7f106dd9b700 1 --2- 172.21.15.125:0/18380125 >> v2:172.21.15.184:3300/0 conn(0x7f10781599e0 0x7f1078070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:31.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.898+0000 7f1076d9d700 1 -- 172.21.15.125:0/18380125 >> v2:172.21.15.184:3300/0 conn(0x7f10781599e0 msgr2=0x7f1078070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:31.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.898+0000 7f1076d9d700 1 --2- 172.21.15.125:0/18380125 >> v2:172.21.15.184:3300/0 conn(0x7f10781599e0 0x7f1078070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:31.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.898+0000 7f1076d9d700 1 -- 172.21.15.125:0/18380125 >> v1:172.21.15.184:6789/0 conn(0x7f1078159600 legacy=0x7f10780b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:31.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.898+0000 7f1076d9d700 1 -- 172.21.15.125:0/18380125 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107815dab0 con 0x7f107815dfd0 2023-10-17T06:08:31.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.898+0000 7f1076d9d700 1 --2- 172.21.15.125:0/18380125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f107815dfd0 0x7f10780709a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f107806b1e0 tx=0x7f107000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87427e8c9ffcd066 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:31.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.898+0000 7f1075d9b700 1 -- 172.21.15.125:0/18380125 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107000dd90 con 0x7f107815dfd0 2023-10-17T06:08:31.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.898+0000 7f1075d9b700 1 -- 172.21.15.125:0/18380125 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1070010470 con 0x7f107815dfd0 2023-10-17T06:08:31.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.898+0000 7f1075d9b700 1 -- 172.21.15.125:0/18380125 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1070010800 con 0x7f107815dfd0 2023-10-17T06:08:31.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.902+0000 7f107759e700 1 -- 172.21.15.125:0/18380125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f107815dfd0 msgr2=0x7f10780709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:31.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.902+0000 7f107759e700 1 --2- 172.21.15.125:0/18380125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f107815dfd0 0x7f10780709a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f107806b1e0 tx=0x7f107000be90 comp rx=0 tx=0).stop 2023-10-17T06:08:31.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.902+0000 7f107759e700 1 -- 172.21.15.125:0/18380125 shutdown_connections 2023-10-17T06:08:31.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.902+0000 7f107759e700 1 --2- 172.21.15.125:0/18380125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f107815dfd0 0x7f10780709a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:31.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.902+0000 7f107759e700 1 --2- 172.21.15.125:0/18380125 >> v2:172.21.15.184:3300/0 conn(0x7f10781599e0 0x7f1078070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:31.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.902+0000 7f107759e700 1 -- 172.21.15.125:0/18380125 >> 172.21.15.125:0/18380125 conn(0x7f107806a600 msgr2=0x7f10780ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:31.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.902+0000 7f107759e700 1 -- 172.21.15.125:0/18380125 shutdown_connections 2023-10-17T06:08:31.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.902+0000 7f107759e700 1 -- 172.21.15.125:0/18380125 wait complete. 2023-10-17T06:08:31.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.902+0000 7f107759e700 1 Processor -- start 2023-10-17T06:08:31.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.902+0000 7f107759e700 1 -- start start 2023-10-17T06:08:31.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f107759e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1078159600 0x7f1078142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:31.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f107759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10781599e0 0x7f1078156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:31.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f107759e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f107815dfd0 0x7f1078157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:31.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f107759e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10780b2dc0 con 0x7f1078159600 2023-10-17T06:08:31.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f107759e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1078159ef0 con 0x7f107815dfd0 2023-10-17T06:08:31.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f107759e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1078143530 con 0x7f10781599e0 2023-10-17T06:08:31.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f107659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1078159600 0x7f1078142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:31.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f107659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1078159600 0x7f1078142ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35744/0 (socket says 172.21.15.125:35744) 2023-10-17T06:08:31.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f107659c700 1 -- 172.21.15.125:0/3686277582 learned_addr learned my addr 172.21.15.125:0/3686277582 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:31.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f1076d9d700 1 --2- 172.21.15.125:0/3686277582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f107815dfd0 0x7f1078157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:31.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f106dd9b700 1 --2- 172.21.15.125:0/3686277582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10781599e0 0x7f1078156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:31.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f107659c700 1 -- 172.21.15.125:0/3686277582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10781599e0 msgr2=0x7f1078156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:31.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f107659c700 1 --2- 172.21.15.125:0/3686277582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10781599e0 0x7f1078156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:31.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f107659c700 1 -- 172.21.15.125:0/3686277582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f107815dfd0 msgr2=0x7f1078157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:31.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f107659c700 1 --2- 172.21.15.125:0/3686277582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f107815dfd0 0x7f1078157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:31.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f107659c700 1 -- 172.21.15.125:0/3686277582 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107000b810 con 0x7f1078159600 2023-10-17T06:08:31.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f107659c700 1 --2- 172.21.15.125:0/3686277582 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1078159600 0x7f1078142ff0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f106800c500 tx=0x7f106800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:31.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f106f7fe700 1 -- 172.21.15.125:0/3686277582 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10680052d0 con 0x7f1078159600 2023-10-17T06:08:31.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f106f7fe700 1 -- 172.21.15.125:0/3686277582 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1068005430 con 0x7f1078159600 2023-10-17T06:08:31.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f107759e700 1 -- 172.21.15.125:0/3686277582 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10780b0e30 con 0x7f1078159600 2023-10-17T06:08:31.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.906+0000 7f106f7fe700 1 -- 172.21.15.125:0/3686277582 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10680055a0 con 0x7f1078159600 2023-10-17T06:08:31.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.910+0000 7f107759e700 1 -- 172.21.15.125:0/3686277582 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10781589c0 con 0x7f1078159600 2023-10-17T06:08:31.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.910+0000 7f107759e700 1 -- 172.21.15.125:0/3686277582 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1078072e60 con 0x7f1078159600 2023-10-17T06:08:31.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.910+0000 7f106f7fe700 1 -- 172.21.15.125:0/3686277582 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f10680038e0 con 0x7f1078159600 2023-10-17T06:08:31.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.914+0000 7f106f7fe700 1 --2- 172.21.15.125:0/3686277582 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f10580656f0 0x7f1058067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.914+0000 7f106f7fe700 1 -- 172.21.15.125:0/3686277582 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1068082620 con 0x7f1078159600 2023-10-17T06:08:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.914+0000 7f106dd9b700 1 --2- 172.21.15.125:0/3686277582 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f10580656f0 0x7f1058067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:31.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.914+0000 7f106dd9b700 1 --2- 172.21.15.125:0/3686277582 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f10580656f0 0x7f1058067bb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f10780cd780 tx=0x7f10600098d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:31.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:31.918+0000 7f106f7fe700 1 -- 172.21.15.125:0/3686277582 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f106804fc80 con 0x7f1078159600 2023-10-17T06:08:32.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.102+0000 7f107759e700 1 -- 172.21.15.125:0/3686277582 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1078158d30 con 0x7f1078159600 2023-10-17T06:08:32.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.102+0000 7f106f7fe700 1 -- 172.21.15.125:0/3686277582 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f10680532a0 con 0x7f1078159600 2023-10-17T06:08:32.106 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:08:32.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.102+0000 7f107759e700 1 -- 172.21.15.125:0/3686277582 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f10580656f0 msgr2=0x7f1058067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:32.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.102+0000 7f107759e700 1 --2- 172.21.15.125:0/3686277582 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f10580656f0 0x7f1058067bb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f10780cd780 tx=0x7f10600098d0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.102+0000 7f107759e700 1 -- 172.21.15.125:0/3686277582 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1078159600 msgr2=0x7f1078142ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:32.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.102+0000 7f107759e700 1 --2- 172.21.15.125:0/3686277582 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1078159600 0x7f1078142ff0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f106800c500 tx=0x7f106800c810 comp rx=0 tx=0).stop 2023-10-17T06:08:32.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.102+0000 7f107759e700 1 -- 172.21.15.125:0/3686277582 shutdown_connections 2023-10-17T06:08:32.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.102+0000 7f107759e700 1 --2- 172.21.15.125:0/3686277582 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f10580656f0 0x7f1058067bb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.102+0000 7f107759e700 1 --2- 172.21.15.125:0/3686277582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f107815dfd0 0x7f1078157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.102+0000 7f107759e700 1 --2- 172.21.15.125:0/3686277582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f10781599e0 0x7f1078156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.102+0000 7f107759e700 1 --2- 172.21.15.125:0/3686277582 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1078159600 0x7f1078142ff0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.102+0000 7f107759e700 1 -- 172.21.15.125:0/3686277582 >> 172.21.15.125:0/3686277582 conn(0x7f107806a600 msgr2=0x7f10780cc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:32.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.106+0000 7f107759e700 1 -- 172.21.15.125:0/3686277582 shutdown_connections 2023-10-17T06:08:32.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.106+0000 7f107759e700 1 -- 172.21.15.125:0/3686277582 wait complete. 2023-10-17T06:08:32.129 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:08:32.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.318+0000 7f087e0b8700 1 Processor -- start 2023-10-17T06:08:32.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.322+0000 7f087e0b8700 1 -- start start 2023-10-17T06:08:32.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.322+0000 7f087e0b8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0878160710 0x7f08780b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:32.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.322+0000 7f087e0b8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f087815d0d0 con 0x7f08780d2e00 2023-10-17T06:08:32.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.322+0000 7f087e0b8700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f087806f0f0 con 0x7f08780b5ae0 2023-10-17T06:08:32.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.322+0000 7f087e0b8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087815df90 con 0x7f0878160710 2023-10-17T06:08:32.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.322+0000 7f087d0b6700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f08780d2e00 0x7f08780d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55464/0 (socket says 172.21.15.125:55464) 2023-10-17T06:08:32.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.322+0000 7f087d0b6700 1 -- 172.21.15.125:0/2811412000 learned_addr learned my addr 172.21.15.125:0/2811412000 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:32.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.322+0000 7f087c8b5700 1 --2- 172.21.15.125:0/2811412000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0878160710 0x7f08780b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:32.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.322+0000 7f087c8b5700 1 -- 172.21.15.125:0/2811412000 >> v1:172.21.15.184:6789/0 conn(0x7f08780b5ae0 legacy=0x7f087806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:32.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.322+0000 7f086ffff700 1 -- 172.21.15.125:0/2811412000 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154432351 0 0) 0x7f0874001110 con 0x7f08780d2e00 2023-10-17T06:08:32.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.322+0000 7f087c8b5700 1 -- 172.21.15.125:0/2811412000 >> v1:172.21.15.125:6789/0 conn(0x7f08780d2e00 legacy=0x7f08780d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:32.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.322+0000 7f087c8b5700 1 -- 172.21.15.125:0/2811412000 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087815d310 con 0x7f0878160710 2023-10-17T06:08:32.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.326+0000 7f087c8b5700 1 --2- 172.21.15.125:0/2811412000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0878160710 0x7f08780b6e00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f08680098b0 tx=0x7f0868009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de155fec22473428 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:32.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.326+0000 7f086ffff700 1 -- 172.21.15.125:0/2811412000 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0868011830 con 0x7f0878160710 2023-10-17T06:08:32.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.326+0000 7f086ffff700 1 -- 172.21.15.125:0/2811412000 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0868011990 con 0x7f0878160710 2023-10-17T06:08:32.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.326+0000 7f086ffff700 1 -- 172.21.15.125:0/2811412000 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0868011d20 con 0x7f0878160710 2023-10-17T06:08:32.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.326+0000 7f087e0b8700 1 -- 172.21.15.125:0/2811412000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0878160710 msgr2=0x7f08780b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:32.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.326+0000 7f087e0b8700 1 --2- 172.21.15.125:0/2811412000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0878160710 0x7f08780b6e00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f08680098b0 tx=0x7f0868009bc0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.326+0000 7f087e0b8700 1 -- 172.21.15.125:0/2811412000 shutdown_connections 2023-10-17T06:08:32.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.326+0000 7f087e0b8700 1 --2- 172.21.15.125:0/2811412000 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0878160710 0x7f08780b6e00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.326+0000 7f087e0b8700 1 -- 172.21.15.125:0/2811412000 >> 172.21.15.125:0/2811412000 conn(0x7f0878069f20 msgr2=0x7f087806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:32.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.326+0000 7f087e0b8700 1 -- 172.21.15.125:0/2811412000 shutdown_connections 2023-10-17T06:08:32.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.326+0000 7f087e0b8700 1 -- 172.21.15.125:0/2811412000 wait complete. 2023-10-17T06:08:32.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.330+0000 7f087e0b8700 1 Processor -- start 2023-10-17T06:08:32.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.330+0000 7f087e0b8700 1 -- start start 2023-10-17T06:08:32.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.330+0000 7f087e0b8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08780b5ae0 0x7f08780ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:32.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.330+0000 7f087e0b8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08780d2e00 0x7f0878158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:32.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.330+0000 7f087e0b8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0878160710 0x7f08780b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:32.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.330+0000 7f087e0b8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08780ae380 con 0x7f08780b5ae0 2023-10-17T06:08:32.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.330+0000 7f087e0b8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08780b0740 con 0x7f08780d2e00 2023-10-17T06:08:32.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.330+0000 7f087e0b8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08780af870 con 0x7f0878160710 2023-10-17T06:08:32.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.330+0000 7f087d0b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08780b5ae0 0x7f08780ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:32.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.330+0000 7f087d0b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08780b5ae0 0x7f08780ade40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35754/0 (socket says 172.21.15.125:35754) 2023-10-17T06:08:32.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.330+0000 7f087d0b6700 1 -- 172.21.15.125:0/1608256786 learned_addr learned my addr 172.21.15.125:0/1608256786 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:32.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.330+0000 7f087c8b5700 1 --2- 172.21.15.125:0/1608256786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08780d2e00 0x7f0878158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:32.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.330+0000 7f087d8b7700 1 --2- 172.21.15.125:0/1608256786 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0878160710 0x7f08780b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:32.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.330+0000 7f087d0b6700 1 -- 172.21.15.125:0/1608256786 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0878160710 msgr2=0x7f08780b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:32.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.330+0000 7f087d0b6700 1 --2- 172.21.15.125:0/1608256786 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0878160710 0x7f08780b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.330+0000 7f087d0b6700 1 -- 172.21.15.125:0/1608256786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08780d2e00 msgr2=0x7f0878158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:32.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.330+0000 7f087d0b6700 1 --2- 172.21.15.125:0/1608256786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08780d2e00 0x7f0878158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.330+0000 7f087d0b6700 1 -- 172.21.15.125:0/1608256786 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08680094b0 con 0x7f08780b5ae0 2023-10-17T06:08:32.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.334+0000 7f087d0b6700 1 --2- 172.21.15.125:0/1608256786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08780b5ae0 0x7f08780ade40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f087400c4a0 tx=0x7f087400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:32.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.334+0000 7f086dffb700 1 -- 172.21.15.125:0/1608256786 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0874004ca0 con 0x7f08780b5ae0 2023-10-17T06:08:32.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.334+0000 7f086dffb700 1 -- 172.21.15.125:0/1608256786 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0874004e00 con 0x7f08780b5ae0 2023-10-17T06:08:32.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.334+0000 7f087e0b8700 1 -- 172.21.15.125:0/1608256786 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08780afb30 con 0x7f08780b5ae0 2023-10-17T06:08:32.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.334+0000 7f086dffb700 1 -- 172.21.15.125:0/1608256786 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0874007310 con 0x7f08780b5ae0 2023-10-17T06:08:32.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.334+0000 7f087e0b8700 1 -- 172.21.15.125:0/1608256786 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08780b00f0 con 0x7f08780b5ae0 2023-10-17T06:08:32.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.334+0000 7f087e0b8700 1 -- 172.21.15.125:0/1608256786 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f087804e910 con 0x7f08780b5ae0 2023-10-17T06:08:32.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.338+0000 7f086dffb700 1 -- 172.21.15.125:0/1608256786 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0874007470 con 0x7f08780b5ae0 2023-10-17T06:08:32.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.338+0000 7f086dffb700 1 --2- 172.21.15.125:0/1608256786 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f085c065740 0x7f085c067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:32.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.338+0000 7f086dffb700 1 -- 172.21.15.125:0/1608256786 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f08740829f0 con 0x7f08780b5ae0 2023-10-17T06:08:32.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.338+0000 7f087c8b5700 1 --2- 172.21.15.125:0/1608256786 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f085c065740 0x7f085c067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:32.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.338+0000 7f087c8b5700 1 --2- 172.21.15.125:0/1608256786 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f085c065740 0x7f085c067c00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f08680098b0 tx=0x7f0868008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:32.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.346+0000 7f086dffb700 1 -- 172.21.15.125:0/1608256786 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0874084e60 con 0x7f08780b5ae0 2023-10-17T06:08:32.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.518+0000 7f087e0b8700 1 -- 172.21.15.125:0/1608256786 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f087815d0d0 con 0x7f08780b5ae0 2023-10-17T06:08:32.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.518+0000 7f086dffb700 1 -- 172.21.15.125:0/1608256786 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f087815d0d0 con 0x7f08780b5ae0 2023-10-17T06:08:32.523 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:08:32.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.522+0000 7f087e0b8700 1 -- 172.21.15.125:0/1608256786 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f085c065740 msgr2=0x7f085c067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:32.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.522+0000 7f087e0b8700 1 --2- 172.21.15.125:0/1608256786 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f085c065740 0x7f085c067c00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f08680098b0 tx=0x7f0868008030 comp rx=0 tx=0).stop 2023-10-17T06:08:32.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.522+0000 7f087e0b8700 1 -- 172.21.15.125:0/1608256786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08780b5ae0 msgr2=0x7f08780ade40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:32.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.522+0000 7f087e0b8700 1 --2- 172.21.15.125:0/1608256786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08780b5ae0 0x7f08780ade40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f087400c4a0 tx=0x7f087400c7b0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.522+0000 7f087e0b8700 1 -- 172.21.15.125:0/1608256786 shutdown_connections 2023-10-17T06:08:32.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.522+0000 7f087e0b8700 1 --2- 172.21.15.125:0/1608256786 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f085c065740 0x7f085c067c00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.522+0000 7f087e0b8700 1 --2- 172.21.15.125:0/1608256786 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0878160710 0x7f08780b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.522+0000 7f087e0b8700 1 --2- 172.21.15.125:0/1608256786 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08780d2e00 0x7f0878158230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.522+0000 7f087e0b8700 1 --2- 172.21.15.125:0/1608256786 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08780b5ae0 0x7f08780ade40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.522+0000 7f087e0b8700 1 -- 172.21.15.125:0/1608256786 >> 172.21.15.125:0/1608256786 conn(0x7f0878069f20 msgr2=0x7f08780b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:32.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.522+0000 7f087e0b8700 1 -- 172.21.15.125:0/1608256786 shutdown_connections 2023-10-17T06:08:32.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.522+0000 7f087e0b8700 1 -- 172.21.15.125:0/1608256786 wait complete. 2023-10-17T06:08:32.549 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-17T06:08:32.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.730+0000 7f00c2c7d700 1 Processor -- start 2023-10-17T06:08:32.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.730+0000 7f00c2c7d700 1 -- start start 2023-10-17T06:08:32.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c2c7d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f00bc160710 0x7f00bc0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:32.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c2c7d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc0b5ae0 0x7f00bc06db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:32.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c2c7d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00bc15d0d0 con 0x7f00bc0d2e00 2023-10-17T06:08:32.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c2c7d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00bc15df90 con 0x7f00bc160710 2023-10-17T06:08:32.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c2c7d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc06f0f0 con 0x7f00bc0b5ae0 2023-10-17T06:08:32.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c1c7b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f00bc0d2e00 0x7f00bc0d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:55480/0 (socket says 172.21.15.125:55480) 2023-10-17T06:08:32.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c1c7b700 1 -- 172.21.15.125:0/1716086016 learned_addr learned my addr 172.21.15.125:0/1716086016 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:32.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c147a700 1 --2- 172.21.15.125:0/1716086016 >> v2:172.21.15.184:3300/0 conn(0x7f00bc160710 0x7f00bc0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:32.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c247c700 1 --2- 172.21.15.125:0/1716086016 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc0b5ae0 0x7f00bc06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:32.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c0c79700 1 -- 172.21.15.125:0/1716086016 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875220197 0 0) 0x7f00b8001110 con 0x7f00bc0d2e00 2023-10-17T06:08:32.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c0c79700 1 -- 172.21.15.125:0/1716086016 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00a80035d0 con 0x7f00bc0d2e00 2023-10-17T06:08:32.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c0c79700 1 -- 172.21.15.125:0/1716086016 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 490302261 0 0) 0x7f00a80035d0 con 0x7f00bc0d2e00 2023-10-17T06:08:32.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c0c79700 1 -- 172.21.15.125:0/1716086016 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc0b5ae0 msgr2=0x7f00bc06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:32.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c0c79700 1 --2- 172.21.15.125:0/1716086016 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc0b5ae0 0x7f00bc06db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c0c79700 1 -- 172.21.15.125:0/1716086016 >> v2:172.21.15.184:3300/0 conn(0x7f00bc160710 msgr2=0x7f00bc0b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:32.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c0c79700 1 --2- 172.21.15.125:0/1716086016 >> v2:172.21.15.184:3300/0 conn(0x7f00bc160710 0x7f00bc0b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c0c79700 1 -- 172.21.15.125:0/1716086016 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00bc15d310 con 0x7f00bc0d2e00 2023-10-17T06:08:32.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c0c79700 1 -- 172.21.15.125:0/1716086016 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7f00b8001800 con 0x7f00bc0d2e00 2023-10-17T06:08:32.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c0c79700 1 -- 172.21.15.125:0/1716086016 >> v1:172.21.15.125:6789/0 conn(0x7f00bc0d2e00 legacy=0x7f00bc0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:32.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c0c79700 1 --2- 172.21.15.125:0/1716086016 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a8003a90 0x7f00a8003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:32.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c0c79700 1 --2- 172.21.15.125:0/1716086016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00a8004870 0x7f00a8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:32.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.734+0000 7f00c0c79700 1 --2- 172.21.15.125:0/1716086016 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc0b5ae0 0x7f00a8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:32.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c0c79700 1 -- 172.21.15.125:0/1716086016 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc15df90 con 0x7f00a8003a90 2023-10-17T06:08:32.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c0c79700 1 -- 172.21.15.125:0/1716086016 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc06f0f0 con 0x7f00a8004870 2023-10-17T06:08:32.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c0c79700 1 -- 172.21.15.125:0/1716086016 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a800ba30 con 0x7f00bc0b5ae0 2023-10-17T06:08:32.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c147a700 1 --2- 172.21.15.125:0/1716086016 >> v2:172.21.15.184:3300/0 conn(0x7f00bc160710 0x7f00bc0b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:08:32.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c1c7b700 1 --2- 172.21.15.125:0/1716086016 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a8003a90 0x7f00a8003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:32.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c247c700 1 --2- 172.21.15.125:0/1716086016 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc0b5ae0 0x7f00a8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:32.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c147a700 1 --2- 172.21.15.125:0/1716086016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00a8004870 0x7f00a8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:32.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c1c7b700 1 -- 172.21.15.125:0/1716086016 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc0b5ae0 msgr2=0x7f00a8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:32.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c1c7b700 1 --2- 172.21.15.125:0/1716086016 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc0b5ae0 0x7f00a8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c1c7b700 1 -- 172.21.15.125:0/1716086016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00a8004870 msgr2=0x7f00a8004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:32.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c1c7b700 1 --2- 172.21.15.125:0/1716086016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00a8004870 0x7f00a8004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c1c7b700 1 -- 172.21.15.125:0/1716086016 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a80035d0 con 0x7f00a8003a90 2023-10-17T06:08:32.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c1c7b700 1 --2- 172.21.15.125:0/1716086016 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a8003a90 0x7f00a8003eb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f00b800c320 tx=0x7f00a80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c800804e11d05e30 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:32.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c0c79700 1 -- 172.21.15.125:0/1716086016 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b800ce20 con 0x7f00a8003a90 2023-10-17T06:08:32.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c0c79700 1 -- 172.21.15.125:0/1716086016 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b8005980 con 0x7f00a8003a90 2023-10-17T06:08:32.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c0c79700 1 -- 172.21.15.125:0/1716086016 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b8005d30 con 0x7f00a8003a90 2023-10-17T06:08:32.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c2c7d700 1 -- 172.21.15.125:0/1716086016 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a8003a90 msgr2=0x7f00a8003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:32.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c2c7d700 1 --2- 172.21.15.125:0/1716086016 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a8003a90 0x7f00a8003eb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f00b800c320 tx=0x7f00a80058a0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c247c700 1 -- 172.21.15.125:0/1716086016 reap_dead start 2023-10-17T06:08:32.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c2c7d700 1 -- 172.21.15.125:0/1716086016 shutdown_connections 2023-10-17T06:08:32.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c2c7d700 1 -- 172.21.15.125:0/1716086016 >> 172.21.15.125:0/1716086016 conn(0x7f00bc069f20 msgr2=0x7f00bc06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:32.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c2c7d700 1 -- 172.21.15.125:0/1716086016 shutdown_connections 2023-10-17T06:08:32.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.738+0000 7f00c2c7d700 1 -- 172.21.15.125:0/1716086016 wait complete. 2023-10-17T06:08:32.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.742+0000 7f00c2c7d700 1 Processor -- start 2023-10-17T06:08:32.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.742+0000 7f00c2c7d700 1 -- start start 2023-10-17T06:08:32.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c2c7d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a8003a90 0x7f00bc1f2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:32.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c2c7d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc14a050 0x7f00bc0ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:32.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c2c7d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00bc14d540 0x7f00bc14d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:32.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c2c7d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc14b1d0 con 0x7f00a8003a90 2023-10-17T06:08:32.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c2c7d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc1f2840 con 0x7f00bc14d540 2023-10-17T06:08:32.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c2c7d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc14a550 con 0x7f00bc14a050 2023-10-17T06:08:32.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c1c7b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a8003a90 0x7f00bc1f2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:32.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c1c7b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a8003a90 0x7f00bc1f2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35786/0 (socket says 172.21.15.125:35786) 2023-10-17T06:08:32.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c1c7b700 1 -- 172.21.15.125:0/1026535252 learned_addr learned my addr 172.21.15.125:0/1026535252 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:32.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c147a700 1 --2- 172.21.15.125:0/1026535252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc14a050 0x7f00bc0ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:32.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c1c7b700 1 -- 172.21.15.125:0/1026535252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc14a050 msgr2=0x7f00bc0ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:32.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c1c7b700 1 --2- 172.21.15.125:0/1026535252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc14a050 0x7f00bc0ad4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c247c700 1 --2- 172.21.15.125:0/1026535252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00bc14d540 0x7f00bc14d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:32.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c1c7b700 1 -- 172.21.15.125:0/1026535252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00bc14d540 msgr2=0x7f00bc14d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:32.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c1c7b700 1 --2- 172.21.15.125:0/1026535252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00bc14d540 0x7f00bc14d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c1c7b700 1 -- 172.21.15.125:0/1026535252 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00bc14a830 con 0x7f00a8003a90 2023-10-17T06:08:32.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c147a700 1 --2- 172.21.15.125:0/1026535252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc14a050 0x7f00bc0ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:32.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c1c7b700 1 --2- 172.21.15.125:0/1026535252 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a8003a90 0x7f00bc1f2300 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f00a8004760 tx=0x7f00b8001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:32.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00b27fc700 1 -- 172.21.15.125:0/1026535252 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b8004890 con 0x7f00a8003a90 2023-10-17T06:08:32.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00b27fc700 1 -- 172.21.15.125:0/1026535252 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b80049f0 con 0x7f00a8003a90 2023-10-17T06:08:32.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c2c7d700 1 -- 172.21.15.125:0/1026535252 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00bc14ab10 con 0x7f00a8003a90 2023-10-17T06:08:32.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00b27fc700 1 -- 172.21.15.125:0/1026535252 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b8004da0 con 0x7f00a8003a90 2023-10-17T06:08:32.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c2c7d700 1 -- 172.21.15.125:0/1026535252 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00bc0ada10 con 0x7f00a8003a90 2023-10-17T06:08:32.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.746+0000 7f00c2c7d700 1 -- 172.21.15.125:0/1026535252 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00bc04e910 con 0x7f00a8003a90 2023-10-17T06:08:32.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.750+0000 7f00b27fc700 1 -- 172.21.15.125:0/1026535252 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f00b8005040 con 0x7f00a8003a90 2023-10-17T06:08:32.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.750+0000 7f00b27fc700 1 --2- 172.21.15.125:0/1026535252 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f00a00656f0 0x7f00a0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:32.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.750+0000 7f00b27fc700 1 -- 172.21.15.125:0/1026535252 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f00b80843a0 con 0x7f00a8003a90 2023-10-17T06:08:32.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.750+0000 7f00c147a700 1 --2- 172.21.15.125:0/1026535252 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f00a00656f0 0x7f00a0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:32.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.754+0000 7f00c147a700 1 --2- 172.21.15.125:0/1026535252 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f00a00656f0 0x7f00a0067bb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f00bc0cf270 tx=0x7f00ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:32.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.758+0000 7f00b27fc700 1 -- 172.21.15.125:0/1026535252 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f00b8051c40 con 0x7f00a8003a90 2023-10-17T06:08:32.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.934+0000 7f00c2c7d700 1 -- 172.21.15.125:0/1026535252 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f00bc15d0d0 con 0x7f00a8003a90 2023-10-17T06:08:32.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.934+0000 7f00b27fc700 1 -- 172.21.15.125:0/1026535252 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f00bc15d0d0 con 0x7f00a8003a90 2023-10-17T06:08:32.941 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:32.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.938+0000 7f00c2c7d700 1 -- 172.21.15.125:0/1026535252 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f00a00656f0 msgr2=0x7f00a0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:32.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.938+0000 7f00c2c7d700 1 --2- 172.21.15.125:0/1026535252 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f00a00656f0 0x7f00a0067bb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f00bc0cf270 tx=0x7f00ac008040 comp rx=0 tx=0).stop 2023-10-17T06:08:32.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.938+0000 7f00c2c7d700 1 -- 172.21.15.125:0/1026535252 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a8003a90 msgr2=0x7f00bc1f2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:32.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.938+0000 7f00c2c7d700 1 --2- 172.21.15.125:0/1026535252 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a8003a90 0x7f00bc1f2300 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f00a8004760 tx=0x7f00b8001b90 comp rx=0 tx=0).stop 2023-10-17T06:08:32.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.942+0000 7f00c2c7d700 1 -- 172.21.15.125:0/1026535252 shutdown_connections 2023-10-17T06:08:32.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.942+0000 7f00c2c7d700 1 --2- 172.21.15.125:0/1026535252 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f00a00656f0 0x7f00a0067bb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.942+0000 7f00c2c7d700 1 --2- 172.21.15.125:0/1026535252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00bc14d540 0x7f00bc14d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.942+0000 7f00c2c7d700 1 --2- 172.21.15.125:0/1026535252 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00bc14a050 0x7f00bc0ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.942+0000 7f00c2c7d700 1 --2- 172.21.15.125:0/1026535252 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00a8003a90 0x7f00bc1f2300 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:32.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.942+0000 7f00c2c7d700 1 -- 172.21.15.125:0/1026535252 >> 172.21.15.125:0/1026535252 conn(0x7f00bc069f20 msgr2=0x7f00bc15c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:32.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.942+0000 7f00c2c7d700 1 -- 172.21.15.125:0/1026535252 shutdown_connections 2023-10-17T06:08:32.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:32.942+0000 7f00c2c7d700 1 -- 172.21.15.125:0/1026535252 wait complete. 2023-10-17T06:08:32.967 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-17T06:08:33.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.142+0000 7f463f534700 1 Processor -- start 2023-10-17T06:08:33.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.142+0000 7f463f534700 1 -- start start 2023-10-17T06:08:33.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.146+0000 7f463f534700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f46380aeaf0 0x7f46380ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:33.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.146+0000 7f463f534700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4638164d50 0x7f46381651e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:33.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.146+0000 7f463f534700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4638070b60 con 0x7f46380aeed0 2023-10-17T06:08:33.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.146+0000 7f463f534700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46380cba10 con 0x7f46380aeaf0 2023-10-17T06:08:33.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.146+0000 7f463f534700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4638165720 con 0x7f4638164d50 2023-10-17T06:08:33.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.146+0000 7f463dad1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4638164d50 0x7f46381651e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:33.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.146+0000 7f463dad1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4638164d50 0x7f46381651e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:54258/0 (socket says 172.21.15.125:54258) 2023-10-17T06:08:33.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.146+0000 7f463dad1700 1 -- 172.21.15.125:0/119899890 learned_addr learned my addr 172.21.15.125:0/119899890 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:33.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.146+0000 7f463d2d0700 1 --2- 172.21.15.125:0/119899890 >> v2:172.21.15.184:3300/0 conn(0x7f46380aeaf0 0x7f46380ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:33.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.146+0000 7f463dad1700 1 -- 172.21.15.125:0/119899890 >> v2:172.21.15.184:3300/0 conn(0x7f46380aeaf0 msgr2=0x7f46380ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:33.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.146+0000 7f463dad1700 1 --2- 172.21.15.125:0/119899890 >> v2:172.21.15.184:3300/0 conn(0x7f46380aeaf0 0x7f46380ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.146+0000 7f463dad1700 1 -- 172.21.15.125:0/119899890 >> v1:172.21.15.184:6789/0 conn(0x7f46380aeed0 legacy=0x7f46380caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:33.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.146+0000 7f463dad1700 1 -- 172.21.15.125:0/119899890 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46380c3000 con 0x7f4638164d50 2023-10-17T06:08:33.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.146+0000 7f463dad1700 1 --2- 172.21.15.125:0/119899890 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4638164d50 0x7f46381651e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4630009e50 tx=0x7f463000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9651075d6a335f42 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:33.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.150+0000 7f462ffff700 1 -- 172.21.15.125:0/119899890 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463000e070 con 0x7f4638164d50 2023-10-17T06:08:33.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.150+0000 7f462ffff700 1 -- 172.21.15.125:0/119899890 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463000b910 con 0x7f4638164d50 2023-10-17T06:08:33.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.150+0000 7f462ffff700 1 -- 172.21.15.125:0/119899890 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463000bcc0 con 0x7f4638164d50 2023-10-17T06:08:33.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.150+0000 7f463f534700 1 -- 172.21.15.125:0/119899890 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4638164d50 msgr2=0x7f46381651e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:33.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.150+0000 7f463f534700 1 --2- 172.21.15.125:0/119899890 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4638164d50 0x7f46381651e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4630009e50 tx=0x7f463000b330 comp rx=0 tx=0).stop 2023-10-17T06:08:33.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.150+0000 7f463f534700 1 -- 172.21.15.125:0/119899890 shutdown_connections 2023-10-17T06:08:33.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.150+0000 7f463f534700 1 --2- 172.21.15.125:0/119899890 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4638164d50 0x7f46381651e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.150+0000 7f463f534700 1 --2- 172.21.15.125:0/119899890 >> v2:172.21.15.184:3300/0 conn(0x7f46380aeaf0 0x7f46380ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.150+0000 7f463f534700 1 -- 172.21.15.125:0/119899890 >> 172.21.15.125:0/119899890 conn(0x7f463806a220 msgr2=0x7f463806a600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:33.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.150+0000 7f463f534700 1 -- 172.21.15.125:0/119899890 shutdown_connections 2023-10-17T06:08:33.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.150+0000 7f463f534700 1 -- 172.21.15.125:0/119899890 wait complete. 2023-10-17T06:08:33.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.154+0000 7f463f534700 1 Processor -- start 2023-10-17T06:08:33.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.154+0000 7f463f534700 1 -- start start 2023-10-17T06:08:33.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.154+0000 7f463f534700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46380aeaf0 0x7f46380c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:33.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.154+0000 7f463f534700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46380aeed0 0x7f46380c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:33.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.154+0000 7f463f534700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4638164d50 0x7f46381ec4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:33.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.154+0000 7f463f534700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46380c88b0 con 0x7f46380aeaf0 2023-10-17T06:08:33.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.154+0000 7f463f534700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46380c8d40 con 0x7f46380aeed0 2023-10-17T06:08:33.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.154+0000 7f463f534700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46380c7ca0 con 0x7f4638164d50 2023-10-17T06:08:33.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.154+0000 7f463d2d0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46380aeaf0 0x7f46380c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:33.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.154+0000 7f463d2d0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46380aeaf0 0x7f46380c9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35794/0 (socket says 172.21.15.125:35794) 2023-10-17T06:08:33.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.154+0000 7f463d2d0700 1 -- 172.21.15.125:0/3228502002 learned_addr learned my addr 172.21.15.125:0/3228502002 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:33.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.158+0000 7f463dad1700 1 --2- 172.21.15.125:0/3228502002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4638164d50 0x7f46381ec4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:33.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.158+0000 7f463cacf700 1 --2- 172.21.15.125:0/3228502002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46380aeed0 0x7f46380c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:33.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.158+0000 7f463d2d0700 1 -- 172.21.15.125:0/3228502002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4638164d50 msgr2=0x7f46381ec4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:33.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.158+0000 7f463d2d0700 1 --2- 172.21.15.125:0/3228502002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4638164d50 0x7f46381ec4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.158+0000 7f463d2d0700 1 -- 172.21.15.125:0/3228502002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46380aeed0 msgr2=0x7f46380c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:33.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.158+0000 7f463d2d0700 1 --2- 172.21.15.125:0/3228502002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46380aeed0 0x7f46380c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.158+0000 7f463d2d0700 1 -- 172.21.15.125:0/3228502002 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4630009b30 con 0x7f46380aeaf0 2023-10-17T06:08:33.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.158+0000 7f463d2d0700 1 --2- 172.21.15.125:0/3228502002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46380aeaf0 0x7f46380c9490 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f463400e9d0 tx=0x7f463400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:33.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.158+0000 7f462dffb700 1 -- 172.21.15.125:0/3228502002 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634009720 con 0x7f46380aeaf0 2023-10-17T06:08:33.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.158+0000 7f462dffb700 1 -- 172.21.15.125:0/3228502002 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463400c850 con 0x7f46380aeaf0 2023-10-17T06:08:33.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.158+0000 7f463f534700 1 -- 172.21.15.125:0/3228502002 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46380c7f80 con 0x7f46380aeaf0 2023-10-17T06:08:33.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.158+0000 7f462dffb700 1 -- 172.21.15.125:0/3228502002 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463400cbc0 con 0x7f46380aeaf0 2023-10-17T06:08:33.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.158+0000 7f463f534700 1 -- 172.21.15.125:0/3228502002 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46380c8540 con 0x7f46380aeaf0 2023-10-17T06:08:33.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.158+0000 7f463f534700 1 -- 172.21.15.125:0/3228502002 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4638072e60 con 0x7f46380aeaf0 2023-10-17T06:08:33.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.162+0000 7f462dffb700 1 -- 172.21.15.125:0/3228502002 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f463400cd20 con 0x7f46380aeaf0 2023-10-17T06:08:33.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.162+0000 7f462dffb700 1 --2- 172.21.15.125:0/3228502002 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f461c0656f0 0x7f461c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:33.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.162+0000 7f462dffb700 1 -- 172.21.15.125:0/3228502002 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f46340832a0 con 0x7f46380aeaf0 2023-10-17T06:08:33.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.162+0000 7f463cacf700 1 --2- 172.21.15.125:0/3228502002 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f461c0656f0 0x7f461c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:33.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.162+0000 7f463cacf700 1 --2- 172.21.15.125:0/3228502002 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f461c0656f0 0x7f461c067bb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f46381642b0 tx=0x7f4628009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:33.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.170+0000 7f462dffb700 1 -- 172.21.15.125:0/3228502002 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f46340544c0 con 0x7f46380aeaf0 2023-10-17T06:08:33.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.346+0000 7f463f534700 1 -- 172.21.15.125:0/3228502002 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f46380b5880 con 0x7f46380aeaf0 2023-10-17T06:08:33.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.346+0000 7f462dffb700 1 -- 172.21.15.125:0/3228502002 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4634054050 con 0x7f46380aeaf0 2023-10-17T06:08:33.352 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-17T06:08:33.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.350+0000 7f463f534700 1 -- 172.21.15.125:0/3228502002 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f461c0656f0 msgr2=0x7f461c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:33.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.350+0000 7f463f534700 1 --2- 172.21.15.125:0/3228502002 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f461c0656f0 0x7f461c067bb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f46381642b0 tx=0x7f4628009040 comp rx=0 tx=0).stop 2023-10-17T06:08:33.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.350+0000 7f463f534700 1 -- 172.21.15.125:0/3228502002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46380aeaf0 msgr2=0x7f46380c9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:33.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.350+0000 7f463f534700 1 --2- 172.21.15.125:0/3228502002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46380aeaf0 0x7f46380c9490 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f463400e9d0 tx=0x7f463400ed90 comp rx=0 tx=0).stop 2023-10-17T06:08:33.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.350+0000 7f463f534700 1 -- 172.21.15.125:0/3228502002 shutdown_connections 2023-10-17T06:08:33.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.350+0000 7f463f534700 1 --2- 172.21.15.125:0/3228502002 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f461c0656f0 0x7f461c067bb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.350+0000 7f463f534700 1 --2- 172.21.15.125:0/3228502002 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4638164d50 0x7f46381ec4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.350+0000 7f463f534700 1 --2- 172.21.15.125:0/3228502002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46380aeed0 0x7f46380c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.350+0000 7f463f534700 1 --2- 172.21.15.125:0/3228502002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46380aeaf0 0x7f46380c9490 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.350+0000 7f463f534700 1 -- 172.21.15.125:0/3228502002 >> 172.21.15.125:0/3228502002 conn(0x7f463806a220 msgr2=0x7f4638160570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:33.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.350+0000 7f463f534700 1 -- 172.21.15.125:0/3228502002 shutdown_connections 2023-10-17T06:08:33.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.350+0000 7f463f534700 1 -- 172.21.15.125:0/3228502002 wait complete. 2023-10-17T06:08:33.376 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-17T06:08:33.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.554+0000 7fdf0d8d6700 1 Processor -- start 2023-10-17T06:08:33.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.554+0000 7fdf0d8d6700 1 -- start start 2023-10-17T06:08:33.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.558+0000 7fdf0d8d6700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdf080d2610 0x7fdf0806e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:33.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.558+0000 7fdf0d8d6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdf0815e7d0 0x7fdf080d2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:33.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.558+0000 7fdf0d8d6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf080d29f0 con 0x7fdf080b1e60 2023-10-17T06:08:33.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.558+0000 7fdf0d8d6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf080b64b0 con 0x7fdf0815e7d0 2023-10-17T06:08:33.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.558+0000 7fdf0d8d6700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf080b6750 con 0x7fdf080d2610 2023-10-17T06:08:33.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.558+0000 7fdf067fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdf0815e7d0 0x7fdf080d2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:33.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.558+0000 7fdf067fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdf0815e7d0 0x7fdf080d2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48520/0 (socket says 172.21.15.125:48520) 2023-10-17T06:08:33.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.558+0000 7fdf067fc700 1 -- 172.21.15.125:0/1414222695 learned_addr learned my addr 172.21.15.125:0/1414222695 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:33.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.558+0000 7fdf077fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdf080b1e60 0x7fdf0806f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58934/0 (socket says 172.21.15.125:58934) 2023-10-17T06:08:33.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.558+0000 7fdf06ffd700 1 --2- 172.21.15.125:0/1414222695 >> v2:172.21.15.184:3300/0 conn(0x7fdf080d2610 0x7fdf0806e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:33.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.562+0000 7fdf067fc700 1 -- 172.21.15.125:0/1414222695 >> v2:172.21.15.184:3300/0 conn(0x7fdf080d2610 msgr2=0x7fdf0806e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:33.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.562+0000 7fdf067fc700 1 --2- 172.21.15.125:0/1414222695 >> v2:172.21.15.184:3300/0 conn(0x7fdf080d2610 0x7fdf0806e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.562+0000 7fdf067fc700 1 -- 172.21.15.125:0/1414222695 >> v1:172.21.15.125:6789/0 conn(0x7fdf080b1e60 legacy=0x7fdf0806f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:33.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.562+0000 7fdf067fc700 1 -- 172.21.15.125:0/1414222695 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf080b6a30 con 0x7fdf0815e7d0 2023-10-17T06:08:33.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.562+0000 7fdf05ffb700 1 -- 172.21.15.125:0/1414222695 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968851617 0 0) 0x7fdf080d29f0 con 0x7fdf080b1e60 2023-10-17T06:08:33.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.562+0000 7fdf06ffd700 1 --2- 172.21.15.125:0/1414222695 >> v2:172.21.15.184:3300/0 conn(0x7fdf080d2610 0x7fdf0806e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:33.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.562+0000 7fdf067fc700 1 --2- 172.21.15.125:0/1414222695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf0815e7d0 0x7fdf080d2fa0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdf0806dce0 tx=0x7fdefc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7962dad4ac900554 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:33.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.562+0000 7fdf05ffb700 1 -- 172.21.15.125:0/1414222695 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc00b8a0 con 0x7fdf0815e7d0 2023-10-17T06:08:33.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.562+0000 7fdf05ffb700 1 -- 172.21.15.125:0/1414222695 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc00ba00 con 0x7fdf0815e7d0 2023-10-17T06:08:33.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.562+0000 7fdf05ffb700 1 -- 172.21.15.125:0/1414222695 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc00bd90 con 0x7fdf0815e7d0 2023-10-17T06:08:33.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.562+0000 7fdf0d8d6700 1 -- 172.21.15.125:0/1414222695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf0815e7d0 msgr2=0x7fdf080d2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:33.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.562+0000 7fdf0d8d6700 1 --2- 172.21.15.125:0/1414222695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf0815e7d0 0x7fdf080d2fa0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdf0806dce0 tx=0x7fdefc009bf0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.562+0000 7fdf0d8d6700 1 -- 172.21.15.125:0/1414222695 shutdown_connections 2023-10-17T06:08:33.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.562+0000 7fdf0d8d6700 1 --2- 172.21.15.125:0/1414222695 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf0815e7d0 0x7fdf080d2fa0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.562+0000 7fdf0d8d6700 1 --2- 172.21.15.125:0/1414222695 >> v2:172.21.15.184:3300/0 conn(0x7fdf080d2610 0x7fdf0806e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.562+0000 7fdf0d8d6700 1 -- 172.21.15.125:0/1414222695 >> 172.21.15.125:0/1414222695 conn(0x7fdf08069f20 msgr2=0x7fdf0806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:33.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.562+0000 7fdf0d8d6700 1 -- 172.21.15.125:0/1414222695 shutdown_connections 2023-10-17T06:08:33.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.562+0000 7fdf0d8d6700 1 -- 172.21.15.125:0/1414222695 wait complete. 2023-10-17T06:08:33.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf0d8d6700 1 Processor -- start 2023-10-17T06:08:33.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf0d8d6700 1 -- start start 2023-10-17T06:08:33.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf0d8d6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf080b1e60 0x7fdf08153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:33.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf0d8d6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf080d2610 0x7fdf08155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:33.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf0d8d6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf0815e7d0 0x7fdf080d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:33.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf0d8d6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf08157d00 con 0x7fdf0815e7d0 2023-10-17T06:08:33.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf0d8d6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf08157f80 con 0x7fdf080b1e60 2023-10-17T06:08:33.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf0d8d6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf08158260 con 0x7fdf080d2610 2023-10-17T06:08:33.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf077fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf0815e7d0 0x7fdf080d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:33.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf077fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf0815e7d0 0x7fdf080d0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48524/0 (socket says 172.21.15.125:48524) 2023-10-17T06:08:33.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf077fe700 1 -- 172.21.15.125:0/3716837020 learned_addr learned my addr 172.21.15.125:0/3716837020 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:33.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf06ffd700 1 --2- 172.21.15.125:0/3716837020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf080b1e60 0x7fdf08153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:33.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf067fc700 1 --2- 172.21.15.125:0/3716837020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf080d2610 0x7fdf08155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:33.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf077fe700 1 -- 172.21.15.125:0/3716837020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf080d2610 msgr2=0x7fdf08155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:33.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf077fe700 1 --2- 172.21.15.125:0/3716837020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf080d2610 0x7fdf08155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf077fe700 1 -- 172.21.15.125:0/3716837020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf080b1e60 msgr2=0x7fdf08153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:33.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf077fe700 1 --2- 172.21.15.125:0/3716837020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf080b1e60 0x7fdf08153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf077fe700 1 -- 172.21.15.125:0/3716837020 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc009570 con 0x7fdf0815e7d0 2023-10-17T06:08:33.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf067fc700 1 --2- 172.21.15.125:0/3716837020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf080d2610 0x7fdf08155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:33.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf077fe700 1 --2- 172.21.15.125:0/3716837020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf0815e7d0 0x7fdf080d0f40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdf0000cca0 tx=0x7fdf0000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:33.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdeeffff700 1 -- 172.21.15.125:0/3716837020 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0000cea0 con 0x7fdf0815e7d0 2023-10-17T06:08:33.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdeeffff700 1 -- 172.21.15.125:0/3716837020 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0000ade0 con 0x7fdf0815e7d0 2023-10-17T06:08:33.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf0d8d6700 1 -- 172.21.15.125:0/3716837020 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf08158540 con 0x7fdf0815e7d0 2023-10-17T06:08:33.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdeeffff700 1 -- 172.21.15.125:0/3716837020 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00007310 con 0x7fdf0815e7d0 2023-10-17T06:08:33.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.566+0000 7fdf0d8d6700 1 -- 172.21.15.125:0/3716837020 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf08153a60 con 0x7fdf0815e7d0 2023-10-17T06:08:33.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.570+0000 7fdf0d8d6700 1 -- 172.21.15.125:0/3716837020 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf08072e60 con 0x7fdf0815e7d0 2023-10-17T06:08:33.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.570+0000 7fdeeffff700 1 -- 172.21.15.125:0/3716837020 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fdf00007470 con 0x7fdf0815e7d0 2023-10-17T06:08:33.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.574+0000 7fdeeffff700 1 --2- 172.21.15.125:0/3716837020 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdef4065720 0x7fdef4067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:33.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.574+0000 7fdeeffff700 1 -- 172.21.15.125:0/3716837020 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdf00083080 con 0x7fdf0815e7d0 2023-10-17T06:08:33.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.574+0000 7fdf06ffd700 1 --2- 172.21.15.125:0/3716837020 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdef4065720 0x7fdef4067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:33.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.574+0000 7fdf06ffd700 1 --2- 172.21.15.125:0/3716837020 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdef4065720 0x7fdef4067be0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdef8003780 tx=0x7fdef8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:33.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.578+0000 7fdeeffff700 1 -- 172.21.15.125:0/3716837020 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fdf000b3d40 con 0x7fdf0815e7d0 2023-10-17T06:08:33.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.754+0000 7fdf0d8d6700 1 -- 172.21.15.125:0/3716837020 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdf080b5550 con 0x7fdf0815e7d0 2023-10-17T06:08:33.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.754+0000 7fdeeffff700 1 -- 172.21.15.125:0/3716837020 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdf000180a0 con 0x7fdf0815e7d0 2023-10-17T06:08:33.759 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:08:33.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.758+0000 7fdf0d8d6700 1 -- 172.21.15.125:0/3716837020 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdef4065720 msgr2=0x7fdef4067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:33.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.758+0000 7fdf0d8d6700 1 --2- 172.21.15.125:0/3716837020 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdef4065720 0x7fdef4067be0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdef8003780 tx=0x7fdef8008040 comp rx=0 tx=0).stop 2023-10-17T06:08:33.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.758+0000 7fdf0d8d6700 1 -- 172.21.15.125:0/3716837020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf0815e7d0 msgr2=0x7fdf080d0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:33.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.758+0000 7fdf0d8d6700 1 --2- 172.21.15.125:0/3716837020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf0815e7d0 0x7fdf080d0f40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdf0000cca0 tx=0x7fdf0000a340 comp rx=0 tx=0).stop 2023-10-17T06:08:33.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.758+0000 7fdf0d8d6700 1 -- 172.21.15.125:0/3716837020 shutdown_connections 2023-10-17T06:08:33.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.758+0000 7fdf0d8d6700 1 --2- 172.21.15.125:0/3716837020 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdef4065720 0x7fdef4067be0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.758+0000 7fdf0d8d6700 1 --2- 172.21.15.125:0/3716837020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdf0815e7d0 0x7fdf080d0f40 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.758+0000 7fdf0d8d6700 1 --2- 172.21.15.125:0/3716837020 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf080d2610 0x7fdf08155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.758+0000 7fdf0d8d6700 1 --2- 172.21.15.125:0/3716837020 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf080b1e60 0x7fdf08153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.758+0000 7fdf0d8d6700 1 -- 172.21.15.125:0/3716837020 >> 172.21.15.125:0/3716837020 conn(0x7fdf08069f20 msgr2=0x7fdf0815c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:33.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.758+0000 7fdf0d8d6700 1 -- 172.21.15.125:0/3716837020 shutdown_connections 2023-10-17T06:08:33.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.758+0000 7fdf0d8d6700 1 -- 172.21.15.125:0/3716837020 wait complete. 2023-10-17T06:08:33.785 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:08:33.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.950+0000 7ff5da853700 1 Processor -- start 2023-10-17T06:08:33.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.954+0000 7ff5da853700 1 -- start start 2023-10-17T06:08:33.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.954+0000 7ff5da853700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d406d470 0x7ff5d4070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:33.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.954+0000 7ff5da853700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d415e990 con 0x7ff5d4070f50 2023-10-17T06:08:33.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.954+0000 7ff5da853700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d415ec50 con 0x7ff5d406d090 2023-10-17T06:08:33.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.954+0000 7ff5da853700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d415f4f0 con 0x7ff5d406d470 2023-10-17T06:08:33.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.954+0000 7ff5da052700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff5d4070f50 0x7ff5d415a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58936/0 (socket says 172.21.15.125:58936) 2023-10-17T06:08:33.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.954+0000 7ff5da052700 1 -- 172.21.15.125:0/3367937796 learned_addr learned my addr 172.21.15.125:0/3367937796 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:33.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.954+0000 7ff5d9050700 1 --2- 172.21.15.125:0/3367937796 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d406d470 0x7ff5d4070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:33.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.954+0000 7ff5d884f700 1 -- 172.21.15.125:0/3367937796 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702555043 0 0) 0x7ff5d415e990 con 0x7ff5d4070f50 2023-10-17T06:08:33.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.954+0000 7ff5d884f700 1 -- 172.21.15.125:0/3367937796 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5c00035d0 con 0x7ff5d4070f50 2023-10-17T06:08:33.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.954+0000 7ff5d884f700 1 -- 172.21.15.125:0/3367937796 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494209381 0 0) 0x7ff5d415ec50 con 0x7ff5d406d090 2023-10-17T06:08:33.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.954+0000 7ff5d884f700 1 -- 172.21.15.125:0/3367937796 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5d415e990 con 0x7ff5d406d090 2023-10-17T06:08:33.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.958+0000 7ff5d884f700 1 -- 172.21.15.125:0/3367937796 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3548020171 0 0) 0x7ff5c00035d0 con 0x7ff5d4070f50 2023-10-17T06:08:33.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.958+0000 7ff5d9050700 1 -- 172.21.15.125:0/3367937796 >> v1:172.21.15.184:6789/0 conn(0x7ff5d406d090 legacy=0x7ff5d40b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:33.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.958+0000 7ff5d9050700 1 -- 172.21.15.125:0/3367937796 >> v1:172.21.15.125:6789/0 conn(0x7ff5d4070f50 legacy=0x7ff5d415a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:33.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.958+0000 7ff5d9050700 1 -- 172.21.15.125:0/3367937796 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d415ef30 con 0x7ff5d406d470 2023-10-17T06:08:33.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.958+0000 7ff5d9050700 1 --2- 172.21.15.125:0/3367937796 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d406d470 0x7ff5d4070a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009880 tx=0x7ff5c4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=722512e8f7666fae server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:33.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.958+0000 7ff5d884f700 1 -- 172.21.15.125:0/3367937796 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc001670 con 0x7ff5d406d470 2023-10-17T06:08:33.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.958+0000 7ff5d884f700 1 -- 172.21.15.125:0/3367937796 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c4004030 con 0x7ff5d406d470 2023-10-17T06:08:33.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.958+0000 7ff5d884f700 1 -- 172.21.15.125:0/3367937796 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40043c0 con 0x7ff5d406d470 2023-10-17T06:08:33.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.958+0000 7ff5da853700 1 -- 172.21.15.125:0/3367937796 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d406d470 msgr2=0x7ff5d4070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:33.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.958+0000 7ff5da853700 1 --2- 172.21.15.125:0/3367937796 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d406d470 0x7ff5d4070a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009880 tx=0x7ff5c4009b90 comp rx=0 tx=0).stop 2023-10-17T06:08:33.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.958+0000 7ff5da853700 1 -- 172.21.15.125:0/3367937796 shutdown_connections 2023-10-17T06:08:33.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.958+0000 7ff5da853700 1 --2- 172.21.15.125:0/3367937796 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d406d470 0x7ff5d4070a10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.958+0000 7ff5da853700 1 -- 172.21.15.125:0/3367937796 >> 172.21.15.125:0/3367937796 conn(0x7ff5d40ce5c0 msgr2=0x7ff5d40ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:33.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.958+0000 7ff5da853700 1 -- 172.21.15.125:0/3367937796 shutdown_connections 2023-10-17T06:08:33.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.958+0000 7ff5da853700 1 -- 172.21.15.125:0/3367937796 wait complete. 2023-10-17T06:08:33.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.962+0000 7ff5da853700 1 Processor -- start 2023-10-17T06:08:33.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.962+0000 7ff5da853700 1 -- start start 2023-10-17T06:08:33.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.962+0000 7ff5da853700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d406d090 0x7ff5d4149100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:33.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.962+0000 7ff5da853700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d406d470 0x7ff5d4159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:33.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.962+0000 7ff5da853700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5d4070f50 0x7ff5d4159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:33.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.962+0000 7ff5da853700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d41547b0 con 0x7ff5d4070f50 2023-10-17T06:08:33.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.962+0000 7ff5da853700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d4149640 con 0x7ff5d406d470 2023-10-17T06:08:33.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.962+0000 7ff5da853700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d415b700 con 0x7ff5d406d090 2023-10-17T06:08:33.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.962+0000 7ff5da052700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5d4070f50 0x7ff5d4159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:33.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.962+0000 7ff5da052700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5d4070f50 0x7ff5d4159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48532/0 (socket says 172.21.15.125:48532) 2023-10-17T06:08:33.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.962+0000 7ff5da052700 1 -- 172.21.15.125:0/1982893783 learned_addr learned my addr 172.21.15.125:0/1982893783 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:33.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.962+0000 7ff5d9050700 1 --2- 172.21.15.125:0/1982893783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d406d470 0x7ff5d4159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:33.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.962+0000 7ff5d9851700 1 --2- 172.21.15.125:0/1982893783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d406d090 0x7ff5d4149100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:33.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.962+0000 7ff5da052700 1 -- 172.21.15.125:0/1982893783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d406d090 msgr2=0x7ff5d4149100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:33.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.962+0000 7ff5da052700 1 --2- 172.21.15.125:0/1982893783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d406d090 0x7ff5d4149100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.962+0000 7ff5da052700 1 -- 172.21.15.125:0/1982893783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d406d470 msgr2=0x7ff5d4159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:33.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.962+0000 7ff5da052700 1 --2- 172.21.15.125:0/1982893783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d406d470 0x7ff5d4159590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:33.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.962+0000 7ff5da052700 1 -- 172.21.15.125:0/1982893783 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c40094b0 con 0x7ff5d4070f50 2023-10-17T06:08:33.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.962+0000 7ff5d9851700 1 --2- 172.21.15.125:0/1982893783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d406d090 0x7ff5d4149100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:33.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.966+0000 7ff5da052700 1 --2- 172.21.15.125:0/1982893783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5d4070f50 0x7ff5d4159ad0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0011e0 tx=0x7ff5cc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:33.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.966+0000 7ff5ca7fc700 1 -- 172.21.15.125:0/1982893783 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc004ca0 con 0x7ff5d4070f50 2023-10-17T06:08:33.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.966+0000 7ff5ca7fc700 1 -- 172.21.15.125:0/1982893783 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc004e00 con 0x7ff5d4070f50 2023-10-17T06:08:33.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.966+0000 7ff5ca7fc700 1 -- 172.21.15.125:0/1982893783 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc007310 con 0x7ff5d4070f50 2023-10-17T06:08:33.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.966+0000 7ff5da853700 1 -- 172.21.15.125:0/1982893783 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d40ccda0 con 0x7ff5d4070f50 2023-10-17T06:08:33.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.966+0000 7ff5da853700 1 -- 172.21.15.125:0/1982893783 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d415b390 con 0x7ff5d4070f50 2023-10-17T06:08:33.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.966+0000 7ff5da853700 1 -- 172.21.15.125:0/1982893783 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d40cd2c0 con 0x7ff5d4070f50 2023-10-17T06:08:33.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.966+0000 7ff5ca7fc700 1 -- 172.21.15.125:0/1982893783 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff5cc007470 con 0x7ff5d4070f50 2023-10-17T06:08:33.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.970+0000 7ff5ca7fc700 1 --2- 172.21.15.125:0/1982893783 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff5b80656f0 0x7ff5b8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:33.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.970+0000 7ff5ca7fc700 1 -- 172.21.15.125:0/1982893783 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff5cc082d80 con 0x7ff5d4070f50 2023-10-17T06:08:33.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.970+0000 7ff5d9851700 1 --2- 172.21.15.125:0/1982893783 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff5b80656f0 0x7ff5b8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:33.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.970+0000 7ff5d9851700 1 --2- 172.21.15.125:0/1982893783 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff5b80656f0 0x7ff5b8067bb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0001560 tx=0x7ff5d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:33.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:33.974+0000 7ff5ca7fc700 1 -- 172.21.15.125:0/1982893783 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff5d40cd2c0 con 0x7ff5d4070f50 2023-10-17T06:08:34.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.302+0000 7ff5da853700 1 -- 172.21.15.125:0/1982893783 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5d40cd2c0 con 0x7ff5d4070f50 2023-10-17T06:08:34.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.302+0000 7ff5ca7fc700 1 -- 172.21.15.125:0/1982893783 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7ff5d40cd2c0 con 0x7ff5d4070f50 2023-10-17T06:08:34.308 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:34.308 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/3744648044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3744648044},{"type":"v1","addr":"172.21.15.184:6833","nonce":3744648044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/181458401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181458401},{"type":"v1","addr":"172.21.15.184:6835","nonce":181458401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/908363262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":908363262},{"type":"v1","addr":"172.21.15.125:6835","nonce":908363262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:07:09.036610+0000","modified":"2023-10-17T06:07:35.578225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/3617198893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":3617198893},{"type":"v1","addr":"172.21.15.125:6837","nonce":3617198893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-17T06:08:34.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.310+0000 7ff5da853700 1 -- 172.21.15.125:0/1982893783 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff5b80656f0 msgr2=0x7ff5b8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:34.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.310+0000 7ff5da853700 1 --2- 172.21.15.125:0/1982893783 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff5b80656f0 0x7ff5b8067bb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0001560 tx=0x7ff5d0009040 comp rx=0 tx=0).stop 2023-10-17T06:08:34.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.310+0000 7ff5da853700 1 -- 172.21.15.125:0/1982893783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5d4070f50 msgr2=0x7ff5d4159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:34.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.310+0000 7ff5da853700 1 --2- 172.21.15.125:0/1982893783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5d4070f50 0x7ff5d4159ad0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0011e0 tx=0x7ff5cc00c800 comp rx=0 tx=0).stop 2023-10-17T06:08:34.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.310+0000 7ff5da853700 1 -- 172.21.15.125:0/1982893783 shutdown_connections 2023-10-17T06:08:34.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.310+0000 7ff5da853700 1 --2- 172.21.15.125:0/1982893783 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff5b80656f0 0x7ff5b8067bb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:34.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.310+0000 7ff5da853700 1 --2- 172.21.15.125:0/1982893783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff5d4070f50 0x7ff5d4159ad0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:34.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.310+0000 7ff5da853700 1 --2- 172.21.15.125:0/1982893783 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff5d406d470 0x7ff5d4159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:34.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.310+0000 7ff5da853700 1 --2- 172.21.15.125:0/1982893783 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff5d406d090 0x7ff5d4149100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:34.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.310+0000 7ff5da853700 1 -- 172.21.15.125:0/1982893783 >> 172.21.15.125:0/1982893783 conn(0x7ff5d40ce5c0 msgr2=0x7ff5d40c9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:34.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.310+0000 7ff5da853700 1 -- 172.21.15.125:0/1982893783 shutdown_connections 2023-10-17T06:08:34.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.310+0000 7ff5da853700 1 -- 172.21.15.125:0/1982893783 wait complete. 2023-10-17T06:08:34.316 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 9 2023-10-17T06:08:34.336 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:08:34.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.514+0000 7fc26d5af700 1 Processor -- start 2023-10-17T06:08:34.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.514+0000 7fc26d5af700 1 -- start start 2023-10-17T06:08:34.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.518+0000 7fc26d5af700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680d2e00 0x7fc2680b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:34.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.518+0000 7fc26d5af700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc2680b5ae0 0x7fc26806db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:34.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.518+0000 7fc26d5af700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26815d0d0 con 0x7fc268160710 2023-10-17T06:08:34.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.518+0000 7fc26d5af700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26815df90 con 0x7fc2680b5ae0 2023-10-17T06:08:34.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.518+0000 7fc26d5af700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26806f0f0 con 0x7fc2680d2e00 2023-10-17T06:08:34.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.518+0000 7fc26cdae700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc2680b5ae0 0x7fc26806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:34.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.518+0000 7fc25ffff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fc268160710 0x7fc2680d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:49776/0 (socket says 172.21.15.125:49776) 2023-10-17T06:08:34.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.518+0000 7fc25ffff700 1 -- 172.21.15.125:0/3865585517 learned_addr learned my addr 172.21.15.125:0/3865585517 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:34.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.518+0000 7fc267fff700 1 --2- 172.21.15.125:0/3865585517 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680d2e00 0x7fc2680b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:34.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.522+0000 7fc26cdae700 1 -- 172.21.15.125:0/3865585517 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680d2e00 msgr2=0x7fc2680b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:34.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.522+0000 7fc26cdae700 1 --2- 172.21.15.125:0/3865585517 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680d2e00 0x7fc2680b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:34.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.522+0000 7fc26cdae700 1 -- 172.21.15.125:0/3865585517 >> v1:172.21.15.184:6789/0 conn(0x7fc268160710 legacy=0x7fc2680d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:34.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.522+0000 7fc2677fe700 1 -- 172.21.15.125:0/3865585517 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113805859 0 0) 0x7fc250001110 con 0x7fc268160710 2023-10-17T06:08:34.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.522+0000 7fc26cdae700 1 -- 172.21.15.125:0/3865585517 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26815d310 con 0x7fc2680b5ae0 2023-10-17T06:08:34.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.522+0000 7fc26cdae700 1 --2- 172.21.15.125:0/3865585517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2680b5ae0 0x7fc26806db60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc260009dc0 tx=0x7fc26000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec613dda16c6339e server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:34.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.522+0000 7fc2677fe700 1 -- 172.21.15.125:0/3865585517 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26000e070 con 0x7fc2680b5ae0 2023-10-17T06:08:34.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.522+0000 7fc2677fe700 1 -- 172.21.15.125:0/3865585517 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26000bae0 con 0x7fc2680b5ae0 2023-10-17T06:08:34.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.522+0000 7fc2677fe700 1 -- 172.21.15.125:0/3865585517 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26000be90 con 0x7fc2680b5ae0 2023-10-17T06:08:34.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.522+0000 7fc26d5af700 1 -- 172.21.15.125:0/3865585517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2680b5ae0 msgr2=0x7fc26806db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:34.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.522+0000 7fc26d5af700 1 --2- 172.21.15.125:0/3865585517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2680b5ae0 0x7fc26806db60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc260009dc0 tx=0x7fc26000b330 comp rx=0 tx=0).stop 2023-10-17T06:08:34.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.522+0000 7fc26d5af700 1 -- 172.21.15.125:0/3865585517 shutdown_connections 2023-10-17T06:08:34.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.522+0000 7fc26d5af700 1 --2- 172.21.15.125:0/3865585517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2680b5ae0 0x7fc26806db60 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:34.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.522+0000 7fc26d5af700 1 --2- 172.21.15.125:0/3865585517 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680d2e00 0x7fc2680b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:34.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.522+0000 7fc26d5af700 1 -- 172.21.15.125:0/3865585517 >> 172.21.15.125:0/3865585517 conn(0x7fc268069f20 msgr2=0x7fc26806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:34.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.522+0000 7fc26d5af700 1 -- 172.21.15.125:0/3865585517 shutdown_connections 2023-10-17T06:08:34.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.522+0000 7fc26d5af700 1 -- 172.21.15.125:0/3865585517 wait complete. 2023-10-17T06:08:34.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.526+0000 7fc26d5af700 1 Processor -- start 2023-10-17T06:08:34.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.526+0000 7fc26d5af700 1 -- start start 2023-10-17T06:08:34.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.526+0000 7fc26d5af700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2680b5ae0 0x7fc2680ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:34.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.526+0000 7fc26d5af700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680d2e00 0x7fc2680acf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:34.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.526+0000 7fc26d5af700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc268160710 0x7fc2680b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:34.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.526+0000 7fc26d5af700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2680acb70 con 0x7fc2680b5ae0 2023-10-17T06:08:34.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.526+0000 7fc26d5af700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2680abef0 con 0x7fc268160710 2023-10-17T06:08:34.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.526+0000 7fc26d5af700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2680ac1d0 con 0x7fc2680d2e00 2023-10-17T06:08:34.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.526+0000 7fc267fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2680b5ae0 0x7fc2680ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:34.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.526+0000 7fc267fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2680b5ae0 0x7fc2680ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48546/0 (socket says 172.21.15.125:48546) 2023-10-17T06:08:34.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.526+0000 7fc267fff700 1 -- 172.21.15.125:0/570564070 learned_addr learned my addr 172.21.15.125:0/570564070 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:34.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.526+0000 7fc26cdae700 1 --2- 172.21.15.125:0/570564070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc268160710 0x7fc2680b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:34.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.526+0000 7fc25ffff700 1 --2- 172.21.15.125:0/570564070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680d2e00 0x7fc2680acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:34.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.526+0000 7fc267fff700 1 -- 172.21.15.125:0/570564070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680d2e00 msgr2=0x7fc2680acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:34.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.526+0000 7fc267fff700 1 --2- 172.21.15.125:0/570564070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680d2e00 0x7fc2680acf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:34.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.526+0000 7fc267fff700 1 -- 172.21.15.125:0/570564070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc268160710 msgr2=0x7fc2680b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:34.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.526+0000 7fc267fff700 1 --2- 172.21.15.125:0/570564070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc268160710 0x7fc2680b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:34.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.526+0000 7fc267fff700 1 -- 172.21.15.125:0/570564070 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc260009a70 con 0x7fc2680b5ae0 2023-10-17T06:08:34.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.526+0000 7fc267fff700 1 --2- 172.21.15.125:0/570564070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2680b5ae0 0x7fc2680ab8e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc25800e840 tx=0x7fc25800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:34.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.530+0000 7fc2657fa700 1 -- 172.21.15.125:0/570564070 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2580095a0 con 0x7fc2680b5ae0 2023-10-17T06:08:34.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.530+0000 7fc2657fa700 1 -- 172.21.15.125:0/570564070 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc258013680 con 0x7fc2680b5ae0 2023-10-17T06:08:34.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.530+0000 7fc26d5af700 1 -- 172.21.15.125:0/570564070 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2680ac4b0 con 0x7fc2680b5ae0 2023-10-17T06:08:34.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.530+0000 7fc2657fa700 1 -- 172.21.15.125:0/570564070 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2580139f0 con 0x7fc2680b5ae0 2023-10-17T06:08:34.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.530+0000 7fc26d5af700 1 -- 172.21.15.125:0/570564070 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2680b0b60 con 0x7fc2680b5ae0 2023-10-17T06:08:34.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.530+0000 7fc26d5af700 1 -- 172.21.15.125:0/570564070 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc268072e60 con 0x7fc2680b5ae0 2023-10-17T06:08:34.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.530+0000 7fc2657fa700 1 -- 172.21.15.125:0/570564070 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc258013b50 con 0x7fc2680b5ae0 2023-10-17T06:08:34.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.534+0000 7fc2657fa700 1 --2- 172.21.15.125:0/570564070 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc248065740 0x7fc248067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:34.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.534+0000 7fc2657fa700 1 -- 172.21.15.125:0/570564070 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc258082db0 con 0x7fc2680b5ae0 2023-10-17T06:08:34.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.534+0000 7fc25ffff700 1 --2- 172.21.15.125:0/570564070 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc248065740 0x7fc248067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:34.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.534+0000 7fc25ffff700 1 --2- 172.21.15.125:0/570564070 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc248065740 0x7fc248067c00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc26806d7b0 tx=0x7fc250007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:34.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.542+0000 7fc2657fa700 1 -- 172.21.15.125:0/570564070 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc258054140 con 0x7fc2680b5ae0 2023-10-17T06:08:34.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.718+0000 7fc26d5af700 1 -- 172.21.15.125:0/570564070 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc26806d3c0 con 0x7fc2680b5ae0 2023-10-17T06:08:34.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.722+0000 7fc2657fa700 1 -- 172.21.15.125:0/570564070 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20252 (secure 0 0 0) 0x7fc258017090 con 0x7fc2680b5ae0 2023-10-17T06:08:34.726 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:34.726 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":30,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:49.710984+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:08:34.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.726+0000 7fc26d5af700 1 -- 172.21.15.125:0/570564070 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc248065740 msgr2=0x7fc248067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:34.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.726+0000 7fc26d5af700 1 --2- 172.21.15.125:0/570564070 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc248065740 0x7fc248067c00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc26806d7b0 tx=0x7fc250007e90 comp rx=0 tx=0).stop 2023-10-17T06:08:34.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.726+0000 7fc26d5af700 1 -- 172.21.15.125:0/570564070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2680b5ae0 msgr2=0x7fc2680ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:34.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.726+0000 7fc26d5af700 1 --2- 172.21.15.125:0/570564070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2680b5ae0 0x7fc2680ab8e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc25800e840 tx=0x7fc25800eb50 comp rx=0 tx=0).stop 2023-10-17T06:08:34.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.726+0000 7fc26d5af700 1 -- 172.21.15.125:0/570564070 shutdown_connections 2023-10-17T06:08:34.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.726+0000 7fc26d5af700 1 --2- 172.21.15.125:0/570564070 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc248065740 0x7fc248067c00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:34.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.726+0000 7fc26d5af700 1 --2- 172.21.15.125:0/570564070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc268160710 0x7fc2680b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:34.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.726+0000 7fc26d5af700 1 --2- 172.21.15.125:0/570564070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc2680d2e00 0x7fc2680acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:34.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.726+0000 7fc26d5af700 1 --2- 172.21.15.125:0/570564070 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2680b5ae0 0x7fc2680ab8e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:34.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.726+0000 7fc26d5af700 1 -- 172.21.15.125:0/570564070 >> 172.21.15.125:0/570564070 conn(0x7fc268069f20 msgr2=0x7fc2680d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:34.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.726+0000 7fc26d5af700 1 -- 172.21.15.125:0/570564070 shutdown_connections 2023-10-17T06:08:34.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.726+0000 7fc26d5af700 1 -- 172.21.15.125:0/570564070 wait complete. 2023-10-17T06:08:34.753 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-17T06:08:34.753 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:08:34.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.922+0000 7f9f42668700 1 Processor -- start 2023-10-17T06:08:34.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.922+0000 7f9f42668700 1 -- start start 2023-10-17T06:08:34.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f42668700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9f3c06d530 0x7f9f3c0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:34.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f42668700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f3c0ca4c0 con 0x7f9f3c164a20 2023-10-17T06:08:34.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f42668700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f3c0ca7a0 con 0x7f9f3c0b3d40 2023-10-17T06:08:34.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f42668700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f3c06e2d0 con 0x7f9f3c06d530 2023-10-17T06:08:34.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f40e65700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9f3c164a20 0x7f9f3c06ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58948/0 (socket says 172.21.15.125:58948) 2023-10-17T06:08:34.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f40e65700 1 -- 172.21.15.125:0/2500287406 learned_addr learned my addr 172.21.15.125:0/2500287406 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:34.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f41e67700 1 --2- 172.21.15.125:0/2500287406 >> v2:172.21.15.184:3300/0 conn(0x7f9f3c06d530 0x7f9f3c0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:34.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f33fff700 1 -- 172.21.15.125:0/2500287406 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083883270 0 0) 0x7f9f3c0ca4c0 con 0x7f9f3c164a20 2023-10-17T06:08:34.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f33fff700 1 -- 172.21.15.125:0/2500287406 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f280035d0 con 0x7f9f3c164a20 2023-10-17T06:08:34.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f33fff700 1 -- 172.21.15.125:0/2500287406 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335823126 0 0) 0x7f9f3c0ca7a0 con 0x7f9f3c0b3d40 2023-10-17T06:08:34.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f33fff700 1 -- 172.21.15.125:0/2500287406 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f3c0ca4c0 con 0x7f9f3c0b3d40 2023-10-17T06:08:34.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f33fff700 1 -- 172.21.15.125:0/2500287406 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2338085569 0 0) 0x7f9f280035d0 con 0x7f9f3c164a20 2023-10-17T06:08:34.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f33fff700 1 -- 172.21.15.125:0/2500287406 >> v2:172.21.15.184:3300/0 conn(0x7f9f3c06d530 msgr2=0x7f9f3c0cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:34.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f33fff700 1 --2- 172.21.15.125:0/2500287406 >> v2:172.21.15.184:3300/0 conn(0x7f9f3c06d530 0x7f9f3c0cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:34.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f33fff700 1 -- 172.21.15.125:0/2500287406 >> v1:172.21.15.184:6789/0 conn(0x7f9f3c0b3d40 legacy=0x7f9f3c0c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:34.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f33fff700 1 -- 172.21.15.125:0/2500287406 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c0caa80 con 0x7f9f3c164a20 2023-10-17T06:08:34.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f33fff700 1 -- 172.21.15.125:0/2500287406 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7f9f2c001670 con 0x7f9f3c164a20 2023-10-17T06:08:34.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f33fff700 1 -- 172.21.15.125:0/2500287406 >> v1:172.21.15.125:6789/0 conn(0x7f9f3c164a20 legacy=0x7f9f3c06ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:34.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f33fff700 1 --2- 172.21.15.125:0/2500287406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f28003bb0 0x7f9f28003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:34.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f33fff700 1 --2- 172.21.15.125:0/2500287406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f28004870 0x7f9f28004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:34.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f33fff700 1 --2- 172.21.15.125:0/2500287406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f28005230 0x7f9f2800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:34.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f33fff700 1 -- 172.21.15.125:0/2500287406 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c06e2d0 con 0x7f9f28005230 2023-10-17T06:08:34.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f33fff700 1 -- 172.21.15.125:0/2500287406 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2800c160 con 0x7f9f28003bb0 2023-10-17T06:08:34.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f33fff700 1 -- 172.21.15.125:0/2500287406 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2800c320 con 0x7f9f28004870 2023-10-17T06:08:34.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f41e67700 1 --2- 172.21.15.125:0/2500287406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f28005230 0x7f9f2800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:34.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.926+0000 7f9f41666700 1 --2- 172.21.15.125:0/2500287406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f28003bb0 0x7f9f28003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:34.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.930+0000 7f9f40e65700 1 --2- 172.21.15.125:0/2500287406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f28004870 0x7f9f28004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:34.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.930+0000 7f9f41e67700 1 -- 172.21.15.125:0/2500287406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f28004870 msgr2=0x7f9f28004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:34.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.930+0000 7f9f41e67700 1 --2- 172.21.15.125:0/2500287406 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f28004870 0x7f9f28004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:34.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.930+0000 7f9f41e67700 1 -- 172.21.15.125:0/2500287406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f28003bb0 msgr2=0x7f9f28003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:34.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.930+0000 7f9f41e67700 1 --2- 172.21.15.125:0/2500287406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f28003bb0 0x7f9f28003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:34.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.930+0000 7f9f41e67700 1 -- 172.21.15.125:0/2500287406 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f280035d0 con 0x7f9f28005230 2023-10-17T06:08:34.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.930+0000 7f9f41e67700 1 -- 172.21.15.125:0/2500287406 reap_dead start 2023-10-17T06:08:34.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.930+0000 7f9f41e67700 1 --2- 172.21.15.125:0/2500287406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f28005230 0x7f9f2800ba30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009f90 tx=0x7f9f280058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376ccb69318a8526 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:34.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.930+0000 7f9f33fff700 1 -- 172.21.15.125:0/2500287406 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3400ec30 con 0x7f9f28005230 2023-10-17T06:08:34.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.930+0000 7f9f33fff700 1 -- 172.21.15.125:0/2500287406 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3400f040 con 0x7f9f28005230 2023-10-17T06:08:34.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.930+0000 7f9f33fff700 1 -- 172.21.15.125:0/2500287406 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34014480 con 0x7f9f28005230 2023-10-17T06:08:34.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.930+0000 7f9f42668700 1 -- 172.21.15.125:0/2500287406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f28005230 msgr2=0x7f9f2800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:34.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.930+0000 7f9f42668700 1 --2- 172.21.15.125:0/2500287406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f28005230 0x7f9f2800ba30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009f90 tx=0x7f9f280058a0 comp rx=0 tx=0).stop 2023-10-17T06:08:34.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.930+0000 7f9f42668700 1 -- 172.21.15.125:0/2500287406 shutdown_connections 2023-10-17T06:08:34.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.930+0000 7f9f42668700 1 --2- 172.21.15.125:0/2500287406 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f28005230 0x7f9f2800ba30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:34.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.930+0000 7f9f42668700 1 -- 172.21.15.125:0/2500287406 >> 172.21.15.125:0/2500287406 conn(0x7f9f3c0ce5c0 msgr2=0x7f9f3c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:34.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.930+0000 7f9f42668700 1 -- 172.21.15.125:0/2500287406 shutdown_connections 2023-10-17T06:08:34.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.930+0000 7f9f42668700 1 -- 172.21.15.125:0/2500287406 wait complete. 2023-10-17T06:08:34.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.934+0000 7f9f42668700 1 Processor -- start 2023-10-17T06:08:34.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.934+0000 7f9f42668700 1 -- start start 2023-10-17T06:08:34.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.934+0000 7f9f42668700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f28005230 0x7f9f3c1f9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:34.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.934+0000 7f9f42668700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f3c162d60 0x7f9f3c15f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:34.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.934+0000 7f9f42668700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f3c0cafa0 0x7f9f3c0cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:34.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.934+0000 7f9f42668700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c0cb960 con 0x7f9f28005230 2023-10-17T06:08:34.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.934+0000 7f9f42668700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c163e10 con 0x7f9f3c0cafa0 2023-10-17T06:08:34.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.934+0000 7f9f42668700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c163290 con 0x7f9f3c162d60 2023-10-17T06:08:34.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.934+0000 7f9f41666700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f28005230 0x7f9f3c1f9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:34.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.934+0000 7f9f41666700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f28005230 0x7f9f3c1f9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48570/0 (socket says 172.21.15.125:48570) 2023-10-17T06:08:34.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.934+0000 7f9f41666700 1 -- 172.21.15.125:0/1791979136 learned_addr learned my addr 172.21.15.125:0/1791979136 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:34.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.934+0000 7f9f40e65700 1 --2- 172.21.15.125:0/1791979136 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f3c162d60 0x7f9f3c15f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:34.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.934+0000 7f9f41e67700 1 --2- 172.21.15.125:0/1791979136 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f3c0cafa0 0x7f9f3c0cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:34.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.934+0000 7f9f41666700 1 -- 172.21.15.125:0/1791979136 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f3c162d60 msgr2=0x7f9f3c15f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:34.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.934+0000 7f9f41666700 1 --2- 172.21.15.125:0/1791979136 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f3c162d60 0x7f9f3c15f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:34.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.934+0000 7f9f41666700 1 -- 172.21.15.125:0/1791979136 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f3c0cafa0 msgr2=0x7f9f3c0cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:34.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.934+0000 7f9f41666700 1 --2- 172.21.15.125:0/1791979136 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f3c0cafa0 0x7f9f3c0cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:34.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.934+0000 7f9f41666700 1 -- 172.21.15.125:0/1791979136 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c163570 con 0x7f9f28005230 2023-10-17T06:08:34.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.934+0000 7f9f41666700 1 --2- 172.21.15.125:0/1791979136 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f28005230 0x7f9f3c1f9410 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800f750 tx=0x7f9f3800fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:34.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.938+0000 7f9f31ffb700 1 -- 172.21.15.125:0/1791979136 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38005320 con 0x7f9f28005230 2023-10-17T06:08:34.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.938+0000 7f9f31ffb700 1 -- 172.21.15.125:0/1791979136 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f380054a0 con 0x7f9f28005230 2023-10-17T06:08:34.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.938+0000 7f9f31ffb700 1 -- 172.21.15.125:0/1791979136 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38006ac0 con 0x7f9f28005230 2023-10-17T06:08:34.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.938+0000 7f9f42668700 1 -- 172.21.15.125:0/1791979136 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3c163850 con 0x7f9f28005230 2023-10-17T06:08:34.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.938+0000 7f9f42668700 1 -- 172.21.15.125:0/1791979136 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3c1f9950 con 0x7f9f28005230 2023-10-17T06:08:34.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.938+0000 7f9f42668700 1 -- 172.21.15.125:0/1791979136 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f3c14a300 con 0x7f9f28005230 2023-10-17T06:08:34.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.938+0000 7f9f31ffb700 1 -- 172.21.15.125:0/1791979136 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9f38006c20 con 0x7f9f28005230 2023-10-17T06:08:34.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.942+0000 7f9f31ffb700 1 --2- 172.21.15.125:0/1791979136 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9f200656f0 0x7f9f20067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:34.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.942+0000 7f9f31ffb700 1 -- 172.21.15.125:0/1791979136 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9f38082700 con 0x7f9f28005230 2023-10-17T06:08:34.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.942+0000 7f9f40e65700 1 --2- 172.21.15.125:0/1791979136 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9f200656f0 0x7f9f20067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:34.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.942+0000 7f9f40e65700 1 --2- 172.21.15.125:0/1791979136 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9f200656f0 0x7f9f20067bb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0cbf20 tx=0x7f9f2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:34.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:34.946+0000 7f9f31ffb700 1 -- 172.21.15.125:0/1791979136 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f9f3c14a300 con 0x7f9f28005230 2023-10-17T06:08:35.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.150+0000 7f9f42668700 1 -- 172.21.15.125:0/1791979136 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f3c14a300 con 0x7f9f28005230 2023-10-17T06:08:35.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.150+0000 7f9f31ffb700 1 -- 172.21.15.125:0/1791979136 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f9f3804fdf0 con 0x7f9f28005230 2023-10-17T06:08:35.156 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:35.157 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/3744648044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3744648044},{"type":"v1","addr":"172.21.15.184:6833","nonce":3744648044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/181458401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181458401},{"type":"v1","addr":"172.21.15.184:6835","nonce":181458401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/908363262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":908363262},{"type":"v1","addr":"172.21.15.125:6835","nonce":908363262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:07:09.036610+0000","modified":"2023-10-17T06:07:35.578225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/3617198893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":3617198893},{"type":"v1","addr":"172.21.15.125:6837","nonce":3617198893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-17T06:08:35.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.154+0000 7f9f42668700 1 -- 172.21.15.125:0/1791979136 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9f200656f0 msgr2=0x7f9f20067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:35.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.154+0000 7f9f42668700 1 --2- 172.21.15.125:0/1791979136 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9f200656f0 0x7f9f20067bb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0cbf20 tx=0x7f9f2c009040 comp rx=0 tx=0).stop 2023-10-17T06:08:35.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.154+0000 7f9f42668700 1 -- 172.21.15.125:0/1791979136 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f28005230 msgr2=0x7f9f3c1f9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:35.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.154+0000 7f9f42668700 1 --2- 172.21.15.125:0/1791979136 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f28005230 0x7f9f3c1f9410 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800f750 tx=0x7f9f3800fb10 comp rx=0 tx=0).stop 2023-10-17T06:08:35.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.154+0000 7f9f42668700 1 -- 172.21.15.125:0/1791979136 shutdown_connections 2023-10-17T06:08:35.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.154+0000 7f9f42668700 1 --2- 172.21.15.125:0/1791979136 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9f200656f0 0x7f9f20067bb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:35.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.154+0000 7f9f42668700 1 --2- 172.21.15.125:0/1791979136 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f3c0cafa0 0x7f9f3c0cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:35.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.154+0000 7f9f42668700 1 --2- 172.21.15.125:0/1791979136 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f3c162d60 0x7f9f3c15f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:35.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.154+0000 7f9f42668700 1 --2- 172.21.15.125:0/1791979136 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f28005230 0x7f9f3c1f9410 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:35.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.154+0000 7f9f42668700 1 -- 172.21.15.125:0/1791979136 >> 172.21.15.125:0/1791979136 conn(0x7f9f3c0ce5c0 msgr2=0x7f9f3c0cc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:35.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.154+0000 7f9f42668700 1 -- 172.21.15.125:0/1791979136 shutdown_connections 2023-10-17T06:08:35.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.154+0000 7f9f42668700 1 -- 172.21.15.125:0/1791979136 wait complete. 2023-10-17T06:08:35.165 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 9 2023-10-17T06:08:35.180 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:08:35.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.346+0000 7f38e214c700 1 Processor -- start 2023-10-17T06:08:35.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.346+0000 7f38e214c700 1 -- start start 2023-10-17T06:08:35.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.350+0000 7f38e214c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f38dc160710 0x7f38dc0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:35.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.350+0000 7f38e214c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f38dc0b5ae0 0x7f38dc06db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:35.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.350+0000 7f38e214c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38dc15d0d0 con 0x7f38dc0d2e00 2023-10-17T06:08:35.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.350+0000 7f38e214c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38dc15df90 con 0x7f38dc160710 2023-10-17T06:08:35.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.350+0000 7f38e214c700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38dc06f0f0 con 0x7f38dc0b5ae0 2023-10-17T06:08:35.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.350+0000 7f38e0949700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f38dc160710 0x7f38dc0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:35.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.350+0000 7f38e114a700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f38dc0d2e00 0x7f38dc0d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58954/0 (socket says 172.21.15.125:58954) 2023-10-17T06:08:35.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.350+0000 7f38e114a700 1 -- 172.21.15.125:0/4193138506 learned_addr learned my addr 172.21.15.125:0/4193138506 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:35.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.350+0000 7f38e194b700 1 --2- 172.21.15.125:0/4193138506 >> v2:172.21.15.184:3300/0 conn(0x7f38dc0b5ae0 0x7f38dc06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:35.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.350+0000 7f38e0949700 1 -- 172.21.15.125:0/4193138506 >> v2:172.21.15.184:3300/0 conn(0x7f38dc0b5ae0 msgr2=0x7f38dc06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:35.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.350+0000 7f38e0949700 1 --2- 172.21.15.125:0/4193138506 >> v2:172.21.15.184:3300/0 conn(0x7f38dc0b5ae0 0x7f38dc06db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:35.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.350+0000 7f38e0949700 1 -- 172.21.15.125:0/4193138506 >> v1:172.21.15.125:6789/0 conn(0x7f38dc0d2e00 legacy=0x7f38dc0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:35.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.350+0000 7f38e0949700 1 -- 172.21.15.125:0/4193138506 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38dc15d310 con 0x7f38dc160710 2023-10-17T06:08:35.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.350+0000 7f38e194b700 1 --2- 172.21.15.125:0/4193138506 >> v2:172.21.15.184:3300/0 conn(0x7f38dc0b5ae0 0x7f38dc06db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:35.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.350+0000 7f38e0949700 1 --2- 172.21.15.125:0/4193138506 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38dc160710 0x7f38dc0b6e00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f38dc06d040 tx=0x7f38cc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf5af68c3ca3c51 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:35.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.350+0000 7f38d3fff700 1 -- 172.21.15.125:0/4193138506 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc011830 con 0x7f38dc160710 2023-10-17T06:08:35.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.350+0000 7f38d3fff700 1 -- 172.21.15.125:0/4193138506 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc011990 con 0x7f38dc160710 2023-10-17T06:08:35.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.350+0000 7f38d3fff700 1 -- 172.21.15.125:0/4193138506 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc011d40 con 0x7f38dc160710 2023-10-17T06:08:35.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.354+0000 7f38e214c700 1 -- 172.21.15.125:0/4193138506 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38dc160710 msgr2=0x7f38dc0b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:35.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.354+0000 7f38e214c700 1 --2- 172.21.15.125:0/4193138506 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38dc160710 0x7f38dc0b6e00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f38dc06d040 tx=0x7f38cc009b30 comp rx=0 tx=0).stop 2023-10-17T06:08:35.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.354+0000 7f38e214c700 1 -- 172.21.15.125:0/4193138506 shutdown_connections 2023-10-17T06:08:35.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.354+0000 7f38e214c700 1 --2- 172.21.15.125:0/4193138506 >> v2:172.21.15.184:3300/0 conn(0x7f38dc0b5ae0 0x7f38dc06db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:35.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.354+0000 7f38e214c700 1 --2- 172.21.15.125:0/4193138506 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38dc160710 0x7f38dc0b6e00 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:35.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.354+0000 7f38e214c700 1 -- 172.21.15.125:0/4193138506 >> 172.21.15.125:0/4193138506 conn(0x7f38dc069f20 msgr2=0x7f38dc06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:35.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.354+0000 7f38e214c700 1 -- 172.21.15.125:0/4193138506 shutdown_connections 2023-10-17T06:08:35.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.354+0000 7f38e214c700 1 -- 172.21.15.125:0/4193138506 wait complete. 2023-10-17T06:08:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.358+0000 7f38e214c700 1 Processor -- start 2023-10-17T06:08:35.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.358+0000 7f38e214c700 1 -- start start 2023-10-17T06:08:35.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.358+0000 7f38e214c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38dc0b5ae0 0x7f38dc158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:35.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.358+0000 7f38e214c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38dc0d2e00 0x7f38dc1514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:35.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.358+0000 7f38e214c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38dc160710 0x7f38dc0b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:35.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.358+0000 7f38e214c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc1598b0 con 0x7f38dc0b5ae0 2023-10-17T06:08:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.358+0000 7f38e214c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc159b90 con 0x7f38dc160710 2023-10-17T06:08:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.358+0000 7f38e214c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc159e70 con 0x7f38dc0d2e00 2023-10-17T06:08:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.358+0000 7f38e114a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38dc0b5ae0 0x7f38dc158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.358+0000 7f38e114a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38dc0b5ae0 0x7f38dc158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48596/0 (socket says 172.21.15.125:48596) 2023-10-17T06:08:35.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.358+0000 7f38e114a700 1 -- 172.21.15.125:0/92952740 learned_addr learned my addr 172.21.15.125:0/92952740 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:35.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.358+0000 7f38e194b700 1 --2- 172.21.15.125:0/92952740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38dc160710 0x7f38dc0b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:35.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.358+0000 7f38e0949700 1 --2- 172.21.15.125:0/92952740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38dc0d2e00 0x7f38dc1514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:35.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.362+0000 7f38e114a700 1 -- 172.21.15.125:0/92952740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38dc0d2e00 msgr2=0x7f38dc1514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:35.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.362+0000 7f38e114a700 1 --2- 172.21.15.125:0/92952740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38dc0d2e00 0x7f38dc1514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:35.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.362+0000 7f38e114a700 1 -- 172.21.15.125:0/92952740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38dc160710 msgr2=0x7f38dc0b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:35.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.362+0000 7f38e114a700 1 --2- 172.21.15.125:0/92952740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38dc160710 0x7f38dc0b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:35.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.362+0000 7f38e114a700 1 -- 172.21.15.125:0/92952740 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc0094b0 con 0x7f38dc0b5ae0 2023-10-17T06:08:35.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.362+0000 7f38e114a700 1 --2- 172.21.15.125:0/92952740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38dc0b5ae0 0x7f38dc158f80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f38d8001eb0 tx=0x7f38d800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:35.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.362+0000 7f38d1ffb700 1 -- 172.21.15.125:0/92952740 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d8005d90 con 0x7f38dc0b5ae0 2023-10-17T06:08:35.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.362+0000 7f38d1ffb700 1 -- 172.21.15.125:0/92952740 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d80070d0 con 0x7f38dc0b5ae0 2023-10-17T06:08:35.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.362+0000 7f38e214c700 1 -- 172.21.15.125:0/92952740 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38dc15a150 con 0x7f38dc0b5ae0 2023-10-17T06:08:35.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.362+0000 7f38d1ffb700 1 -- 172.21.15.125:0/92952740 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d8007440 con 0x7f38dc0b5ae0 2023-10-17T06:08:35.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.362+0000 7f38e214c700 1 -- 172.21.15.125:0/92952740 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38dc1594c0 con 0x7f38dc0b5ae0 2023-10-17T06:08:35.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.362+0000 7f38e214c700 1 -- 172.21.15.125:0/92952740 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38dc072e60 con 0x7f38dc0b5ae0 2023-10-17T06:08:35.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.366+0000 7f38d1ffb700 1 -- 172.21.15.125:0/92952740 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f38d80075a0 con 0x7f38dc0b5ae0 2023-10-17T06:08:35.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.366+0000 7f38d1ffb700 1 --2- 172.21.15.125:0/92952740 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f38c00656f0 0x7f38c0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:35.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.366+0000 7f38d1ffb700 1 -- 172.21.15.125:0/92952740 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f38d8082210 con 0x7f38dc0b5ae0 2023-10-17T06:08:35.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.366+0000 7f38e0949700 1 --2- 172.21.15.125:0/92952740 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f38c00656f0 0x7f38c0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:35.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.366+0000 7f38e0949700 1 --2- 172.21.15.125:0/92952740 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f38c00656f0 0x7f38c0067bb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f38dc06d040 tx=0x7f38cc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:35.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.374+0000 7f38d1ffb700 1 -- 172.21.15.125:0/92952740 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f38d804fa40 con 0x7f38dc0b5ae0 2023-10-17T06:08:35.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.598+0000 7f38e214c700 1 -- 172.21.15.125:0/92952740 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38dc15d0d0 con 0x7f38dc0b5ae0 2023-10-17T06:08:35.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.598+0000 7f38d1ffb700 1 -- 172.21.15.125:0/92952740 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f38dc15d0d0 con 0x7f38dc0b5ae0 2023-10-17T06:08:35.604 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:35.605 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/3744648044","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":3744648044},{"type":"v1","addr":"172.21.15.184:6833","nonce":3744648044}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/181458401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":181458401},{"type":"v1","addr":"172.21.15.184:6835","nonce":181458401}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/908363262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":908363262},{"type":"v1","addr":"172.21.15.125:6835","nonce":908363262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:07:09.036610+0000","modified":"2023-10-17T06:07:35.578225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/3617198893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":3617198893},{"type":"v1","addr":"172.21.15.125:6837","nonce":3617198893}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-17T06:08:35.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.602+0000 7f38e214c700 1 -- 172.21.15.125:0/92952740 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f38c00656f0 msgr2=0x7f38c0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:35.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.602+0000 7f38e214c700 1 --2- 172.21.15.125:0/92952740 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f38c00656f0 0x7f38c0067bb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f38dc06d040 tx=0x7f38cc008030 comp rx=0 tx=0).stop 2023-10-17T06:08:35.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.602+0000 7f38e214c700 1 -- 172.21.15.125:0/92952740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38dc0b5ae0 msgr2=0x7f38dc158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:35.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.602+0000 7f38e214c700 1 --2- 172.21.15.125:0/92952740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38dc0b5ae0 0x7f38dc158f80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f38d8001eb0 tx=0x7f38d800c7b0 comp rx=0 tx=0).stop 2023-10-17T06:08:35.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.602+0000 7f38e214c700 1 -- 172.21.15.125:0/92952740 shutdown_connections 2023-10-17T06:08:35.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.602+0000 7f38e214c700 1 --2- 172.21.15.125:0/92952740 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f38c00656f0 0x7f38c0067bb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:35.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.602+0000 7f38e214c700 1 --2- 172.21.15.125:0/92952740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38dc160710 0x7f38dc0b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:35.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.602+0000 7f38e214c700 1 --2- 172.21.15.125:0/92952740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38dc0d2e00 0x7f38dc1514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:35.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.602+0000 7f38e214c700 1 --2- 172.21.15.125:0/92952740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f38dc0b5ae0 0x7f38dc158f80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:35.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.602+0000 7f38e214c700 1 -- 172.21.15.125:0/92952740 >> 172.21.15.125:0/92952740 conn(0x7f38dc069f20 msgr2=0x7f38dc0b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:35.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.602+0000 7f38e214c700 1 -- 172.21.15.125:0/92952740 shutdown_connections 2023-10-17T06:08:35.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.602+0000 7f38e214c700 1 -- 172.21.15.125:0/92952740 wait complete. 2023-10-17T06:08:35.609 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 9 2023-10-17T06:08:35.625 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:08:35.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.794+0000 7f78b1cd8700 1 Processor -- start 2023-10-17T06:08:35.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.794+0000 7f78b1cd8700 1 -- start start 2023-10-17T06:08:35.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78b1cd8700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f78ac06d090 0x7f78ac0b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:35.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78b1cd8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f78ac06d470 0x7f78ac070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:35.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78b1cd8700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78ac15e990 con 0x7f78ac070f50 2023-10-17T06:08:35.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78b1cd8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ac15f4f0 con 0x7f78ac06d470 2023-10-17T06:08:35.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78b1cd8700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ac15ec50 con 0x7f78ac06d090 2023-10-17T06:08:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78a3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f78ac06d470 0x7f78ac070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78a3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f78ac06d470 0x7f78ac070a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48614/0 (socket says 172.21.15.125:48614) 2023-10-17T06:08:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78a3fff700 1 -- 172.21.15.125:0/2131646556 learned_addr learned my addr 172.21.15.125:0/2131646556 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78b0cd6700 1 --2- 172.21.15.125:0/2131646556 >> v2:172.21.15.184:3300/0 conn(0x7f78ac06d090 0x7f78ac0b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:35.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78a3fff700 1 -- 172.21.15.125:0/2131646556 >> v2:172.21.15.184:3300/0 conn(0x7f78ac06d090 msgr2=0x7f78ac0b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:35.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78a3fff700 1 --2- 172.21.15.125:0/2131646556 >> v2:172.21.15.184:3300/0 conn(0x7f78ac06d090 0x7f78ac0b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:35.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78a3fff700 1 -- 172.21.15.125:0/2131646556 >> v1:172.21.15.184:6789/0 conn(0x7f78ac070f50 legacy=0x7f78ac15a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:35.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78a3fff700 1 -- 172.21.15.125:0/2131646556 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac15ef30 con 0x7f78ac06d470 2023-10-17T06:08:35.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78a3fff700 1 --2- 172.21.15.125:0/2131646556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78ac06d470 0x7f78ac070a10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0cf440 tx=0x7f789c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fcf228550d4db server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:35.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78a37fe700 1 -- 172.21.15.125:0/2131646556 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c00b8a0 con 0x7f78ac06d470 2023-10-17T06:08:35.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78a37fe700 1 -- 172.21.15.125:0/2131646556 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c00ba00 con 0x7f78ac06d470 2023-10-17T06:08:35.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78a37fe700 1 -- 172.21.15.125:0/2131646556 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c00bd90 con 0x7f78ac06d470 2023-10-17T06:08:35.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78b1cd8700 1 -- 172.21.15.125:0/2131646556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78ac06d470 msgr2=0x7f78ac070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:35.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78b1cd8700 1 --2- 172.21.15.125:0/2131646556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78ac06d470 0x7f78ac070a10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0cf440 tx=0x7f789c009bf0 comp rx=0 tx=0).stop 2023-10-17T06:08:35.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78b1cd8700 1 -- 172.21.15.125:0/2131646556 shutdown_connections 2023-10-17T06:08:35.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78b1cd8700 1 --2- 172.21.15.125:0/2131646556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78ac06d470 0x7f78ac070a10 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:35.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78b1cd8700 1 --2- 172.21.15.125:0/2131646556 >> v2:172.21.15.184:3300/0 conn(0x7f78ac06d090 0x7f78ac0b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:35.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.798+0000 7f78b1cd8700 1 -- 172.21.15.125:0/2131646556 >> 172.21.15.125:0/2131646556 conn(0x7f78ac0ce5c0 msgr2=0x7f78ac0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:35.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.802+0000 7f78b1cd8700 1 -- 172.21.15.125:0/2131646556 shutdown_connections 2023-10-17T06:08:35.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.802+0000 7f78b1cd8700 1 -- 172.21.15.125:0/2131646556 wait complete. 2023-10-17T06:08:35.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.802+0000 7f78b1cd8700 1 Processor -- start 2023-10-17T06:08:35.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.802+0000 7f78b1cd8700 1 -- start start 2023-10-17T06:08:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.806+0000 7f78b1cd8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78ac06d090 0x7f78ac1449d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.806+0000 7f78b1cd8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78ac06d470 0x7f78ac1f13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.806+0000 7f78b1cd8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78ac070f50 0x7f78ac1f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.806+0000 7f78b1cd8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac1f4fc0 con 0x7f78ac070f50 2023-10-17T06:08:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.806+0000 7f78b1cd8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac1f4a00 con 0x7f78ac06d090 2023-10-17T06:08:35.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.806+0000 7f78b1cd8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac1f4ce0 con 0x7f78ac06d470 2023-10-17T06:08:35.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.806+0000 7f78b14d7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78ac070f50 0x7f78ac1f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:35.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.806+0000 7f78b0cd6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78ac06d090 0x7f78ac1449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:35.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.806+0000 7f78b14d7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78ac070f50 0x7f78ac1f40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48616/0 (socket says 172.21.15.125:48616) 2023-10-17T06:08:35.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.806+0000 7f78b14d7700 1 -- 172.21.15.125:0/3045632418 learned_addr learned my addr 172.21.15.125:0/3045632418 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:35.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.806+0000 7f78a3fff700 1 --2- 172.21.15.125:0/3045632418 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78ac06d470 0x7f78ac1f13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:35.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.806+0000 7f78b14d7700 1 -- 172.21.15.125:0/3045632418 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78ac06d470 msgr2=0x7f78ac1f13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:35.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.806+0000 7f78b14d7700 1 --2- 172.21.15.125:0/3045632418 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78ac06d470 0x7f78ac1f13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:35.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.806+0000 7f78b14d7700 1 -- 172.21.15.125:0/3045632418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78ac06d090 msgr2=0x7f78ac1449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:35.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.806+0000 7f78b14d7700 1 --2- 172.21.15.125:0/3045632418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78ac06d090 0x7f78ac1449d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:35.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.806+0000 7f78b14d7700 1 -- 172.21.15.125:0/3045632418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c009570 con 0x7f78ac070f50 2023-10-17T06:08:35.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.810+0000 7f78b14d7700 1 --2- 172.21.15.125:0/3045632418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78ac070f50 0x7f78ac1f40b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f78a400cb50 tx=0x7f78a400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:35.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.810+0000 7f78a17fa700 1 -- 172.21.15.125:0/3045632418 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a4003c20 con 0x7f78ac070f50 2023-10-17T06:08:35.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.810+0000 7f78a17fa700 1 -- 172.21.15.125:0/3045632418 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a4003d80 con 0x7f78ac070f50 2023-10-17T06:08:35.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.810+0000 7f78a17fa700 1 -- 172.21.15.125:0/3045632418 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a400aa20 con 0x7f78ac070f50 2023-10-17T06:08:35.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.810+0000 7f78b1cd8700 1 -- 172.21.15.125:0/3045632418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ac1f0bd0 con 0x7f78ac070f50 2023-10-17T06:08:35.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.810+0000 7f78b1cd8700 1 -- 172.21.15.125:0/3045632418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ac1f1910 con 0x7f78ac070f50 2023-10-17T06:08:35.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.810+0000 7f78b1cd8700 1 -- 172.21.15.125:0/3045632418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78ac1f1ad0 con 0x7f78ac070f50 2023-10-17T06:08:35.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.814+0000 7f78a17fa700 1 -- 172.21.15.125:0/3045632418 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f78a400ab80 con 0x7f78ac070f50 2023-10-17T06:08:35.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.814+0000 7f78a17fa700 1 --2- 172.21.15.125:0/3045632418 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f78980656f0 0x7f7898067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:35.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.814+0000 7f78a17fa700 1 -- 172.21.15.125:0/3045632418 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f78a4083160 con 0x7f78ac070f50 2023-10-17T06:08:35.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.814+0000 7f78b0cd6700 1 --2- 172.21.15.125:0/3045632418 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f78980656f0 0x7f7898067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:35.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.814+0000 7f78b0cd6700 1 --2- 172.21.15.125:0/3045632418 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f78980656f0 0x7f7898067bb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0c3830 tx=0x7f78a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:35.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.822+0000 7f78a17fa700 1 -- 172.21.15.125:0/3045632418 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f78a4050860 con 0x7f78ac070f50 2023-10-17T06:08:36.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:35.998+0000 7f78b1cd8700 1 -- 172.21.15.125:0/3045632418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78ac1f10f0 con 0x7f78ac070f50 2023-10-17T06:08:36.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.002+0000 7f78a17fa700 1 -- 172.21.15.125:0/3045632418 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20252 (secure 0 0 0) 0x7f78ac1f10f0 con 0x7f78ac070f50 2023-10-17T06:08:36.007 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:36.007 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":30,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:07:49.710984+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:07:06.629169+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-17T06:07:08.148117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-17T06:07:11.895112+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:08:36.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.006+0000 7f78b1cd8700 1 -- 172.21.15.125:0/3045632418 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f78980656f0 msgr2=0x7f7898067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:36.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.006+0000 7f78b1cd8700 1 --2- 172.21.15.125:0/3045632418 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f78980656f0 0x7f7898067bb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0c3830 tx=0x7f78a8008040 comp rx=0 tx=0).stop 2023-10-17T06:08:36.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.006+0000 7f78b1cd8700 1 -- 172.21.15.125:0/3045632418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78ac070f50 msgr2=0x7f78ac1f40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:36.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.006+0000 7f78b1cd8700 1 --2- 172.21.15.125:0/3045632418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78ac070f50 0x7f78ac1f40b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f78a400cb50 tx=0x7f78a400ce60 comp rx=0 tx=0).stop 2023-10-17T06:08:36.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.006+0000 7f78b1cd8700 1 -- 172.21.15.125:0/3045632418 shutdown_connections 2023-10-17T06:08:36.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.006+0000 7f78b1cd8700 1 --2- 172.21.15.125:0/3045632418 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f78980656f0 0x7f7898067bb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:36.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.006+0000 7f78b1cd8700 1 --2- 172.21.15.125:0/3045632418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78ac070f50 0x7f78ac1f40b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:36.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.006+0000 7f78b1cd8700 1 --2- 172.21.15.125:0/3045632418 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78ac06d470 0x7f78ac1f13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:36.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.006+0000 7f78b1cd8700 1 --2- 172.21.15.125:0/3045632418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78ac06d090 0x7f78ac1449d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:36.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.006+0000 7f78b1cd8700 1 -- 172.21.15.125:0/3045632418 >> 172.21.15.125:0/3045632418 conn(0x7f78ac0ce5c0 msgr2=0x7f78ac1575b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:36.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.006+0000 7f78b1cd8700 1 -- 172.21.15.125:0/3045632418 shutdown_connections 2023-10-17T06:08:36.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.006+0000 7f78b1cd8700 1 -- 172.21.15.125:0/3045632418 wait complete. 2023-10-17T06:08:36.031 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-17T06:08:36.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.214+0000 7f25653af700 1 Processor -- start 2023-10-17T06:08:36.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.214+0000 7f25653af700 1 -- start start 2023-10-17T06:08:36.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.218+0000 7f25653af700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f256015cc60 0x7f256006da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:36.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.218+0000 7f25653af700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f25600b1d60 0x7f256006dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:36.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.218+0000 7f25653af700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f256015d040 con 0x7f256006e510 2023-10-17T06:08:36.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.218+0000 7f25653af700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25600b64f0 con 0x7f25600b1d60 2023-10-17T06:08:36.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.218+0000 7f25653af700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25600b67d0 con 0x7f256015cc60 2023-10-17T06:08:36.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.218+0000 7f25577fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f25600b1d60 0x7f256006dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:36.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.218+0000 7f2564bae700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f256006e510 0x7f2560160800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58956/0 (socket says 172.21.15.125:58956) 2023-10-17T06:08:36.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.218+0000 7f25577fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f25600b1d60 0x7f256006dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48634/0 (socket says 172.21.15.125:48634) 2023-10-17T06:08:36.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.218+0000 7f2564bae700 1 -- 172.21.15.125:0/150852147 learned_addr learned my addr 172.21.15.125:0/150852147 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:36.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.218+0000 7f255ffff700 1 --2- 172.21.15.125:0/150852147 >> v2:172.21.15.184:3300/0 conn(0x7f256015cc60 0x7f256006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:36.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.218+0000 7f25577fe700 1 -- 172.21.15.125:0/150852147 >> v2:172.21.15.184:3300/0 conn(0x7f256015cc60 msgr2=0x7f256006da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:36.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.218+0000 7f25577fe700 1 --2- 172.21.15.125:0/150852147 >> v2:172.21.15.184:3300/0 conn(0x7f256015cc60 0x7f256006da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:36.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.218+0000 7f25577fe700 1 -- 172.21.15.125:0/150852147 >> v1:172.21.15.125:6789/0 conn(0x7f256006e510 legacy=0x7f2560160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:36.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.218+0000 7f25577fe700 1 -- 172.21.15.125:0/150852147 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25600b6ab0 con 0x7f25600b1d60 2023-10-17T06:08:36.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.218+0000 7f255f7fe700 1 -- 172.21.15.125:0/150852147 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496329712 0 0) 0x7f256015d040 con 0x7f256006e510 2023-10-17T06:08:36.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.222+0000 7f25577fe700 1 --2- 172.21.15.125:0/150852147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25600b1d60 0x7f256006dfd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2560067170 tx=0x7f2548009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d16914a34e95e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:36.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.222+0000 7f255f7fe700 1 -- 172.21.15.125:0/150852147 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548011830 con 0x7f25600b1d60 2023-10-17T06:08:36.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.222+0000 7f255f7fe700 1 -- 172.21.15.125:0/150852147 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2548011990 con 0x7f25600b1d60 2023-10-17T06:08:36.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.222+0000 7f255f7fe700 1 -- 172.21.15.125:0/150852147 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548011d20 con 0x7f25600b1d60 2023-10-17T06:08:36.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.222+0000 7f25653af700 1 -- 172.21.15.125:0/150852147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25600b1d60 msgr2=0x7f256006dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:36.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.222+0000 7f25653af700 1 --2- 172.21.15.125:0/150852147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25600b1d60 0x7f256006dfd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2560067170 tx=0x7f2548009b30 comp rx=0 tx=0).stop 2023-10-17T06:08:36.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.222+0000 7f25653af700 1 -- 172.21.15.125:0/150852147 shutdown_connections 2023-10-17T06:08:36.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.222+0000 7f25653af700 1 --2- 172.21.15.125:0/150852147 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25600b1d60 0x7f256006dfd0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:36.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.222+0000 7f25653af700 1 --2- 172.21.15.125:0/150852147 >> v2:172.21.15.184:3300/0 conn(0x7f256015cc60 0x7f256006da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:36.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.222+0000 7f25653af700 1 -- 172.21.15.125:0/150852147 >> 172.21.15.125:0/150852147 conn(0x7f256006f450 msgr2=0x7f256006f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:36.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.222+0000 7f25653af700 1 -- 172.21.15.125:0/150852147 shutdown_connections 2023-10-17T06:08:36.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.222+0000 7f25653af700 1 -- 172.21.15.125:0/150852147 wait complete. 2023-10-17T06:08:36.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.226+0000 7f25653af700 1 Processor -- start 2023-10-17T06:08:36.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.226+0000 7f25653af700 1 -- start start 2023-10-17T06:08:36.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f25653af700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f256006e510 0x7f25601501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:36.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f25653af700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25600b1d60 0x7f256015bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:36.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f25653af700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f256015cc60 0x7f2560155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:36.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f25653af700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256014f4a0 con 0x7f256015cc60 2023-10-17T06:08:36.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f25653af700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256014fd40 con 0x7f25600b1d60 2023-10-17T06:08:36.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f25653af700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256014ef20 con 0x7f256006e510 2023-10-17T06:08:36.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f2564bae700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f256015cc60 0x7f2560155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:36.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f2564bae700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f256015cc60 0x7f2560155bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48636/0 (socket says 172.21.15.125:48636) 2023-10-17T06:08:36.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f2564bae700 1 -- 172.21.15.125:0/1345477699 learned_addr learned my addr 172.21.15.125:0/1345477699 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:36.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f25577fe700 1 --2- 172.21.15.125:0/1345477699 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25600b1d60 0x7f256015bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:36.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f255ffff700 1 --2- 172.21.15.125:0/1345477699 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f256006e510 0x7f25601501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:36.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f2564bae700 1 -- 172.21.15.125:0/1345477699 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f256006e510 msgr2=0x7f25601501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:36.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f2564bae700 1 --2- 172.21.15.125:0/1345477699 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f256006e510 0x7f25601501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:36.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f2564bae700 1 -- 172.21.15.125:0/1345477699 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25600b1d60 msgr2=0x7f256015bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:36.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f2564bae700 1 --2- 172.21.15.125:0/1345477699 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25600b1d60 0x7f256015bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:36.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f2564bae700 1 -- 172.21.15.125:0/1345477699 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25480094b0 con 0x7f256015cc60 2023-10-17T06:08:36.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f255ffff700 1 --2- 172.21.15.125:0/1345477699 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f256006e510 0x7f25601501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:36.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f2564bae700 1 --2- 172.21.15.125:0/1345477699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f256015cc60 0x7f2560155bb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f255800c580 tx=0x7f255800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:36.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f255d7fa700 1 -- 172.21.15.125:0/1345477699 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558004ca0 con 0x7f256015cc60 2023-10-17T06:08:36.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f25653af700 1 -- 172.21.15.125:0/1345477699 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f256014f6f0 con 0x7f256015cc60 2023-10-17T06:08:36.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f255d7fa700 1 -- 172.21.15.125:0/1345477699 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2558004e00 con 0x7f256015cc60 2023-10-17T06:08:36.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f255d7fa700 1 -- 172.21.15.125:0/1345477699 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25580072d0 con 0x7f256015cc60 2023-10-17T06:08:36.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f25653af700 1 -- 172.21.15.125:0/1345477699 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256015c400 con 0x7f256015cc60 2023-10-17T06:08:36.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.230+0000 7f25653af700 1 -- 172.21.15.125:0/1345477699 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256014fed0 con 0x7f256015cc60 2023-10-17T06:08:36.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.234+0000 7f255d7fa700 1 -- 172.21.15.125:0/1345477699 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2558007430 con 0x7f256015cc60 2023-10-17T06:08:36.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.234+0000 7f255d7fa700 1 --2- 172.21.15.125:0/1345477699 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2540065720 0x7f2540067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:36.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.234+0000 7f255d7fa700 1 -- 172.21.15.125:0/1345477699 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2558082c20 con 0x7f256015cc60 2023-10-17T06:08:36.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.234+0000 7f255ffff700 1 --2- 172.21.15.125:0/1345477699 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2540065720 0x7f2540067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:36.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.234+0000 7f255ffff700 1 --2- 172.21.15.125:0/1345477699 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2540065720 0x7f2540067be0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2550007440 tx=0x7f255000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:36.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.242+0000 7f255d7fa700 1 -- 172.21.15.125:0/1345477699 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2558053e50 con 0x7f256015cc60 2023-10-17T06:08:36.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.706+0000 7f25653af700 1 -- 172.21.15.125:0/1345477699 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2560072e60 con 0x7f256015cc60 2023-10-17T06:08:36.711 INFO:tasks.ceph.mon.a.smithi125.stderr:2023-10-17T06:08:36.706+0000 7fa0d23f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-17T06:08:36.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.718+0000 7f255d7fa700 1 -- 172.21.15.125:0/1345477699 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f25580539e0 con 0x7f256015cc60 2023-10-17T06:08:36.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.722+0000 7f25653af700 1 -- 172.21.15.125:0/1345477699 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2540065720 msgr2=0x7f2540067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:36.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.722+0000 7f25653af700 1 --2- 172.21.15.125:0/1345477699 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2540065720 0x7f2540067be0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2550007440 tx=0x7f255000b040 comp rx=0 tx=0).stop 2023-10-17T06:08:36.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.722+0000 7f25653af700 1 -- 172.21.15.125:0/1345477699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f256015cc60 msgr2=0x7f2560155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:36.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.722+0000 7f25653af700 1 --2- 172.21.15.125:0/1345477699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f256015cc60 0x7f2560155bb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f255800c580 tx=0x7f255800c940 comp rx=0 tx=0).stop 2023-10-17T06:08:36.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.722+0000 7f25653af700 1 -- 172.21.15.125:0/1345477699 shutdown_connections 2023-10-17T06:08:36.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.722+0000 7f25653af700 1 --2- 172.21.15.125:0/1345477699 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2540065720 0x7f2540067be0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:36.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.722+0000 7f25653af700 1 --2- 172.21.15.125:0/1345477699 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f256015cc60 0x7f2560155bb0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:36.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.722+0000 7f25653af700 1 --2- 172.21.15.125:0/1345477699 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f25600b1d60 0x7f256015bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:36.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.722+0000 7f25653af700 1 --2- 172.21.15.125:0/1345477699 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f256006e510 0x7f25601501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:36.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.722+0000 7f25653af700 1 -- 172.21.15.125:0/1345477699 >> 172.21.15.125:0/1345477699 conn(0x7f256006f450 msgr2=0x7f25600b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:36.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.722+0000 7f25653af700 1 -- 172.21.15.125:0/1345477699 shutdown_connections 2023-10-17T06:08:36.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.722+0000 7f25653af700 1 -- 172.21.15.125:0/1345477699 wait complete. 2023-10-17T06:08:36.730 INFO:teuthology.orchestra.run.smithi125.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-17T06:08:36.740 INFO:tasks.ceph.mds.c.smithi125.stderr: -5968> 2023-10-17T06:07:13.908+0000 7fb335c8d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-17T06:08:36.755 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-17T06:08:36.801 INFO:tasks.ceph.mds.c.smithi125.stdout:starting mds.c at 2023-10-17T06:08:36.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.962+0000 7f3bcae71700 1 Processor -- start 2023-10-17T06:08:36.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.962+0000 7f3bcae71700 1 -- start start 2023-10-17T06:08:36.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.962+0000 7f3bcae71700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3bc41467c0 0x7f3bc40b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:36.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.962+0000 7f3bcae71700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3bc41612e0 0x7f3bc415d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:36.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.962+0000 7f3bcae71700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc4146ba0 con 0x7f3bc406f9a0 2023-10-17T06:08:36.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.962+0000 7f3bcae71700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc40d0920 con 0x7f3bc41612e0 2023-10-17T06:08:36.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.962+0000 7f3bcae71700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc40b6160 con 0x7f3bc41467c0 2023-10-17T06:08:36.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bc3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3bc41612e0 0x7f3bc415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:36.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bc940e700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f3bc406f9a0 0x7f3bc40d0db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:49802/0 (socket says 172.21.15.125:49802) 2023-10-17T06:08:36.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bc940e700 1 -- 172.21.15.125:0/543976485 learned_addr learned my addr 172.21.15.125:0/543976485 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:36.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bc8c0d700 1 --2- 172.21.15.125:0/543976485 >> v2:172.21.15.184:3300/0 conn(0x7f3bc41467c0 0x7f3bc40b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:36.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bc3fff700 1 -- 172.21.15.125:0/543976485 >> v2:172.21.15.184:3300/0 conn(0x7f3bc41467c0 msgr2=0x7f3bc40b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:36.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bc3fff700 1 --2- 172.21.15.125:0/543976485 >> v2:172.21.15.184:3300/0 conn(0x7f3bc41467c0 0x7f3bc40b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:36.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bc3fff700 1 -- 172.21.15.125:0/543976485 >> v1:172.21.15.184:6789/0 conn(0x7f3bc406f9a0 legacy=0x7f3bc40d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:36.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bc37fe700 1 -- 172.21.15.125:0/543976485 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906102323 0 0) 0x7f3bc4146ba0 con 0x7f3bc406f9a0 2023-10-17T06:08:36.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bc3fff700 1 -- 172.21.15.125:0/543976485 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc40b6440 con 0x7f3bc41612e0 2023-10-17T06:08:36.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bc8c0d700 1 --2- 172.21.15.125:0/543976485 >> v2:172.21.15.184:3300/0 conn(0x7f3bc41467c0 0x7f3bc40b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:36.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bc3fff700 1 --2- 172.21.15.125:0/543976485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bc41612e0 0x7f3bc415d310 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40b6f30 tx=0x7f3bb0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cdc9125362a5e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:36.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bc37fe700 1 -- 172.21.15.125:0/543976485 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0011830 con 0x7f3bc41612e0 2023-10-17T06:08:36.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bc37fe700 1 -- 172.21.15.125:0/543976485 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb0011990 con 0x7f3bc41612e0 2023-10-17T06:08:36.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bc37fe700 1 -- 172.21.15.125:0/543976485 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0011d40 con 0x7f3bc41612e0 2023-10-17T06:08:36.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bcae71700 1 -- 172.21.15.125:0/543976485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bc41612e0 msgr2=0x7f3bc415d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:36.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bcae71700 1 --2- 172.21.15.125:0/543976485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bc41612e0 0x7f3bc415d310 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40b6f30 tx=0x7f3bb0009b30 comp rx=0 tx=0).stop 2023-10-17T06:08:36.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bcae71700 1 -- 172.21.15.125:0/543976485 shutdown_connections 2023-10-17T06:08:36.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bcae71700 1 --2- 172.21.15.125:0/543976485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bc41612e0 0x7f3bc415d310 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:36.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bcae71700 1 --2- 172.21.15.125:0/543976485 >> v2:172.21.15.184:3300/0 conn(0x7f3bc41467c0 0x7f3bc40b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:36.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bcae71700 1 -- 172.21.15.125:0/543976485 >> 172.21.15.125:0/543976485 conn(0x7f3bc406a130 msgr2=0x7f3bc406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:36.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bcae71700 1 -- 172.21.15.125:0/543976485 shutdown_connections 2023-10-17T06:08:36.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.966+0000 7f3bcae71700 1 -- 172.21.15.125:0/543976485 wait complete. 2023-10-17T06:08:36.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.970+0000 7f3bcae71700 1 Processor -- start 2023-10-17T06:08:36.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bcae71700 1 -- start start 2023-10-17T06:08:36.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bcae71700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bc406f9a0 0x7f3bc415c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:36.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bcae71700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bc41467c0 0x7f3bc40c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:36.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bcae71700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bc41612e0 0x7f3bc415ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:36.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bcae71700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc415cd40 con 0x7f3bc41612e0 2023-10-17T06:08:36.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bcae71700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc40c95b0 con 0x7f3bc41467c0 2023-10-17T06:08:36.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bcae71700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc40c9890 con 0x7f3bc406f9a0 2023-10-17T06:08:36.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bc940e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bc41612e0 0x7f3bc415ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:36.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bc940e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bc41612e0 0x7f3bc415ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48668/0 (socket says 172.21.15.125:48668) 2023-10-17T06:08:36.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bc940e700 1 -- 172.21.15.125:0/2868452270 learned_addr learned my addr 172.21.15.125:0/2868452270 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:36.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bc3fff700 1 --2- 172.21.15.125:0/2868452270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bc41467c0 0x7f3bc40c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:36.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bc8c0d700 1 --2- 172.21.15.125:0/2868452270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bc406f9a0 0x7f3bc415c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:36.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bc940e700 1 -- 172.21.15.125:0/2868452270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bc406f9a0 msgr2=0x7f3bc415c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:36.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bc940e700 1 --2- 172.21.15.125:0/2868452270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bc406f9a0 0x7f3bc415c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:36.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bc940e700 1 -- 172.21.15.125:0/2868452270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bc41467c0 msgr2=0x7f3bc40c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:36.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bc940e700 1 --2- 172.21.15.125:0/2868452270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bc41467c0 0x7f3bc40c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:36.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bc940e700 1 -- 172.21.15.125:0/2868452270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb00094b0 con 0x7f3bc41612e0 2023-10-17T06:08:36.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bc8c0d700 1 --2- 172.21.15.125:0/2868452270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bc406f9a0 0x7f3bc415c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:36.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bc940e700 1 --2- 172.21.15.125:0/2868452270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bc41612e0 0x7f3bc415ec10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc002230 tx=0x7f3bbc00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:36.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bc17fa700 1 -- 172.21.15.125:0/2868452270 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc00ab70 con 0x7f3bc41612e0 2023-10-17T06:08:36.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bc17fa700 1 -- 172.21.15.125:0/2868452270 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bbc00acf0 con 0x7f3bc41612e0 2023-10-17T06:08:36.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bc17fa700 1 -- 172.21.15.125:0/2868452270 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc007310 con 0x7f3bc41612e0 2023-10-17T06:08:36.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bcae71700 1 -- 172.21.15.125:0/2868452270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc413f120 con 0x7f3bc41612e0 2023-10-17T06:08:36.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.974+0000 7f3bcae71700 1 -- 172.21.15.125:0/2868452270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc40c9270 con 0x7f3bc41612e0 2023-10-17T06:08:36.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.978+0000 7f3bcae71700 1 -- 172.21.15.125:0/2868452270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc413f640 con 0x7f3bc41612e0 2023-10-17T06:08:36.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.978+0000 7f3bc17fa700 1 -- 172.21.15.125:0/2868452270 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f3bbc007470 con 0x7f3bc41612e0 2023-10-17T06:08:36.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.982+0000 7f3bc17fa700 1 --2- 172.21.15.125:0/2868452270 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3ba80656f0 0x7f3ba8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:36.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.982+0000 7f3bc17fa700 1 -- 172.21.15.125:0/2868452270 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f3bbc082c20 con 0x7f3bc41612e0 2023-10-17T06:08:36.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.982+0000 7f3bc8c0d700 1 --2- 172.21.15.125:0/2868452270 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3ba80656f0 0x7f3ba8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:36.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.982+0000 7f3bc8c0d700 1 --2- 172.21.15.125:0/2868452270 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3ba80656f0 0x7f3ba8067bb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80037d0 tx=0x7f3bb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:36.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:36.986+0000 7f3bc17fa700 1 -- 172.21.15.125:0/2868452270 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f3bc413f640 con 0x7f3bc41612e0 2023-10-17T06:08:37.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.462+0000 7f3bcae71700 1 -- 172.21.15.125:0/2868452270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3bc413f640 con 0x7f3bc41612e0 2023-10-17T06:08:37.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.722+0000 7f3bc17fa700 1 -- 172.21.15.125:0/2868452270 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3bc413f640 con 0x7f3bc41612e0 2023-10-17T06:08:37.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.726+0000 7f3bcae71700 1 -- 172.21.15.125:0/2868452270 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3ba80656f0 msgr2=0x7f3ba8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:37.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.726+0000 7f3bcae71700 1 --2- 172.21.15.125:0/2868452270 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3ba80656f0 0x7f3ba8067bb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80037d0 tx=0x7f3bb8008040 comp rx=0 tx=0).stop 2023-10-17T06:08:37.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.726+0000 7f3bcae71700 1 -- 172.21.15.125:0/2868452270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bc41612e0 msgr2=0x7f3bc415ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:37.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.726+0000 7f3bcae71700 1 --2- 172.21.15.125:0/2868452270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bc41612e0 0x7f3bc415ec10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc002230 tx=0x7f3bbc00cf50 comp rx=0 tx=0).stop 2023-10-17T06:08:37.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.726+0000 7f3bcae71700 1 -- 172.21.15.125:0/2868452270 shutdown_connections 2023-10-17T06:08:37.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.726+0000 7f3bcae71700 1 --2- 172.21.15.125:0/2868452270 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3ba80656f0 0x7f3ba8067bb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:37.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.726+0000 7f3bcae71700 1 --2- 172.21.15.125:0/2868452270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bc41612e0 0x7f3bc415ec10 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:37.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.726+0000 7f3bcae71700 1 --2- 172.21.15.125:0/2868452270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bc41467c0 0x7f3bc40c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:37.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.726+0000 7f3bcae71700 1 --2- 172.21.15.125:0/2868452270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bc406f9a0 0x7f3bc415c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:37.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.726+0000 7f3bcae71700 1 -- 172.21.15.125:0/2868452270 >> 172.21.15.125:0/2868452270 conn(0x7f3bc406a130 msgr2=0x7f3bc41442e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:37.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.726+0000 7f3bcae71700 1 -- 172.21.15.125:0/2868452270 shutdown_connections 2023-10-17T06:08:37.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.726+0000 7f3bcae71700 1 -- 172.21.15.125:0/2868452270 wait complete. 2023-10-17T06:08:37.755 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-17T06:08:37.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.982+0000 7f02886fa700 1 Processor -- start 2023-10-17T06:08:37.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.982+0000 7f02886fa700 1 -- start start 2023-10-17T06:08:37.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.986+0000 7f02886fa700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f028015cde0 0x7f02800708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:37.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.986+0000 7f02886fa700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f028015d1c0 con 0x7f028006e440 2023-10-17T06:08:37.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.986+0000 7f02886fa700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0280070df0 con 0x7f028006e8d0 2023-10-17T06:08:37.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.986+0000 7f02886fa700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f028006f810 con 0x7f028015cde0 2023-10-17T06:08:37.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.986+0000 7f0285c95700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f028006e440 0x7f02800b64d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58980/0 (socket says 172.21.15.125:58980) 2023-10-17T06:08:37.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.986+0000 7f0285c95700 1 -- 172.21.15.125:0/3013215249 learned_addr learned my addr 172.21.15.125:0/3013215249 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:37.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.986+0000 7f0286496700 1 --2- 172.21.15.125:0/3013215249 >> v2:172.21.15.125:3300/0 conn(0x7f028015cde0 0x7f02800708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:37.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.986+0000 7f0285494700 1 -- 172.21.15.125:0/3013215249 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018616771 0 0) 0x7f028015d1c0 con 0x7f028006e440 2023-10-17T06:08:37.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.986+0000 7f0285494700 1 -- 172.21.15.125:0/3013215249 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f026c0035d0 con 0x7f028006e440 2023-10-17T06:08:37.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.986+0000 7f0285494700 1 -- 172.21.15.125:0/3013215249 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943383220 0 0) 0x7f0278001490 con 0x7f028006e8d0 2023-10-17T06:08:37.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.986+0000 7f0285494700 1 -- 172.21.15.125:0/3013215249 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f028015d1c0 con 0x7f028006e8d0 2023-10-17T06:08:37.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.986+0000 7f0286496700 1 -- 172.21.15.125:0/3013215249 >> v1:172.21.15.184:6789/0 conn(0x7f028006e8d0 legacy=0x7f02800cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:37.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.986+0000 7f0286496700 1 -- 172.21.15.125:0/3013215249 >> v1:172.21.15.125:6789/0 conn(0x7f028006e440 legacy=0x7f02800b64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:37.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.986+0000 7f0286496700 1 -- 172.21.15.125:0/3013215249 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028006faf0 con 0x7f028015cde0 2023-10-17T06:08:37.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.990+0000 7f0286496700 1 --2- 172.21.15.125:0/3013215249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f028015cde0 0x7f02800708b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f027c009850 tx=0x7f027c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbbe765d3ba3e3e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:37.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.990+0000 7f0285494700 1 -- 172.21.15.125:0/3013215249 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c011830 con 0x7f028015cde0 2023-10-17T06:08:37.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.990+0000 7f0285494700 1 -- 172.21.15.125:0/3013215249 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c011990 con 0x7f028015cde0 2023-10-17T06:08:38.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.990+0000 7f0285494700 1 -- 172.21.15.125:0/3013215249 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c011d40 con 0x7f028015cde0 2023-10-17T06:08:38.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.990+0000 7f02886fa700 1 -- 172.21.15.125:0/3013215249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f028015cde0 msgr2=0x7f02800708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:38.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.990+0000 7f02886fa700 1 --2- 172.21.15.125:0/3013215249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f028015cde0 0x7f02800708b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f027c009850 tx=0x7f027c009b60 comp rx=0 tx=0).stop 2023-10-17T06:08:38.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.990+0000 7f02886fa700 1 -- 172.21.15.125:0/3013215249 shutdown_connections 2023-10-17T06:08:38.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.990+0000 7f02886fa700 1 --2- 172.21.15.125:0/3013215249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f028015cde0 0x7f02800708b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:38.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.990+0000 7f02886fa700 1 -- 172.21.15.125:0/3013215249 >> 172.21.15.125:0/3013215249 conn(0x7f028006a130 msgr2=0x7f028006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:38.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.990+0000 7f02886fa700 1 -- 172.21.15.125:0/3013215249 shutdown_connections 2023-10-17T06:08:38.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.990+0000 7f02886fa700 1 -- 172.21.15.125:0/3013215249 wait complete. 2023-10-17T06:08:38.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.994+0000 7f02886fa700 1 Processor -- start 2023-10-17T06:08:38.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.994+0000 7f02886fa700 1 -- start start 2023-10-17T06:08:38.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.994+0000 7f02886fa700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f028006e440 0x7f02801f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:38.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.994+0000 7f02886fa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f028006e8d0 0x7f0280148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:38.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.994+0000 7f02886fa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f028015cde0 0x7f02801458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:38.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.994+0000 7f02886fa700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02801490e0 con 0x7f028006e8d0 2023-10-17T06:08:38.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.994+0000 7f02886fa700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02801461a0 con 0x7f028006e440 2023-10-17T06:08:38.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.994+0000 7f02886fa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0280145df0 con 0x7f028015cde0 2023-10-17T06:08:38.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.994+0000 7f0285c95700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f028006e8d0 0x7f0280148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:38.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.994+0000 7f0285c95700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f028006e8d0 0x7f0280148ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48692/0 (socket says 172.21.15.125:48692) 2023-10-17T06:08:38.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.994+0000 7f0285c95700 1 -- 172.21.15.125:0/1186316418 learned_addr learned my addr 172.21.15.125:0/1186316418 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:38.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.994+0000 7f0286496700 1 --2- 172.21.15.125:0/1186316418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f028006e440 0x7f02801f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:38.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.994+0000 7f0286c97700 1 --2- 172.21.15.125:0/1186316418 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f028015cde0 0x7f02801458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:38.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.998+0000 7f0285c95700 1 -- 172.21.15.125:0/1186316418 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f028015cde0 msgr2=0x7f02801458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:38.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.998+0000 7f0285c95700 1 --2- 172.21.15.125:0/1186316418 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f028015cde0 0x7f02801458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:38.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.998+0000 7f0285c95700 1 -- 172.21.15.125:0/1186316418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f028006e440 msgr2=0x7f02801f25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:38.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.998+0000 7f0285c95700 1 --2- 172.21.15.125:0/1186316418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f028006e440 0x7f02801f25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:38.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.998+0000 7f0285c95700 1 -- 172.21.15.125:0/1186316418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c0094b0 con 0x7f028006e8d0 2023-10-17T06:08:38.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.998+0000 7f0285c95700 1 --2- 172.21.15.125:0/1186316418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f028006e8d0 0x7f0280148ba0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f027000c560 tx=0x7f027000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:38.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.998+0000 7f0276ffd700 1 -- 172.21.15.125:0/1186316418 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0270005d90 con 0x7f028006e8d0 2023-10-17T06:08:38.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.998+0000 7f0276ffd700 1 -- 172.21.15.125:0/1186316418 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02700070d0 con 0x7f028006e8d0 2023-10-17T06:08:38.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.998+0000 7f02886fa700 1 -- 172.21.15.125:0/1186316418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02801f2bf0 con 0x7f028006e8d0 2023-10-17T06:08:38.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.998+0000 7f0276ffd700 1 -- 172.21.15.125:0/1186316418 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0270007460 con 0x7f028006e8d0 2023-10-17T06:08:38.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.998+0000 7f02886fa700 1 -- 172.21.15.125:0/1186316418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02801f31b0 con 0x7f028006e8d0 2023-10-17T06:08:38.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:37.998+0000 7f02886fa700 1 -- 172.21.15.125:0/1186316418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0280146310 con 0x7f028006e8d0 2023-10-17T06:08:38.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.002+0000 7f0276ffd700 1 -- 172.21.15.125:0/1186316418 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f02700075c0 con 0x7f028006e8d0 2023-10-17T06:08:38.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.002+0000 7f0276ffd700 1 --2- 172.21.15.125:0/1186316418 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02640656f0 0x7f0264067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:38.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.002+0000 7f0276ffd700 1 -- 172.21.15.125:0/1186316418 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f0270082680 con 0x7f028006e8d0 2023-10-17T06:08:38.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.002+0000 7f0286496700 1 --2- 172.21.15.125:0/1186316418 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02640656f0 0x7f0264067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:38.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.002+0000 7f0286496700 1 --2- 172.21.15.125:0/1186316418 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02640656f0 0x7f0264067bb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f027c0090b0 tx=0x7f027c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:38.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.010+0000 7f0276ffd700 1 -- 172.21.15.125:0/1186316418 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f027004fd20 con 0x7f028006e8d0 2023-10-17T06:08:38.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.190+0000 7f02886fa700 1 -- 172.21.15.125:0/1186316418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0280073f00 con 0x7f028006e8d0 2023-10-17T06:08:38.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.734+0000 7f0276ffd700 1 -- 172.21.15.125:0/1186316418 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v32) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0270053340 con 0x7f028006e8d0 2023-10-17T06:08:38.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.742+0000 7f02886fa700 1 -- 172.21.15.125:0/1186316418 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02640656f0 msgr2=0x7f0264067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:38.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.742+0000 7f02886fa700 1 --2- 172.21.15.125:0/1186316418 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02640656f0 0x7f0264067bb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f027c0090b0 tx=0x7f027c01c040 comp rx=0 tx=0).stop 2023-10-17T06:08:38.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.742+0000 7f02886fa700 1 -- 172.21.15.125:0/1186316418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f028006e8d0 msgr2=0x7f0280148ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:38.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.742+0000 7f02886fa700 1 --2- 172.21.15.125:0/1186316418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f028006e8d0 0x7f0280148ba0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f027000c560 tx=0x7f027000c870 comp rx=0 tx=0).stop 2023-10-17T06:08:38.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.742+0000 7f02886fa700 1 -- 172.21.15.125:0/1186316418 shutdown_connections 2023-10-17T06:08:38.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.742+0000 7f02886fa700 1 --2- 172.21.15.125:0/1186316418 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f02640656f0 0x7f0264067bb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:38.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.742+0000 7f02886fa700 1 --2- 172.21.15.125:0/1186316418 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f028015cde0 0x7f02801458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:38.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.742+0000 7f02886fa700 1 --2- 172.21.15.125:0/1186316418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f028006e8d0 0x7f0280148ba0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:38.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.742+0000 7f02886fa700 1 --2- 172.21.15.125:0/1186316418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f028006e440 0x7f02801f25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:38.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.742+0000 7f02886fa700 1 -- 172.21.15.125:0/1186316418 >> 172.21.15.125:0/1186316418 conn(0x7f028006a130 msgr2=0x7f02800b5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:38.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.742+0000 7f02886fa700 1 -- 172.21.15.125:0/1186316418 shutdown_connections 2023-10-17T06:08:38.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.742+0000 7f02886fa700 1 -- 172.21.15.125:0/1186316418 wait complete. 2023-10-17T06:08:38.750 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_metadata' removed 2023-10-17T06:08:38.770 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-17T06:08:38.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.958+0000 7f7d7a584700 1 Processor -- start 2023-10-17T06:08:38.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.958+0000 7f7d7a584700 1 -- start start 2023-10-17T06:08:38.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d7a584700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7d741467a0 0x7f7d740b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:38.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d7a584700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d740b5560 0x7f7d740ced80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:38.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d7a584700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7d740cf2c0 0x7f7d74160770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:38.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d7a584700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d740cf9f0 con 0x7f7d740cf2c0 2023-10-17T06:08:38.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d7a584700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d740cf750 con 0x7f7d741467a0 2023-10-17T06:08:38.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d7a584700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d740d2200 con 0x7f7d740b5560 2023-10-17T06:08:38.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d79d83700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7d740cf2c0 0x7f7d74160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:38.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d79d83700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7d740cf2c0 0x7f7d74160770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48704/0 (socket says 172.21.15.125:48704) 2023-10-17T06:08:38.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d79d83700 1 -- 172.21.15.125:0/2478782251 learned_addr learned my addr 172.21.15.125:0/2478782251 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:38.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d79582700 1 --2- 172.21.15.125:0/2478782251 >> v2:172.21.15.184:3300/0 conn(0x7f7d741467a0 0x7f7d740b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:38.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d78d81700 1 --2- 172.21.15.125:0/2478782251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d740b5560 0x7f7d740ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:38.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d79d83700 1 -- 172.21.15.125:0/2478782251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d740b5560 msgr2=0x7f7d740ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:38.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d79d83700 1 --2- 172.21.15.125:0/2478782251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d740b5560 0x7f7d740ced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:38.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d79d83700 1 -- 172.21.15.125:0/2478782251 >> v2:172.21.15.184:3300/0 conn(0x7f7d741467a0 msgr2=0x7f7d740b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:38.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d79d83700 1 --2- 172.21.15.125:0/2478782251 >> v2:172.21.15.184:3300/0 conn(0x7f7d741467a0 0x7f7d740b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:38.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d79d83700 1 -- 172.21.15.125:0/2478782251 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7406f5f0 con 0x7f7d740cf2c0 2023-10-17T06:08:38.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d79d83700 1 --2- 172.21.15.125:0/2478782251 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d740cf2c0 0x7f7d74160770 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7d740b4ff0 tx=0x7f7d6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0d41b92e774b93 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:38.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d6bfff700 1 -- 172.21.15.125:0/2478782251 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c00e070 con 0x7f7d740cf2c0 2023-10-17T06:08:38.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d6bfff700 1 -- 172.21.15.125:0/2478782251 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6c00b980 con 0x7f7d740cf2c0 2023-10-17T06:08:38.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d6bfff700 1 -- 172.21.15.125:0/2478782251 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c00bd30 con 0x7f7d740cf2c0 2023-10-17T06:08:38.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d7a584700 1 -- 172.21.15.125:0/2478782251 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d740cf2c0 msgr2=0x7f7d74160770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:38.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.962+0000 7f7d7a584700 1 --2- 172.21.15.125:0/2478782251 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d740cf2c0 0x7f7d74160770 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7d740b4ff0 tx=0x7f7d6c00b330 comp rx=0 tx=0).stop 2023-10-17T06:08:38.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.966+0000 7f7d7a584700 1 -- 172.21.15.125:0/2478782251 shutdown_connections 2023-10-17T06:08:38.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.966+0000 7f7d7a584700 1 --2- 172.21.15.125:0/2478782251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d740b5560 0x7f7d740ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:38.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.966+0000 7f7d7a584700 1 --2- 172.21.15.125:0/2478782251 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d740cf2c0 0x7f7d74160770 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:38.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.966+0000 7f7d7a584700 1 --2- 172.21.15.125:0/2478782251 >> v2:172.21.15.184:3300/0 conn(0x7f7d741467a0 0x7f7d740b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:38.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.966+0000 7f7d7a584700 1 -- 172.21.15.125:0/2478782251 >> 172.21.15.125:0/2478782251 conn(0x7f7d7406ce90 msgr2=0x7f7d740b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:38.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.966+0000 7f7d7a584700 1 -- 172.21.15.125:0/2478782251 shutdown_connections 2023-10-17T06:08:38.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.966+0000 7f7d7a584700 1 -- 172.21.15.125:0/2478782251 wait complete. 2023-10-17T06:08:38.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.966+0000 7f7d7a584700 1 Processor -- start 2023-10-17T06:08:38.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.966+0000 7f7d7a584700 1 -- start start 2023-10-17T06:08:38.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d7a584700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d740b5560 0x7f7d741f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:38.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d7a584700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d740cf2c0 0x7f7d741406d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:38.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d7a584700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d741467a0 0x7f7d741f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:38.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d7a584700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d741f32a0 con 0x7f7d740b5560 2023-10-17T06:08:38.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d7a584700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d74144f30 con 0x7f7d740cf2c0 2023-10-17T06:08:38.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d7a584700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d74140c10 con 0x7f7d741467a0 2023-10-17T06:08:38.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d79582700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d740b5560 0x7f7d741f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:38.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d79582700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d740b5560 0x7f7d741f22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48716/0 (socket says 172.21.15.125:48716) 2023-10-17T06:08:38.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d79582700 1 -- 172.21.15.125:0/3998896960 learned_addr learned my addr 172.21.15.125:0/3998896960 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:38.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d79d83700 1 --2- 172.21.15.125:0/3998896960 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d741467a0 0x7f7d741f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:38.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d78d81700 1 --2- 172.21.15.125:0/3998896960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d740cf2c0 0x7f7d741406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:38.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d79582700 1 -- 172.21.15.125:0/3998896960 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d741467a0 msgr2=0x7f7d741f5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:38.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d79582700 1 --2- 172.21.15.125:0/3998896960 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d741467a0 0x7f7d741f5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:38.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d79582700 1 -- 172.21.15.125:0/3998896960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d740cf2c0 msgr2=0x7f7d741406d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:38.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d79582700 1 --2- 172.21.15.125:0/3998896960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d740cf2c0 0x7f7d741406d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:38.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d79582700 1 -- 172.21.15.125:0/3998896960 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c009b30 con 0x7f7d740b5560 2023-10-17T06:08:38.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d79582700 1 --2- 172.21.15.125:0/3998896960 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d740b5560 0x7f7d741f22f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7d7000e760 tx=0x7f7d7000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:38.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d69ffb700 1 -- 172.21.15.125:0/3998896960 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d70013610 con 0x7f7d740b5560 2023-10-17T06:08:38.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d69ffb700 1 -- 172.21.15.125:0/3998896960 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d70013770 con 0x7f7d740b5560 2023-10-17T06:08:38.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d7a584700 1 -- 172.21.15.125:0/3998896960 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d741f2a00 con 0x7f7d740b5560 2023-10-17T06:08:38.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d69ffb700 1 -- 172.21.15.125:0/3998896960 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d70013ae0 con 0x7f7d740b5560 2023-10-17T06:08:38.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.970+0000 7f7d7a584700 1 -- 172.21.15.125:0/3998896960 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d741f2fc0 con 0x7f7d740b5560 2023-10-17T06:08:38.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.974+0000 7f7d7a584700 1 -- 172.21.15.125:0/3998896960 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d74072e60 con 0x7f7d740b5560 2023-10-17T06:08:38.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.974+0000 7f7d69ffb700 1 -- 172.21.15.125:0/3998896960 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7d70013c40 con 0x7f7d740b5560 2023-10-17T06:08:38.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.974+0000 7f7d69ffb700 1 --2- 172.21.15.125:0/3998896960 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7d580656f0 0x7f7d58067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:38.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.974+0000 7f7d69ffb700 1 -- 172.21.15.125:0/3998896960 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f7d70082d00 con 0x7f7d740b5560 2023-10-17T06:08:38.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.974+0000 7f7d78d81700 1 --2- 172.21.15.125:0/3998896960 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7d580656f0 0x7f7d58067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:38.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.978+0000 7f7d78d81700 1 --2- 172.21.15.125:0/3998896960 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7d580656f0 0x7f7d58067bb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7d740b6970 tx=0x7f7d64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:38.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:38.978+0000 7f7d69ffb700 1 -- 172.21.15.125:0/3998896960 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f7d70053fe0 con 0x7f7d740b5560 2023-10-17T06:08:39.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.234+0000 7f7d7a584700 1 -- 172.21.15.125:0/3998896960 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7d740b4030 con 0x7f7d740b5560 2023-10-17T06:08:39.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.738+0000 7f7d69ffb700 1 -- 172.21.15.125:0/3998896960 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v33) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7d700210d0 con 0x7f7d740b5560 2023-10-17T06:08:39.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.742+0000 7f7d7a584700 1 -- 172.21.15.125:0/3998896960 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7d580656f0 msgr2=0x7f7d58067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:39.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.742+0000 7f7d7a584700 1 --2- 172.21.15.125:0/3998896960 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7d580656f0 0x7f7d58067bb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7d740b6970 tx=0x7f7d64008040 comp rx=0 tx=0).stop 2023-10-17T06:08:39.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.742+0000 7f7d7a584700 1 -- 172.21.15.125:0/3998896960 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d740b5560 msgr2=0x7f7d741f22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:39.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.742+0000 7f7d7a584700 1 --2- 172.21.15.125:0/3998896960 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d740b5560 0x7f7d741f22f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7d7000e760 tx=0x7f7d7000eb20 comp rx=0 tx=0).stop 2023-10-17T06:08:39.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.742+0000 7f7d7a584700 1 -- 172.21.15.125:0/3998896960 shutdown_connections 2023-10-17T06:08:39.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.746+0000 7f7d7a584700 1 --2- 172.21.15.125:0/3998896960 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7d580656f0 0x7f7d58067bb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:39.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.746+0000 7f7d7a584700 1 --2- 172.21.15.125:0/3998896960 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7d741467a0 0x7f7d741f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:39.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.746+0000 7f7d7a584700 1 --2- 172.21.15.125:0/3998896960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7d740cf2c0 0x7f7d741406d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:39.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.746+0000 7f7d7a584700 1 --2- 172.21.15.125:0/3998896960 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d740b5560 0x7f7d741f22f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:39.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.746+0000 7f7d7a584700 1 -- 172.21.15.125:0/3998896960 >> 172.21.15.125:0/3998896960 conn(0x7f7d7406ce90 msgr2=0x7f7d740b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:39.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.746+0000 7f7d7a584700 1 -- 172.21.15.125:0/3998896960 shutdown_connections 2023-10-17T06:08:39.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.746+0000 7f7d7a584700 1 -- 172.21.15.125:0/3998896960 wait complete. 2023-10-17T06:08:39.755 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data' removed 2023-10-17T06:08:39.775 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-17T06:08:39.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.962+0000 7f9d26a82700 1 Processor -- start 2023-10-17T06:08:39.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.962+0000 7f9d26a82700 1 -- start start 2023-10-17T06:08:39.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.966+0000 7f9d26a82700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9d2015adc0 0x7f9d200d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:39.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.966+0000 7f9d26a82700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9d2006f450 0x7f9d2006f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:39.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.966+0000 7f9d26a82700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d200b69b0 con 0x7f9d200cbc60 2023-10-17T06:08:39.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.966+0000 7f9d26a82700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d20070df0 con 0x7f9d2015adc0 2023-10-17T06:08:39.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.966+0000 7f9d26a82700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d2015b1a0 con 0x7f9d2006f450 2023-10-17T06:08:39.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.966+0000 7f9d2481e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9d2015adc0 0x7f9d200d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:39.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.966+0000 7f9d2481e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9d2015adc0 0x7f9d200d03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48726/0 (socket says 172.21.15.125:48726) 2023-10-17T06:08:39.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.966+0000 7f9d2481e700 1 -- 172.21.15.125:0/2088332008 learned_addr learned my addr 172.21.15.125:0/2088332008 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:39.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.966+0000 7f9d2501f700 1 --2- 172.21.15.125:0/2088332008 >> v2:172.21.15.184:3300/0 conn(0x7f9d2006f450 0x7f9d2006f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:39.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.966+0000 7f9d2481e700 1 -- 172.21.15.125:0/2088332008 >> v2:172.21.15.184:3300/0 conn(0x7f9d2006f450 msgr2=0x7f9d2006f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:39.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.966+0000 7f9d2481e700 1 --2- 172.21.15.125:0/2088332008 >> v2:172.21.15.184:3300/0 conn(0x7f9d2006f450 0x7f9d2006f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:39.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.966+0000 7f9d2481e700 1 -- 172.21.15.125:0/2088332008 >> v1:172.21.15.184:6789/0 conn(0x7f9d200cbc60 legacy=0x7f9d200b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:39.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.966+0000 7f9d2481e700 1 -- 172.21.15.125:0/2088332008 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d200cf610 con 0x7f9d2015adc0 2023-10-17T06:08:39.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.966+0000 7f9d2481e700 1 --2- 172.21.15.125:0/2088332008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d2015adc0 0x7f9d200d03d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9d2006f150 tx=0x7f9d14009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48b0d29b7f1c70f server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:39.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.970+0000 7f9d1f7fe700 1 -- 172.21.15.125:0/2088332008 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14011830 con 0x7f9d2015adc0 2023-10-17T06:08:39.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.970+0000 7f9d1f7fe700 1 -- 172.21.15.125:0/2088332008 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d14011990 con 0x7f9d2015adc0 2023-10-17T06:08:39.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.970+0000 7f9d1f7fe700 1 -- 172.21.15.125:0/2088332008 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14011d20 con 0x7f9d2015adc0 2023-10-17T06:08:39.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.970+0000 7f9d26a82700 1 -- 172.21.15.125:0/2088332008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d2015adc0 msgr2=0x7f9d200d03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:39.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.970+0000 7f9d26a82700 1 --2- 172.21.15.125:0/2088332008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d2015adc0 0x7f9d200d03d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9d2006f150 tx=0x7f9d14009bf0 comp rx=0 tx=0).stop 2023-10-17T06:08:39.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.970+0000 7f9d26a82700 1 -- 172.21.15.125:0/2088332008 shutdown_connections 2023-10-17T06:08:39.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.970+0000 7f9d26a82700 1 --2- 172.21.15.125:0/2088332008 >> v2:172.21.15.184:3300/0 conn(0x7f9d2006f450 0x7f9d2006f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:39.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.970+0000 7f9d26a82700 1 --2- 172.21.15.125:0/2088332008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d2015adc0 0x7f9d200d03d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:39.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.970+0000 7f9d26a82700 1 -- 172.21.15.125:0/2088332008 >> 172.21.15.125:0/2088332008 conn(0x7f9d200d09b0 msgr2=0x7f9d200d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:39.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.970+0000 7f9d26a82700 1 -- 172.21.15.125:0/2088332008 shutdown_connections 2023-10-17T06:08:39.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.970+0000 7f9d26a82700 1 -- 172.21.15.125:0/2088332008 wait complete. 2023-10-17T06:08:39.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.974+0000 7f9d26a82700 1 Processor -- start 2023-10-17T06:08:39.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.974+0000 7f9d26a82700 1 -- start start 2023-10-17T06:08:39.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.974+0000 7f9d26a82700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d2006f450 0x7f9d200c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:39.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.974+0000 7f9d26a82700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d200cbc60 0x7f9d2015db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:39.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.974+0000 7f9d26a82700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d2015adc0 0x7f9d20146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:39.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.974+0000 7f9d26a82700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200c8b70 con 0x7f9d2015adc0 2023-10-17T06:08:39.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.974+0000 7f9d26a82700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200c8f00 con 0x7f9d200cbc60 2023-10-17T06:08:39.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.974+0000 7f9d26a82700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200c82d0 con 0x7f9d2006f450 2023-10-17T06:08:39.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.978+0000 7f9d2501f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d2015adc0 0x7f9d20146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:39.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.978+0000 7f9d2501f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d2015adc0 0x7f9d20146a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48734/0 (socket says 172.21.15.125:48734) 2023-10-17T06:08:39.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.978+0000 7f9d2501f700 1 -- 172.21.15.125:0/3051490251 learned_addr learned my addr 172.21.15.125:0/3051490251 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:39.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.978+0000 7f9d1ffff700 1 --2- 172.21.15.125:0/3051490251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d200cbc60 0x7f9d2015db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:39.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.978+0000 7f9d2481e700 1 --2- 172.21.15.125:0/3051490251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d2006f450 0x7f9d200c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:39.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.978+0000 7f9d2501f700 1 -- 172.21.15.125:0/3051490251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d2006f450 msgr2=0x7f9d200c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:39.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.978+0000 7f9d2501f700 1 --2- 172.21.15.125:0/3051490251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d2006f450 0x7f9d200c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:39.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.978+0000 7f9d2501f700 1 -- 172.21.15.125:0/3051490251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d200cbc60 msgr2=0x7f9d2015db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:39.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.978+0000 7f9d2501f700 1 --2- 172.21.15.125:0/3051490251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d200cbc60 0x7f9d2015db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:39.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.978+0000 7f9d2501f700 1 -- 172.21.15.125:0/3051490251 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d14009570 con 0x7f9d2015adc0 2023-10-17T06:08:39.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.978+0000 7f9d2481e700 1 --2- 172.21.15.125:0/3051490251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d2006f450 0x7f9d200c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:39.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.978+0000 7f9d2501f700 1 --2- 172.21.15.125:0/3051490251 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d2015adc0 0x7f9d20146a10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009d30 tx=0x7f9d1800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:39.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.978+0000 7f9d1d7fa700 1 -- 172.21.15.125:0/3051490251 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1800cd40 con 0x7f9d2015adc0 2023-10-17T06:08:39.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.978+0000 7f9d1d7fa700 1 -- 172.21.15.125:0/3051490251 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1800f040 con 0x7f9d2015adc0 2023-10-17T06:08:39.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.978+0000 7f9d1d7fa700 1 -- 172.21.15.125:0/3051490251 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d180146c0 con 0x7f9d2015adc0 2023-10-17T06:08:39.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.978+0000 7f9d26a82700 1 -- 172.21.15.125:0/3051490251 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d200c85b0 con 0x7f9d2015adc0 2023-10-17T06:08:39.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.978+0000 7f9d26a82700 1 -- 172.21.15.125:0/3051490251 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d200c7fc0 con 0x7f9d2015adc0 2023-10-17T06:08:39.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.982+0000 7f9d26a82700 1 -- 172.21.15.125:0/3051490251 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d200c8cd0 con 0x7f9d2015adc0 2023-10-17T06:08:39.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.982+0000 7f9d1d7fa700 1 -- 172.21.15.125:0/3051490251 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9d18014820 con 0x7f9d2015adc0 2023-10-17T06:08:39.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.982+0000 7f9d1d7fa700 1 --2- 172.21.15.125:0/3051490251 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9d040656f0 0x7f9d04067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:39.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.982+0000 7f9d1d7fa700 1 -- 172.21.15.125:0/3051490251 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f9d180834d0 con 0x7f9d2015adc0 2023-10-17T06:08:39.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.982+0000 7f9d2481e700 1 --2- 172.21.15.125:0/3051490251 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9d040656f0 0x7f9d04067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:39.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.986+0000 7f9d2481e700 1 --2- 172.21.15.125:0/3051490251 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9d040656f0 0x7f9d04067bb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9d14000c00 tx=0x7f9d14008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:39.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:39.990+0000 7f9d1d7fa700 1 -- 172.21.15.125:0/3051490251 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f9d200c8cd0 con 0x7f9d2015adc0 2023-10-17T06:08:40.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:40.190+0000 7f9d26a82700 1 -- 172.21.15.125:0/3051490251 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9d20073f00 con 0x7f9d2015adc0 2023-10-17T06:08:40.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:40.762+0000 7f9d1d7fa700 1 -- 172.21.15.125:0/3051490251 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v34) v1 ==== 178+0+0 (secure 0 0 0) 0x7f9d18051030 con 0x7f9d2015adc0 2023-10-17T06:08:40.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:40.770+0000 7f9d26a82700 1 -- 172.21.15.125:0/3051490251 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9d040656f0 msgr2=0x7f9d04067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:40.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:40.770+0000 7f9d26a82700 1 --2- 172.21.15.125:0/3051490251 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9d040656f0 0x7f9d04067bb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9d14000c00 tx=0x7f9d14008030 comp rx=0 tx=0).stop 2023-10-17T06:08:40.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:40.770+0000 7f9d26a82700 1 -- 172.21.15.125:0/3051490251 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d2015adc0 msgr2=0x7f9d20146a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:40.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:40.770+0000 7f9d26a82700 1 --2- 172.21.15.125:0/3051490251 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d2015adc0 0x7f9d20146a10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009d30 tx=0x7f9d1800c3a0 comp rx=0 tx=0).stop 2023-10-17T06:08:40.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:40.770+0000 7f9d26a82700 1 -- 172.21.15.125:0/3051490251 shutdown_connections 2023-10-17T06:08:40.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:40.770+0000 7f9d26a82700 1 --2- 172.21.15.125:0/3051490251 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9d040656f0 0x7f9d04067bb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:40.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:40.770+0000 7f9d26a82700 1 --2- 172.21.15.125:0/3051490251 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9d2015adc0 0x7f9d20146a10 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:40.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:40.770+0000 7f9d26a82700 1 --2- 172.21.15.125:0/3051490251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d200cbc60 0x7f9d2015db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:40.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:40.770+0000 7f9d26a82700 1 --2- 172.21.15.125:0/3051490251 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9d2006f450 0x7f9d200c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:40.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:40.770+0000 7f9d26a82700 1 -- 172.21.15.125:0/3051490251 >> 172.21.15.125:0/3051490251 conn(0x7f9d200d09b0 msgr2=0x7f9d200cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:40.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:40.770+0000 7f9d26a82700 1 -- 172.21.15.125:0/3051490251 shutdown_connections 2023-10-17T06:08:40.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:40.770+0000 7f9d26a82700 1 -- 172.21.15.125:0/3051490251 wait complete. 2023-10-17T06:08:40.778 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data_ec' removed 2023-10-17T06:08:40.798 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-17T06:08:40.798 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-17T06:08:40.799 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-17T06:08:40.799 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:08:40.799 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-17T06:08:40.800 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-17T06:08:40.800 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-17T06:08:40.800 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:08:40.801 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-17T06:08:40.801 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-17T06:08:40.801 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-17T06:08:40.801 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:08:40.802 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-17T06:08:40.802 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-17T06:08:40.802 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-17T06:08:40.803 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:08:40.819 INFO:tasks.ceph.mds.a:Stopped 2023-10-17T06:08:40.819 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-17T06:08:40.822 INFO:tasks.ceph.mds.c:Stopped 2023-10-17T06:08:40.822 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-17T06:08:40.826 INFO:tasks.ceph.mds.d:Stopped 2023-10-17T06:08:40.826 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-17T06:08:40.830 INFO:tasks.ceph.mds.b:Stopped 2023-10-17T06:08:40.831 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-17T06:08:40.874 INFO:tasks.ceph.mds.a:Started 2023-10-17T06:08:40.875 DEBUG:teuthology.parallel:result is None 2023-10-17T06:08:40.878 INFO:tasks.ceph.mds.c:Started 2023-10-17T06:08:40.878 DEBUG:teuthology.parallel:result is None 2023-10-17T06:08:40.883 INFO:tasks.ceph.mds.d:Started 2023-10-17T06:08:40.883 DEBUG:teuthology.parallel:result is None 2023-10-17T06:08:40.887 INFO:tasks.ceph.mds.b:Started 2023-10-17T06:08:40.887 DEBUG:teuthology.parallel:result is None 2023-10-17T06:08:40.888 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-17T06:08:40.987 INFO:tasks.ceph.mds.a.smithi125.stdout:starting mds.a at 2023-10-17T06:08:40.990 INFO:tasks.ceph.mds.c.smithi125.stdout:starting mds.c at 2023-10-17T06:08:41.005 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-10-17T06:08:41.007 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-10-17T06:08:41.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.062+0000 7fd2188d6700 1 Processor -- start 2023-10-17T06:08:41.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.062+0000 7fd2188d6700 1 -- start start 2023-10-17T06:08:41.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.062+0000 7fd2188d6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd214159200 0x7fd21415a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:41.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.062+0000 7fd2188d6700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd2140ce030 0x7fd21406d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:41.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.062+0000 7fd2188d6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21406d870 con 0x7fd21406ced0 2023-10-17T06:08:41.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.062+0000 7fd2188d6700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2140ccb90 con 0x7fd2140ce030 2023-10-17T06:08:41.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd2188d6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21415a890 con 0x7fd214159200 2023-10-17T06:08:41.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd20bfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd21406ced0 0x7fd21406f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58988/0 (socket says 172.21.15.125:58988) 2023-10-17T06:08:41.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd20bfff700 1 -- 172.21.15.125:0/1969511976 learned_addr learned my addr 172.21.15.125:0/1969511976 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd21259c700 1 --2- 172.21.15.125:0/1969511976 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd214159200 0x7fd21415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:41.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd212d9d700 1 --2- 172.21.15.125:0/1969511976 >> v2:172.21.15.184:3300/0 conn(0x7fd2140ce030 0x7fd21406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:41.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd211d9b700 1 -- 172.21.15.125:0/1969511976 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758048788 0 0) 0x7fd21406d870 con 0x7fd21406ced0 2023-10-17T06:08:41.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd211d9b700 1 -- 172.21.15.125:0/1969511976 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1f80035d0 con 0x7fd21406ced0 2023-10-17T06:08:41.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd21259c700 1 -- 172.21.15.125:0/1969511976 >> v2:172.21.15.184:3300/0 conn(0x7fd2140ce030 msgr2=0x7fd21406d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:41.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd21259c700 1 --2- 172.21.15.125:0/1969511976 >> v2:172.21.15.184:3300/0 conn(0x7fd2140ce030 0x7fd21406d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:41.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd21259c700 1 -- 172.21.15.125:0/1969511976 >> v1:172.21.15.125:6789/0 conn(0x7fd21406ced0 legacy=0x7fd21406f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:41.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd21259c700 1 -- 172.21.15.125:0/1969511976 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21415d2f0 con 0x7fd214159200 2023-10-17T06:08:41.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd21259c700 1 --2- 172.21.15.125:0/1969511976 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd214159200 0x7fd21415a350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd204009d90 tx=0x7fd20400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c852f99cddba9ab5 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd211d9b700 1 -- 172.21.15.125:0/1969511976 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20400e070 con 0x7fd214159200 2023-10-17T06:08:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd211d9b700 1 -- 172.21.15.125:0/1969511976 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20400bb20 con 0x7fd214159200 2023-10-17T06:08:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd211d9b700 1 -- 172.21.15.125:0/1969511976 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204012430 con 0x7fd214159200 2023-10-17T06:08:41.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd2188d6700 1 -- 172.21.15.125:0/1969511976 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd214159200 msgr2=0x7fd21415a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:41.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd2188d6700 1 --2- 172.21.15.125:0/1969511976 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd214159200 0x7fd21415a350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd204009d90 tx=0x7fd20400b330 comp rx=0 tx=0).stop 2023-10-17T06:08:41.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd2188d6700 1 -- 172.21.15.125:0/1969511976 shutdown_connections 2023-10-17T06:08:41.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd2188d6700 1 --2- 172.21.15.125:0/1969511976 >> v2:172.21.15.184:3300/0 conn(0x7fd2140ce030 0x7fd21406d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:41.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd2188d6700 1 --2- 172.21.15.125:0/1969511976 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd214159200 0x7fd21415a350 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:41.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.066+0000 7fd2188d6700 1 -- 172.21.15.125:0/1969511976 >> 172.21.15.125:0/1969511976 conn(0x7fd21406a340 msgr2=0x7fd2140b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:41.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.070+0000 7fd2188d6700 1 -- 172.21.15.125:0/1969511976 shutdown_connections 2023-10-17T06:08:41.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.070+0000 7fd2188d6700 1 -- 172.21.15.125:0/1969511976 wait complete. 2023-10-17T06:08:41.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.070+0000 7fd2188d6700 1 Processor -- start 2023-10-17T06:08:41.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd2188d6700 1 -- start start 2023-10-17T06:08:41.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd2188d6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd21406ced0 0x7fd214146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:41.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd2188d6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2140ce030 0x7fd2141f6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:41.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd2188d6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd214159200 0x7fd214159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:41.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd2188d6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd214146aa0 con 0x7fd214159200 2023-10-17T06:08:41.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd2188d6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2141f9bb0 con 0x7fd2140ce030 2023-10-17T06:08:41.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd2188d6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21414bc50 con 0x7fd21406ced0 2023-10-17T06:08:41.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd212d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd214159200 0x7fd214159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:41.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd212d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd214159200 0x7fd214159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48758/0 (socket says 172.21.15.125:48758) 2023-10-17T06:08:41.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd212d9d700 1 -- 172.21.15.125:0/3514149396 learned_addr learned my addr 172.21.15.125:0/3514149396 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:41.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd21259c700 1 --2- 172.21.15.125:0/3514149396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd21406ced0 0x7fd214146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:41.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd20bfff700 1 --2- 172.21.15.125:0/3514149396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2140ce030 0x7fd2141f6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:41.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd212d9d700 1 -- 172.21.15.125:0/3514149396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd21406ced0 msgr2=0x7fd214146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:41.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd212d9d700 1 --2- 172.21.15.125:0/3514149396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd21406ced0 0x7fd214146560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:41.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd212d9d700 1 -- 172.21.15.125:0/3514149396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2140ce030 msgr2=0x7fd2141f6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:41.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd212d9d700 1 --2- 172.21.15.125:0/3514149396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2140ce030 0x7fd2141f6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:41.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd212d9d700 1 -- 172.21.15.125:0/3514149396 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd204009a70 con 0x7fd214159200 2023-10-17T06:08:41.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd20bfff700 1 --2- 172.21.15.125:0/3514149396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2140ce030 0x7fd2141f6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:41.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd212d9d700 1 --2- 172.21.15.125:0/3514149396 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd214159200 0x7fd214159930 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00e900 tx=0x7fd20c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:41.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd20affd700 1 -- 172.21.15.125:0/3514149396 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0096e0 con 0x7fd214159200 2023-10-17T06:08:41.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd20affd700 1 -- 172.21.15.125:0/3514149396 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c00ee50 con 0x7fd214159200 2023-10-17T06:08:41.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd20affd700 1 -- 172.21.15.125:0/3514149396 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c00ca70 con 0x7fd214159200 2023-10-17T06:08:41.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.074+0000 7fd2188d6700 1 -- 172.21.15.125:0/3514149396 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21414bec0 con 0x7fd214159200 2023-10-17T06:08:41.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.078+0000 7fd2188d6700 1 -- 172.21.15.125:0/3514149396 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21414c480 con 0x7fd214159200 2023-10-17T06:08:41.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.078+0000 7fd2188d6700 1 -- 172.21.15.125:0/3514149396 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd214072e60 con 0x7fd214159200 2023-10-17T06:08:41.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.078+0000 7fd20affd700 1 -- 172.21.15.125:0/3514149396 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd20c00cbd0 con 0x7fd214159200 2023-10-17T06:08:41.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.082+0000 7fd20affd700 1 --2- 172.21.15.125:0/3514149396 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd1fc0656f0 0x7fd1fc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:41.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.082+0000 7fd20affd700 1 -- 172.21.15.125:0/3514149396 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fd20c082b40 con 0x7fd214159200 2023-10-17T06:08:41.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.082+0000 7fd21259c700 1 --2- 172.21.15.125:0/3514149396 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd1fc0656f0 0x7fd1fc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:41.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.082+0000 7fd21259c700 1 --2- 172.21.15.125:0/3514149396 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd1fc0656f0 0x7fd1fc067bb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd204014040 tx=0x7fd204011000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:41.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.086+0000 7fd20affd700 1 -- 172.21.15.125:0/3514149396 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fd20c0542e0 con 0x7fd214159200 2023-10-17T06:08:41.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:41.290+0000 7fd2188d6700 1 -- 172.21.15.125:0/3514149396 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd2140cc260 con 0x7fd214159200 2023-10-17T06:08:42.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.626+0000 7fd20affd700 1 -- 172.21.15.125:0/3514149396 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v39) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd20c053e70 con 0x7fd214159200 2023-10-17T06:08:42.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.626+0000 7fd2188d6700 1 -- 172.21.15.125:0/3514149396 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd1fc0656f0 msgr2=0x7fd1fc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:42.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.626+0000 7fd2188d6700 1 --2- 172.21.15.125:0/3514149396 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd1fc0656f0 0x7fd1fc067bb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd204014040 tx=0x7fd204011000 comp rx=0 tx=0).stop 2023-10-17T06:08:42.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.626+0000 7fd2188d6700 1 -- 172.21.15.125:0/3514149396 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd214159200 msgr2=0x7fd214159930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:42.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.626+0000 7fd2188d6700 1 --2- 172.21.15.125:0/3514149396 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd214159200 0x7fd214159930 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00e900 tx=0x7fd20c00ec10 comp rx=0 tx=0).stop 2023-10-17T06:08:42.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.626+0000 7fd2188d6700 1 -- 172.21.15.125:0/3514149396 shutdown_connections 2023-10-17T06:08:42.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.626+0000 7fd2188d6700 1 --2- 172.21.15.125:0/3514149396 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd1fc0656f0 0x7fd1fc067bb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:42.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.630+0000 7fd2188d6700 1 --2- 172.21.15.125:0/3514149396 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd214159200 0x7fd214159930 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:42.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.630+0000 7fd2188d6700 1 --2- 172.21.15.125:0/3514149396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2140ce030 0x7fd2141f6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:42.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.630+0000 7fd2188d6700 1 --2- 172.21.15.125:0/3514149396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd21406ced0 0x7fd214146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:42.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.630+0000 7fd2188d6700 1 -- 172.21.15.125:0/3514149396 >> 172.21.15.125:0/3514149396 conn(0x7fd21406a340 msgr2=0x7fd21415aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:42.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.630+0000 7fd2188d6700 1 -- 172.21.15.125:0/3514149396 shutdown_connections 2023-10-17T06:08:42.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.630+0000 7fd2188d6700 1 -- 172.21.15.125:0/3514149396 wait complete. 2023-10-17T06:08:42.635 INFO:teuthology.orchestra.run.smithi125.stderr: removed all blocklist entries 2023-10-17T06:08:42.655 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-17T06:08:42.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.830+0000 7f03f8b5f700 1 Processor -- start 2023-10-17T06:08:42.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.830+0000 7f03f8b5f700 1 -- start start 2023-10-17T06:08:42.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.830+0000 7f03f8b5f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03f406d090 0x7f03f40b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:42.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.830+0000 7f03f8b5f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f03f415a410 0x7f03f415a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:42.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.830+0000 7f03f8b5f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f4071120 con 0x7f03f406d470 2023-10-17T06:08:42.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.830+0000 7f03f8b5f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f415f4f0 con 0x7f03f415a410 2023-10-17T06:08:42.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.830+0000 7f03f8b5f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f415e990 con 0x7f03f406d090 2023-10-17T06:08:42.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.834+0000 7f03f3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f03f415a410 0x7f03f415a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:42.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.834+0000 7f03f3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f03f415a410 0x7f03f415a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48762/0 (socket says 172.21.15.125:48762) 2023-10-17T06:08:42.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.834+0000 7f03f3fff700 1 -- 172.21.15.125:0/2922032403 learned_addr learned my addr 172.21.15.125:0/2922032403 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:42.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.834+0000 7f03f37fe700 1 --2- 172.21.15.125:0/2922032403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03f406d090 0x7f03f40b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:42.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.834+0000 7f03f3fff700 1 -- 172.21.15.125:0/2922032403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03f406d090 msgr2=0x7f03f40b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:42.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.834+0000 7f03f3fff700 1 --2- 172.21.15.125:0/2922032403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03f406d090 0x7f03f40b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:42.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.834+0000 7f03f3fff700 1 -- 172.21.15.125:0/2922032403 >> v1:172.21.15.184:6789/0 conn(0x7f03f406d470 legacy=0x7f03f4070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:42.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.834+0000 7f03f3fff700 1 -- 172.21.15.125:0/2922032403 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f415ec50 con 0x7f03f415a410 2023-10-17T06:08:42.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.834+0000 7f03f3fff700 1 --2- 172.21.15.125:0/2922032403 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03f415a410 0x7f03f415a8a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009e50 tx=0x7f03ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3643b2b0d402f520 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:42.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.834+0000 7f03f2ffd700 1 -- 172.21.15.125:0/2922032403 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec00e070 con 0x7f03f415a410 2023-10-17T06:08:42.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.834+0000 7f03f2ffd700 1 -- 172.21.15.125:0/2922032403 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ec00b9c0 con 0x7f03f415a410 2023-10-17T06:08:42.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.834+0000 7f03f2ffd700 1 -- 172.21.15.125:0/2922032403 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec00bd70 con 0x7f03f415a410 2023-10-17T06:08:42.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.834+0000 7f03f8b5f700 1 -- 172.21.15.125:0/2922032403 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03f415a410 msgr2=0x7f03f415a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:42.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.834+0000 7f03f8b5f700 1 --2- 172.21.15.125:0/2922032403 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03f415a410 0x7f03f415a8a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009e50 tx=0x7f03ec00b330 comp rx=0 tx=0).stop 2023-10-17T06:08:42.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.834+0000 7f03f8b5f700 1 -- 172.21.15.125:0/2922032403 shutdown_connections 2023-10-17T06:08:42.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.834+0000 7f03f8b5f700 1 --2- 172.21.15.125:0/2922032403 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03f415a410 0x7f03f415a8a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:42.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.834+0000 7f03f8b5f700 1 --2- 172.21.15.125:0/2922032403 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03f406d090 0x7f03f40b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:42.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.834+0000 7f03f8b5f700 1 -- 172.21.15.125:0/2922032403 >> 172.21.15.125:0/2922032403 conn(0x7f03f40ce5c0 msgr2=0x7f03f40ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:42.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.834+0000 7f03f8b5f700 1 -- 172.21.15.125:0/2922032403 shutdown_connections 2023-10-17T06:08:42.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.834+0000 7f03f8b5f700 1 -- 172.21.15.125:0/2922032403 wait complete. 2023-10-17T06:08:42.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.838+0000 7f03f8b5f700 1 Processor -- start 2023-10-17T06:08:42.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.838+0000 7f03f8b5f700 1 -- start start 2023-10-17T06:08:42.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.838+0000 7f03f8b5f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03f406d090 0x7f03f41f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:42.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.838+0000 7f03f8b5f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03f406d470 0x7f03f414ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:42.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.838+0000 7f03f8b5f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03f415a410 0x7f03f4154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:42.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.838+0000 7f03f8b5f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40cd6a0 con 0x7f03f406d090 2023-10-17T06:08:42.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.838+0000 7f03f8b5f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f41f2660 con 0x7f03f406d470 2023-10-17T06:08:42.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.838+0000 7f03f8b5f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f41f6120 con 0x7f03f415a410 2023-10-17T06:08:42.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.838+0000 7f03f37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03f406d090 0x7f03f41f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:42.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.838+0000 7f03f37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03f406d090 0x7f03f41f5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48764/0 (socket says 172.21.15.125:48764) 2023-10-17T06:08:42.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.838+0000 7f03f37fe700 1 -- 172.21.15.125:0/2241768760 learned_addr learned my addr 172.21.15.125:0/2241768760 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:42.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.842+0000 7f03ebfff700 1 --2- 172.21.15.125:0/2241768760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03f406d470 0x7f03f414ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:42.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.842+0000 7f03f3fff700 1 --2- 172.21.15.125:0/2241768760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03f415a410 0x7f03f4154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:42.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.842+0000 7f03f37fe700 1 -- 172.21.15.125:0/2241768760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03f415a410 msgr2=0x7f03f4154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:42.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.842+0000 7f03f37fe700 1 --2- 172.21.15.125:0/2241768760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03f415a410 0x7f03f4154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:42.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.842+0000 7f03f37fe700 1 -- 172.21.15.125:0/2241768760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03f406d470 msgr2=0x7f03f414ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:42.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.842+0000 7f03f37fe700 1 --2- 172.21.15.125:0/2241768760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03f406d470 0x7f03f414ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:42.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.842+0000 7f03f37fe700 1 -- 172.21.15.125:0/2241768760 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec009b30 con 0x7f03f406d090 2023-10-17T06:08:42.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.842+0000 7f03ebfff700 1 --2- 172.21.15.125:0/2241768760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03f406d470 0x7f03f414ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:42.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.842+0000 7f03f3fff700 1 --2- 172.21.15.125:0/2241768760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03f415a410 0x7f03f4154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:42.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.842+0000 7f03f37fe700 1 --2- 172.21.15.125:0/2241768760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03f406d090 0x7f03f41f5b40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f03e400e760 tx=0x7f03e400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:42.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.842+0000 7f03f0ff9700 1 -- 172.21.15.125:0/2241768760 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4013610 con 0x7f03f406d090 2023-10-17T06:08:42.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.842+0000 7f03f0ff9700 1 -- 172.21.15.125:0/2241768760 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e4013770 con 0x7f03f406d090 2023-10-17T06:08:42.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.842+0000 7f03f8b5f700 1 -- 172.21.15.125:0/2241768760 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f41f6400 con 0x7f03f406d090 2023-10-17T06:08:42.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.842+0000 7f03f0ff9700 1 -- 172.21.15.125:0/2241768760 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4013ae0 con 0x7f03f406d090 2023-10-17T06:08:42.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.842+0000 7f03f8b5f700 1 -- 172.21.15.125:0/2241768760 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f41f69c0 con 0x7f03f406d090 2023-10-17T06:08:42.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.842+0000 7f03f8b5f700 1 -- 172.21.15.125:0/2241768760 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f4072e60 con 0x7f03f406d090 2023-10-17T06:08:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.842+0000 7f03f0ff9700 1 -- 172.21.15.125:0/2241768760 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f03e4013c40 con 0x7f03f406d090 2023-10-17T06:08:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.846+0000 7f03f0ff9700 1 --2- 172.21.15.125:0/2241768760 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f03d40656f0 0x7f03d4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.846+0000 7f03f0ff9700 1 -- 172.21.15.125:0/2241768760 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f03e4082900 con 0x7f03f406d090 2023-10-17T06:08:42.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.846+0000 7f03ebfff700 1 --2- 172.21.15.125:0/2241768760 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f03d40656f0 0x7f03d4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:42.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.846+0000 7f03ebfff700 1 --2- 172.21.15.125:0/2241768760 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f03d40656f0 0x7f03d4067bb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f03f40cdfb0 tx=0x7f03dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:42.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:42.850+0000 7f03f0ff9700 1 -- 172.21.15.125:0/2241768760 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f03e4053fc0 con 0x7f03f406d090 2023-10-17T06:08:43.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.110+0000 7f03f8b5f700 1 -- 172.21.15.125:0/2241768760 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f03f406e030 con 0x7f03f406d090 2023-10-17T06:08:43.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.110+0000 7f03f0ff9700 1 -- 172.21.15.125:0/2241768760 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f03e4021090 con 0x7f03f406d090 2023-10-17T06:08:43.115 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:43.115 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-17T06:08:43.115 INFO:teuthology.orchestra.run.smithi125.stdout: "auth_dump": [ 2023-10-17T06:08:43.115 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.116 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.a", 2023-10-17T06:08:43.116 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBMJC5lbwFsGBAAg30VvKz8gdZC7vuR/25KrQ==", 2023-10-17T06:08:43.116 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.116 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-17T06:08:43.116 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-10-17T06:08:43.117 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-10-17T06:08:43.117 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-17T06:08:43.117 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.117 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.117 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.118 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.b", 2023-10-17T06:08:43.118 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBMJC5l0oW3KxAACNIHUFhALoDq5ApUiETKIw==", 2023-10-17T06:08:43.118 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.118 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-17T06:08:43.118 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-10-17T06:08:43.119 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-10-17T06:08:43.119 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-17T06:08:43.119 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.119 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.120 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.120 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.c", 2023-10-17T06:08:43.120 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBMJC5lQuhLIxAAjHxZw3JyPuU4dM84yABF7A==", 2023-10-17T06:08:43.120 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.120 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-17T06:08:43.121 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-10-17T06:08:43.121 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-10-17T06:08:43.121 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-17T06:08:43.121 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.121 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.122 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.122 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.d", 2023-10-17T06:08:43.122 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBMJC5lvCnINhAAdwKQRv4EI5ghCnm88z2FDg==", 2023-10-17T06:08:43.122 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.122 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-17T06:08:43.123 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-10-17T06:08:43.123 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-10-17T06:08:43.123 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-17T06:08:43.123 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.123 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.124 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.124 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.0", 2023-10-17T06:08:43.124 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBQJC5lBqiVKhAApFbSJD8hHjVCxYE2twpOXg==", 2023-10-17T06:08:43.124 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.124 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-17T06:08:43.125 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-17T06:08:43.125 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-17T06:08:43.125 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.125 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.125 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.125 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.1", 2023-10-17T06:08:43.126 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBTJC5lEYe6NxAAhPDwNfWkQ3AYfyRw6a5b+g==", 2023-10-17T06:08:43.126 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.126 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-17T06:08:43.126 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-17T06:08:43.126 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-17T06:08:43.127 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.127 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.127 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.127 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.2", 2023-10-17T06:08:43.127 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBXJC5lY3FbChAAGj4bCxuhQTvlXyVL8VeZKQ==", 2023-10-17T06:08:43.128 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.128 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-17T06:08:43.128 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-17T06:08:43.128 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-17T06:08:43.128 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.129 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.129 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.129 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.3", 2023-10-17T06:08:43.129 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBaJC5looamFxAAii4ABnhybpRFTINvAPi1hg==", 2023-10-17T06:08:43.129 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.130 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-17T06:08:43.130 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-17T06:08:43.130 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-17T06:08:43.130 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.130 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.131 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.131 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.4", 2023-10-17T06:08:43.131 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBgJC5lSUNNMRAAQdbVEi1QShkJJoYJCuljSQ==", 2023-10-17T06:08:43.131 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.131 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-17T06:08:43.132 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-17T06:08:43.132 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-17T06:08:43.132 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.132 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.132 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.133 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.5", 2023-10-17T06:08:43.133 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBkJC5l6XGCAxAAS5CJqVk8Ne0psdGgNttBqA==", 2023-10-17T06:08:43.133 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.133 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-17T06:08:43.133 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-17T06:08:43.133 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-17T06:08:43.134 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.134 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.134 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.134 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.6", 2023-10-17T06:08:43.134 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBnJC5lTF4hERAAP2kjm98J37GBMzfiMrOCOQ==", 2023-10-17T06:08:43.135 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.135 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-17T06:08:43.135 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-17T06:08:43.135 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-17T06:08:43.135 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.136 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.136 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.136 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.7", 2023-10-17T06:08:43.136 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBqJC5lLO6hIRAA5WuKIexp7r1Xtw2jX/7c4g==", 2023-10-17T06:08:43.136 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.137 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-17T06:08:43.137 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-17T06:08:43.137 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-17T06:08:43.137 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.137 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.138 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.138 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.0", 2023-10-17T06:08:43.138 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBNJC5lWPILAhAAvN089kyq+D6h+L1E8T+LQA==", 2023-10-17T06:08:43.138 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.138 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-17T06:08:43.139 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-10-17T06:08:43.139 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-10-17T06:08:43.139 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-10-17T06:08:43.139 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.139 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.139 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.140 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.1", 2023-10-17T06:08:43.140 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBNJC5lTHSNDhAA5AND2sAS7MqLaJ6ly4GGLw==", 2023-10-17T06:08:43.140 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.140 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-17T06:08:43.140 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-10-17T06:08:43.141 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-10-17T06:08:43.141 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-10-17T06:08:43.141 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.141 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.141 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.142 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.2", 2023-10-17T06:08:43.142 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBNJC5lOG06CBAAwyjkl91C81I3JM9OAElRFA==", 2023-10-17T06:08:43.142 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.142 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-17T06:08:43.142 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-10-17T06:08:43.143 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-10-17T06:08:43.143 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-10-17T06:08:43.143 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.143 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.143 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.143 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.3", 2023-10-17T06:08:43.144 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBNJC5lNI23FBAAIwAzQFVDutGBm0x9ayQh0g==", 2023-10-17T06:08:43.144 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.144 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-17T06:08:43.144 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-10-17T06:08:43.144 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-10-17T06:08:43.145 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-10-17T06:08:43.145 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.145 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.145 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.145 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.admin", 2023-10-17T06:08:43.146 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBLJC5loLEXKRAAFGSDA943U0+y0fNuQfuQVA==", 2023-10-17T06:08:43.146 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.146 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow *", 2023-10-17T06:08:43.146 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-10-17T06:08:43.146 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-10-17T06:08:43.147 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-17T06:08:43.147 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.147 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.147 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.147 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.bootstrap-mds", 2023-10-17T06:08:43.147 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBxJC5ljlviLRAA3jKjwWlmC6vtPyim3oo6hw==", 2023-10-17T06:08:43.148 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.148 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile bootstrap-mds" 2023-10-17T06:08:43.148 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.148 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.148 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.149 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.bootstrap-mgr", 2023-10-17T06:08:43.149 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBxJC5lnWziLRAAHip148rpK14v58adxlfF7A==", 2023-10-17T06:08:43.149 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.149 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-17T06:08:43.149 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.150 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.150 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.150 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.bootstrap-osd", 2023-10-17T06:08:43.150 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBxJC5lDX3iLRAANqNDFLMvOstvzBo8PHNAbQ==", 2023-10-17T06:08:43.150 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.151 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile bootstrap-osd" 2023-10-17T06:08:43.151 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.151 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.151 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.151 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.bootstrap-rbd", 2023-10-17T06:08:43.151 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBxJC5lBYviLRAA6VVt9VUPg2IGr11L/9X8sg==", 2023-10-17T06:08:43.152 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.152 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-17T06:08:43.152 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.152 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.152 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.153 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-17T06:08:43.153 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBxJC5l0ZfiLRAAw3jpEFlJZ3oGbQlTmUJI1g==", 2023-10-17T06:08:43.153 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.153 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-17T06:08:43.153 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.154 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.154 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.154 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.bootstrap-rgw", 2023-10-17T06:08:43.154 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBxJC5lrKTiLRAA2zH/XO7ddKOvHW2BpWgT2w==", 2023-10-17T06:08:43.154 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.155 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-17T06:08:43.155 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.155 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.155 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.155 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mgr.x", 2023-10-17T06:08:43.155 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBMJC5luST0EBAAlwryGbYZc6rp+liC3XMOcQ==", 2023-10-17T06:08:43.156 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.156 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow *", 2023-10-17T06:08:43.156 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile mgr", 2023-10-17T06:08:43.156 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-17T06:08:43.156 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.157 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:43.157 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:43.157 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mgr.y", 2023-10-17T06:08:43.157 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQBMJC5l/spoChAAa8GK97TQHrtWg9Kz5dIRwQ==", 2023-10-17T06:08:43.157 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-17T06:08:43.157 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow *", 2023-10-17T06:08:43.158 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile mgr", 2023-10-17T06:08:43.158 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-17T06:08:43.158 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.158 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:43.158 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-17T06:08:43.159 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-17T06:08:43.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.114+0000 7f03f8b5f700 1 -- 172.21.15.125:0/2241768760 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f03d40656f0 msgr2=0x7f03d4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:43.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.114+0000 7f03f8b5f700 1 --2- 172.21.15.125:0/2241768760 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f03d40656f0 0x7f03d4067bb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f03f40cdfb0 tx=0x7f03dc009040 comp rx=0 tx=0).stop 2023-10-17T06:08:43.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.114+0000 7f03f8b5f700 1 -- 172.21.15.125:0/2241768760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03f406d090 msgr2=0x7f03f41f5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:43.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.114+0000 7f03f8b5f700 1 --2- 172.21.15.125:0/2241768760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03f406d090 0x7f03f41f5b40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f03e400e760 tx=0x7f03e400eb20 comp rx=0 tx=0).stop 2023-10-17T06:08:43.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.114+0000 7f03f8b5f700 1 -- 172.21.15.125:0/2241768760 shutdown_connections 2023-10-17T06:08:43.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.114+0000 7f03f8b5f700 1 --2- 172.21.15.125:0/2241768760 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f03d40656f0 0x7f03d4067bb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:43.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.114+0000 7f03f8b5f700 1 --2- 172.21.15.125:0/2241768760 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f03f415a410 0x7f03f4154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:43.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.114+0000 7f03f8b5f700 1 --2- 172.21.15.125:0/2241768760 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f03f406d470 0x7f03f414ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:43.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.114+0000 7f03f8b5f700 1 --2- 172.21.15.125:0/2241768760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f03f406d090 0x7f03f41f5b40 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:43.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.114+0000 7f03f8b5f700 1 -- 172.21.15.125:0/2241768760 >> 172.21.15.125:0/2241768760 conn(0x7f03f40ce5c0 msgr2=0x7f03f40c3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:43.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.114+0000 7f03f8b5f700 1 -- 172.21.15.125:0/2241768760 shutdown_connections 2023-10-17T06:08:43.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.114+0000 7f03f8b5f700 1 -- 172.21.15.125:0/2241768760 wait complete. 2023-10-17T06:08:43.163 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-17T06:08:43.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.334+0000 7f3e5eb9e700 1 Processor -- start 2023-10-17T06:08:43.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.334+0000 7f3e5eb9e700 1 -- start start 2023-10-17T06:08:43.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.338+0000 7f3e5eb9e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3e580cb8a0 0x7f3e580cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:43.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.338+0000 7f3e5eb9e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e580b22f0 0x7f3e580b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:43.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.338+0000 7f3e5eb9e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e58070de0 con 0x7f3e58144150 2023-10-17T06:08:43.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.338+0000 7f3e5eb9e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e580cc270 con 0x7f3e580cb8a0 2023-10-17T06:08:43.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.338+0000 7f3e5eb9e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e580701d0 con 0x7f3e580b22f0 2023-10-17T06:08:43.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.338+0000 7f3e5d39b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3e580cb8a0 0x7f3e580cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:43.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.338+0000 7f3e5e39d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e580b22f0 0x7f3e580b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:43.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.338+0000 7f3e5db9c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f3e58144150 0x7f3e580cdc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:49842/0 (socket says 172.21.15.125:49842) 2023-10-17T06:08:43.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.338+0000 7f3e5e39d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e580b22f0 0x7f3e580b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:59420/0 (socket says 172.21.15.125:59420) 2023-10-17T06:08:43.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.338+0000 7f3e5db9c700 1 -- 172.21.15.125:0/2955426888 learned_addr learned my addr 172.21.15.125:0/2955426888 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:43.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.338+0000 7f3e5d39b700 1 -- 172.21.15.125:0/2955426888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e580b22f0 msgr2=0x7f3e580b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:43.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.338+0000 7f3e5d39b700 1 --2- 172.21.15.125:0/2955426888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e580b22f0 0x7f3e580b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:43.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.338+0000 7f3e5d39b700 1 -- 172.21.15.125:0/2955426888 >> v1:172.21.15.184:6789/0 conn(0x7f3e58144150 legacy=0x7f3e580cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:43.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.338+0000 7f3e5d39b700 1 -- 172.21.15.125:0/2955426888 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e580704b0 con 0x7f3e580cb8a0 2023-10-17T06:08:43.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.338+0000 7f3e5e39d700 1 --2- 172.21.15.125:0/2955426888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e580b22f0 0x7f3e580b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:08:43.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.342+0000 7f3e5d39b700 1 --2- 172.21.15.125:0/2955426888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e580cb8a0 0x7f3e580cbd30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009850 tx=0x7f3e48009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1709892489efab55 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:43.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.342+0000 7f3e5cb9a700 1 -- 172.21.15.125:0/2955426888 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48011830 con 0x7f3e580cb8a0 2023-10-17T06:08:43.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.342+0000 7f3e5cb9a700 1 -- 172.21.15.125:0/2955426888 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e48011990 con 0x7f3e580cb8a0 2023-10-17T06:08:43.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.342+0000 7f3e5cb9a700 1 -- 172.21.15.125:0/2955426888 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48011d40 con 0x7f3e580cb8a0 2023-10-17T06:08:43.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.342+0000 7f3e5eb9e700 1 -- 172.21.15.125:0/2955426888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e580cb8a0 msgr2=0x7f3e580cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:43.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.342+0000 7f3e5eb9e700 1 --2- 172.21.15.125:0/2955426888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e580cb8a0 0x7f3e580cbd30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009850 tx=0x7f3e48009b60 comp rx=0 tx=0).stop 2023-10-17T06:08:43.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.342+0000 7f3e5eb9e700 1 -- 172.21.15.125:0/2955426888 shutdown_connections 2023-10-17T06:08:43.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.342+0000 7f3e5eb9e700 1 --2- 172.21.15.125:0/2955426888 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e580b22f0 0x7f3e580b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:43.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.342+0000 7f3e5eb9e700 1 --2- 172.21.15.125:0/2955426888 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e580cb8a0 0x7f3e580cbd30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:43.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.342+0000 7f3e5eb9e700 1 -- 172.21.15.125:0/2955426888 >> 172.21.15.125:0/2955426888 conn(0x7f3e580b0bf0 msgr2=0x7f3e580ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:43.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.342+0000 7f3e5eb9e700 1 -- 172.21.15.125:0/2955426888 shutdown_connections 2023-10-17T06:08:43.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.342+0000 7f3e5eb9e700 1 -- 172.21.15.125:0/2955426888 wait complete. 2023-10-17T06:08:43.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.346+0000 7f3e5eb9e700 1 Processor -- start 2023-10-17T06:08:43.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.346+0000 7f3e5eb9e700 1 -- start start 2023-10-17T06:08:43.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.350+0000 7f3e5eb9e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e580b22f0 0x7f3e581406f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:43.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.350+0000 7f3e5eb9e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e580cb8a0 0x7f3e5806df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:43.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.350+0000 7f3e5eb9e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e58144150 0x7f3e580acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:43.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.350+0000 7f3e5eb9e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e580abb10 con 0x7f3e58144150 2023-10-17T06:08:43.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.350+0000 7f3e5eb9e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e580abd40 con 0x7f3e580cb8a0 2023-10-17T06:08:43.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.350+0000 7f3e5eb9e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e580abfe0 con 0x7f3e580b22f0 2023-10-17T06:08:43.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.350+0000 7f3e5e39d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e58144150 0x7f3e580acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:43.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.350+0000 7f3e5db9c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e580b22f0 0x7f3e581406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:43.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.350+0000 7f3e5d39b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e580cb8a0 0x7f3e5806df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:43.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.350+0000 7f3e5e39d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e58144150 0x7f3e580acda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48778/0 (socket says 172.21.15.125:48778) 2023-10-17T06:08:43.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.350+0000 7f3e5db9c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e580b22f0 0x7f3e581406f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:59426/0 (socket says 172.21.15.125:59426) 2023-10-17T06:08:43.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.350+0000 7f3e5e39d700 1 -- 172.21.15.125:0/3525882812 learned_addr learned my addr 172.21.15.125:0/3525882812 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:43.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.350+0000 7f3e5e39d700 1 -- 172.21.15.125:0/3525882812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e580b22f0 msgr2=0x7f3e581406f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:43.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.350+0000 7f3e5e39d700 1 --2- 172.21.15.125:0/3525882812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e580b22f0 0x7f3e581406f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:43.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.350+0000 7f3e5e39d700 1 -- 172.21.15.125:0/3525882812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e580cb8a0 msgr2=0x7f3e5806df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:43.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.350+0000 7f3e5e39d700 1 --2- 172.21.15.125:0/3525882812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e580cb8a0 0x7f3e5806df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:43.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.350+0000 7f3e5e39d700 1 -- 172.21.15.125:0/3525882812 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e50009a70 con 0x7f3e58144150 2023-10-17T06:08:43.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.354+0000 7f3e5e39d700 1 --2- 172.21.15.125:0/3525882812 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e58144150 0x7f3e580acda0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000efc0 tx=0x7f3e5000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:43.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.354+0000 7f3e4e7fc700 1 -- 172.21.15.125:0/3525882812 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000ca90 con 0x7f3e58144150 2023-10-17T06:08:43.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.354+0000 7f3e4e7fc700 1 -- 172.21.15.125:0/3525882812 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5000f040 con 0x7f3e58144150 2023-10-17T06:08:43.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.354+0000 7f3e5eb9e700 1 -- 172.21.15.125:0/3525882812 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e480094b0 con 0x7f3e58144150 2023-10-17T06:08:43.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.354+0000 7f3e4e7fc700 1 -- 172.21.15.125:0/3525882812 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5000ce30 con 0x7f3e58144150 2023-10-17T06:08:43.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.354+0000 7f3e5eb9e700 1 -- 172.21.15.125:0/3525882812 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e580ac5a0 con 0x7f3e58144150 2023-10-17T06:08:43.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.354+0000 7f3e5eb9e700 1 -- 172.21.15.125:0/3525882812 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e58072e60 con 0x7f3e58144150 2023-10-17T06:08:43.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.358+0000 7f3e4e7fc700 1 -- 172.21.15.125:0/3525882812 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f3e50014480 con 0x7f3e58144150 2023-10-17T06:08:43.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.358+0000 7f3e4e7fc700 1 --2- 172.21.15.125:0/3525882812 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3e3c0656f0 0x7f3e3c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:43.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.358+0000 7f3e4e7fc700 1 -- 172.21.15.125:0/3525882812 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f3e500831f0 con 0x7f3e58144150 2023-10-17T06:08:43.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.358+0000 7f3e5db9c700 1 --2- 172.21.15.125:0/3525882812 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3e3c0656f0 0x7f3e3c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:43.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.358+0000 7f3e5db9c700 1 --2- 172.21.15.125:0/3525882812 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3e3c0656f0 0x7f3e3c067bb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3e54005930 tx=0x7f3e54009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:43.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.366+0000 7f3e4e7fc700 1 -- 172.21.15.125:0/3525882812 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f3e50050ec0 con 0x7f3e58144150 2023-10-17T06:08:43.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.786+0000 7f3e5eb9e700 1 -- 172.21.15.125:0/3525882812 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f3e580b3780 con 0x7f3e58144150 2023-10-17T06:08:43.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.794+0000 7f3e4e7fc700 1 -- 172.21.15.125:0/3525882812 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3e50009cd0 con 0x7f3e58144150 2023-10-17T06:08:43.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.798+0000 7f3e5eb9e700 1 -- 172.21.15.125:0/3525882812 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3e3c0656f0 msgr2=0x7f3e3c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:43.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.798+0000 7f3e5eb9e700 1 --2- 172.21.15.125:0/3525882812 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3e3c0656f0 0x7f3e3c067bb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3e54005930 tx=0x7f3e54009040 comp rx=0 tx=0).stop 2023-10-17T06:08:43.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.798+0000 7f3e5eb9e700 1 -- 172.21.15.125:0/3525882812 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e58144150 msgr2=0x7f3e580acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:43.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.798+0000 7f3e5eb9e700 1 --2- 172.21.15.125:0/3525882812 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e58144150 0x7f3e580acda0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000efc0 tx=0x7f3e5000c3a0 comp rx=0 tx=0).stop 2023-10-17T06:08:43.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.798+0000 7f3e5eb9e700 1 -- 172.21.15.125:0/3525882812 shutdown_connections 2023-10-17T06:08:43.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.798+0000 7f3e5eb9e700 1 --2- 172.21.15.125:0/3525882812 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3e3c0656f0 0x7f3e3c067bb0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:43.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.798+0000 7f3e5eb9e700 1 --2- 172.21.15.125:0/3525882812 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3e58144150 0x7f3e580acda0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:43.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.798+0000 7f3e5eb9e700 1 --2- 172.21.15.125:0/3525882812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e580cb8a0 0x7f3e5806df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:43.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.798+0000 7f3e5eb9e700 1 --2- 172.21.15.125:0/3525882812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e580b22f0 0x7f3e581406f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:43.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.798+0000 7f3e5eb9e700 1 -- 172.21.15.125:0/3525882812 >> 172.21.15.125:0/3525882812 conn(0x7f3e580b0bf0 msgr2=0x7f3e5806f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:43.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.798+0000 7f3e5eb9e700 1 -- 172.21.15.125:0/3525882812 shutdown_connections 2023-10-17T06:08:43.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:43.798+0000 7f3e5eb9e700 1 -- 172.21.15.125:0/3525882812 wait complete. 2023-10-17T06:08:43.824 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-17T06:08:44.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.010+0000 7ff48c651700 1 Processor -- start 2023-10-17T06:08:44.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.010+0000 7ff48c651700 1 -- start start 2023-10-17T06:08:44.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.010+0000 7ff48c651700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff484144390 0x7ff4840701d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:44.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.010+0000 7ff48c651700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4840cdb60 0x7ff4840cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:44.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.010+0000 7ff48c651700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4840ce500 con 0x7ff4840cc7d0 2023-10-17T06:08:44.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.010+0000 7ff48c651700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff484144770 con 0x7ff484144390 2023-10-17T06:08:44.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.010+0000 7ff48c651700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48406fd40 con 0x7ff4840cdb60 2023-10-17T06:08:44.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff489bec700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4840cdb60 0x7ff4840cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:44.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff48a3ed700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff484144390 0x7ff4840701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:44.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff48a3ed700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff484144390 0x7ff4840701d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:42048/0 (socket says 172.21.15.125:42048) 2023-10-17T06:08:44.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff48a3ed700 1 -- 172.21.15.125:0/237527240 learned_addr learned my addr 172.21.15.125:0/237527240 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:44.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff48abee700 1 --1- 172.21.15.125:0/237527240 >> v1:172.21.15.184:6789/0 conn(0x7ff4840cc7d0 0x7ff4840ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:43542/0 (socket says 172.21.15.125:43542) 2023-10-17T06:08:44.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff48a3ed700 1 -- 172.21.15.125:0/237527240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4840cdb60 msgr2=0x7ff4840cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:44.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff48a3ed700 1 --2- 172.21.15.125:0/237527240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4840cdb60 0x7ff4840cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:44.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff48a3ed700 1 -- 172.21.15.125:0/237527240 >> v1:172.21.15.184:6789/0 conn(0x7ff4840cc7d0 legacy=0x7ff4840ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:44.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff48a3ed700 1 -- 172.21.15.125:0/237527240 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48406f450 con 0x7ff484144390 2023-10-17T06:08:44.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff48a3ed700 1 --2- 172.21.15.125:0/237527240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff484144390 0x7ff4840701d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff480009910 tx=0x7ff480009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d45d178c85f91e6f server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:44.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff4893eb700 1 -- 172.21.15.125:0/237527240 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480011830 con 0x7ff484144390 2023-10-17T06:08:44.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff4893eb700 1 -- 172.21.15.125:0/237527240 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff480011990 con 0x7ff484144390 2023-10-17T06:08:44.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff4893eb700 1 -- 172.21.15.125:0/237527240 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480011d40 con 0x7ff484144390 2023-10-17T06:08:44.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff48c651700 1 -- 172.21.15.125:0/237527240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff484144390 msgr2=0x7ff4840701d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:44.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff48c651700 1 --2- 172.21.15.125:0/237527240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff484144390 0x7ff4840701d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff480009910 tx=0x7ff480009c20 comp rx=0 tx=0).stop 2023-10-17T06:08:44.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff48c651700 1 -- 172.21.15.125:0/237527240 shutdown_connections 2023-10-17T06:08:44.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff48c651700 1 --2- 172.21.15.125:0/237527240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4840cdb60 0x7ff4840cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:44.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff48c651700 1 --2- 172.21.15.125:0/237527240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff484144390 0x7ff4840701d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:44.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff48c651700 1 -- 172.21.15.125:0/237527240 >> 172.21.15.125:0/237527240 conn(0x7ff48406a340 msgr2=0x7ff4840b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:44.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff48c651700 1 -- 172.21.15.125:0/237527240 shutdown_connections 2023-10-17T06:08:44.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.014+0000 7ff48c651700 1 -- 172.21.15.125:0/237527240 wait complete. 2023-10-17T06:08:44.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.018+0000 7ff48c651700 1 Processor -- start 2023-10-17T06:08:44.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.018+0000 7ff48c651700 1 -- start start 2023-10-17T06:08:44.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.018+0000 7ff48c651700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4840cc7d0 0x7ff484140f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:44.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.018+0000 7ff48c651700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4840cdb60 0x7ff48415c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:44.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.018+0000 7ff48c651700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff484144390 0x7ff4841407a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:44.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.022+0000 7ff48c651700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48415c190 con 0x7ff484144390 2023-10-17T06:08:44.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.022+0000 7ff48c651700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48415b510 con 0x7ff4840cc7d0 2023-10-17T06:08:44.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.022+0000 7ff48c651700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48415b7f0 con 0x7ff4840cdb60 2023-10-17T06:08:44.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.022+0000 7ff48abee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff484144390 0x7ff4841407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:44.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.022+0000 7ff48abee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff484144390 0x7ff4841407a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33212/0 (socket says 172.21.15.125:33212) 2023-10-17T06:08:44.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.022+0000 7ff48abee700 1 -- 172.21.15.125:0/1905736689 learned_addr learned my addr 172.21.15.125:0/1905736689 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:44.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.022+0000 7ff489bec700 1 --2- 172.21.15.125:0/1905736689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4840cdb60 0x7ff48415c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:44.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.022+0000 7ff48a3ed700 1 --2- 172.21.15.125:0/1905736689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4840cc7d0 0x7ff484140f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:44.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.022+0000 7ff48abee700 1 -- 172.21.15.125:0/1905736689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4840cdb60 msgr2=0x7ff48415c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:44.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.022+0000 7ff48abee700 1 --2- 172.21.15.125:0/1905736689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4840cdb60 0x7ff48415c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:44.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.022+0000 7ff48abee700 1 -- 172.21.15.125:0/1905736689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4840cc7d0 msgr2=0x7ff484140f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:44.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.022+0000 7ff48abee700 1 --2- 172.21.15.125:0/1905736689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4840cc7d0 0x7ff484140f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:44.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.022+0000 7ff48abee700 1 -- 172.21.15.125:0/1905736689 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff480009570 con 0x7ff484144390 2023-10-17T06:08:44.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.022+0000 7ff48abee700 1 --2- 172.21.15.125:0/1905736689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff484144390 0x7ff4841407a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00cbd0 tx=0x7ff47c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:44.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.022+0000 7ff47affd700 1 -- 172.21.15.125:0/1905736689 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00aaa0 con 0x7ff484144390 2023-10-17T06:08:44.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.022+0000 7ff47affd700 1 -- 172.21.15.125:0/1905736689 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c00ac00 con 0x7ff484144390 2023-10-17T06:08:44.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.022+0000 7ff48c651700 1 -- 172.21.15.125:0/1905736689 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff48415bad0 con 0x7ff484144390 2023-10-17T06:08:44.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.022+0000 7ff47affd700 1 -- 172.21.15.125:0/1905736689 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c007070 con 0x7ff484144390 2023-10-17T06:08:44.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.022+0000 7ff48c651700 1 -- 172.21.15.125:0/1905736689 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff484140ce0 con 0x7ff484144390 2023-10-17T06:08:44.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.026+0000 7ff48c651700 1 -- 172.21.15.125:0/1905736689 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff48415c2d0 con 0x7ff484144390 2023-10-17T06:08:44.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.026+0000 7ff47affd700 1 -- 172.21.15.125:0/1905736689 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff47c0071d0 con 0x7ff484144390 2023-10-17T06:08:44.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.026+0000 7ff47affd700 1 --2- 172.21.15.125:0/1905736689 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff4680656f0 0x7ff468067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:44.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.026+0000 7ff47affd700 1 -- 172.21.15.125:0/1905736689 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff47c0828b0 con 0x7ff484144390 2023-10-17T06:08:44.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.026+0000 7ff48a3ed700 1 --2- 172.21.15.125:0/1905736689 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff4680656f0 0x7ff468067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:44.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.026+0000 7ff48a3ed700 1 --2- 172.21.15.125:0/1905736689 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff4680656f0 0x7ff468067bb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff480014040 tx=0x7ff480008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:44.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.034+0000 7ff47affd700 1 -- 172.21.15.125:0/1905736689 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff48415c2d0 con 0x7ff484144390 2023-10-17T06:08:44.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.434+0000 7ff48c651700 1 -- 172.21.15.125:0/1905736689 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7ff48415c2d0 con 0x7ff484144390 2023-10-17T06:08:44.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.446+0000 7ff47affd700 1 -- 172.21.15.125:0/1905736689 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff48415c2d0 con 0x7ff484144390 2023-10-17T06:08:44.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.450+0000 7ff48c651700 1 -- 172.21.15.125:0/1905736689 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff4680656f0 msgr2=0x7ff468067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:44.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.450+0000 7ff48c651700 1 --2- 172.21.15.125:0/1905736689 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff4680656f0 0x7ff468067bb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff480014040 tx=0x7ff480008030 comp rx=0 tx=0).stop 2023-10-17T06:08:44.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.450+0000 7ff48c651700 1 -- 172.21.15.125:0/1905736689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff484144390 msgr2=0x7ff4841407a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:44.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.450+0000 7ff48c651700 1 --2- 172.21.15.125:0/1905736689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff484144390 0x7ff4841407a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00cbd0 tx=0x7ff47c00cee0 comp rx=0 tx=0).stop 2023-10-17T06:08:44.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.450+0000 7ff48c651700 1 -- 172.21.15.125:0/1905736689 shutdown_connections 2023-10-17T06:08:44.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.450+0000 7ff48c651700 1 --2- 172.21.15.125:0/1905736689 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff4680656f0 0x7ff468067bb0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:44.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.450+0000 7ff48c651700 1 --2- 172.21.15.125:0/1905736689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff484144390 0x7ff4841407a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:44.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.450+0000 7ff48c651700 1 --2- 172.21.15.125:0/1905736689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4840cdb60 0x7ff48415c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:44.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.450+0000 7ff48c651700 1 --2- 172.21.15.125:0/1905736689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4840cc7d0 0x7ff484140f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:44.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.450+0000 7ff48c651700 1 -- 172.21.15.125:0/1905736689 >> 172.21.15.125:0/1905736689 conn(0x7ff48406a340 msgr2=0x7ff4840ad480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:44.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.450+0000 7ff48c651700 1 -- 172.21.15.125:0/1905736689 shutdown_connections 2023-10-17T06:08:44.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.450+0000 7ff48c651700 1 -- 172.21.15.125:0/1905736689 wait complete. 2023-10-17T06:08:44.476 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-17T06:08:44.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.634+0000 7f2b7b67b700 1 Processor -- start 2023-10-17T06:08:44.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.634+0000 7f2b7b67b700 1 -- start start 2023-10-17T06:08:44.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.638+0000 7f2b7b67b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b74161230 0x7f2b7406ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:44.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.638+0000 7f2b7b67b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b74165770 con 0x7f2b740cb8a0 2023-10-17T06:08:44.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.638+0000 7f2b7b67b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7406ea40 con 0x7f2b740adb60 2023-10-17T06:08:44.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.638+0000 7f2b7b67b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b74161610 con 0x7f2b74161230 2023-10-17T06:08:44.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.638+0000 7f2b79c18700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2b740cb8a0 0x7f2b740cc9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56366/0 (socket says 172.21.15.125:56366) 2023-10-17T06:08:44.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.638+0000 7f2b79c18700 1 -- 172.21.15.125:0/2574404287 learned_addr learned my addr 172.21.15.125:0/2574404287 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:44.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.638+0000 7f2b79417700 1 --2- 172.21.15.125:0/2574404287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b74161230 0x7f2b7406ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:44.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.638+0000 7f2b6bfff700 1 -- 172.21.15.125:0/2574404287 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317514115 0 0) 0x7f2b74165770 con 0x7f2b740cb8a0 2023-10-17T06:08:44.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.638+0000 7f2b6bfff700 1 -- 172.21.15.125:0/2574404287 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b600035d0 con 0x7f2b740cb8a0 2023-10-17T06:08:44.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.638+0000 7f2b6bfff700 1 -- 172.21.15.125:0/2574404287 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171224761 0 0) 0x7f2b7406ea40 con 0x7f2b740adb60 2023-10-17T06:08:44.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.638+0000 7f2b6bfff700 1 -- 172.21.15.125:0/2574404287 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b74165770 con 0x7f2b740adb60 2023-10-17T06:08:44.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.638+0000 7f2b79417700 1 -- 172.21.15.125:0/2574404287 >> v1:172.21.15.184:6789/0 conn(0x7f2b740adb60 legacy=0x7f2b740cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:44.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.638+0000 7f2b79417700 1 -- 172.21.15.125:0/2574404287 >> v1:172.21.15.125:6789/0 conn(0x7f2b740cb8a0 legacy=0x7f2b740cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:44.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.638+0000 7f2b79417700 1 -- 172.21.15.125:0/2574404287 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b74165ca0 con 0x7f2b74161230 2023-10-17T06:08:44.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.638+0000 7f2b79417700 1 --2- 172.21.15.125:0/2574404287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b74161230 0x7f2b7406ced0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009880 tx=0x7f2b70009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=895e955a9bc6d41c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:44.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.642+0000 7f2b6bfff700 1 -- 172.21.15.125:0/2574404287 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b70011830 con 0x7f2b74161230 2023-10-17T06:08:44.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.642+0000 7f2b6bfff700 1 -- 172.21.15.125:0/2574404287 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b70011990 con 0x7f2b74161230 2023-10-17T06:08:44.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.642+0000 7f2b6bfff700 1 -- 172.21.15.125:0/2574404287 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b70011d20 con 0x7f2b74161230 2023-10-17T06:08:44.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.642+0000 7f2b7b67b700 1 -- 172.21.15.125:0/2574404287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b74161230 msgr2=0x7f2b7406ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:44.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.642+0000 7f2b7b67b700 1 --2- 172.21.15.125:0/2574404287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b74161230 0x7f2b7406ced0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009880 tx=0x7f2b70009b90 comp rx=0 tx=0).stop 2023-10-17T06:08:44.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.642+0000 7f2b7b67b700 1 -- 172.21.15.125:0/2574404287 shutdown_connections 2023-10-17T06:08:44.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.642+0000 7f2b7b67b700 1 --2- 172.21.15.125:0/2574404287 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b74161230 0x7f2b7406ced0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:44.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.642+0000 7f2b7b67b700 1 -- 172.21.15.125:0/2574404287 >> 172.21.15.125:0/2574404287 conn(0x7f2b7406a340 msgr2=0x7f2b740b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:44.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.642+0000 7f2b7b67b700 1 -- 172.21.15.125:0/2574404287 shutdown_connections 2023-10-17T06:08:44.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.642+0000 7f2b7b67b700 1 -- 172.21.15.125:0/2574404287 wait complete. 2023-10-17T06:08:44.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.642+0000 7f2b7b67b700 1 Processor -- start 2023-10-17T06:08:44.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b7b67b700 1 -- start start 2023-10-17T06:08:44.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b7b67b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b740adb60 0x7f2b74162830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:44.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b7b67b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b740cb8a0 0x7f2b7406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:44.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b7b67b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b74161230 0x7f2b74158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:44.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b7b67b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7415cff0 con 0x7f2b740cb8a0 2023-10-17T06:08:44.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b7b67b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7415d290 con 0x7f2b740adb60 2023-10-17T06:08:44.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b7b67b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7415d570 con 0x7f2b74161230 2023-10-17T06:08:44.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b78c16700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b740cb8a0 0x7f2b7406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:44.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b78c16700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b740cb8a0 0x7f2b7406fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33214/0 (socket says 172.21.15.125:33214) 2023-10-17T06:08:44.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b78c16700 1 -- 172.21.15.125:0/3113148073 learned_addr learned my addr 172.21.15.125:0/3113148073 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:44.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b79417700 1 --2- 172.21.15.125:0/3113148073 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b740adb60 0x7f2b74162830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:44.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b79c18700 1 --2- 172.21.15.125:0/3113148073 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b74161230 0x7f2b74158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:44.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b78c16700 1 -- 172.21.15.125:0/3113148073 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b74161230 msgr2=0x7f2b74158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:44.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b78c16700 1 --2- 172.21.15.125:0/3113148073 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b74161230 0x7f2b74158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:44.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b78c16700 1 -- 172.21.15.125:0/3113148073 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b740adb60 msgr2=0x7f2b74162830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:44.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b78c16700 1 --2- 172.21.15.125:0/3113148073 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b740adb60 0x7f2b74162830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:44.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b78c16700 1 -- 172.21.15.125:0/3113148073 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b700094b0 con 0x7f2b740cb8a0 2023-10-17T06:08:44.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b79417700 1 --2- 172.21.15.125:0/3113148073 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b740adb60 0x7f2b74162830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:44.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b78c16700 1 --2- 172.21.15.125:0/3113148073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b740cb8a0 0x7f2b7406fa10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400c730 tx=0x7f2b6400caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:44.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b69ffb700 1 -- 172.21.15.125:0/3113148073 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b640052d0 con 0x7f2b740cb8a0 2023-10-17T06:08:44.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b69ffb700 1 -- 172.21.15.125:0/3113148073 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b64005430 con 0x7f2b740cb8a0 2023-10-17T06:08:44.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b7b67b700 1 -- 172.21.15.125:0/3113148073 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7415d850 con 0x7f2b740cb8a0 2023-10-17T06:08:44.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.646+0000 7f2b69ffb700 1 -- 172.21.15.125:0/3113148073 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b640055a0 con 0x7f2b740cb8a0 2023-10-17T06:08:44.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.650+0000 7f2b7b67b700 1 -- 172.21.15.125:0/3113148073 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b740ad2a0 con 0x7f2b740cb8a0 2023-10-17T06:08:44.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.650+0000 7f2b7b67b700 1 -- 172.21.15.125:0/3113148073 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7415da90 con 0x7f2b740cb8a0 2023-10-17T06:08:44.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.650+0000 7f2b69ffb700 1 -- 172.21.15.125:0/3113148073 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2b640038e0 con 0x7f2b740cb8a0 2023-10-17T06:08:44.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.654+0000 7f2b69ffb700 1 --2- 172.21.15.125:0/3113148073 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2b580656f0 0x7f2b58067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:44.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.654+0000 7f2b69ffb700 1 -- 172.21.15.125:0/3113148073 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2b64082200 con 0x7f2b740cb8a0 2023-10-17T06:08:44.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.654+0000 7f2b79417700 1 --2- 172.21.15.125:0/3113148073 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2b580656f0 0x7f2b58067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:44.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.654+0000 7f2b79417700 1 --2- 172.21.15.125:0/3113148073 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2b580656f0 0x7f2b58067bb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2b700090b0 tx=0x7f2b7001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:44.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:44.658+0000 7f2b69ffb700 1 -- 172.21.15.125:0/3113148073 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2b7415da90 con 0x7f2b740cb8a0 2023-10-17T06:08:45.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.062+0000 7f2b7b67b700 1 -- 172.21.15.125:0/3113148073 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f2b7415da90 con 0x7f2b740cb8a0 2023-10-17T06:08:45.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.070+0000 7f2b69ffb700 1 -- 172.21.15.125:0/3113148073 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2b7415da90 con 0x7f2b740cb8a0 2023-10-17T06:08:45.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.074+0000 7f2b7b67b700 1 -- 172.21.15.125:0/3113148073 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2b580656f0 msgr2=0x7f2b58067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:45.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.074+0000 7f2b7b67b700 1 --2- 172.21.15.125:0/3113148073 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2b580656f0 0x7f2b58067bb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2b700090b0 tx=0x7f2b7001c040 comp rx=0 tx=0).stop 2023-10-17T06:08:45.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.074+0000 7f2b7b67b700 1 -- 172.21.15.125:0/3113148073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b740cb8a0 msgr2=0x7f2b7406fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:45.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.074+0000 7f2b7b67b700 1 --2- 172.21.15.125:0/3113148073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b740cb8a0 0x7f2b7406fa10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400c730 tx=0x7f2b6400caf0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.074+0000 7f2b7b67b700 1 -- 172.21.15.125:0/3113148073 shutdown_connections 2023-10-17T06:08:45.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.074+0000 7f2b7b67b700 1 --2- 172.21.15.125:0/3113148073 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2b580656f0 0x7f2b58067bb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.074+0000 7f2b7b67b700 1 --2- 172.21.15.125:0/3113148073 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b74161230 0x7f2b74158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.074+0000 7f2b7b67b700 1 --2- 172.21.15.125:0/3113148073 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b740cb8a0 0x7f2b7406fa10 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.074+0000 7f2b7b67b700 1 --2- 172.21.15.125:0/3113148073 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b740adb60 0x7f2b74162830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.074+0000 7f2b7b67b700 1 -- 172.21.15.125:0/3113148073 >> 172.21.15.125:0/3113148073 conn(0x7f2b7406a340 msgr2=0x7f2b740cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:45.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.074+0000 7f2b7b67b700 1 -- 172.21.15.125:0/3113148073 shutdown_connections 2023-10-17T06:08:45.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.074+0000 7f2b7b67b700 1 -- 172.21.15.125:0/3113148073 wait complete. 2023-10-17T06:08:45.103 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-17T06:08:45.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.266+0000 7faae1c68700 1 Processor -- start 2023-10-17T06:08:45.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.266+0000 7faae1c68700 1 -- start start 2023-10-17T06:08:45.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faae1c68700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7faadc0b6c70 0x7faadc06a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:45.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faae1c68700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faadc06e390 con 0x7faadc15cbd0 2023-10-17T06:08:45.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faae1c68700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faadc15cfb0 con 0x7faadc0b5ae0 2023-10-17T06:08:45.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faae1c68700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faadc0b6050 con 0x7faadc0b6c70 2023-10-17T06:08:45.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faae0c66700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7faadc15cbd0 0x7faadc0b6560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56374/0 (socket says 172.21.15.125:56374) 2023-10-17T06:08:45.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faae0c66700 1 -- 172.21.15.125:0/1964565702 learned_addr learned my addr 172.21.15.125:0/1964565702 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:45.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faad3fff700 1 --2- 172.21.15.125:0/1964565702 >> v2:172.21.15.184:3300/0 conn(0x7faadc0b6c70 0x7faadc06a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:45.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faad37fe700 1 -- 172.21.15.125:0/1964565702 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892994986 0 0) 0x7faadc06e390 con 0x7faadc15cbd0 2023-10-17T06:08:45.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faad37fe700 1 -- 172.21.15.125:0/1964565702 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faac40035d0 con 0x7faadc15cbd0 2023-10-17T06:08:45.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faad37fe700 1 -- 172.21.15.125:0/1964565702 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3541644790 0 0) 0x7faac40035d0 con 0x7faadc15cbd0 2023-10-17T06:08:45.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faad37fe700 1 -- 172.21.15.125:0/1964565702 >> v2:172.21.15.184:3300/0 conn(0x7faadc0b6c70 msgr2=0x7faadc06a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:45.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faad37fe700 1 --2- 172.21.15.125:0/1964565702 >> v2:172.21.15.184:3300/0 conn(0x7faadc0b6c70 0x7faadc06a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faad37fe700 1 -- 172.21.15.125:0/1964565702 >> v1:172.21.15.184:6789/0 conn(0x7faadc0b5ae0 legacy=0x7faadc06a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:45.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faad37fe700 1 -- 172.21.15.125:0/1964565702 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc06e5e0 con 0x7faadc15cbd0 2023-10-17T06:08:45.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faad37fe700 1 -- 172.21.15.125:0/1964565702 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7faad8001670 con 0x7faadc15cbd0 2023-10-17T06:08:45.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faad37fe700 1 -- 172.21.15.125:0/1964565702 >> v1:172.21.15.125:6789/0 conn(0x7faadc15cbd0 legacy=0x7faadc0b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:45.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faad37fe700 1 --2- 172.21.15.125:0/1964565702 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faac4003a20 0x7faac4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:45.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faad37fe700 1 --2- 172.21.15.125:0/1964565702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faac4004870 0x7faac4004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:45.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faad37fe700 1 --2- 172.21.15.125:0/1964565702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faac4005280 0x7faac400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:45.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faad37fe700 1 -- 172.21.15.125:0/1964565702 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0b6050 con 0x7faac4005280 2023-10-17T06:08:45.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faad37fe700 1 -- 172.21.15.125:0/1964565702 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac400c1d0 con 0x7faac4004870 2023-10-17T06:08:45.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faad37fe700 1 -- 172.21.15.125:0/1964565702 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac400c390 con 0x7faac4003a20 2023-10-17T06:08:45.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faae1467700 1 --2- 172.21.15.125:0/1964565702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faac4005280 0x7faac400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:45.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faad3fff700 1 --2- 172.21.15.125:0/1964565702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faac4004870 0x7faac4004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:45.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faae0c66700 1 --2- 172.21.15.125:0/1964565702 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faac4003a20 0x7faac4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:45.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faae1467700 1 -- 172.21.15.125:0/1964565702 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faac4003a20 msgr2=0x7faac4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:45.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faae1467700 1 --2- 172.21.15.125:0/1964565702 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faac4003a20 0x7faac4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faae1467700 1 -- 172.21.15.125:0/1964565702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faac4004870 msgr2=0x7faac4004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:45.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.270+0000 7faae1467700 1 --2- 172.21.15.125:0/1964565702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faac4004870 0x7faac4004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.274+0000 7faae1467700 1 -- 172.21.15.125:0/1964565702 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac40035d0 con 0x7faac4005280 2023-10-17T06:08:45.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.274+0000 7faad3fff700 1 --2- 172.21.15.125:0/1964565702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faac4004870 0x7faac4004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:45.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.274+0000 7faae1467700 1 -- 172.21.15.125:0/1964565702 reap_dead start 2023-10-17T06:08:45.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.274+0000 7faae1467700 1 --2- 172.21.15.125:0/1964565702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faac4005280 0x7faac400ba30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7faad400c290 tx=0x7faac40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701f0fc1ce0c8f55 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:45.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.274+0000 7faad37fe700 1 -- 172.21.15.125:0/1964565702 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad4001e70 con 0x7faac4005280 2023-10-17T06:08:45.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.274+0000 7faad37fe700 1 -- 172.21.15.125:0/1964565702 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad400ce70 con 0x7faac4005280 2023-10-17T06:08:45.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.274+0000 7faad37fe700 1 -- 172.21.15.125:0/1964565702 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad4003c40 con 0x7faac4005280 2023-10-17T06:08:45.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.274+0000 7faae1c68700 1 -- 172.21.15.125:0/1964565702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faac4005280 msgr2=0x7faac400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:45.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.274+0000 7faae1c68700 1 --2- 172.21.15.125:0/1964565702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faac4005280 0x7faac400ba30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7faad400c290 tx=0x7faac40058a0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.274+0000 7faae1c68700 1 -- 172.21.15.125:0/1964565702 shutdown_connections 2023-10-17T06:08:45.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.274+0000 7faae1c68700 1 --2- 172.21.15.125:0/1964565702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faac4005280 0x7faac400ba30 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.274+0000 7faae1c68700 1 -- 172.21.15.125:0/1964565702 >> 172.21.15.125:0/1964565702 conn(0x7faadc06f450 msgr2=0x7faadc06f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:45.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.274+0000 7faae1c68700 1 -- 172.21.15.125:0/1964565702 shutdown_connections 2023-10-17T06:08:45.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.274+0000 7faae1c68700 1 -- 172.21.15.125:0/1964565702 wait complete. 2023-10-17T06:08:45.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.278+0000 7faae1c68700 1 Processor -- start 2023-10-17T06:08:45.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.278+0000 7faae1c68700 1 -- start start 2023-10-17T06:08:45.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.278+0000 7faae1c68700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faac4005280 0x7faadc13f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:45.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.278+0000 7faae1c68700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faadc142bb0 0x7faadc13f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:45.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.278+0000 7faae1c68700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faadc13fce0 0x7faadc13dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:45.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.278+0000 7faae1c68700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc13d650 con 0x7faadc13fce0 2023-10-17T06:08:45.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.278+0000 7faae1c68700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc154420 con 0x7faac4005280 2023-10-17T06:08:45.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.278+0000 7faae1c68700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc154700 con 0x7faadc142bb0 2023-10-17T06:08:45.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.278+0000 7faae1467700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faadc13fce0 0x7faadc13dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:45.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.278+0000 7faae1467700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faadc13fce0 0x7faadc13dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33228/0 (socket says 172.21.15.125:33228) 2023-10-17T06:08:45.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.278+0000 7faae1467700 1 -- 172.21.15.125:0/1405629248 learned_addr learned my addr 172.21.15.125:0/1405629248 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:45.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.278+0000 7faae0c66700 1 --2- 172.21.15.125:0/1405629248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faac4005280 0x7faadc13f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:45.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.278+0000 7faad3fff700 1 --2- 172.21.15.125:0/1405629248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faadc142bb0 0x7faadc13f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:45.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.282+0000 7faae1467700 1 -- 172.21.15.125:0/1405629248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faadc142bb0 msgr2=0x7faadc13f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:45.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.282+0000 7faae1467700 1 --2- 172.21.15.125:0/1405629248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faadc142bb0 0x7faadc13f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.282+0000 7faae1467700 1 -- 172.21.15.125:0/1405629248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faac4005280 msgr2=0x7faadc13f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:45.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.282+0000 7faae1467700 1 --2- 172.21.15.125:0/1405629248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faac4005280 0x7faadc13f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.282+0000 7faae1467700 1 -- 172.21.15.125:0/1405629248 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc13d000 con 0x7faadc13fce0 2023-10-17T06:08:45.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.282+0000 7faad3fff700 1 --2- 172.21.15.125:0/1405629248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faadc142bb0 0x7faadc13f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:45.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.282+0000 7faae1467700 1 --2- 172.21.15.125:0/1405629248 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faadc13fce0 0x7faadc13dae0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7faadc0d2a70 tx=0x7faad40015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:45.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.282+0000 7faad17fa700 1 -- 172.21.15.125:0/1405629248 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad4017070 con 0x7faadc13fce0 2023-10-17T06:08:45.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.282+0000 7faad17fa700 1 -- 172.21.15.125:0/1405629248 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad40052e0 con 0x7faadc13fce0 2023-10-17T06:08:45.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.282+0000 7faae1c68700 1 -- 172.21.15.125:0/1405629248 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc13d2e0 con 0x7faadc13fce0 2023-10-17T06:08:45.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.282+0000 7faad17fa700 1 -- 172.21.15.125:0/1405629248 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad4005650 con 0x7faadc13fce0 2023-10-17T06:08:45.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.282+0000 7faae1c68700 1 -- 172.21.15.125:0/1405629248 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc13e020 con 0x7faadc13fce0 2023-10-17T06:08:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.282+0000 7faae1c68700 1 -- 172.21.15.125:0/1405629248 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faadc13d800 con 0x7faadc13fce0 2023-10-17T06:08:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.286+0000 7faad17fa700 1 -- 172.21.15.125:0/1405629248 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7faad40057b0 con 0x7faadc13fce0 2023-10-17T06:08:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.286+0000 7faad17fa700 1 --2- 172.21.15.125:0/1405629248 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7faac8065720 0x7faac8067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.286+0000 7faad17fa700 1 -- 172.21.15.125:0/1405629248 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7faad401a040 con 0x7faadc13fce0 2023-10-17T06:08:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.286+0000 7faae0c66700 1 --2- 172.21.15.125:0/1405629248 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7faac8065720 0x7faac8067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:45.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.286+0000 7faae0c66700 1 --2- 172.21.15.125:0/1405629248 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7faac8065720 0x7faac8067be0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faad8000c00 tx=0x7faad8007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:45.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.290+0000 7faad17fa700 1 -- 172.21.15.125:0/1405629248 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7faadc13d800 con 0x7faadc13fce0 2023-10-17T06:08:45.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.710+0000 7faae1c68700 1 -- 172.21.15.125:0/1405629248 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7faadc072e60 con 0x7faadc13fce0 2023-10-17T06:08:45.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.718+0000 7faad17fa700 1 -- 172.21.15.125:0/1405629248 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7faad40512f0 con 0x7faadc13fce0 2023-10-17T06:08:45.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.718+0000 7faae1c68700 1 -- 172.21.15.125:0/1405629248 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7faac8065720 msgr2=0x7faac8067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:45.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.718+0000 7faae1c68700 1 --2- 172.21.15.125:0/1405629248 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7faac8065720 0x7faac8067be0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faad8000c00 tx=0x7faad8007040 comp rx=0 tx=0).stop 2023-10-17T06:08:45.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.718+0000 7faae1c68700 1 -- 172.21.15.125:0/1405629248 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faadc13fce0 msgr2=0x7faadc13dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:45.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.718+0000 7faae1c68700 1 --2- 172.21.15.125:0/1405629248 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faadc13fce0 0x7faadc13dae0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7faadc0d2a70 tx=0x7faad40015b0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.722+0000 7faae1c68700 1 -- 172.21.15.125:0/1405629248 shutdown_connections 2023-10-17T06:08:45.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.722+0000 7faae1c68700 1 --2- 172.21.15.125:0/1405629248 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7faac8065720 0x7faac8067be0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.722+0000 7faae1c68700 1 --2- 172.21.15.125:0/1405629248 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faadc13fce0 0x7faadc13dae0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.722+0000 7faae1c68700 1 --2- 172.21.15.125:0/1405629248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faadc142bb0 0x7faadc13f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.722+0000 7faae1c68700 1 --2- 172.21.15.125:0/1405629248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faac4005280 0x7faadc13f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.722+0000 7faae1c68700 1 -- 172.21.15.125:0/1405629248 >> 172.21.15.125:0/1405629248 conn(0x7faadc06f450 msgr2=0x7faadc0d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:45.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.722+0000 7faae1c68700 1 -- 172.21.15.125:0/1405629248 shutdown_connections 2023-10-17T06:08:45.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.722+0000 7faae1c68700 1 -- 172.21.15.125:0/1405629248 wait complete. 2023-10-17T06:08:45.745 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-17T06:08:45.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.918+0000 7fdc993eb700 1 Processor -- start 2023-10-17T06:08:45.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.918+0000 7fdc993eb700 1 -- start start 2023-10-17T06:08:45.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.922+0000 7fdc993eb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc941647a0 0x7fdc9406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:45.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.922+0000 7fdc993eb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdc940ce020 0x7fdc940cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:45.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.922+0000 7fdc993eb700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc9406e940 con 0x7fdc940cd990 2023-10-17T06:08:45.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.922+0000 7fdc993eb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc9406d3d0 con 0x7fdc940ce020 2023-10-17T06:08:45.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.922+0000 7fdc993eb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9406ebe0 con 0x7fdc941647a0 2023-10-17T06:08:45.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.922+0000 7fdc937fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdc940ce020 0x7fdc940cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:45.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.922+0000 7fdc937fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdc940ce020 0x7fdc940cafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33242/0 (socket says 172.21.15.125:33242) 2023-10-17T06:08:45.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.922+0000 7fdc937fe700 1 -- 172.21.15.125:0/1751457558 learned_addr learned my addr 172.21.15.125:0/1751457558 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:45.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.922+0000 7fdc93fff700 1 --2- 172.21.15.125:0/1751457558 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc941647a0 0x7fdc9406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:45.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.922+0000 7fdc937fe700 1 -- 172.21.15.125:0/1751457558 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc941647a0 msgr2=0x7fdc9406ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:45.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.922+0000 7fdc937fe700 1 --2- 172.21.15.125:0/1751457558 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc941647a0 0x7fdc9406ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.922+0000 7fdc937fe700 1 -- 172.21.15.125:0/1751457558 >> v1:172.21.15.184:6789/0 conn(0x7fdc940cd990 legacy=0x7fdc940b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:45.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.922+0000 7fdc937fe700 1 -- 172.21.15.125:0/1751457558 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9406eec0 con 0x7fdc940ce020 2023-10-17T06:08:45.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.922+0000 7fdc937fe700 1 --2- 172.21.15.125:0/1751457558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc940ce020 0x7fdc940cafa0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009910 tx=0x7fdc88009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998b6802b88802e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:45.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.922+0000 7fdc92ffd700 1 -- 172.21.15.125:0/1751457558 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8800ba60 con 0x7fdc940ce020 2023-10-17T06:08:45.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.922+0000 7fdc92ffd700 1 -- 172.21.15.125:0/1751457558 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8800bbc0 con 0x7fdc940ce020 2023-10-17T06:08:45.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.922+0000 7fdc92ffd700 1 -- 172.21.15.125:0/1751457558 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc88009e60 con 0x7fdc940ce020 2023-10-17T06:08:45.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.926+0000 7fdc993eb700 1 -- 172.21.15.125:0/1751457558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc940ce020 msgr2=0x7fdc940cafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:45.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.926+0000 7fdc993eb700 1 --2- 172.21.15.125:0/1751457558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc940ce020 0x7fdc940cafa0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdc88009910 tx=0x7fdc88009c20 comp rx=0 tx=0).stop 2023-10-17T06:08:45.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.926+0000 7fdc993eb700 1 -- 172.21.15.125:0/1751457558 shutdown_connections 2023-10-17T06:08:45.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.926+0000 7fdc993eb700 1 --2- 172.21.15.125:0/1751457558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc940ce020 0x7fdc940cafa0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.926+0000 7fdc993eb700 1 --2- 172.21.15.125:0/1751457558 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc941647a0 0x7fdc9406ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.926+0000 7fdc993eb700 1 -- 172.21.15.125:0/1751457558 >> 172.21.15.125:0/1751457558 conn(0x7fdc9406a450 msgr2=0x7fdc940b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:45.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.926+0000 7fdc993eb700 1 -- 172.21.15.125:0/1751457558 shutdown_connections 2023-10-17T06:08:45.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.926+0000 7fdc993eb700 1 -- 172.21.15.125:0/1751457558 wait complete. 2023-10-17T06:08:45.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.926+0000 7fdc993eb700 1 Processor -- start 2023-10-17T06:08:45.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.926+0000 7fdc993eb700 1 -- start start 2023-10-17T06:08:45.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc993eb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc940cd990 0x7fdc94149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:45.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc993eb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc940ce020 0x7fdc940a77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:45.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc993eb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc941647a0 0x7fdc940b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:45.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc993eb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9415f820 con 0x7fdc940ce020 2023-10-17T06:08:45.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc993eb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9415fa70 con 0x7fdc940cd990 2023-10-17T06:08:45.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc993eb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9415fd50 con 0x7fdc941647a0 2023-10-17T06:08:45.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc937fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc940ce020 0x7fdc940a77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:45.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc937fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc940ce020 0x7fdc940a77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33244/0 (socket says 172.21.15.125:33244) 2023-10-17T06:08:45.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc937fe700 1 -- 172.21.15.125:0/336510971 learned_addr learned my addr 172.21.15.125:0/336510971 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:45.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc98bea700 1 --2- 172.21.15.125:0/336510971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc941647a0 0x7fdc940b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:45.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc93fff700 1 --2- 172.21.15.125:0/336510971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc940cd990 0x7fdc94149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:45.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc937fe700 1 -- 172.21.15.125:0/336510971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc941647a0 msgr2=0x7fdc940b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:45.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc937fe700 1 --2- 172.21.15.125:0/336510971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc941647a0 0x7fdc940b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc937fe700 1 -- 172.21.15.125:0/336510971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc940cd990 msgr2=0x7fdc94149cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:45.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc937fe700 1 --2- 172.21.15.125:0/336510971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc940cd990 0x7fdc94149cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:45.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc937fe700 1 -- 172.21.15.125:0/336510971 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc88009570 con 0x7fdc940ce020 2023-10-17T06:08:45.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc98bea700 1 --2- 172.21.15.125:0/336510971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc941647a0 0x7fdc940b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:45.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc937fe700 1 --2- 172.21.15.125:0/336510971 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc940ce020 0x7fdc940a77f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fdc940cbe20 tx=0x7fdc88004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:45.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc90ff9700 1 -- 172.21.15.125:0/336510971 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc88004510 con 0x7fdc940ce020 2023-10-17T06:08:45.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc90ff9700 1 -- 172.21.15.125:0/336510971 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8801f070 con 0x7fdc940ce020 2023-10-17T06:08:45.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc993eb700 1 -- 172.21.15.125:0/336510971 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc94160030 con 0x7fdc940ce020 2023-10-17T06:08:45.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc90ff9700 1 -- 172.21.15.125:0/336510971 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc88003900 con 0x7fdc940ce020 2023-10-17T06:08:45.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.930+0000 7fdc993eb700 1 -- 172.21.15.125:0/336510971 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc941605f0 con 0x7fdc940ce020 2023-10-17T06:08:45.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.934+0000 7fdc993eb700 1 -- 172.21.15.125:0/336510971 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9404e910 con 0x7fdc940ce020 2023-10-17T06:08:45.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.934+0000 7fdc90ff9700 1 -- 172.21.15.125:0/336510971 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fdc88003a60 con 0x7fdc940ce020 2023-10-17T06:08:45.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.938+0000 7fdc90ff9700 1 --2- 172.21.15.125:0/336510971 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdc800656f0 0x7fdc80067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:45.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.938+0000 7fdc90ff9700 1 -- 172.21.15.125:0/336510971 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fdc88021070 con 0x7fdc940ce020 2023-10-17T06:08:45.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.938+0000 7fdc93fff700 1 --2- 172.21.15.125:0/336510971 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdc800656f0 0x7fdc80067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:45.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.938+0000 7fdc93fff700 1 --2- 172.21.15.125:0/336510971 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdc800656f0 0x7fdc80067bb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdc84006b40 tx=0x7fdc84008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:45.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:45.942+0000 7fdc90ff9700 1 -- 172.21.15.125:0/336510971 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fdc880520c0 con 0x7fdc940ce020 2023-10-17T06:08:46.175 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.170+0000 7fdc993eb700 1 -- 172.21.15.125:0/336510971 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fdc94161630 con 0x7fdc940ce020 2023-10-17T06:08:46.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.178+0000 7fdc90ff9700 1 -- 172.21.15.125:0/336510971 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdc880556e0 con 0x7fdc940ce020 2023-10-17T06:08:46.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.182+0000 7fdc993eb700 1 -- 172.21.15.125:0/336510971 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdc800656f0 msgr2=0x7fdc80067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:46.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.182+0000 7fdc993eb700 1 --2- 172.21.15.125:0/336510971 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdc800656f0 0x7fdc80067bb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdc84006b40 tx=0x7fdc84008040 comp rx=0 tx=0).stop 2023-10-17T06:08:46.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.182+0000 7fdc993eb700 1 -- 172.21.15.125:0/336510971 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc940ce020 msgr2=0x7fdc940a77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:46.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.182+0000 7fdc993eb700 1 --2- 172.21.15.125:0/336510971 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc940ce020 0x7fdc940a77f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fdc940cbe20 tx=0x7fdc88004770 comp rx=0 tx=0).stop 2023-10-17T06:08:46.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.182+0000 7fdc993eb700 1 -- 172.21.15.125:0/336510971 shutdown_connections 2023-10-17T06:08:46.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.182+0000 7fdc993eb700 1 --2- 172.21.15.125:0/336510971 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdc800656f0 0x7fdc80067bb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:46.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.182+0000 7fdc993eb700 1 --2- 172.21.15.125:0/336510971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc941647a0 0x7fdc940b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:46.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.182+0000 7fdc993eb700 1 --2- 172.21.15.125:0/336510971 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc940ce020 0x7fdc940a77f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:46.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.182+0000 7fdc993eb700 1 --2- 172.21.15.125:0/336510971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc940cd990 0x7fdc94149cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:46.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.182+0000 7fdc993eb700 1 -- 172.21.15.125:0/336510971 >> 172.21.15.125:0/336510971 conn(0x7fdc9406a450 msgr2=0x7fdc94163960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:46.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.182+0000 7fdc993eb700 1 -- 172.21.15.125:0/336510971 shutdown_connections 2023-10-17T06:08:46.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.182+0000 7fdc993eb700 1 -- 172.21.15.125:0/336510971 wait complete. 2023-10-17T06:08:46.209 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-17T06:08:46.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.390+0000 7fde7bcdf700 1 Processor -- start 2023-10-17T06:08:46.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.390+0000 7fde7bcdf700 1 -- start start 2023-10-17T06:08:46.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.394+0000 7fde7bcdf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fde740b5b80 0x7fde7406f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:46.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.394+0000 7fde7bcdf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde7415e680 con 0x7fde74146800 2023-10-17T06:08:46.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.394+0000 7fde7bcdf700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde74070310 con 0x7fde7406fee0 2023-10-17T06:08:46.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.394+0000 7fde7bcdf700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde740b6180 con 0x7fde740b5b80 2023-10-17T06:08:46.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.394+0000 7fde79a7b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fde74146800 0x7fde7415dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56380/0 (socket says 172.21.15.125:56380) 2023-10-17T06:08:46.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.394+0000 7fde79a7b700 1 -- 172.21.15.125:0/462209202 learned_addr learned my addr 172.21.15.125:0/462209202 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:46.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.394+0000 7fde7927a700 1 --2- 172.21.15.125:0/462209202 >> v2:172.21.15.125:3300/0 conn(0x7fde740b5b80 0x7fde7406f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:46.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.394+0000 7fde78a79700 1 -- 172.21.15.125:0/462209202 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407181952 0 0) 0x7fde7415e680 con 0x7fde74146800 2023-10-17T06:08:46.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.394+0000 7fde78a79700 1 -- 172.21.15.125:0/462209202 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde600035d0 con 0x7fde74146800 2023-10-17T06:08:46.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.394+0000 7fde7927a700 1 -- 172.21.15.125:0/462209202 >> v1:172.21.15.184:6789/0 conn(0x7fde7406fee0 legacy=0x7fde7415eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:46.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.394+0000 7fde7927a700 1 -- 172.21.15.125:0/462209202 >> v1:172.21.15.125:6789/0 conn(0x7fde74146800 legacy=0x7fde7415dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:46.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.394+0000 7fde7927a700 1 -- 172.21.15.125:0/462209202 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde740b6460 con 0x7fde740b5b80 2023-10-17T06:08:46.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.398+0000 7fde7927a700 1 --2- 172.21.15.125:0/462209202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde740b5b80 0x7fde7406f9a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fde64009850 tx=0x7fde64009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b77fff138a9a2ac server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:46.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.398+0000 7fde78a79700 1 -- 172.21.15.125:0/462209202 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde64011830 con 0x7fde740b5b80 2023-10-17T06:08:46.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.398+0000 7fde78a79700 1 -- 172.21.15.125:0/462209202 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde64011990 con 0x7fde740b5b80 2023-10-17T06:08:46.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.398+0000 7fde78a79700 1 -- 172.21.15.125:0/462209202 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde64011d40 con 0x7fde740b5b80 2023-10-17T06:08:46.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.398+0000 7fde7bcdf700 1 -- 172.21.15.125:0/462209202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde740b5b80 msgr2=0x7fde7406f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:46.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.398+0000 7fde7bcdf700 1 --2- 172.21.15.125:0/462209202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde740b5b80 0x7fde7406f9a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fde64009850 tx=0x7fde64009b60 comp rx=0 tx=0).stop 2023-10-17T06:08:46.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.398+0000 7fde7bcdf700 1 -- 172.21.15.125:0/462209202 shutdown_connections 2023-10-17T06:08:46.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.398+0000 7fde7bcdf700 1 --2- 172.21.15.125:0/462209202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde740b5b80 0x7fde7406f9a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:46.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.398+0000 7fde7bcdf700 1 -- 172.21.15.125:0/462209202 >> 172.21.15.125:0/462209202 conn(0x7fde7406a130 msgr2=0x7fde7406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:46.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.398+0000 7fde7bcdf700 1 -- 172.21.15.125:0/462209202 shutdown_connections 2023-10-17T06:08:46.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.398+0000 7fde7bcdf700 1 -- 172.21.15.125:0/462209202 wait complete. 2023-10-17T06:08:46.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde7bcdf700 1 Processor -- start 2023-10-17T06:08:46.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde7bcdf700 1 -- start start 2023-10-17T06:08:46.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde7bcdf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde7406fee0 0x7fde7415c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:46.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde7bcdf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde740b5b80 0x7fde741e7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:46.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde7bcdf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde74146800 0x7fde740ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:46.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde7bcdf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde741e80b0 con 0x7fde7406fee0 2023-10-17T06:08:46.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde7bcdf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde741e8390 con 0x7fde740b5b80 2023-10-17T06:08:46.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde7bcdf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde741e8670 con 0x7fde74146800 2023-10-17T06:08:46.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde79a7b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde7406fee0 0x7fde7415c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:46.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde79a7b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde7406fee0 0x7fde7415c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33262/0 (socket says 172.21.15.125:33262) 2023-10-17T06:08:46.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde79a7b700 1 -- 172.21.15.125:0/425784380 learned_addr learned my addr 172.21.15.125:0/425784380 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:46.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde7927a700 1 --2- 172.21.15.125:0/425784380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde740b5b80 0x7fde741e7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:46.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde7a27c700 1 --2- 172.21.15.125:0/425784380 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde74146800 0x7fde740ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:46.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde79a7b700 1 -- 172.21.15.125:0/425784380 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde74146800 msgr2=0x7fde740ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:46.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde79a7b700 1 --2- 172.21.15.125:0/425784380 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde74146800 0x7fde740ca070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:46.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde79a7b700 1 -- 172.21.15.125:0/425784380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde740b5b80 msgr2=0x7fde741e7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:46.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde79a7b700 1 --2- 172.21.15.125:0/425784380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde740b5b80 0x7fde741e7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:46.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde79a7b700 1 -- 172.21.15.125:0/425784380 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde640094b0 con 0x7fde7406fee0 2023-10-17T06:08:46.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde7927a700 1 --2- 172.21.15.125:0/425784380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde740b5b80 0x7fde741e7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:46.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde79a7b700 1 --2- 172.21.15.125:0/425784380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde7406fee0 0x7fde7415c4f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fde7000c4d0 tx=0x7fde7000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:46.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.402+0000 7fde6a7fc700 1 -- 172.21.15.125:0/425784380 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde70005d90 con 0x7fde7406fee0 2023-10-17T06:08:46.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.406+0000 7fde6a7fc700 1 -- 172.21.15.125:0/425784380 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde700070d0 con 0x7fde7406fee0 2023-10-17T06:08:46.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.406+0000 7fde7bcdf700 1 -- 172.21.15.125:0/425784380 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde741e8950 con 0x7fde7406fee0 2023-10-17T06:08:46.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.406+0000 7fde6a7fc700 1 -- 172.21.15.125:0/425784380 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde70007480 con 0x7fde7406fee0 2023-10-17T06:08:46.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.406+0000 7fde7bcdf700 1 -- 172.21.15.125:0/425784380 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde741e7da0 con 0x7fde7406fee0 2023-10-17T06:08:46.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.406+0000 7fde7bcdf700 1 -- 172.21.15.125:0/425784380 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde741e8e70 con 0x7fde7406fee0 2023-10-17T06:08:46.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.406+0000 7fde6a7fc700 1 -- 172.21.15.125:0/425784380 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fde700075e0 con 0x7fde7406fee0 2023-10-17T06:08:46.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.410+0000 7fde6a7fc700 1 --2- 172.21.15.125:0/425784380 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fde580656f0 0x7fde58067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:46.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.410+0000 7fde6a7fc700 1 -- 172.21.15.125:0/425784380 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fde700821b0 con 0x7fde7406fee0 2023-10-17T06:08:46.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.410+0000 7fde7927a700 1 --2- 172.21.15.125:0/425784380 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fde580656f0 0x7fde58067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:46.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.410+0000 7fde7927a700 1 --2- 172.21.15.125:0/425784380 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fde580656f0 0x7fde58067bb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fde640090b0 tx=0x7fde64008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:46.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.414+0000 7fde6a7fc700 1 -- 172.21.15.125:0/425784380 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fde741e8e70 con 0x7fde7406fee0 2023-10-17T06:08:46.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.834+0000 7fde7bcdf700 1 -- 172.21.15.125:0/425784380 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fde741e8e70 con 0x7fde7406fee0 2023-10-17T06:08:46.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.842+0000 7fde6a7fc700 1 -- 172.21.15.125:0/425784380 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fde741e8e70 con 0x7fde7406fee0 2023-10-17T06:08:46.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.846+0000 7fde7bcdf700 1 -- 172.21.15.125:0/425784380 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fde580656f0 msgr2=0x7fde58067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:46.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.846+0000 7fde7bcdf700 1 --2- 172.21.15.125:0/425784380 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fde580656f0 0x7fde58067bb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fde640090b0 tx=0x7fde64008030 comp rx=0 tx=0).stop 2023-10-17T06:08:46.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.846+0000 7fde7bcdf700 1 -- 172.21.15.125:0/425784380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde7406fee0 msgr2=0x7fde7415c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:46.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.846+0000 7fde7bcdf700 1 --2- 172.21.15.125:0/425784380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde7406fee0 0x7fde7415c4f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fde7000c4d0 tx=0x7fde7000c890 comp rx=0 tx=0).stop 2023-10-17T06:08:46.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.846+0000 7fde7bcdf700 1 -- 172.21.15.125:0/425784380 shutdown_connections 2023-10-17T06:08:46.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.846+0000 7fde7bcdf700 1 --2- 172.21.15.125:0/425784380 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fde580656f0 0x7fde58067bb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:46.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.846+0000 7fde7bcdf700 1 --2- 172.21.15.125:0/425784380 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde74146800 0x7fde740ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:46.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.846+0000 7fde7bcdf700 1 --2- 172.21.15.125:0/425784380 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde740b5b80 0x7fde741e7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:46.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.846+0000 7fde7bcdf700 1 --2- 172.21.15.125:0/425784380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde7406fee0 0x7fde7415c4f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:46.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.846+0000 7fde7bcdf700 1 -- 172.21.15.125:0/425784380 >> 172.21.15.125:0/425784380 conn(0x7fde7406a130 msgr2=0x7fde7406e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:46.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.846+0000 7fde7bcdf700 1 -- 172.21.15.125:0/425784380 shutdown_connections 2023-10-17T06:08:46.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:46.846+0000 7fde7bcdf700 1 -- 172.21.15.125:0/425784380 wait complete. 2023-10-17T06:08:46.874 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:08:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.042+0000 7ff6ad4df700 1 Processor -- start 2023-10-17T06:08:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.042+0000 7ff6ad4df700 1 -- start start 2023-10-17T06:08:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.042+0000 7ff6ad4df700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6a806d470 0x7ff6a8070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.042+0000 7ff6ad4df700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff6a8070f50 0x7ff6a815a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.042+0000 7ff6ad4df700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a815e990 con 0x7ff6a806d090 2023-10-17T06:08:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.042+0000 7ff6ad4df700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a815f4f0 con 0x7ff6a806d470 2023-10-17T06:08:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.042+0000 7ff6ad4df700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a80b2ca0 con 0x7ff6a8070f50 2023-10-17T06:08:47.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.046+0000 7ff6a67fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6a806d470 0x7ff6a8070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:47.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.046+0000 7ff6a67fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff6a806d470 0x7ff6a8070a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33276/0 (socket says 172.21.15.125:33276) 2023-10-17T06:08:47.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.046+0000 7ff6a67fc700 1 -- 172.21.15.125:0/115971019 learned_addr learned my addr 172.21.15.125:0/115971019 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.046+0000 7ff6a77fe700 1 --2- 172.21.15.125:0/115971019 >> v2:172.21.15.184:3300/0 conn(0x7ff6a8070f50 0x7ff6a815a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.046+0000 7ff6a67fc700 1 -- 172.21.15.125:0/115971019 >> v2:172.21.15.184:3300/0 conn(0x7ff6a8070f50 msgr2=0x7ff6a815a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.046+0000 7ff6a67fc700 1 --2- 172.21.15.125:0/115971019 >> v2:172.21.15.184:3300/0 conn(0x7ff6a8070f50 0x7ff6a815a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.046+0000 7ff6a67fc700 1 -- 172.21.15.125:0/115971019 >> v1:172.21.15.184:6789/0 conn(0x7ff6a806d090 legacy=0x7ff6a80b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.046+0000 7ff6a67fc700 1 -- 172.21.15.125:0/115971019 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a815ec50 con 0x7ff6a806d470 2023-10-17T06:08:47.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.046+0000 7ff6a67fc700 1 --2- 172.21.15.125:0/115971019 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a806d470 0x7ff6a8070a10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80b1b40 tx=0x7ff69c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbcc17ea396090c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:47.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.046+0000 7ff6a5ffb700 1 -- 172.21.15.125:0/115971019 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c011830 con 0x7ff6a806d470 2023-10-17T06:08:47.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.046+0000 7ff6a5ffb700 1 -- 172.21.15.125:0/115971019 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c011990 con 0x7ff6a806d470 2023-10-17T06:08:47.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.046+0000 7ff6a5ffb700 1 -- 172.21.15.125:0/115971019 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c011d20 con 0x7ff6a806d470 2023-10-17T06:08:47.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.046+0000 7ff6ad4df700 1 -- 172.21.15.125:0/115971019 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a806d470 msgr2=0x7ff6a8070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:47.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.046+0000 7ff6ad4df700 1 --2- 172.21.15.125:0/115971019 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a806d470 0x7ff6a8070a10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80b1b40 tx=0x7ff69c009bf0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.050+0000 7ff6ad4df700 1 -- 172.21.15.125:0/115971019 shutdown_connections 2023-10-17T06:08:47.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.050+0000 7ff6ad4df700 1 --2- 172.21.15.125:0/115971019 >> v2:172.21.15.184:3300/0 conn(0x7ff6a8070f50 0x7ff6a815a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.050+0000 7ff6ad4df700 1 --2- 172.21.15.125:0/115971019 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a806d470 0x7ff6a8070a10 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.050+0000 7ff6ad4df700 1 -- 172.21.15.125:0/115971019 >> 172.21.15.125:0/115971019 conn(0x7ff6a80ce5c0 msgr2=0x7ff6a80ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:47.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.050+0000 7ff6ad4df700 1 -- 172.21.15.125:0/115971019 shutdown_connections 2023-10-17T06:08:47.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.050+0000 7ff6ad4df700 1 -- 172.21.15.125:0/115971019 wait complete. 2023-10-17T06:08:47.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.050+0000 7ff6ad4df700 1 Processor -- start 2023-10-17T06:08:47.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.050+0000 7ff6ad4df700 1 -- start start 2023-10-17T06:08:47.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff6ad4df700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a806d090 0x7ff6a81f33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:47.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff6ad4df700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a806d470 0x7ff6a80a74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:47.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff6ad4df700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6a8070f50 0x7ff6a81f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:47.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff6ad4df700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80a8680 con 0x7ff6a806d470 2023-10-17T06:08:47.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff6ad4df700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a815cba0 con 0x7ff6a806d090 2023-10-17T06:08:47.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff6ad4df700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a815bca0 con 0x7ff6a8070f50 2023-10-17T06:08:47.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff6a67fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a806d470 0x7ff6a80a74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:47.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff6a67fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a806d470 0x7ff6a80a74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33288/0 (socket says 172.21.15.125:33288) 2023-10-17T06:08:47.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff6a67fc700 1 -- 172.21.15.125:0/3432337747 learned_addr learned my addr 172.21.15.125:0/3432337747 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:47.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff6a77fe700 1 --2- 172.21.15.125:0/3432337747 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6a8070f50 0x7ff6a81f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:47.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff6a6ffd700 1 --2- 172.21.15.125:0/3432337747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a806d090 0x7ff6a81f33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:47.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff6a67fc700 1 -- 172.21.15.125:0/3432337747 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6a8070f50 msgr2=0x7ff6a81f3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:47.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff6a67fc700 1 --2- 172.21.15.125:0/3432337747 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6a8070f50 0x7ff6a81f3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff6a67fc700 1 -- 172.21.15.125:0/3432337747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a806d090 msgr2=0x7ff6a81f33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:47.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff6a67fc700 1 --2- 172.21.15.125:0/3432337747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a806d090 0x7ff6a81f33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff6a67fc700 1 -- 172.21.15.125:0/3432337747 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c009570 con 0x7ff6a806d470 2023-10-17T06:08:47.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff6a6ffd700 1 --2- 172.21.15.125:0/3432337747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a806d090 0x7ff6a81f33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:47.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff6a67fc700 1 --2- 172.21.15.125:0/3432337747 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a806d470 0x7ff6a80a74d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff6a806b190 tx=0x7ff69c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:47.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff68f7fe700 1 -- 172.21.15.125:0/3432337747 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c004550 con 0x7ff6a806d470 2023-10-17T06:08:47.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff68f7fe700 1 -- 172.21.15.125:0/3432337747 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c01f070 con 0x7ff6a806d470 2023-10-17T06:08:47.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff68f7fe700 1 -- 172.21.15.125:0/3432337747 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c003900 con 0x7ff6a806d470 2023-10-17T06:08:47.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff6ad4df700 1 -- 172.21.15.125:0/3432337747 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a815bf20 con 0x7ff6a806d470 2023-10-17T06:08:47.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.054+0000 7ff6ad4df700 1 -- 172.21.15.125:0/3432337747 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a815c4e0 con 0x7ff6a806d470 2023-10-17T06:08:47.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.058+0000 7ff6ad4df700 1 -- 172.21.15.125:0/3432337747 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a8072e60 con 0x7ff6a806d470 2023-10-17T06:08:47.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.058+0000 7ff68f7fe700 1 -- 172.21.15.125:0/3432337747 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff69c003a60 con 0x7ff6a806d470 2023-10-17T06:08:47.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.058+0000 7ff68f7fe700 1 --2- 172.21.15.125:0/3432337747 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff6940656f0 0x7ff694067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:47.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.058+0000 7ff68f7fe700 1 -- 172.21.15.125:0/3432337747 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff69c021070 con 0x7ff6a806d470 2023-10-17T06:08:47.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.058+0000 7ff6a6ffd700 1 --2- 172.21.15.125:0/3432337747 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff6940656f0 0x7ff694067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:47.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.062+0000 7ff6a6ffd700 1 --2- 172.21.15.125:0/3432337747 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff6940656f0 0x7ff694067bb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff6a81f1570 tx=0x7ff698009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:47.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.066+0000 7ff68f7fe700 1 -- 172.21.15.125:0/3432337747 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff69c051d80 con 0x7ff6a806d470 2023-10-17T06:08:47.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.250+0000 7ff6ad4df700 1 -- 172.21.15.125:0/3432337747 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6a815efc0 con 0x7ff6a806d470 2023-10-17T06:08:47.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.250+0000 7ff68f7fe700 1 -- 172.21.15.125:0/3432337747 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+14880 (secure 0 0 0) 0x7ff69c015090 con 0x7ff6a806d470 2023-10-17T06:08:47.256 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:47.256 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":39,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:08:42.618120+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:08:47.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.254+0000 7ff6ad4df700 1 -- 172.21.15.125:0/3432337747 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff6940656f0 msgr2=0x7ff694067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:47.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.254+0000 7ff6ad4df700 1 --2- 172.21.15.125:0/3432337747 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff6940656f0 0x7ff694067bb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff6a81f1570 tx=0x7ff698009040 comp rx=0 tx=0).stop 2023-10-17T06:08:47.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.254+0000 7ff6ad4df700 1 -- 172.21.15.125:0/3432337747 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a806d470 msgr2=0x7ff6a80a74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:47.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.254+0000 7ff6ad4df700 1 --2- 172.21.15.125:0/3432337747 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a806d470 0x7ff6a80a74d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff6a806b190 tx=0x7ff69c004770 comp rx=0 tx=0).stop 2023-10-17T06:08:47.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.254+0000 7ff6ad4df700 1 -- 172.21.15.125:0/3432337747 shutdown_connections 2023-10-17T06:08:47.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.254+0000 7ff6ad4df700 1 --2- 172.21.15.125:0/3432337747 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff6940656f0 0x7ff694067bb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.254+0000 7ff6ad4df700 1 --2- 172.21.15.125:0/3432337747 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff6a8070f50 0x7ff6a81f3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.254+0000 7ff6ad4df700 1 --2- 172.21.15.125:0/3432337747 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6a806d470 0x7ff6a80a74d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.254+0000 7ff6ad4df700 1 --2- 172.21.15.125:0/3432337747 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a806d090 0x7ff6a81f33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.254+0000 7ff6ad4df700 1 -- 172.21.15.125:0/3432337747 >> 172.21.15.125:0/3432337747 conn(0x7ff6a80ce5c0 msgr2=0x7ff6a81576e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:47.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.254+0000 7ff6ad4df700 1 -- 172.21.15.125:0/3432337747 shutdown_connections 2023-10-17T06:08:47.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.254+0000 7ff6ad4df700 1 -- 172.21.15.125:0/3432337747 wait complete. 2023-10-17T06:08:47.283 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-17T06:08:47.284 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:08:47.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.450+0000 7f5928daf700 1 Processor -- start 2023-10-17T06:08:47.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.454+0000 7f5928daf700 1 -- start start 2023-10-17T06:08:47.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.454+0000 7f5928daf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f592415aef0 0x7f592415f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:47.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.454+0000 7f5928daf700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f592406e5e0 0x7f592406d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:47.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.454+0000 7f5928daf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592406f450 con 0x7f592415ab10 2023-10-17T06:08:47.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.454+0000 7f5928daf700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5924070e50 con 0x7f592415aef0 2023-10-17T06:08:47.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.454+0000 7f5928daf700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592415f780 con 0x7f592406e5e0 2023-10-17T06:08:47.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.454+0000 7f591bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f592415aef0 0x7f592415f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:47.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.454+0000 7f59237fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f592415ab10 0x7f5924070740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56384/0 (socket says 172.21.15.125:56384) 2023-10-17T06:08:47.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.454+0000 7f59237fe700 1 -- 172.21.15.125:0/205709961 learned_addr learned my addr 172.21.15.125:0/205709961 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:47.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.454+0000 7f5923fff700 1 --2- 172.21.15.125:0/205709961 >> v2:172.21.15.184:3300/0 conn(0x7f592406e5e0 0x7f592406d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:47.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.458+0000 7f591bfff700 1 -- 172.21.15.125:0/205709961 >> v2:172.21.15.184:3300/0 conn(0x7f592406e5e0 msgr2=0x7f592406d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:47.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.458+0000 7f591bfff700 1 --2- 172.21.15.125:0/205709961 >> v2:172.21.15.184:3300/0 conn(0x7f592406e5e0 0x7f592406d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.458+0000 7f591bfff700 1 -- 172.21.15.125:0/205709961 >> v1:172.21.15.125:6789/0 conn(0x7f592415ab10 legacy=0x7f5924070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:47.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.458+0000 7f591bfff700 1 -- 172.21.15.125:0/205709961 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592406f6a0 con 0x7f592415aef0 2023-10-17T06:08:47.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.458+0000 7f5922ffd700 1 -- 172.21.15.125:0/205709961 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1810620358 0 0) 0x7f592406f450 con 0x7f592415ab10 2023-10-17T06:08:47.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.458+0000 7f591bfff700 1 --2- 172.21.15.125:0/205709961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f592415aef0 0x7f592415f240 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f592406d050 tx=0x7f590c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62d200fe0768ebf server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:47.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.458+0000 7f5922ffd700 1 -- 172.21.15.125:0/205709961 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c011830 con 0x7f592415aef0 2023-10-17T06:08:47.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.458+0000 7f5922ffd700 1 -- 172.21.15.125:0/205709961 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590c011990 con 0x7f592415aef0 2023-10-17T06:08:47.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.458+0000 7f5922ffd700 1 -- 172.21.15.125:0/205709961 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c011d20 con 0x7f592415aef0 2023-10-17T06:08:47.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.458+0000 7f5928daf700 1 -- 172.21.15.125:0/205709961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f592415aef0 msgr2=0x7f592415f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:47.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.458+0000 7f5928daf700 1 --2- 172.21.15.125:0/205709961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f592415aef0 0x7f592415f240 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f592406d050 tx=0x7f590c009b30 comp rx=0 tx=0).stop 2023-10-17T06:08:47.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.458+0000 7f5928daf700 1 -- 172.21.15.125:0/205709961 shutdown_connections 2023-10-17T06:08:47.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.458+0000 7f5928daf700 1 --2- 172.21.15.125:0/205709961 >> v2:172.21.15.184:3300/0 conn(0x7f592406e5e0 0x7f592406d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.458+0000 7f5928daf700 1 --2- 172.21.15.125:0/205709961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f592415aef0 0x7f592415f240 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.458+0000 7f5928daf700 1 -- 172.21.15.125:0/205709961 >> 172.21.15.125:0/205709961 conn(0x7f59240cb9f0 msgr2=0x7f59240cbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:47.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.458+0000 7f5928daf700 1 -- 172.21.15.125:0/205709961 shutdown_connections 2023-10-17T06:08:47.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.458+0000 7f5928daf700 1 -- 172.21.15.125:0/205709961 wait complete. 2023-10-17T06:08:47.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.462+0000 7f5928daf700 1 Processor -- start 2023-10-17T06:08:47.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.462+0000 7f5928daf700 1 -- start start 2023-10-17T06:08:47.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f5928daf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f592406e5e0 0x7f59241542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:47.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f5928daf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f592415ab10 0x7f59240c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:47.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f5928daf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f592415aef0 0x7f5924158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:47.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f5928daf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59240c3090 con 0x7f592406e5e0 2023-10-17T06:08:47.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f5928daf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592415d270 con 0x7f592415ab10 2023-10-17T06:08:47.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f5928daf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592415d550 con 0x7f592415aef0 2023-10-17T06:08:47.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f59237fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f592406e5e0 0x7f59241542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:47.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f59237fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f592406e5e0 0x7f59241542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33318/0 (socket says 172.21.15.125:33318) 2023-10-17T06:08:47.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f59237fe700 1 -- 172.21.15.125:0/2797017358 learned_addr learned my addr 172.21.15.125:0/2797017358 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:47.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f5923fff700 1 --2- 172.21.15.125:0/2797017358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f592415aef0 0x7f5924158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:47.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f591bfff700 1 --2- 172.21.15.125:0/2797017358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f592415ab10 0x7f59240c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:47.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f59237fe700 1 -- 172.21.15.125:0/2797017358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f592415aef0 msgr2=0x7f5924158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:47.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f59237fe700 1 --2- 172.21.15.125:0/2797017358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f592415aef0 0x7f5924158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f59237fe700 1 -- 172.21.15.125:0/2797017358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f592415ab10 msgr2=0x7f59240c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:47.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f59237fe700 1 --2- 172.21.15.125:0/2797017358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f592415ab10 0x7f59240c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f59237fe700 1 -- 172.21.15.125:0/2797017358 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c0094b0 con 0x7f592406e5e0 2023-10-17T06:08:47.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f59237fe700 1 --2- 172.21.15.125:0/2797017358 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f592406e5e0 0x7f59241542a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f591400c4e0 tx=0x7f591400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:47.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f5920ff9700 1 -- 172.21.15.125:0/2797017358 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914004ca0 con 0x7f592406e5e0 2023-10-17T06:08:47.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f5920ff9700 1 -- 172.21.15.125:0/2797017358 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5914004e20 con 0x7f592406e5e0 2023-10-17T06:08:47.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f5920ff9700 1 -- 172.21.15.125:0/2797017358 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914007310 con 0x7f592406e5e0 2023-10-17T06:08:47.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f5928daf700 1 -- 172.21.15.125:0/2797017358 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59240c29d0 con 0x7f592406e5e0 2023-10-17T06:08:47.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.466+0000 7f5928daf700 1 -- 172.21.15.125:0/2797017358 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59241547e0 con 0x7f592406e5e0 2023-10-17T06:08:47.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.470+0000 7f5928daf700 1 -- 172.21.15.125:0/2797017358 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592404e910 con 0x7f592406e5e0 2023-10-17T06:08:47.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.470+0000 7f5920ff9700 1 -- 172.21.15.125:0/2797017358 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5914007470 con 0x7f592406e5e0 2023-10-17T06:08:47.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.470+0000 7f5920ff9700 1 --2- 172.21.15.125:0/2797017358 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f59040656f0 0x7f5904067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:47.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.470+0000 7f5920ff9700 1 -- 172.21.15.125:0/2797017358 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5914082760 con 0x7f592406e5e0 2023-10-17T06:08:47.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.470+0000 7f591bfff700 1 --2- 172.21.15.125:0/2797017358 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f59040656f0 0x7f5904067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:47.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.474+0000 7f591bfff700 1 --2- 172.21.15.125:0/2797017358 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f59040656f0 0x7f5904067bb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f592415b300 tx=0x7f590c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:47.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.478+0000 7f5920ff9700 1 -- 172.21.15.125:0/2797017358 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f5914050430 con 0x7f592406e5e0 2023-10-17T06:08:47.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.642+0000 7f5928daf700 1 -- 172.21.15.125:0/2797017358 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f592406fc30 con 0x7f592406e5e0 2023-10-17T06:08:47.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.642+0000 7f5920ff9700 1 -- 172.21.15.125:0/2797017358 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5914007720 con 0x7f592406e5e0 2023-10-17T06:08:47.648 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:08:47.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.646+0000 7f5928daf700 1 -- 172.21.15.125:0/2797017358 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f59040656f0 msgr2=0x7f5904067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:47.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.646+0000 7f5928daf700 1 --2- 172.21.15.125:0/2797017358 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f59040656f0 0x7f5904067bb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f592415b300 tx=0x7f590c008030 comp rx=0 tx=0).stop 2023-10-17T06:08:47.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.646+0000 7f5928daf700 1 -- 172.21.15.125:0/2797017358 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f592406e5e0 msgr2=0x7f59241542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:47.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.646+0000 7f5928daf700 1 --2- 172.21.15.125:0/2797017358 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f592406e5e0 0x7f59241542a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f591400c4e0 tx=0x7f591400c7f0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.646+0000 7f5928daf700 1 -- 172.21.15.125:0/2797017358 shutdown_connections 2023-10-17T06:08:47.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.646+0000 7f5928daf700 1 --2- 172.21.15.125:0/2797017358 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f59040656f0 0x7f5904067bb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.646+0000 7f5928daf700 1 --2- 172.21.15.125:0/2797017358 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f592415aef0 0x7f5924158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.646+0000 7f5928daf700 1 --2- 172.21.15.125:0/2797017358 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f592415ab10 0x7f59240c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.646+0000 7f5928daf700 1 --2- 172.21.15.125:0/2797017358 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f592406e5e0 0x7f59241542a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.646+0000 7f5928daf700 1 -- 172.21.15.125:0/2797017358 >> 172.21.15.125:0/2797017358 conn(0x7f59240cb9f0 msgr2=0x7f59240b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:47.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.646+0000 7f5928daf700 1 -- 172.21.15.125:0/2797017358 shutdown_connections 2023-10-17T06:08:47.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.646+0000 7f5928daf700 1 -- 172.21.15.125:0/2797017358 wait complete. 2023-10-17T06:08:47.671 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:08:47.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.858+0000 7f4abc687700 1 Processor -- start 2023-10-17T06:08:47.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.858+0000 7f4abc687700 1 -- start start 2023-10-17T06:08:47.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.862+0000 7f4abc687700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4ab406eb00 0x7f4ab40b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:47.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.862+0000 7f4abc687700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4ab40b1870 0x7f4ab40ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:47.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.862+0000 7f4abc687700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab4160980 con 0x7f4ab415cf20 2023-10-17T06:08:47.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.862+0000 7f4abc687700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab40b1d00 con 0x7f4ab406eb00 2023-10-17T06:08:47.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.862+0000 7f4abc687700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab415d300 con 0x7f4ab40b1870 2023-10-17T06:08:47.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.862+0000 7f4aba423700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4ab415cf20 0x7f4ab4071820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56400/0 (socket says 172.21.15.125:56400) 2023-10-17T06:08:47.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.862+0000 7f4aba423700 1 -- 172.21.15.125:0/2957469501 learned_addr learned my addr 172.21.15.125:0/2957469501 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:47.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.862+0000 7f4ab9c22700 1 --2- 172.21.15.125:0/2957469501 >> v2:172.21.15.125:3300/0 conn(0x7f4ab406eb00 0x7f4ab40b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:47.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.862+0000 7f4abac24700 1 --2- 172.21.15.125:0/2957469501 >> v2:172.21.15.184:3300/0 conn(0x7f4ab40b1870 0x7f4ab40ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:47.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.862+0000 7f4ab9421700 1 -- 172.21.15.125:0/2957469501 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178294198 0 0) 0x7f4ab4160980 con 0x7f4ab415cf20 2023-10-17T06:08:47.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.862+0000 7f4ab9421700 1 -- 172.21.15.125:0/2957469501 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aa00035d0 con 0x7f4ab415cf20 2023-10-17T06:08:47.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.862+0000 7f4ab9c22700 1 -- 172.21.15.125:0/2957469501 >> v2:172.21.15.184:3300/0 conn(0x7f4ab40b1870 msgr2=0x7f4ab40ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:47.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.862+0000 7f4ab9c22700 1 --2- 172.21.15.125:0/2957469501 >> v2:172.21.15.184:3300/0 conn(0x7f4ab40b1870 0x7f4ab40ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.862+0000 7f4ab9c22700 1 -- 172.21.15.125:0/2957469501 >> v1:172.21.15.125:6789/0 conn(0x7f4ab415cf20 legacy=0x7f4ab4071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:47.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.862+0000 7f4ab9c22700 1 -- 172.21.15.125:0/2957469501 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab4161500 con 0x7f4ab406eb00 2023-10-17T06:08:47.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.862+0000 7f4ab9c22700 1 --2- 172.21.15.125:0/2957469501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab406eb00 0x7f4ab40b1330 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4ab40b2120 tx=0x7f4aa4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170b4e88f27527e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:47.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.866+0000 7f4ab9421700 1 -- 172.21.15.125:0/2957469501 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4011830 con 0x7f4ab406eb00 2023-10-17T06:08:47.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.866+0000 7f4ab9421700 1 -- 172.21.15.125:0/2957469501 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa4011990 con 0x7f4ab406eb00 2023-10-17T06:08:47.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.866+0000 7f4ab9421700 1 -- 172.21.15.125:0/2957469501 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4011d20 con 0x7f4ab406eb00 2023-10-17T06:08:47.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.866+0000 7f4abc687700 1 -- 172.21.15.125:0/2957469501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab406eb00 msgr2=0x7f4ab40b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:47.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.866+0000 7f4abc687700 1 --2- 172.21.15.125:0/2957469501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab406eb00 0x7f4ab40b1330 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4ab40b2120 tx=0x7f4aa4009b60 comp rx=0 tx=0).stop 2023-10-17T06:08:47.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.866+0000 7f4abc687700 1 -- 172.21.15.125:0/2957469501 shutdown_connections 2023-10-17T06:08:47.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.866+0000 7f4abc687700 1 --2- 172.21.15.125:0/2957469501 >> v2:172.21.15.184:3300/0 conn(0x7f4ab40b1870 0x7f4ab40ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.866+0000 7f4abc687700 1 --2- 172.21.15.125:0/2957469501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab406eb00 0x7f4ab40b1330 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.866+0000 7f4abc687700 1 -- 172.21.15.125:0/2957469501 >> 172.21.15.125:0/2957469501 conn(0x7f4ab40cc330 msgr2=0x7f4ab40cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:47.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.866+0000 7f4abc687700 1 -- 172.21.15.125:0/2957469501 shutdown_connections 2023-10-17T06:08:47.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.866+0000 7f4abc687700 1 -- 172.21.15.125:0/2957469501 wait complete. 2023-10-17T06:08:47.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.866+0000 7f4abc687700 1 Processor -- start 2023-10-17T06:08:47.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4abc687700 1 -- start start 2023-10-17T06:08:47.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4abc687700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ab406eb00 0x7f4ab4159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:47.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4abc687700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab40b1870 0x7f4ab40c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:47.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4abc687700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ab415cf20 0x7f4ab415a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:47.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4abc687700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab40c5b10 con 0x7f4ab40b1870 2023-10-17T06:08:47.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4abc687700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab40c5210 con 0x7f4ab406eb00 2023-10-17T06:08:47.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4abc687700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab40c42b0 con 0x7f4ab415cf20 2023-10-17T06:08:47.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4ab9c22700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab40b1870 0x7f4ab40c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:47.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4ab9c22700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab40b1870 0x7f4ab40c5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33340/0 (socket says 172.21.15.125:33340) 2023-10-17T06:08:47.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4ab9c22700 1 -- 172.21.15.125:0/1350844356 learned_addr learned my addr 172.21.15.125:0/1350844356 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:47.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4aba423700 1 --2- 172.21.15.125:0/1350844356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ab406eb00 0x7f4ab4159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:47.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4abac24700 1 --2- 172.21.15.125:0/1350844356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ab415cf20 0x7f4ab415a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:47.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4ab9c22700 1 -- 172.21.15.125:0/1350844356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ab415cf20 msgr2=0x7f4ab415a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:47.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4ab9c22700 1 --2- 172.21.15.125:0/1350844356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ab415cf20 0x7f4ab415a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4ab9c22700 1 -- 172.21.15.125:0/1350844356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ab406eb00 msgr2=0x7f4ab4159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:47.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4ab9c22700 1 --2- 172.21.15.125:0/1350844356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ab406eb00 0x7f4ab4159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:47.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4ab9c22700 1 -- 172.21.15.125:0/1350844356 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa40094b0 con 0x7f4ab40b1870 2023-10-17T06:08:47.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4aba423700 1 --2- 172.21.15.125:0/1350844356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ab406eb00 0x7f4ab4159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:47.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4ab9c22700 1 --2- 172.21.15.125:0/1350844356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab40b1870 0x7f4ab40c5fa0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009ba0 tx=0x7f4aa4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:47.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4aaaffd700 1 -- 172.21.15.125:0/1350844356 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4004530 con 0x7f4ab40b1870 2023-10-17T06:08:47.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4aaaffd700 1 -- 172.21.15.125:0/1350844356 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa401f070 con 0x7f4ab40b1870 2023-10-17T06:08:47.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4abc687700 1 -- 172.21.15.125:0/1350844356 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab40c54c0 con 0x7f4ab40b1870 2023-10-17T06:08:47.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4aaaffd700 1 -- 172.21.15.125:0/1350844356 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40038e0 con 0x7f4ab40b1870 2023-10-17T06:08:47.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.870+0000 7f4abc687700 1 -- 172.21.15.125:0/1350844356 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab415ae80 con 0x7f4ab40b1870 2023-10-17T06:08:47.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.874+0000 7f4abc687700 1 -- 172.21.15.125:0/1350844356 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab40c5c80 con 0x7f4ab40b1870 2023-10-17T06:08:47.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.874+0000 7f4aaaffd700 1 -- 172.21.15.125:0/1350844356 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4aa4021030 con 0x7f4ab40b1870 2023-10-17T06:08:47.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.874+0000 7f4aaaffd700 1 --2- 172.21.15.125:0/1350844356 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4a980656f0 0x7f4a98067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:47.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.874+0000 7f4aaaffd700 1 -- 172.21.15.125:0/1350844356 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f4aa4083fc0 con 0x7f4ab40b1870 2023-10-17T06:08:47.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.874+0000 7f4aba423700 1 --2- 172.21.15.125:0/1350844356 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4a980656f0 0x7f4a98067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:47.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.878+0000 7f4aba423700 1 --2- 172.21.15.125:0/1350844356 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4a980656f0 0x7f4a98067bb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00011e0 tx=0x7f4ab0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:47.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:47.882+0000 7f4aaaffd700 1 -- 172.21.15.125:0/1350844356 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f4aa4051c80 con 0x7f4ab40b1870 2023-10-17T06:08:48.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.062+0000 7f4abc687700 1 -- 172.21.15.125:0/1350844356 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4ab4160ba0 con 0x7f4ab40b1870 2023-10-17T06:08:48.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.062+0000 7f4aaaffd700 1 -- 172.21.15.125:0/1350844356 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4aa40552a0 con 0x7f4ab40b1870 2023-10-17T06:08:48.066 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:08:48.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.062+0000 7f4abc687700 1 -- 172.21.15.125:0/1350844356 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4a980656f0 msgr2=0x7f4a98067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:48.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.062+0000 7f4abc687700 1 --2- 172.21.15.125:0/1350844356 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4a980656f0 0x7f4a98067bb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00011e0 tx=0x7f4ab0009040 comp rx=0 tx=0).stop 2023-10-17T06:08:48.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.062+0000 7f4abc687700 1 -- 172.21.15.125:0/1350844356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab40b1870 msgr2=0x7f4ab40c5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:48.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.062+0000 7f4abc687700 1 --2- 172.21.15.125:0/1350844356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab40b1870 0x7f4ab40c5fa0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009ba0 tx=0x7f4aa4004770 comp rx=0 tx=0).stop 2023-10-17T06:08:48.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.062+0000 7f4abc687700 1 -- 172.21.15.125:0/1350844356 shutdown_connections 2023-10-17T06:08:48.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.062+0000 7f4abc687700 1 --2- 172.21.15.125:0/1350844356 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4a980656f0 0x7f4a98067bb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:48.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.062+0000 7f4abc687700 1 --2- 172.21.15.125:0/1350844356 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ab415cf20 0x7f4ab415a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:48.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.062+0000 7f4abc687700 1 --2- 172.21.15.125:0/1350844356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ab40b1870 0x7f4ab40c5fa0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:48.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.062+0000 7f4abc687700 1 --2- 172.21.15.125:0/1350844356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ab406eb00 0x7f4ab4159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:48.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.062+0000 7f4abc687700 1 -- 172.21.15.125:0/1350844356 >> 172.21.15.125:0/1350844356 conn(0x7f4ab40cc330 msgr2=0x7f4ab406dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:48.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.062+0000 7f4abc687700 1 -- 172.21.15.125:0/1350844356 shutdown_connections 2023-10-17T06:08:48.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.066+0000 7f4abc687700 1 -- 172.21.15.125:0/1350844356 wait complete. 2023-10-17T06:08:48.089 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-17T06:08:48.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.254+0000 7f9504278700 1 Processor -- start 2023-10-17T06:08:48.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.258+0000 7f9504278700 1 -- start start 2023-10-17T06:08:48.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.258+0000 7f9504278700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f94fc0cb8a0 0x7f94fc06f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:48.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.258+0000 7f9504278700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94fc15e130 con 0x7f94fc06e8a0 2023-10-17T06:08:48.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.258+0000 7f9504278700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94fc0ce1b0 con 0x7f94fc154040 2023-10-17T06:08:48.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.258+0000 7f9504278700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94fc0cdfa0 con 0x7f94fc0cb8a0 2023-10-17T06:08:48.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.262+0000 7f9501813700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f94fc06e8a0 0x7f94fc0cb190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56404/0 (socket says 172.21.15.125:56404) 2023-10-17T06:08:48.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.262+0000 7f9501813700 1 -- 172.21.15.125:0/2451258036 learned_addr learned my addr 172.21.15.125:0/2451258036 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:48.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.262+0000 7f9502815700 1 --2- 172.21.15.125:0/2451258036 >> v2:172.21.15.184:3300/0 conn(0x7f94fc0cb8a0 0x7f94fc06f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:48.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.262+0000 7f9501012700 1 -- 172.21.15.125:0/2451258036 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351307102 0 0) 0x7f94fc15e130 con 0x7f94fc06e8a0 2023-10-17T06:08:48.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.262+0000 7f9501012700 1 -- 172.21.15.125:0/2451258036 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94e80035d0 con 0x7f94fc06e8a0 2023-10-17T06:08:48.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.262+0000 7f9502815700 1 -- 172.21.15.125:0/2451258036 >> v1:172.21.15.184:6789/0 conn(0x7f94fc154040 legacy=0x7f94fc0cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:48.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.262+0000 7f9502815700 1 -- 172.21.15.125:0/2451258036 >> v1:172.21.15.125:6789/0 conn(0x7f94fc06e8a0 legacy=0x7f94fc0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:48.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.262+0000 7f9502815700 1 -- 172.21.15.125:0/2451258036 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94fc0ce490 con 0x7f94fc0cb8a0 2023-10-17T06:08:48.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.262+0000 7f9502815700 1 --2- 172.21.15.125:0/2451258036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94fc0cb8a0 0x7f94fc06f970 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009d90 tx=0x7f94f400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86507361fe5c6e server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:48.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.262+0000 7f9501012700 1 -- 172.21.15.125:0/2451258036 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f400e070 con 0x7f94fc0cb8a0 2023-10-17T06:08:48.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.262+0000 7f9501012700 1 -- 172.21.15.125:0/2451258036 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f400bb20 con 0x7f94fc0cb8a0 2023-10-17T06:08:48.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.262+0000 7f9501012700 1 -- 172.21.15.125:0/2451258036 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f4012430 con 0x7f94fc0cb8a0 2023-10-17T06:08:48.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.262+0000 7f9504278700 1 -- 172.21.15.125:0/2451258036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94fc0cb8a0 msgr2=0x7f94fc06f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:48.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.262+0000 7f9504278700 1 --2- 172.21.15.125:0/2451258036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94fc0cb8a0 0x7f94fc06f970 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009d90 tx=0x7f94f400b330 comp rx=0 tx=0).stop 2023-10-17T06:08:48.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.262+0000 7f9504278700 1 -- 172.21.15.125:0/2451258036 shutdown_connections 2023-10-17T06:08:48.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.262+0000 7f9504278700 1 --2- 172.21.15.125:0/2451258036 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94fc0cb8a0 0x7f94fc06f970 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:48.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.262+0000 7f9504278700 1 -- 172.21.15.125:0/2451258036 >> 172.21.15.125:0/2451258036 conn(0x7f94fc06a340 msgr2=0x7f94fc0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:48.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.266+0000 7f9504278700 1 -- 172.21.15.125:0/2451258036 shutdown_connections 2023-10-17T06:08:48.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.266+0000 7f9504278700 1 -- 172.21.15.125:0/2451258036 wait complete. 2023-10-17T06:08:48.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.266+0000 7f9504278700 1 Processor -- start 2023-10-17T06:08:48.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.266+0000 7f9504278700 1 -- start start 2023-10-17T06:08:48.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.266+0000 7f9504278700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94fc06e8a0 0x7f94fc15c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:48.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.266+0000 7f9504278700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94fc0cb8a0 0x7f94fc1551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:48.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.266+0000 7f9504278700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94fc154040 0x7f94fc1556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:48.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.266+0000 7f9504278700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc1f2550 con 0x7f94fc06e8a0 2023-10-17T06:08:48.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.266+0000 7f9504278700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc1569a0 con 0x7f94fc0cb8a0 2023-10-17T06:08:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.266+0000 7f9504278700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc156c80 con 0x7f94fc154040 2023-10-17T06:08:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.270+0000 7f9502014700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94fc06e8a0 0x7f94fc15c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.270+0000 7f9502014700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94fc06e8a0 0x7f94fc15c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33354/0 (socket says 172.21.15.125:33354) 2023-10-17T06:08:48.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.270+0000 7f9502014700 1 -- 172.21.15.125:0/1639143805 learned_addr learned my addr 172.21.15.125:0/1639143805 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:48.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.270+0000 7f9501813700 1 --2- 172.21.15.125:0/1639143805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94fc0cb8a0 0x7f94fc1551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:48.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.270+0000 7f9502815700 1 --2- 172.21.15.125:0/1639143805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94fc154040 0x7f94fc1556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:48.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.270+0000 7f9502014700 1 -- 172.21.15.125:0/1639143805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94fc154040 msgr2=0x7f94fc1556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:48.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.270+0000 7f9502014700 1 --2- 172.21.15.125:0/1639143805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94fc154040 0x7f94fc1556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:48.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.270+0000 7f9502014700 1 -- 172.21.15.125:0/1639143805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94fc0cb8a0 msgr2=0x7f94fc1551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:48.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.270+0000 7f9502014700 1 --2- 172.21.15.125:0/1639143805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94fc0cb8a0 0x7f94fc1551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:48.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.270+0000 7f9502014700 1 -- 172.21.15.125:0/1639143805 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f4009a70 con 0x7f94fc06e8a0 2023-10-17T06:08:48.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.270+0000 7f9502014700 1 --2- 172.21.15.125:0/1639143805 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94fc06e8a0 0x7f94fc15c530 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f94f800c500 tx=0x7f94f800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:48.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.270+0000 7f94f2ffd700 1 -- 172.21.15.125:0/1639143805 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f80052d0 con 0x7f94fc06e8a0 2023-10-17T06:08:48.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.270+0000 7f9504278700 1 -- 172.21.15.125:0/1639143805 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94fc156f60 con 0x7f94fc06e8a0 2023-10-17T06:08:48.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.270+0000 7f94f2ffd700 1 -- 172.21.15.125:0/1639143805 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f80011c0 con 0x7f94fc06e8a0 2023-10-17T06:08:48.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.270+0000 7f94f2ffd700 1 -- 172.21.15.125:0/1639143805 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f80036a0 con 0x7f94fc06e8a0 2023-10-17T06:08:48.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.270+0000 7f9504278700 1 -- 172.21.15.125:0/1639143805 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94fc157240 con 0x7f94fc06e8a0 2023-10-17T06:08:48.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.270+0000 7f9504278700 1 -- 172.21.15.125:0/1639143805 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94fc1f2350 con 0x7f94fc06e8a0 2023-10-17T06:08:48.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.274+0000 7f94f2ffd700 1 -- 172.21.15.125:0/1639143805 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f94f8003800 con 0x7f94fc06e8a0 2023-10-17T06:08:48.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.274+0000 7f94f2ffd700 1 --2- 172.21.15.125:0/1639143805 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f94e00656f0 0x7f94e0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:48.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.274+0000 7f94f2ffd700 1 -- 172.21.15.125:0/1639143805 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f94f8081f10 con 0x7f94fc06e8a0 2023-10-17T06:08:48.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.274+0000 7f9501813700 1 --2- 172.21.15.125:0/1639143805 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f94e00656f0 0x7f94e0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:48.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.274+0000 7f9501813700 1 --2- 172.21.15.125:0/1639143805 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f94e00656f0 0x7f94e0067bb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f94fc0b36d0 tx=0x7f94ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:48.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.282+0000 7f94f2ffd700 1 -- 172.21.15.125:0/1639143805 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f94f804fc90 con 0x7f94fc06e8a0 2023-10-17T06:08:48.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.478+0000 7f9504278700 1 -- 172.21.15.125:0/1639143805 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f94fc072e60 con 0x7f94fc06e8a0 2023-10-17T06:08:48.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.478+0000 7f94f2ffd700 1 -- 172.21.15.125:0/1639143805 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v39) v1 ==== 84+0+126 (secure 0 0 0) 0x7f94f80532b0 con 0x7f94fc06e8a0 2023-10-17T06:08:48.484 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:48.485 INFO:teuthology.orchestra.run.smithi125.stdout:[ 2023-10-17T06:08:48.485 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:48.485 INFO:teuthology.orchestra.run.smithi125.stdout: "poolnum": 1, 2023-10-17T06:08:48.485 INFO:teuthology.orchestra.run.smithi125.stdout: "poolname": ".mgr" 2023-10-17T06:08:48.485 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-17T06:08:48.486 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-17T06:08:48.486 INFO:teuthology.orchestra.run.smithi125.stdout: "poolnum": 2, 2023-10-17T06:08:48.486 INFO:teuthology.orchestra.run.smithi125.stdout: "poolname": "rbd" 2023-10-17T06:08:48.486 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-17T06:08:48.486 INFO:teuthology.orchestra.run.smithi125.stdout:] 2023-10-17T06:08:48.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.482+0000 7f9504278700 1 -- 172.21.15.125:0/1639143805 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f94e00656f0 msgr2=0x7f94e0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:48.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.482+0000 7f9504278700 1 --2- 172.21.15.125:0/1639143805 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f94e00656f0 0x7f94e0067bb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f94fc0b36d0 tx=0x7f94ec009040 comp rx=0 tx=0).stop 2023-10-17T06:08:48.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.482+0000 7f9504278700 1 -- 172.21.15.125:0/1639143805 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94fc06e8a0 msgr2=0x7f94fc15c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:48.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.482+0000 7f9504278700 1 --2- 172.21.15.125:0/1639143805 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94fc06e8a0 0x7f94fc15c530 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f94f800c500 tx=0x7f94f800c8c0 comp rx=0 tx=0).stop 2023-10-17T06:08:48.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.482+0000 7f9504278700 1 -- 172.21.15.125:0/1639143805 shutdown_connections 2023-10-17T06:08:48.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.482+0000 7f9504278700 1 --2- 172.21.15.125:0/1639143805 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f94e00656f0 0x7f94e0067bb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:48.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.482+0000 7f9504278700 1 --2- 172.21.15.125:0/1639143805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f94fc154040 0x7f94fc1556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:48.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.482+0000 7f9504278700 1 --2- 172.21.15.125:0/1639143805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f94fc0cb8a0 0x7f94fc1551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:48.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.482+0000 7f9504278700 1 --2- 172.21.15.125:0/1639143805 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f94fc06e8a0 0x7f94fc15c530 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:48.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.482+0000 7f9504278700 1 -- 172.21.15.125:0/1639143805 >> 172.21.15.125:0/1639143805 conn(0x7f94fc06a340 msgr2=0x7f94fc0aebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:48.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.482+0000 7f9504278700 1 -- 172.21.15.125:0/1639143805 shutdown_connections 2023-10-17T06:08:48.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.482+0000 7f9504278700 1 -- 172.21.15.125:0/1639143805 wait complete. 2023-10-17T06:08:48.508 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-17T06:08:48.509 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-17T06:08:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.690+0000 7f4cb5f56700 1 Processor -- start 2023-10-17T06:08:48.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.690+0000 7f4cb5f56700 1 -- start start 2023-10-17T06:08:48.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4cb5f56700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4cb00cc150 0x7f4cb0165a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:48.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4cb5f56700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb00b37e0 con 0x7f4cb01443d0 2023-10-17T06:08:48.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4cb5f56700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb01447b0 con 0x7f4cb0070b70 2023-10-17T06:08:48.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4cb5f56700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb00cc620 con 0x7f4cb00cc150 2023-10-17T06:08:48.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4caf7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4cb01443d0 0x7f4cb0070460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56410/0 (socket says 172.21.15.125:56410) 2023-10-17T06:08:48.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4caf7fe700 1 -- 172.21.15.125:0/3580098312 learned_addr learned my addr 172.21.15.125:0/3580098312 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:48.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4cae7fc700 1 -- 172.21.15.125:0/3580098312 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292458278 0 0) 0x7f4cb00b37e0 con 0x7f4cb01443d0 2023-10-17T06:08:48.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4cae7fc700 1 -- 172.21.15.125:0/3580098312 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c980035d0 con 0x7f4cb01443d0 2023-10-17T06:08:48.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4caffff700 1 --2- 172.21.15.125:0/3580098312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4cb00cc150 0x7f4cb0165a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:48.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4cae7fc700 1 -- 172.21.15.125:0/3580098312 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3600673155 0 0) 0x7f4c980035d0 con 0x7f4cb01443d0 2023-10-17T06:08:48.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4cae7fc700 1 -- 172.21.15.125:0/3580098312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4cb00cc150 msgr2=0x7f4cb0165a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:48.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4cae7fc700 1 --2- 172.21.15.125:0/3580098312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4cb00cc150 0x7f4cb0165a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:48.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4cae7fc700 1 -- 172.21.15.125:0/3580098312 >> v1:172.21.15.184:6789/0 conn(0x7f4cb0070b70 legacy=0x7f4cb00cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:48.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4cae7fc700 1 -- 172.21.15.125:0/3580098312 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb00b11e0 con 0x7f4cb01443d0 2023-10-17T06:08:48.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4cae7fc700 1 -- 172.21.15.125:0/3580098312 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7f4ca0001670 con 0x7f4cb01443d0 2023-10-17T06:08:48.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4cae7fc700 1 -- 172.21.15.125:0/3580098312 >> v1:172.21.15.125:6789/0 conn(0x7f4cb01443d0 legacy=0x7f4cb0070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:48.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4cae7fc700 1 --2- 172.21.15.125:0/3580098312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c98003a50 0x7f4c98003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:48.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4cae7fc700 1 --2- 172.21.15.125:0/3580098312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c98004870 0x7f4c98004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:48.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4cae7fc700 1 --2- 172.21.15.125:0/3580098312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c98005230 0x7f4c9800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:48.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4cae7fc700 1 -- 172.21.15.125:0/3580098312 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb00cc620 con 0x7f4c98004870 2023-10-17T06:08:48.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4cae7fc700 1 -- 172.21.15.125:0/3580098312 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c98010540 con 0x7f4c98005230 2023-10-17T06:08:48.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4cae7fc700 1 -- 172.21.15.125:0/3580098312 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c98010700 con 0x7f4c98003a50 2023-10-17T06:08:48.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4caeffd700 1 --2- 172.21.15.125:0/3580098312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c98004870 0x7f4c98004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:48.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4caf7fe700 1 --2- 172.21.15.125:0/3580098312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c98003a50 0x7f4c98003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:48.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4caffff700 1 --2- 172.21.15.125:0/3580098312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c98005230 0x7f4c9800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:48.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4caeffd700 1 -- 172.21.15.125:0/3580098312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c98003a50 msgr2=0x7f4c98003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:48.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4caeffd700 1 --2- 172.21.15.125:0/3580098312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4c98003a50 0x7f4c98003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:48.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4caeffd700 1 -- 172.21.15.125:0/3580098312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c98005230 msgr2=0x7f4c9800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:48.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4caeffd700 1 --2- 172.21.15.125:0/3580098312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c98005230 0x7f4c9800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:48.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4caeffd700 1 -- 172.21.15.125:0/3580098312 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c980035d0 con 0x7f4c98004870 2023-10-17T06:08:48.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4caeffd700 1 --2- 172.21.15.125:0/3580098312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c98004870 0x7f4c98004cf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4cb015f770 tx=0x7f4c980058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daadd6212ad67afc server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:48.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.694+0000 7f4cae7fc700 1 -- 172.21.15.125:0/3580098312 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4016070 con 0x7f4c98004870 2023-10-17T06:08:48.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.698+0000 7f4cae7fc700 1 -- 172.21.15.125:0/3580098312 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca4006880 con 0x7f4c98004870 2023-10-17T06:08:48.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.698+0000 7f4cae7fc700 1 -- 172.21.15.125:0/3580098312 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca40039b0 con 0x7f4c98004870 2023-10-17T06:08:48.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.698+0000 7f4cb5f56700 1 -- 172.21.15.125:0/3580098312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c98004870 msgr2=0x7f4c98004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:48.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.698+0000 7f4cb5f56700 1 --2- 172.21.15.125:0/3580098312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4c98004870 0x7f4c98004cf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4cb015f770 tx=0x7f4c980058a0 comp rx=0 tx=0).stop 2023-10-17T06:08:48.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.698+0000 7f4caffff700 1 -- 172.21.15.125:0/3580098312 reap_dead start 2023-10-17T06:08:48.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.698+0000 7f4cb5f56700 1 -- 172.21.15.125:0/3580098312 shutdown_connections 2023-10-17T06:08:48.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.698+0000 7f4cb5f56700 1 -- 172.21.15.125:0/3580098312 >> 172.21.15.125:0/3580098312 conn(0x7f4cb006a3c0 msgr2=0x7f4cb00ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:48.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.698+0000 7f4cb5f56700 1 -- 172.21.15.125:0/3580098312 shutdown_connections 2023-10-17T06:08:48.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.698+0000 7f4cb5f56700 1 -- 172.21.15.125:0/3580098312 wait complete. 2023-10-17T06:08:48.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4cb5f56700 1 Processor -- start 2023-10-17T06:08:48.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4cb5f56700 1 -- start start 2023-10-17T06:08:48.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4cb5f56700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c98004870 0x7f4cb013a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:48.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4cb5f56700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4cb014edc0 0x7f4cb0153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:48.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4cb5f56700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4cb014f240 0x7f4cb0153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:48.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4cb5f56700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb013ad50 con 0x7f4cb014edc0 2023-10-17T06:08:48.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4cb5f56700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb014dad0 con 0x7f4c98004870 2023-10-17T06:08:48.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4cb5f56700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb014dd20 con 0x7f4cb014f240 2023-10-17T06:08:48.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4caeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4cb014edc0 0x7f4cb0153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:48.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4caeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4cb014edc0 0x7f4cb0153750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33372/0 (socket says 172.21.15.125:33372) 2023-10-17T06:08:48.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4caeffd700 1 -- 172.21.15.125:0/562294178 learned_addr learned my addr 172.21.15.125:0/562294178 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:48.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4caffff700 1 --2- 172.21.15.125:0/562294178 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4cb014f240 0x7f4cb0153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:48.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4caf7fe700 1 --2- 172.21.15.125:0/562294178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c98004870 0x7f4cb013a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:48.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4caeffd700 1 -- 172.21.15.125:0/562294178 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4cb014f240 msgr2=0x7f4cb0153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:48.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4caeffd700 1 --2- 172.21.15.125:0/562294178 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4cb014f240 0x7f4cb0153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:48.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4caeffd700 1 -- 172.21.15.125:0/562294178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c98004870 msgr2=0x7f4cb013a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:48.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4caeffd700 1 --2- 172.21.15.125:0/562294178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c98004870 0x7f4cb013a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:48.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4caeffd700 1 -- 172.21.15.125:0/562294178 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb014e000 con 0x7f4cb014edc0 2023-10-17T06:08:48.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4caffff700 1 --2- 172.21.15.125:0/562294178 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4cb014f240 0x7f4cb0153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:48.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4caf7fe700 1 --2- 172.21.15.125:0/562294178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c98004870 0x7f4cb013a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:48.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.702+0000 7f4caeffd700 1 --2- 172.21.15.125:0/562294178 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4cb014edc0 0x7f4cb0153750 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00b0930 tx=0x7f4ca40037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:48.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.706+0000 7f4c97fff700 1 -- 172.21.15.125:0/562294178 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4016040 con 0x7f4cb014edc0 2023-10-17T06:08:48.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.706+0000 7f4c97fff700 1 -- 172.21.15.125:0/562294178 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca4025680 con 0x7f4cb014edc0 2023-10-17T06:08:48.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.706+0000 7f4cb5f56700 1 -- 172.21.15.125:0/562294178 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb014e2e0 con 0x7f4cb014edc0 2023-10-17T06:08:48.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.706+0000 7f4c97fff700 1 -- 172.21.15.125:0/562294178 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca40039b0 con 0x7f4cb014edc0 2023-10-17T06:08:48.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.706+0000 7f4cb5f56700 1 -- 172.21.15.125:0/562294178 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb014e8a0 con 0x7f4cb014edc0 2023-10-17T06:08:48.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.706+0000 7f4cb5f56700 1 -- 172.21.15.125:0/562294178 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb014ea60 con 0x7f4cb014edc0 2023-10-17T06:08:48.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.706+0000 7f4c97fff700 1 -- 172.21.15.125:0/562294178 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4ca401c420 con 0x7f4cb014edc0 2023-10-17T06:08:48.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.710+0000 7f4c97fff700 1 --2- 172.21.15.125:0/562294178 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4c9c065720 0x7f4c9c067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:48.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.710+0000 7f4c97fff700 1 -- 172.21.15.125:0/562294178 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f4ca4083c70 con 0x7f4cb014edc0 2023-10-17T06:08:48.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.710+0000 7f4caf7fe700 1 --2- 172.21.15.125:0/562294178 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4c9c065720 0x7f4c9c067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:48.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.710+0000 7f4caf7fe700 1 --2- 172.21.15.125:0/562294178 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4c9c065720 0x7f4c9c067be0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0000c00 tx=0x7f4ca0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:48.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.714+0000 7f4c97fff700 1 -- 172.21.15.125:0/562294178 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f4ca40553c0 con 0x7f4cb014edc0 2023-10-17T06:08:48.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:48.898+0000 7f4cb5f56700 1 -- 172.21.15.125:0/562294178 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4cb0073f00 con 0x7f4cb014edc0 2023-10-17T06:08:49.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:49.842+0000 7f4c97fff700 1 -- 172.21.15.125:0/562294178 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v40) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4ca4054f50 con 0x7f4cb014edc0 2023-10-17T06:08:49.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:49.850+0000 7f4cb5f56700 1 -- 172.21.15.125:0/562294178 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4c9c065720 msgr2=0x7f4c9c067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:49.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:49.850+0000 7f4cb5f56700 1 --2- 172.21.15.125:0/562294178 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4c9c065720 0x7f4c9c067be0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0000c00 tx=0x7f4ca0009040 comp rx=0 tx=0).stop 2023-10-17T06:08:49.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:49.850+0000 7f4cb5f56700 1 -- 172.21.15.125:0/562294178 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4cb014edc0 msgr2=0x7f4cb0153750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:49.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:49.850+0000 7f4cb5f56700 1 --2- 172.21.15.125:0/562294178 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4cb014edc0 0x7f4cb0153750 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00b0930 tx=0x7f4ca40037a0 comp rx=0 tx=0).stop 2023-10-17T06:08:49.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:49.854+0000 7f4cb5f56700 1 -- 172.21.15.125:0/562294178 shutdown_connections 2023-10-17T06:08:49.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:49.854+0000 7f4cb5f56700 1 --2- 172.21.15.125:0/562294178 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f4c9c065720 0x7f4c9c067be0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:49.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:49.854+0000 7f4cb5f56700 1 --2- 172.21.15.125:0/562294178 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4cb014f240 0x7f4cb0153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:49.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:49.854+0000 7f4cb5f56700 1 --2- 172.21.15.125:0/562294178 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4cb014edc0 0x7f4cb0153750 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:49.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:49.854+0000 7f4cb5f56700 1 --2- 172.21.15.125:0/562294178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c98004870 0x7f4cb013a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:49.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:49.854+0000 7f4cb5f56700 1 -- 172.21.15.125:0/562294178 >> 172.21.15.125:0/562294178 conn(0x7f4cb006a3c0 msgr2=0x7f4cb00b26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:49.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:49.854+0000 7f4cb5f56700 1 -- 172.21.15.125:0/562294178 shutdown_connections 2023-10-17T06:08:49.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:49.854+0000 7f4cb5f56700 1 -- 172.21.15.125:0/562294178 wait complete. 2023-10-17T06:08:49.861 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_metadata' created 2023-10-17T06:08:49.880 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-17T06:08:50.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.062+0000 7f23ab04d700 1 Processor -- start 2023-10-17T06:08:50.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.062+0000 7f23ab04d700 1 -- start start 2023-10-17T06:08:50.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.066+0000 7f23ab04d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f23a41467c0 0x7f23a40b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:50.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.066+0000 7f23ab04d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f23a41612e0 0x7f23a415d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:50.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.066+0000 7f23ab04d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a4146ba0 con 0x7f23a406f9a0 2023-10-17T06:08:50.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.066+0000 7f23ab04d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a40d0920 con 0x7f23a41612e0 2023-10-17T06:08:50.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.066+0000 7f23ab04d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a40b6160 con 0x7f23a41467c0 2023-10-17T06:08:50.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.066+0000 7f23a3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f23a41612e0 0x7f23a415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:50.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.066+0000 7f23a95ea700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f23a406f9a0 0x7f23a40d0db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:56414/0 (socket says 172.21.15.125:56414) 2023-10-17T06:08:50.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.066+0000 7f23a95ea700 1 -- 172.21.15.125:0/262309892 learned_addr learned my addr 172.21.15.125:0/262309892 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:50.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.066+0000 7f23a8de9700 1 --2- 172.21.15.125:0/262309892 >> v2:172.21.15.184:3300/0 conn(0x7f23a41467c0 0x7f23a40b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:50.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.066+0000 7f23a37fe700 1 -- 172.21.15.125:0/262309892 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998042181 0 0) 0x7f23a4146ba0 con 0x7f23a406f9a0 2023-10-17T06:08:50.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.066+0000 7f23a37fe700 1 -- 172.21.15.125:0/262309892 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23940035d0 con 0x7f23a406f9a0 2023-10-17T06:08:50.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.066+0000 7f23a3fff700 1 -- 172.21.15.125:0/262309892 >> v2:172.21.15.184:3300/0 conn(0x7f23a41467c0 msgr2=0x7f23a40b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:50.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.066+0000 7f23a3fff700 1 --2- 172.21.15.125:0/262309892 >> v2:172.21.15.184:3300/0 conn(0x7f23a41467c0 0x7f23a40b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:50.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.066+0000 7f23a3fff700 1 -- 172.21.15.125:0/262309892 >> v1:172.21.15.125:6789/0 conn(0x7f23a406f9a0 legacy=0x7f23a40d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:50.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.066+0000 7f23a3fff700 1 -- 172.21.15.125:0/262309892 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a40b6440 con 0x7f23a41612e0 2023-10-17T06:08:50.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.066+0000 7f23a3fff700 1 --2- 172.21.15.125:0/262309892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23a41612e0 0x7f23a415d310 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f23a40b6f30 tx=0x7f2390009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db550f566d7323f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:50.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.066+0000 7f23a37fe700 1 -- 172.21.15.125:0/262309892 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390011830 con 0x7f23a41612e0 2023-10-17T06:08:50.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.066+0000 7f23a37fe700 1 -- 172.21.15.125:0/262309892 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2390011990 con 0x7f23a41612e0 2023-10-17T06:08:50.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.066+0000 7f23a37fe700 1 -- 172.21.15.125:0/262309892 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390011d20 con 0x7f23a41612e0 2023-10-17T06:08:50.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.070+0000 7f23ab04d700 1 -- 172.21.15.125:0/262309892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23a41612e0 msgr2=0x7f23a415d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:50.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.070+0000 7f23ab04d700 1 --2- 172.21.15.125:0/262309892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23a41612e0 0x7f23a415d310 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f23a40b6f30 tx=0x7f2390009b30 comp rx=0 tx=0).stop 2023-10-17T06:08:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.070+0000 7f23ab04d700 1 -- 172.21.15.125:0/262309892 shutdown_connections 2023-10-17T06:08:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.070+0000 7f23ab04d700 1 --2- 172.21.15.125:0/262309892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23a41612e0 0x7f23a415d310 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.070+0000 7f23ab04d700 1 --2- 172.21.15.125:0/262309892 >> v2:172.21.15.184:3300/0 conn(0x7f23a41467c0 0x7f23a40b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.070+0000 7f23ab04d700 1 -- 172.21.15.125:0/262309892 >> 172.21.15.125:0/262309892 conn(0x7f23a406a130 msgr2=0x7f23a406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.070+0000 7f23ab04d700 1 -- 172.21.15.125:0/262309892 shutdown_connections 2023-10-17T06:08:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.070+0000 7f23ab04d700 1 -- 172.21.15.125:0/262309892 wait complete. 2023-10-17T06:08:50.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.070+0000 7f23ab04d700 1 Processor -- start 2023-10-17T06:08:50.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.074+0000 7f23ab04d700 1 -- start start 2023-10-17T06:08:50.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.074+0000 7f23ab04d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23a406f9a0 0x7f23a413d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:50.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.074+0000 7f23ab04d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23a41467c0 0x7f23a413dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:50.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.074+0000 7f23ab04d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23a41612e0 0x7f23a41448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:50.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.074+0000 7f23ab04d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a413e110 con 0x7f23a406f9a0 2023-10-17T06:08:50.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.074+0000 7f23ab04d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a41f3750 con 0x7f23a41467c0 2023-10-17T06:08:50.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.074+0000 7f23ab04d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a41f2750 con 0x7f23a41612e0 2023-10-17T06:08:50.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.074+0000 7f23a8de9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23a406f9a0 0x7f23a413d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:50.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.074+0000 7f23a8de9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23a406f9a0 0x7f23a413d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33384/0 (socket says 172.21.15.125:33384) 2023-10-17T06:08:50.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.074+0000 7f23a8de9700 1 -- 172.21.15.125:0/3659310102 learned_addr learned my addr 172.21.15.125:0/3659310102 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:50.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.074+0000 7f23a8de9700 1 -- 172.21.15.125:0/3659310102 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23a41612e0 msgr2=0x7f23a41448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:50.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.074+0000 7f23a8de9700 1 --2- 172.21.15.125:0/3659310102 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23a41612e0 0x7f23a41448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:50.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.074+0000 7f23a8de9700 1 -- 172.21.15.125:0/3659310102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23a41467c0 msgr2=0x7f23a413dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:50.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.074+0000 7f23a8de9700 1 --2- 172.21.15.125:0/3659310102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23a41467c0 0x7f23a413dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:50.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.074+0000 7f23a8de9700 1 -- 172.21.15.125:0/3659310102 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23900094b0 con 0x7f23a406f9a0 2023-10-17T06:08:50.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.074+0000 7f23a8de9700 1 --2- 172.21.15.125:0/3659310102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23a406f9a0 0x7f23a413d570 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f239800e790 tx=0x7f239800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:50.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.074+0000 7f23a17fa700 1 -- 172.21.15.125:0/3659310102 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2398013610 con 0x7f23a406f9a0 2023-10-17T06:08:50.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.074+0000 7f23a17fa700 1 -- 172.21.15.125:0/3659310102 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2398013770 con 0x7f23a406f9a0 2023-10-17T06:08:50.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.074+0000 7f23ab04d700 1 -- 172.21.15.125:0/3659310102 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a4143e00 con 0x7f23a406f9a0 2023-10-17T06:08:50.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.074+0000 7f23a17fa700 1 -- 172.21.15.125:0/3659310102 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2398013ae0 con 0x7f23a406f9a0 2023-10-17T06:08:50.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.078+0000 7f23ab04d700 1 -- 172.21.15.125:0/3659310102 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a41f2a40 con 0x7f23a406f9a0 2023-10-17T06:08:50.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.078+0000 7f23ab04d700 1 -- 172.21.15.125:0/3659310102 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a40d2510 con 0x7f23a406f9a0 2023-10-17T06:08:50.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.078+0000 7f23a17fa700 1 -- 172.21.15.125:0/3659310102 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2398013c40 con 0x7f23a406f9a0 2023-10-17T06:08:50.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.078+0000 7f23a17fa700 1 --2- 172.21.15.125:0/3659310102 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f23880656f0 0x7f2388067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:50.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.078+0000 7f23a17fa700 1 -- 172.21.15.125:0/3659310102 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f2398082ac0 con 0x7f23a406f9a0 2023-10-17T06:08:50.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.082+0000 7f23a3fff700 1 --2- 172.21.15.125:0/3659310102 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f23880656f0 0x7f2388067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:50.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.082+0000 7f23a3fff700 1 --2- 172.21.15.125:0/3659310102 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f23880656f0 0x7f2388067bb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f23a40ce9e0 tx=0x7f2390010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:50.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.090+0000 7f23a17fa700 1 -- 172.21.15.125:0/3659310102 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2398053f90 con 0x7f23a406f9a0 2023-10-17T06:08:50.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.314+0000 7f23ab04d700 1 -- 172.21.15.125:0/3659310102 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f23a4072e60 con 0x7f23a406f9a0 2023-10-17T06:08:50.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.858+0000 7f23a17fa700 1 -- 172.21.15.125:0/3659310102 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v41) v1 ==== 170+0+0 (secure 0 0 0) 0x7f23980210d0 con 0x7f23a406f9a0 2023-10-17T06:08:50.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.866+0000 7f23ab04d700 1 -- 172.21.15.125:0/3659310102 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f23880656f0 msgr2=0x7f2388067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:50.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.866+0000 7f23ab04d700 1 --2- 172.21.15.125:0/3659310102 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f23880656f0 0x7f2388067bb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f23a40ce9e0 tx=0x7f2390010000 comp rx=0 tx=0).stop 2023-10-17T06:08:50.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.866+0000 7f23ab04d700 1 -- 172.21.15.125:0/3659310102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23a406f9a0 msgr2=0x7f23a413d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:50.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.866+0000 7f23ab04d700 1 --2- 172.21.15.125:0/3659310102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23a406f9a0 0x7f23a413d570 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f239800e790 tx=0x7f239800eb50 comp rx=0 tx=0).stop 2023-10-17T06:08:50.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.866+0000 7f23ab04d700 1 -- 172.21.15.125:0/3659310102 shutdown_connections 2023-10-17T06:08:50.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.866+0000 7f23ab04d700 1 --2- 172.21.15.125:0/3659310102 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f23880656f0 0x7f2388067bb0 secure :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f23a40ce9e0 tx=0x7f2390010000 comp rx=0 tx=0).stop 2023-10-17T06:08:50.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.866+0000 7f23ab04d700 1 --2- 172.21.15.125:0/3659310102 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23a41612e0 0x7f23a41448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:50.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.866+0000 7f23ab04d700 1 --2- 172.21.15.125:0/3659310102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f23a41467c0 0x7f23a413dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:50.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.866+0000 7f23ab04d700 1 --2- 172.21.15.125:0/3659310102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23a406f9a0 0x7f23a413d570 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:50.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.866+0000 7f23ab04d700 1 -- 172.21.15.125:0/3659310102 >> 172.21.15.125:0/3659310102 conn(0x7f23a406a130 msgr2=0x7f23a406e890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:50.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.870+0000 7f23ab04d700 1 -- 172.21.15.125:0/3659310102 shutdown_connections 2023-10-17T06:08:50.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:50.870+0000 7f23ab04d700 1 -- 172.21.15.125:0/3659310102 wait complete. 2023-10-17T06:08:50.877 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data' created 2023-10-17T06:08:50.902 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-17T06:08:51.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.070+0000 7f7e04a33700 1 Processor -- start 2023-10-17T06:08:51.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.070+0000 7f7e04a33700 1 -- start start 2023-10-17T06:08:51.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.070+0000 7f7e04a33700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e000d2e00 0x7f7e000b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:51.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.070+0000 7f7e04a33700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7e000b5ae0 0x7f7e0006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:51.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.070+0000 7f7e04a33700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0015d0d0 con 0x7f7e00160710 2023-10-17T06:08:51.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.070+0000 7f7e04a33700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0015df90 con 0x7f7e000b5ae0 2023-10-17T06:08:51.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.070+0000 7f7e04a33700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0006f0f0 con 0x7f7e000d2e00 2023-10-17T06:08:51.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.074+0000 7f7dff59e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7e000b5ae0 0x7f7e0006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:51.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.074+0000 7f7dff59e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7e000b5ae0 0x7f7e0006db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33386/0 (socket says 172.21.15.125:33386) 2023-10-17T06:08:51.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.074+0000 7f7dff59e700 1 -- 172.21.15.125:0/3523108246 learned_addr learned my addr 172.21.15.125:0/3523108246 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:51.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.074+0000 7f7dfed9d700 1 --2- 172.21.15.125:0/3523108246 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e000d2e00 0x7f7e000b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:51.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.074+0000 7f7dff59e700 1 -- 172.21.15.125:0/3523108246 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e000d2e00 msgr2=0x7f7e000b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:51.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.074+0000 7f7dff59e700 1 --2- 172.21.15.125:0/3523108246 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e000d2e00 0x7f7e000b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:51.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.074+0000 7f7dff59e700 1 -- 172.21.15.125:0/3523108246 >> v1:172.21.15.184:6789/0 conn(0x7f7e00160710 legacy=0x7f7e000d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:51.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.074+0000 7f7dff59e700 1 -- 172.21.15.125:0/3523108246 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0015d310 con 0x7f7e000b5ae0 2023-10-17T06:08:51.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.074+0000 7f7dff59e700 1 --2- 172.21.15.125:0/3523108246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e000b5ae0 0x7f7e0006db60 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7df8009940 tx=0x7f7df8009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c151455d77fffaaa server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:51.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.074+0000 7f7dfdd9b700 1 -- 172.21.15.125:0/3523108246 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df8005ea0 con 0x7f7e000b5ae0 2023-10-17T06:08:51.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.074+0000 7f7dfdd9b700 1 -- 172.21.15.125:0/3523108246 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df8009e90 con 0x7f7e000b5ae0 2023-10-17T06:08:51.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.074+0000 7f7dfdd9b700 1 -- 172.21.15.125:0/3523108246 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df800b830 con 0x7f7e000b5ae0 2023-10-17T06:08:51.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.074+0000 7f7e04a33700 1 -- 172.21.15.125:0/3523108246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e000b5ae0 msgr2=0x7f7e0006db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:51.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.074+0000 7f7e04a33700 1 --2- 172.21.15.125:0/3523108246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e000b5ae0 0x7f7e0006db60 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7df8009940 tx=0x7f7df8009c50 comp rx=0 tx=0).stop 2023-10-17T06:08:51.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.074+0000 7f7e04a33700 1 -- 172.21.15.125:0/3523108246 shutdown_connections 2023-10-17T06:08:51.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.074+0000 7f7e04a33700 1 --2- 172.21.15.125:0/3523108246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e000b5ae0 0x7f7e0006db60 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:51.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.074+0000 7f7e04a33700 1 --2- 172.21.15.125:0/3523108246 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e000d2e00 0x7f7e000b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:51.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.074+0000 7f7e04a33700 1 -- 172.21.15.125:0/3523108246 >> 172.21.15.125:0/3523108246 conn(0x7f7e00069f20 msgr2=0x7f7e0006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:51.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.074+0000 7f7e04a33700 1 -- 172.21.15.125:0/3523108246 shutdown_connections 2023-10-17T06:08:51.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.074+0000 7f7e04a33700 1 -- 172.21.15.125:0/3523108246 wait complete. 2023-10-17T06:08:51.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.078+0000 7f7e04a33700 1 Processor -- start 2023-10-17T06:08:51.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7e04a33700 1 -- start start 2023-10-17T06:08:51.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7e04a33700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e000b5ae0 0x7f7e00159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:51.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7e04a33700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e000d2e00 0x7f7e000ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:51.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7e04a33700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e00160710 0x7f7e001f5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:51.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7e04a33700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000ad100 con 0x7f7e000d2e00 2023-10-17T06:08:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7e04a33700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e001f3400 con 0x7f7e000b5ae0 2023-10-17T06:08:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7e04a33700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e001f36e0 con 0x7f7e00160710 2023-10-17T06:08:51.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7dfe59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e000d2e00 0x7f7e000ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:51.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7dfe59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e000d2e00 0x7f7e000ac640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33396/0 (socket says 172.21.15.125:33396) 2023-10-17T06:08:51.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7dfe59c700 1 -- 172.21.15.125:0/2174818011 learned_addr learned my addr 172.21.15.125:0/2174818011 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:51.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7dfed9d700 1 --2- 172.21.15.125:0/2174818011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e000b5ae0 0x7f7e00159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:51.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7dff59e700 1 --2- 172.21.15.125:0/2174818011 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e00160710 0x7f7e001f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:51.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7dfe59c700 1 -- 172.21.15.125:0/2174818011 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e00160710 msgr2=0x7f7e001f5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:51.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7dfe59c700 1 --2- 172.21.15.125:0/2174818011 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e00160710 0x7f7e001f5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7dfe59c700 1 -- 172.21.15.125:0/2174818011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e000b5ae0 msgr2=0x7f7e00159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7dfe59c700 1 --2- 172.21.15.125:0/2174818011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e000b5ae0 0x7f7e00159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7dfe59c700 1 -- 172.21.15.125:0/2174818011 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df8009570 con 0x7f7e000d2e00 2023-10-17T06:08:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7dfe59c700 1 --2- 172.21.15.125:0/2174818011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e000d2e00 0x7f7e000ac640 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7df400c500 tx=0x7f7df400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7de77fe700 1 -- 172.21.15.125:0/2174818011 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df40052d0 con 0x7f7e000d2e00 2023-10-17T06:08:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7de77fe700 1 -- 172.21.15.125:0/2174818011 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df4005430 con 0x7f7e000d2e00 2023-10-17T06:08:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7e04a33700 1 -- 172.21.15.125:0/2174818011 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e001f39c0 con 0x7f7e000d2e00 2023-10-17T06:08:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7de77fe700 1 -- 172.21.15.125:0/2174818011 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df40055a0 con 0x7f7e000d2e00 2023-10-17T06:08:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.082+0000 7f7e04a33700 1 -- 172.21.15.125:0/2174818011 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e000ad3e0 con 0x7f7e000d2e00 2023-10-17T06:08:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.086+0000 7f7e04a33700 1 -- 172.21.15.125:0/2174818011 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e001f3c00 con 0x7f7e000d2e00 2023-10-17T06:08:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.090+0000 7f7de77fe700 1 -- 172.21.15.125:0/2174818011 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7df40038e0 con 0x7f7e000d2e00 2023-10-17T06:08:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.090+0000 7f7de77fe700 1 --2- 172.21.15.125:0/2174818011 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7dec0656f0 0x7f7dec067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:51.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.090+0000 7f7de77fe700 1 -- 172.21.15.125:0/2174818011 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f7df4082380 con 0x7f7e000d2e00 2023-10-17T06:08:51.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.090+0000 7f7dfed9d700 1 --2- 172.21.15.125:0/2174818011 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7dec0656f0 0x7f7dec067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:51.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.090+0000 7f7dfed9d700 1 --2- 172.21.15.125:0/2174818011 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7dec0656f0 0x7f7dec067bb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009fd0 tx=0x7f7df0009800 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:51.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.094+0000 7f7de77fe700 1 -- 172.21.15.125:0/2174818011 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f7df404fd40 con 0x7f7e000d2e00 2023-10-17T06:08:51.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.322+0000 7f7e04a33700 1 -- 172.21.15.125:0/2174818011 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7e0015d0d0 con 0x7f7e000d2e00 2023-10-17T06:08:51.874 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.870+0000 7f7de77fe700 1 -- 172.21.15.125:0/2174818011 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7e0015d0d0 con 0x7f7e000d2e00 2023-10-17T06:08:51.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.874+0000 7f7e04a33700 1 -- 172.21.15.125:0/2174818011 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7dec0656f0 msgr2=0x7f7dec067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:51.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.874+0000 7f7e04a33700 1 --2- 172.21.15.125:0/2174818011 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7dec0656f0 0x7f7dec067bb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009fd0 tx=0x7f7df0009800 comp rx=0 tx=0).stop 2023-10-17T06:08:51.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.874+0000 7f7e04a33700 1 -- 172.21.15.125:0/2174818011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e000d2e00 msgr2=0x7f7e000ac640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:51.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.874+0000 7f7e04a33700 1 --2- 172.21.15.125:0/2174818011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e000d2e00 0x7f7e000ac640 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7df400c500 tx=0x7f7df400c810 comp rx=0 tx=0).stop 2023-10-17T06:08:51.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.874+0000 7f7e04a33700 1 -- 172.21.15.125:0/2174818011 shutdown_connections 2023-10-17T06:08:51.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.874+0000 7f7e04a33700 1 --2- 172.21.15.125:0/2174818011 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7dec0656f0 0x7f7dec067bb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:51.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.874+0000 7f7e04a33700 1 --2- 172.21.15.125:0/2174818011 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e00160710 0x7f7e001f5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:51.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.874+0000 7f7e04a33700 1 --2- 172.21.15.125:0/2174818011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e000d2e00 0x7f7e000ac640 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:51.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.874+0000 7f7e04a33700 1 --2- 172.21.15.125:0/2174818011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e000b5ae0 0x7f7e00159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:51.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.874+0000 7f7e04a33700 1 -- 172.21.15.125:0/2174818011 >> 172.21.15.125:0/2174818011 conn(0x7f7e00069f20 msgr2=0x7f7e000d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:51.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.878+0000 7f7e04a33700 1 -- 172.21.15.125:0/2174818011 shutdown_connections 2023-10-17T06:08:51.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:51.878+0000 7f7e04a33700 1 -- 172.21.15.125:0/2174818011 wait complete. 2023-10-17T06:08:51.892 INFO:teuthology.orchestra.run.smithi125.stderr:new fs with metadata pool 6 and data pool 7 2023-10-17T06:08:51.907 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:08:52.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.070+0000 7f19f2e71700 1 Processor -- start 2023-10-17T06:08:52.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.070+0000 7f19f2e71700 1 -- start start 2023-10-17T06:08:52.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19f2e71700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19ec154040 0x7f19ec0cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:52.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19f2e71700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f19ec06e8a0 0x7f19ec0cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:52.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19f2e71700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ec15e130 con 0x7f19ec0cb6d0 2023-10-17T06:08:52.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19f2e71700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19ec0cbb60 con 0x7f19ec06e8a0 2023-10-17T06:08:52.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19f2e71700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19ec0cdfa0 con 0x7f19ec154040 2023-10-17T06:08:52.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19e3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f19ec06e8a0 0x7f19ec0cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:52.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19e3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f19ec06e8a0 0x7f19ec0cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33406/0 (socket says 172.21.15.125:33406) 2023-10-17T06:08:52.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19e3fff700 1 -- 172.21.15.125:0/105966904 learned_addr learned my addr 172.21.15.125:0/105966904 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:52.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19f0c0d700 1 --2- 172.21.15.125:0/105966904 >> v2:172.21.15.184:3300/0 conn(0x7f19ec154040 0x7f19ec0cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:52.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19e3fff700 1 -- 172.21.15.125:0/105966904 >> v2:172.21.15.184:3300/0 conn(0x7f19ec154040 msgr2=0x7f19ec0cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:52.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19e3fff700 1 --2- 172.21.15.125:0/105966904 >> v2:172.21.15.184:3300/0 conn(0x7f19ec154040 0x7f19ec0cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19e3fff700 1 -- 172.21.15.125:0/105966904 >> v1:172.21.15.184:6789/0 conn(0x7f19ec0cb6d0 legacy=0x7f19ec06f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:52.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19e3fff700 1 -- 172.21.15.125:0/105966904 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ec0ce1b0 con 0x7f19ec06e8a0 2023-10-17T06:08:52.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19e3fff700 1 --2- 172.21.15.125:0/105966904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19ec06e8a0 0x7f19ec0cb190 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f19ec070f60 tx=0x7f19dc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4a24847e20b73f server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:52.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19e37fe700 1 -- 172.21.15.125:0/105966904 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc00b8a0 con 0x7f19ec06e8a0 2023-10-17T06:08:52.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19e37fe700 1 -- 172.21.15.125:0/105966904 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19dc00ba00 con 0x7f19ec06e8a0 2023-10-17T06:08:52.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19e37fe700 1 -- 172.21.15.125:0/105966904 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc00bd90 con 0x7f19ec06e8a0 2023-10-17T06:08:52.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19f2e71700 1 -- 172.21.15.125:0/105966904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19ec06e8a0 msgr2=0x7f19ec0cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:52.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19f2e71700 1 --2- 172.21.15.125:0/105966904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19ec06e8a0 0x7f19ec0cb190 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f19ec070f60 tx=0x7f19dc009bf0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19f2e71700 1 -- 172.21.15.125:0/105966904 shutdown_connections 2023-10-17T06:08:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19f2e71700 1 --2- 172.21.15.125:0/105966904 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19ec06e8a0 0x7f19ec0cb190 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19f2e71700 1 --2- 172.21.15.125:0/105966904 >> v2:172.21.15.184:3300/0 conn(0x7f19ec154040 0x7f19ec0cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.074+0000 7f19f2e71700 1 -- 172.21.15.125:0/105966904 >> 172.21.15.125:0/105966904 conn(0x7f19ec06a340 msgr2=0x7f19ec0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.078+0000 7f19f2e71700 1 -- 172.21.15.125:0/105966904 shutdown_connections 2023-10-17T06:08:52.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.078+0000 7f19f2e71700 1 -- 172.21.15.125:0/105966904 wait complete. 2023-10-17T06:08:52.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.078+0000 7f19f2e71700 1 Processor -- start 2023-10-17T06:08:52.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.078+0000 7f19f2e71700 1 -- start start 2023-10-17T06:08:52.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.078+0000 7f19f2e71700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19ec06e8a0 0x7f19ec1558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:52.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.078+0000 7f19f2e71700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19ec0cb6d0 0x7f19ec0aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:52.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.078+0000 7f19f2e71700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19ec154040 0x7f19ec147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:52.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.078+0000 7f19f2e71700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec154840 con 0x7f19ec0cb6d0 2023-10-17T06:08:52.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.078+0000 7f19f2e71700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec154b20 con 0x7f19ec154040 2023-10-17T06:08:52.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.078+0000 7f19f2e71700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec154e00 con 0x7f19ec06e8a0 2023-10-17T06:08:52.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.082+0000 7f19e3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19ec0cb6d0 0x7f19ec0aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:52.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.082+0000 7f19e3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19ec0cb6d0 0x7f19ec0aec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33408/0 (socket says 172.21.15.125:33408) 2023-10-17T06:08:52.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.082+0000 7f19e3fff700 1 -- 172.21.15.125:0/1083614066 learned_addr learned my addr 172.21.15.125:0/1083614066 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:52.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.082+0000 7f19f140e700 1 --2- 172.21.15.125:0/1083614066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19ec154040 0x7f19ec147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:52.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.082+0000 7f19f0c0d700 1 --2- 172.21.15.125:0/1083614066 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19ec06e8a0 0x7f19ec1558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:52.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.082+0000 7f19e3fff700 1 -- 172.21.15.125:0/1083614066 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19ec06e8a0 msgr2=0x7f19ec1558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:52.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.082+0000 7f19e3fff700 1 --2- 172.21.15.125:0/1083614066 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19ec06e8a0 0x7f19ec1558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.082+0000 7f19e3fff700 1 -- 172.21.15.125:0/1083614066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19ec154040 msgr2=0x7f19ec147e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:52.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.082+0000 7f19e3fff700 1 --2- 172.21.15.125:0/1083614066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19ec154040 0x7f19ec147e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.082+0000 7f19e3fff700 1 -- 172.21.15.125:0/1083614066 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc009570 con 0x7f19ec0cb6d0 2023-10-17T06:08:52.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.082+0000 7f19f140e700 1 --2- 172.21.15.125:0/1083614066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19ec154040 0x7f19ec147e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:52.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.082+0000 7f19e3fff700 1 --2- 172.21.15.125:0/1083614066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19ec0cb6d0 0x7f19ec0aec70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f19ec06b390 tx=0x7f19dc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:52.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.082+0000 7f19e17fa700 1 -- 172.21.15.125:0/1083614066 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc0038c0 con 0x7f19ec0cb6d0 2023-10-17T06:08:52.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.082+0000 7f19e17fa700 1 -- 172.21.15.125:0/1083614066 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19dc01f070 con 0x7f19ec0cb6d0 2023-10-17T06:08:52.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.082+0000 7f19f2e71700 1 -- 172.21.15.125:0/1083614066 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ec1550e0 con 0x7f19ec0cb6d0 2023-10-17T06:08:52.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.082+0000 7f19e17fa700 1 -- 172.21.15.125:0/1083614066 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc003c60 con 0x7f19ec0cb6d0 2023-10-17T06:08:52.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.082+0000 7f19f2e71700 1 -- 172.21.15.125:0/1083614066 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ec155e20 con 0x7f19ec0cb6d0 2023-10-17T06:08:52.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.082+0000 7f19f2e71700 1 -- 172.21.15.125:0/1083614066 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ec155600 con 0x7f19ec0cb6d0 2023-10-17T06:08:52.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.086+0000 7f19e17fa700 1 -- 172.21.15.125:0/1083614066 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f19dc026480 con 0x7f19ec0cb6d0 2023-10-17T06:08:52.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.086+0000 7f19e17fa700 1 --2- 172.21.15.125:0/1083614066 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19d80656f0 0x7f19d8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:52.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.086+0000 7f19e17fa700 1 -- 172.21.15.125:0/1083614066 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f19dc021070 con 0x7f19ec0cb6d0 2023-10-17T06:08:52.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.086+0000 7f19f0c0d700 1 --2- 172.21.15.125:0/1083614066 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19d80656f0 0x7f19d8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:52.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.090+0000 7f19f0c0d700 1 --2- 172.21.15.125:0/1083614066 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19d80656f0 0x7f19d8067bb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009f60 tx=0x7f19e800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:52.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.090+0000 7f19e17fa700 1 -- 172.21.15.125:0/1083614066 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f19dc052830 con 0x7f19ec0cb6d0 2023-10-17T06:08:52.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.270+0000 7f19f2e71700 1 -- 172.21.15.125:0/1083614066 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19ec155600 con 0x7f19ec0cb6d0 2023-10-17T06:08:52.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.274+0000 7f19e17fa700 1 -- 172.21.15.125:0/1083614066 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18549 (secure 0 0 0) 0x7f19ec155600 con 0x7f19ec0cb6d0 2023-10-17T06:08:52.279 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:52.280 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":42,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:08:51.327669+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:08:48.973490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-17T06:08:50.385778+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:08:52.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.278+0000 7f19f2e71700 1 -- 172.21.15.125:0/1083614066 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19d80656f0 msgr2=0x7f19d8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:52.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.278+0000 7f19f2e71700 1 --2- 172.21.15.125:0/1083614066 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19d80656f0 0x7f19d8067bb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009f60 tx=0x7f19e800b040 comp rx=0 tx=0).stop 2023-10-17T06:08:52.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.278+0000 7f19f2e71700 1 -- 172.21.15.125:0/1083614066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19ec0cb6d0 msgr2=0x7f19ec0aec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:52.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.278+0000 7f19f2e71700 1 --2- 172.21.15.125:0/1083614066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19ec0cb6d0 0x7f19ec0aec70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f19ec06b390 tx=0x7f19dc004770 comp rx=0 tx=0).stop 2023-10-17T06:08:52.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.278+0000 7f19f2e71700 1 -- 172.21.15.125:0/1083614066 shutdown_connections 2023-10-17T06:08:52.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.278+0000 7f19f2e71700 1 --2- 172.21.15.125:0/1083614066 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19d80656f0 0x7f19d8067bb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.278+0000 7f19f2e71700 1 --2- 172.21.15.125:0/1083614066 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19ec154040 0x7f19ec147e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.278+0000 7f19f2e71700 1 --2- 172.21.15.125:0/1083614066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19ec0cb6d0 0x7f19ec0aec70 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.278+0000 7f19f2e71700 1 --2- 172.21.15.125:0/1083614066 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19ec06e8a0 0x7f19ec1558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.278+0000 7f19f2e71700 1 -- 172.21.15.125:0/1083614066 >> 172.21.15.125:0/1083614066 conn(0x7f19ec06a340 msgr2=0x7f19ec06f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:52.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.278+0000 7f19f2e71700 1 -- 172.21.15.125:0/1083614066 shutdown_connections 2023-10-17T06:08:52.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.278+0000 7f19f2e71700 1 -- 172.21.15.125:0/1083614066 wait complete. 2023-10-17T06:08:52.307 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:08:52.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.478+0000 7fe9c1f1d700 1 Processor -- start 2023-10-17T06:08:52.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.478+0000 7fe9c1f1d700 1 -- start start 2023-10-17T06:08:52.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.482+0000 7fe9c1f1d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe9bc159750 0x7fe9bc070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:52.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.482+0000 7fe9c1f1d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9bc0ce040 0x7fe9bc06cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:52.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.482+0000 7fe9c1f1d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9bc0b14f0 con 0x7fe9bc070aa0 2023-10-17T06:08:52.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.482+0000 7fe9c1f1d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9bc0c9aa0 con 0x7fe9bc159750 2023-10-17T06:08:52.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.482+0000 7fe9c1f1d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc070f30 con 0x7fe9bc0ce040 2023-10-17T06:08:52.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.482+0000 7fe9c0f1b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe9bc159750 0x7fe9bc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:52.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.482+0000 7fe9c0f1b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe9bc159750 0x7fe9bc070560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:42234/0 (socket says 172.21.15.125:42234) 2023-10-17T06:08:52.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.482+0000 7fe9c0f1b700 1 -- 172.21.15.125:0/2920947639 learned_addr learned my addr 172.21.15.125:0/2920947639 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:52.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.482+0000 7fe9c171c700 1 --2- 172.21.15.125:0/2920947639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9bc0ce040 0x7fe9bc06cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:52.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.482+0000 7fe9c0f1b700 1 -- 172.21.15.125:0/2920947639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9bc0ce040 msgr2=0x7fe9bc06cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:52.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.482+0000 7fe9c0f1b700 1 --2- 172.21.15.125:0/2920947639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9bc0ce040 0x7fe9bc06cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.482+0000 7fe9c0f1b700 1 -- 172.21.15.125:0/2920947639 >> v1:172.21.15.184:6789/0 conn(0x7fe9bc070aa0 legacy=0x7fe9bc0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:52.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.482+0000 7fe9c0f1b700 1 -- 172.21.15.125:0/2920947639 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9bc15d590 con 0x7fe9bc159750 2023-10-17T06:08:52.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.482+0000 7fe9c0f1b700 1 --2- 172.21.15.125:0/2920947639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9bc159750 0x7fe9bc070560 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009910 tx=0x7fe9b8009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f70ae09c7a18d247 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:52.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.482+0000 7fe9b37fe700 1 -- 172.21.15.125:0/2920947639 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8011830 con 0x7fe9bc159750 2023-10-17T06:08:52.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.482+0000 7fe9b37fe700 1 -- 172.21.15.125:0/2920947639 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b8011990 con 0x7fe9bc159750 2023-10-17T06:08:52.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.482+0000 7fe9b37fe700 1 -- 172.21.15.125:0/2920947639 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8011d40 con 0x7fe9bc159750 2023-10-17T06:08:52.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.486+0000 7fe9c1f1d700 1 -- 172.21.15.125:0/2920947639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9bc159750 msgr2=0x7fe9bc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:52.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.486+0000 7fe9c1f1d700 1 --2- 172.21.15.125:0/2920947639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9bc159750 0x7fe9bc070560 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009910 tx=0x7fe9b8009c20 comp rx=0 tx=0).stop 2023-10-17T06:08:52.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.486+0000 7fe9c1f1d700 1 -- 172.21.15.125:0/2920947639 shutdown_connections 2023-10-17T06:08:52.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.486+0000 7fe9c1f1d700 1 --2- 172.21.15.125:0/2920947639 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9bc0ce040 0x7fe9bc06cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.486+0000 7fe9c1f1d700 1 --2- 172.21.15.125:0/2920947639 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9bc159750 0x7fe9bc070560 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.486+0000 7fe9c1f1d700 1 -- 172.21.15.125:0/2920947639 >> 172.21.15.125:0/2920947639 conn(0x7fe9bc0ce5c0 msgr2=0x7fe9bc0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:52.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.486+0000 7fe9c1f1d700 1 -- 172.21.15.125:0/2920947639 shutdown_connections 2023-10-17T06:08:52.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.486+0000 7fe9c1f1d700 1 -- 172.21.15.125:0/2920947639 wait complete. 2023-10-17T06:08:52.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.486+0000 7fe9c1f1d700 1 Processor -- start 2023-10-17T06:08:52.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.486+0000 7fe9c1f1d700 1 -- start start 2023-10-17T06:08:52.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9c1f1d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9bc070aa0 0x7fe9bc15be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:52.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9c1f1d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9bc0ce040 0x7fe9bc15c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:52.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9c1f1d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9bc159750 0x7fe9bc157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:52.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9c1f1d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc151a50 con 0x7fe9bc070aa0 2023-10-17T06:08:52.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9c1f1d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc157e80 con 0x7fe9bc159750 2023-10-17T06:08:52.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9c1f1d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9bc158160 con 0x7fe9bc0ce040 2023-10-17T06:08:52.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9c0f1b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9bc070aa0 0x7fe9bc15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:52.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9c0f1b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9bc070aa0 0x7fe9bc15be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33416/0 (socket says 172.21.15.125:33416) 2023-10-17T06:08:52.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9c0f1b700 1 -- 172.21.15.125:0/698712546 learned_addr learned my addr 172.21.15.125:0/698712546 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:52.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9b3fff700 1 --2- 172.21.15.125:0/698712546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9bc0ce040 0x7fe9bc15c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:52.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9c171c700 1 --2- 172.21.15.125:0/698712546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9bc159750 0x7fe9bc157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:52.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9c0f1b700 1 -- 172.21.15.125:0/698712546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9bc0ce040 msgr2=0x7fe9bc15c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:52.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9c0f1b700 1 --2- 172.21.15.125:0/698712546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9bc0ce040 0x7fe9bc15c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9c0f1b700 1 -- 172.21.15.125:0/698712546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9bc159750 msgr2=0x7fe9bc157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:52.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9c0f1b700 1 --2- 172.21.15.125:0/698712546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9bc159750 0x7fe9bc157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9c0f1b700 1 -- 172.21.15.125:0/698712546 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b8009570 con 0x7fe9bc070aa0 2023-10-17T06:08:52.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9c0f1b700 1 --2- 172.21.15.125:0/698712546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9bc070aa0 0x7fe9bc15be70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc06b0f0 tx=0x7fe9b8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:52.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9b17fa700 1 -- 172.21.15.125:0/698712546 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8004510 con 0x7fe9bc070aa0 2023-10-17T06:08:52.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9b17fa700 1 -- 172.21.15.125:0/698712546 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b801e070 con 0x7fe9bc070aa0 2023-10-17T06:08:52.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9b17fa700 1 -- 172.21.15.125:0/698712546 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8003900 con 0x7fe9bc070aa0 2023-10-17T06:08:52.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.490+0000 7fe9c1f1d700 1 -- 172.21.15.125:0/698712546 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9bc158440 con 0x7fe9bc070aa0 2023-10-17T06:08:52.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.494+0000 7fe9c1f1d700 1 -- 172.21.15.125:0/698712546 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9bc158a00 con 0x7fe9bc070aa0 2023-10-17T06:08:52.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.494+0000 7fe9c1f1d700 1 -- 172.21.15.125:0/698712546 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9bc072e60 con 0x7fe9bc070aa0 2023-10-17T06:08:52.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.494+0000 7fe9b17fa700 1 -- 172.21.15.125:0/698712546 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe9b8003a60 con 0x7fe9bc070aa0 2023-10-17T06:08:52.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.498+0000 7fe9b17fa700 1 --2- 172.21.15.125:0/698712546 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe9a8065720 0x7fe9a8067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:52.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.498+0000 7fe9b17fa700 1 -- 172.21.15.125:0/698712546 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe9b8084390 con 0x7fe9bc070aa0 2023-10-17T06:08:52.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.498+0000 7fe9b3fff700 1 --2- 172.21.15.125:0/698712546 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe9a8065720 0x7fe9a8067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:52.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.498+0000 7fe9b3fff700 1 --2- 172.21.15.125:0/698712546 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe9a8065720 0x7fe9a8067be0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0c5890 tx=0x7fe9ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:52.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.502+0000 7fe9b17fa700 1 -- 172.21.15.125:0/698712546 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe9b8051da0 con 0x7fe9bc070aa0 2023-10-17T06:08:52.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.682+0000 7fe9c1f1d700 1 -- 172.21.15.125:0/698712546 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9bc0b4390 con 0x7fe9bc070aa0 2023-10-17T06:08:52.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.686+0000 7fe9b17fa700 1 -- 172.21.15.125:0/698712546 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18536 (secure 0 0 0) 0x7fe9b80553c0 con 0x7fe9bc070aa0 2023-10-17T06:08:52.692 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:52.692 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":43,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:08:52.592555+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:08:48.973490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-17T06:08:50.385778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:08:52.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.690+0000 7fe9c1f1d700 1 -- 172.21.15.125:0/698712546 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe9a8065720 msgr2=0x7fe9a8067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:52.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.690+0000 7fe9c1f1d700 1 --2- 172.21.15.125:0/698712546 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe9a8065720 0x7fe9a8067be0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc0c5890 tx=0x7fe9ac009040 comp rx=0 tx=0).stop 2023-10-17T06:08:52.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.690+0000 7fe9c1f1d700 1 -- 172.21.15.125:0/698712546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9bc070aa0 msgr2=0x7fe9bc15be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:52.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.690+0000 7fe9c1f1d700 1 --2- 172.21.15.125:0/698712546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9bc070aa0 0x7fe9bc15be70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc06b0f0 tx=0x7fe9b8004770 comp rx=0 tx=0).stop 2023-10-17T06:08:52.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.690+0000 7fe9c1f1d700 1 -- 172.21.15.125:0/698712546 shutdown_connections 2023-10-17T06:08:52.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.690+0000 7fe9c1f1d700 1 --2- 172.21.15.125:0/698712546 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe9a8065720 0x7fe9a8067be0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.690+0000 7fe9c1f1d700 1 --2- 172.21.15.125:0/698712546 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9bc159750 0x7fe9bc157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.690+0000 7fe9c1f1d700 1 --2- 172.21.15.125:0/698712546 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe9bc0ce040 0x7fe9bc15c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.690+0000 7fe9c1f1d700 1 --2- 172.21.15.125:0/698712546 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9bc070aa0 0x7fe9bc15be70 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.690+0000 7fe9c1f1d700 1 -- 172.21.15.125:0/698712546 >> 172.21.15.125:0/698712546 conn(0x7fe9bc0ce5c0 msgr2=0x7fe9bc1556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:52.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.690+0000 7fe9c1f1d700 1 -- 172.21.15.125:0/698712546 shutdown_connections 2023-10-17T06:08:52.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.690+0000 7fe9c1f1d700 1 -- 172.21.15.125:0/698712546 wait complete. 2023-10-17T06:08:52.718 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-17T06:08:52.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.890+0000 7fa4a5777700 1 Processor -- start 2023-10-17T06:08:52.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.890+0000 7fa4a5777700 1 -- start start 2023-10-17T06:08:52.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.890+0000 7fa4a5777700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa4a00d2e00 0x7fa4a00b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:52.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.890+0000 7fa4a5777700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa4a00b5ae0 0x7fa4a006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:52.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.890+0000 7fa4a5777700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a015d0d0 con 0x7fa4a0160710 2023-10-17T06:08:52.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.890+0000 7fa4a5777700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a015df90 con 0x7fa4a00b5ae0 2023-10-17T06:08:52.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.890+0000 7fa4a5777700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a006f0f0 con 0x7fa4a00d2e00 2023-10-17T06:08:52.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.890+0000 7fa4a4f76700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa4a00b5ae0 0x7fa4a006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:52.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.890+0000 7fa4a4f76700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa4a00b5ae0 0x7fa4a006db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33420/0 (socket says 172.21.15.125:33420) 2023-10-17T06:08:52.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.890+0000 7fa4a4f76700 1 -- 172.21.15.125:0/3175211157 learned_addr learned my addr 172.21.15.125:0/3175211157 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:52.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.890+0000 7fa49ffff700 1 --2- 172.21.15.125:0/3175211157 >> v2:172.21.15.184:3300/0 conn(0x7fa4a00d2e00 0x7fa4a00b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:52.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.894+0000 7fa4a4f76700 1 -- 172.21.15.125:0/3175211157 >> v2:172.21.15.184:3300/0 conn(0x7fa4a00d2e00 msgr2=0x7fa4a00b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:52.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.894+0000 7fa4a4f76700 1 --2- 172.21.15.125:0/3175211157 >> v2:172.21.15.184:3300/0 conn(0x7fa4a00d2e00 0x7fa4a00b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.894+0000 7fa4a4f76700 1 -- 172.21.15.125:0/3175211157 >> v1:172.21.15.125:6789/0 conn(0x7fa4a0160710 legacy=0x7fa4a00d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:52.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.894+0000 7fa4a4f76700 1 -- 172.21.15.125:0/3175211157 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a015d310 con 0x7fa4a00b5ae0 2023-10-17T06:08:52.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.894+0000 7fa4a4f76700 1 --2- 172.21.15.125:0/3175211157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4a00b5ae0 0x7fa4a006db60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0070660 tx=0x7fa49800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7142f368001f65c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:52.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.894+0000 7fa49f7fe700 1 -- 172.21.15.125:0/3175211157 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49800e070 con 0x7fa4a00b5ae0 2023-10-17T06:08:52.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.894+0000 7fa49f7fe700 1 -- 172.21.15.125:0/3175211157 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49800b910 con 0x7fa4a00b5ae0 2023-10-17T06:08:52.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.894+0000 7fa49f7fe700 1 -- 172.21.15.125:0/3175211157 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49800bcc0 con 0x7fa4a00b5ae0 2023-10-17T06:08:52.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.894+0000 7fa4a5777700 1 -- 172.21.15.125:0/3175211157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4a00b5ae0 msgr2=0x7fa4a006db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:52.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.894+0000 7fa4a5777700 1 --2- 172.21.15.125:0/3175211157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4a00b5ae0 0x7fa4a006db60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0070660 tx=0x7fa49800b330 comp rx=0 tx=0).stop 2023-10-17T06:08:52.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.894+0000 7fa4a5777700 1 -- 172.21.15.125:0/3175211157 shutdown_connections 2023-10-17T06:08:52.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.894+0000 7fa4a5777700 1 --2- 172.21.15.125:0/3175211157 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4a00b5ae0 0x7fa4a006db60 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.894+0000 7fa4a5777700 1 --2- 172.21.15.125:0/3175211157 >> v2:172.21.15.184:3300/0 conn(0x7fa4a00d2e00 0x7fa4a00b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.894+0000 7fa4a5777700 1 -- 172.21.15.125:0/3175211157 >> 172.21.15.125:0/3175211157 conn(0x7fa4a0069f20 msgr2=0x7fa4a006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:52.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.894+0000 7fa4a5777700 1 -- 172.21.15.125:0/3175211157 shutdown_connections 2023-10-17T06:08:52.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.894+0000 7fa4a5777700 1 -- 172.21.15.125:0/3175211157 wait complete. 2023-10-17T06:08:52.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.898+0000 7fa4a5777700 1 Processor -- start 2023-10-17T06:08:52.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.898+0000 7fa4a5777700 1 -- start start 2023-10-17T06:08:52.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.898+0000 7fa4a5777700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4a00b5ae0 0x7fa4a0146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:52.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.898+0000 7fa4a5777700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4a00d2e00 0x7fa4a015b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:52.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.898+0000 7fa4a5777700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4a0160710 0x7fa4a015b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:52.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.898+0000 7fa4a5777700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a0154460 con 0x7fa4a0160710 2023-10-17T06:08:52.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.898+0000 7fa4a5777700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a0158f80 con 0x7fa4a00d2e00 2023-10-17T06:08:52.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.898+0000 7fa4a5777700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a0146960 con 0x7fa4a00b5ae0 2023-10-17T06:08:52.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.902+0000 7fa4a4f76700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4a0160710 0x7fa4a015b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:52.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.902+0000 7fa4a4f76700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4a0160710 0x7fa4a015b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:33436/0 (socket says 172.21.15.125:33436) 2023-10-17T06:08:52.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.902+0000 7fa4a4f76700 1 -- 172.21.15.125:0/2695060554 learned_addr learned my addr 172.21.15.125:0/2695060554 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:52.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.902+0000 7fa49ffff700 1 --2- 172.21.15.125:0/2695060554 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4a00b5ae0 0x7fa4a0146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:52.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.902+0000 7fa4977fe700 1 --2- 172.21.15.125:0/2695060554 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4a00d2e00 0x7fa4a015b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:52.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.902+0000 7fa4a4f76700 1 -- 172.21.15.125:0/2695060554 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4a00b5ae0 msgr2=0x7fa4a0146420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:52.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.902+0000 7fa4a4f76700 1 --2- 172.21.15.125:0/2695060554 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4a00b5ae0 0x7fa4a0146420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.902+0000 7fa4a4f76700 1 -- 172.21.15.125:0/2695060554 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4a00d2e00 msgr2=0x7fa4a015b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:52.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.902+0000 7fa4a4f76700 1 --2- 172.21.15.125:0/2695060554 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4a00d2e00 0x7fa4a015b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:52.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.902+0000 7fa4a4f76700 1 -- 172.21.15.125:0/2695060554 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa498009b30 con 0x7fa4a0160710 2023-10-17T06:08:52.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.902+0000 7fa49ffff700 1 --2- 172.21.15.125:0/2695060554 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4a00b5ae0 0x7fa4a0146420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:52.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.902+0000 7fa4a4f76700 1 --2- 172.21.15.125:0/2695060554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4a0160710 0x7fa4a015b910 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa49800b370 tx=0x7fa498004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:52.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.902+0000 7fa49d7fa700 1 -- 172.21.15.125:0/2695060554 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4980048f0 con 0x7fa4a0160710 2023-10-17T06:08:52.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.902+0000 7fa49d7fa700 1 -- 172.21.15.125:0/2695060554 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4980092e0 con 0x7fa4a0160710 2023-10-17T06:08:52.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.902+0000 7fa4a5777700 1 -- 172.21.15.125:0/2695060554 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a0153bc0 con 0x7fa4a0160710 2023-10-17T06:08:52.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.902+0000 7fa49d7fa700 1 -- 172.21.15.125:0/2695060554 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49801b670 con 0x7fa4a0160710 2023-10-17T06:08:52.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.902+0000 7fa4a5777700 1 -- 172.21.15.125:0/2695060554 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a0154180 con 0x7fa4a0160710 2023-10-17T06:08:52.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.906+0000 7fa4a5777700 1 -- 172.21.15.125:0/2695060554 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a004e910 con 0x7fa4a0160710 2023-10-17T06:08:52.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.906+0000 7fa49d7fa700 1 -- 172.21.15.125:0/2695060554 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa49801b7d0 con 0x7fa4a0160710 2023-10-17T06:08:52.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.906+0000 7fa49d7fa700 1 --2- 172.21.15.125:0/2695060554 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fa4800656f0 0x7fa480067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:52.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.906+0000 7fa49d7fa700 1 -- 172.21.15.125:0/2695060554 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa498006e40 con 0x7fa4a0160710 2023-10-17T06:08:52.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.906+0000 7fa49ffff700 1 --2- 172.21.15.125:0/2695060554 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fa4800656f0 0x7fa480067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:52.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.910+0000 7fa49ffff700 1 --2- 172.21.15.125:0/2695060554 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fa4800656f0 0x7fa480067bb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa490009ba0 tx=0x7fa490008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:52.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:52.914+0000 7fa49d7fa700 1 -- 172.21.15.125:0/2695060554 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fa498051e70 con 0x7fa4a0160710 2023-10-17T06:08:53.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:53.282+0000 7fa4a5777700 1 -- 172.21.15.125:0/2695060554 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa4a006d3e0 con 0x7fa4a0160710 2023-10-17T06:08:53.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:53.894+0000 7fa49d7fa700 1 -- 172.21.15.125:0/2695060554 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa498055490 con 0x7fa4a0160710 2023-10-17T06:08:53.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:53.898+0000 7fa4a5777700 1 -- 172.21.15.125:0/2695060554 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fa4800656f0 msgr2=0x7fa480067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:53.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:53.898+0000 7fa4a5777700 1 --2- 172.21.15.125:0/2695060554 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fa4800656f0 0x7fa480067bb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa490009ba0 tx=0x7fa490008040 comp rx=0 tx=0).stop 2023-10-17T06:08:53.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:53.898+0000 7fa4a5777700 1 -- 172.21.15.125:0/2695060554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4a0160710 msgr2=0x7fa4a015b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:53.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:53.898+0000 7fa4a5777700 1 --2- 172.21.15.125:0/2695060554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4a0160710 0x7fa4a015b910 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa49800b370 tx=0x7fa498004b40 comp rx=0 tx=0).stop 2023-10-17T06:08:53.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:53.898+0000 7fa4a5777700 1 -- 172.21.15.125:0/2695060554 shutdown_connections 2023-10-17T06:08:53.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:53.898+0000 7fa4a5777700 1 --2- 172.21.15.125:0/2695060554 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fa4800656f0 0x7fa480067bb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:53.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:53.898+0000 7fa4a5777700 1 --2- 172.21.15.125:0/2695060554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4a0160710 0x7fa4a015b910 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:53.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:53.898+0000 7fa4a5777700 1 --2- 172.21.15.125:0/2695060554 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4a00d2e00 0x7fa4a015b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:53.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:53.898+0000 7fa4a5777700 1 --2- 172.21.15.125:0/2695060554 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4a00b5ae0 0x7fa4a0146420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:53.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:53.898+0000 7fa4a5777700 1 -- 172.21.15.125:0/2695060554 >> 172.21.15.125:0/2695060554 conn(0x7fa4a0069f20 msgr2=0x7fa4a00b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:53.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:53.898+0000 7fa4a5777700 1 -- 172.21.15.125:0/2695060554 shutdown_connections 2023-10-17T06:08:53.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:53.898+0000 7fa4a5777700 1 -- 172.21.15.125:0/2695060554 wait complete. 2023-10-17T06:08:53.928 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-17T06:08:53.928 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-17T06:08:54.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.102+0000 7f6607fff700 1 Processor -- start 2023-10-17T06:08:54.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.102+0000 7f6607fff700 1 -- start start 2023-10-17T06:08:54.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6607fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6608160710 0x7f66080b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:54.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6607fff700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660815d0d0 con 0x7f66080d2e00 2023-10-17T06:08:54.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6607fff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660806f0f0 con 0x7f66080b5ae0 2023-10-17T06:08:54.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6607fff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660815df90 con 0x7f6608160710 2023-10-17T06:08:54.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6606ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f66080d2e00 0x7f66080d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49050/0 (socket says 172.21.15.125:49050) 2023-10-17T06:08:54.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6606ffd700 1 -- 172.21.15.125:0/1027590842 learned_addr learned my addr 172.21.15.125:0/1027590842 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:54.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f66067fc700 1 --2- 172.21.15.125:0/1027590842 >> v2:172.21.15.184:3300/0 conn(0x7f6608160710 0x7f66080b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:54.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6605ffb700 1 -- 172.21.15.125:0/1027590842 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599403327 0 0) 0x7f65f8001110 con 0x7f66080d2e00 2023-10-17T06:08:54.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6605ffb700 1 -- 172.21.15.125:0/1027590842 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65f00035d0 con 0x7f66080d2e00 2023-10-17T06:08:54.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6605ffb700 1 -- 172.21.15.125:0/1027590842 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3944927798 0 0) 0x7f65f00035d0 con 0x7f66080d2e00 2023-10-17T06:08:54.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6605ffb700 1 -- 172.21.15.125:0/1027590842 >> v2:172.21.15.184:3300/0 conn(0x7f6608160710 msgr2=0x7f66080b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:54.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6605ffb700 1 --2- 172.21.15.125:0/1027590842 >> v2:172.21.15.184:3300/0 conn(0x7f6608160710 0x7f66080b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:54.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6605ffb700 1 -- 172.21.15.125:0/1027590842 >> v1:172.21.15.184:6789/0 conn(0x7f66080b5ae0 legacy=0x7f660806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:54.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6605ffb700 1 -- 172.21.15.125:0/1027590842 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660815d310 con 0x7f66080d2e00 2023-10-17T06:08:54.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6605ffb700 1 -- 172.21.15.125:0/1027590842 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7f65f8001800 con 0x7f66080d2e00 2023-10-17T06:08:54.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6605ffb700 1 -- 172.21.15.125:0/1027590842 >> v1:172.21.15.125:6789/0 conn(0x7f66080d2e00 legacy=0x7f66080d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:54.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6605ffb700 1 --2- 172.21.15.125:0/1027590842 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65f0003a90 0x7f65f0003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:54.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6605ffb700 1 --2- 172.21.15.125:0/1027590842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65f0004870 0x7f65f0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:54.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6605ffb700 1 --2- 172.21.15.125:0/1027590842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65f0005230 0x7f65f000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:54.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6605ffb700 1 -- 172.21.15.125:0/1027590842 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660815df90 con 0x7f65f0005230 2023-10-17T06:08:54.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6605ffb700 1 -- 172.21.15.125:0/1027590842 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f000c160 con 0x7f65f0004870 2023-10-17T06:08:54.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f6605ffb700 1 -- 172.21.15.125:0/1027590842 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f000c320 con 0x7f65f0003a90 2023-10-17T06:08:54.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.106+0000 7f66077fe700 1 --2- 172.21.15.125:0/1027590842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65f0005230 0x7f65f000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:54.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f66067fc700 1 --2- 172.21.15.125:0/1027590842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65f0004870 0x7f65f0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:54.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f6606ffd700 1 --2- 172.21.15.125:0/1027590842 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65f0003a90 0x7f65f0003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:54.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f66077fe700 1 -- 172.21.15.125:0/1027590842 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65f0003a90 msgr2=0x7f65f0003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:54.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f66077fe700 1 --2- 172.21.15.125:0/1027590842 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65f0003a90 0x7f65f0003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:54.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f66077fe700 1 -- 172.21.15.125:0/1027590842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65f0004870 msgr2=0x7f65f0004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:54.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f66077fe700 1 --2- 172.21.15.125:0/1027590842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65f0004870 0x7f65f0004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:54.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f66077fe700 1 -- 172.21.15.125:0/1027590842 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f00035d0 con 0x7f65f0005230 2023-10-17T06:08:54.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f6606ffd700 1 --2- 172.21.15.125:0/1027590842 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65f0003a90 0x7f65f0003eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:54.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f66067fc700 1 --2- 172.21.15.125:0/1027590842 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65f0004870 0x7f65f0004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:54.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f66077fe700 1 -- 172.21.15.125:0/1027590842 reap_dead start 2023-10-17T06:08:54.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f66077fe700 1 --2- 172.21.15.125:0/1027590842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65f0005230 0x7f65f000ba30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f660000c110 tx=0x7f65f00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab129c02f9395e89 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:54.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f6605ffb700 1 -- 172.21.15.125:0/1027590842 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600001da0 con 0x7f65f0005230 2023-10-17T06:08:54.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f6605ffb700 1 -- 172.21.15.125:0/1027590842 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6600003c70 con 0x7f65f0005230 2023-10-17T06:08:54.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f6605ffb700 1 -- 172.21.15.125:0/1027590842 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660000ca50 con 0x7f65f0005230 2023-10-17T06:08:54.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f6607fff700 1 -- 172.21.15.125:0/1027590842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65f0005230 msgr2=0x7f65f000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:54.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f6607fff700 1 --2- 172.21.15.125:0/1027590842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65f0005230 0x7f65f000ba30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f660000c110 tx=0x7f65f00058a0 comp rx=0 tx=0).stop 2023-10-17T06:08:54.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f6607fff700 1 -- 172.21.15.125:0/1027590842 shutdown_connections 2023-10-17T06:08:54.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f6607fff700 1 --2- 172.21.15.125:0/1027590842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f65f0005230 0x7f65f000ba30 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:54.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f6607fff700 1 -- 172.21.15.125:0/1027590842 >> 172.21.15.125:0/1027590842 conn(0x7f6608069f20 msgr2=0x7f660806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:54.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f6607fff700 1 -- 172.21.15.125:0/1027590842 shutdown_connections 2023-10-17T06:08:54.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.110+0000 7f6607fff700 1 -- 172.21.15.125:0/1027590842 wait complete. 2023-10-17T06:08:54.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f6607fff700 1 Processor -- start 2023-10-17T06:08:54.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f6607fff700 1 -- start start 2023-10-17T06:08:54.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f6607fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65f0005230 0x7f660815b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:54.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f6607fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66080ae240 0x7f66080ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:54.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f6607fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f660814a030 0x7f660814a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:54.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f6607fff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66081f6410 con 0x7f66080ae240 2023-10-17T06:08:54.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f6607fff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66080aec00 con 0x7f660814a030 2023-10-17T06:08:54.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f6607fff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66081f5b00 con 0x7f65f0005230 2023-10-17T06:08:54.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f66067fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66080ae240 0x7f66080ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:54.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f66067fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66080ae240 0x7f66080ae6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41838/0 (socket says 172.21.15.125:41838) 2023-10-17T06:08:54.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f66067fc700 1 -- 172.21.15.125:0/3742773746 learned_addr learned my addr 172.21.15.125:0/3742773746 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:54.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f66077fe700 1 --2- 172.21.15.125:0/3742773746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f660814a030 0x7f660814a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:54.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f6606ffd700 1 --2- 172.21.15.125:0/3742773746 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65f0005230 0x7f660815b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:54.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f66067fc700 1 -- 172.21.15.125:0/3742773746 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65f0005230 msgr2=0x7f660815b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:54.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f66067fc700 1 --2- 172.21.15.125:0/3742773746 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65f0005230 0x7f660815b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:54.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f66067fc700 1 -- 172.21.15.125:0/3742773746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f660814a030 msgr2=0x7f660814a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:54.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f66067fc700 1 --2- 172.21.15.125:0/3742773746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f660814a030 0x7f660814a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:54.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f66067fc700 1 -- 172.21.15.125:0/3742773746 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660814ada0 con 0x7f66080ae240 2023-10-17T06:08:54.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f66077fe700 1 --2- 172.21.15.125:0/3742773746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f660814a030 0x7f660814a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:54.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f6606ffd700 1 --2- 172.21.15.125:0/3742773746 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65f0005230 0x7f660815b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:54.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f66067fc700 1 --2- 172.21.15.125:0/3742773746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66080ae240 0x7f66080ae6c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f65fc010920 tx=0x7f65fc010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:54.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f65effff700 1 -- 172.21.15.125:0/3742773746 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc00e8d0 con 0x7f66080ae240 2023-10-17T06:08:54.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f65effff700 1 -- 172.21.15.125:0/3742773746 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65fc00ea30 con 0x7f66080ae240 2023-10-17T06:08:54.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f65effff700 1 -- 172.21.15.125:0/3742773746 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc00eda0 con 0x7f66080ae240 2023-10-17T06:08:54.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.114+0000 7f6607fff700 1 -- 172.21.15.125:0/3742773746 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66081f5d50 con 0x7f66080ae240 2023-10-17T06:08:54.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.118+0000 7f6607fff700 1 -- 172.21.15.125:0/3742773746 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660814a9f0 con 0x7f66080ae240 2023-10-17T06:08:54.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.118+0000 7f6607fff700 1 -- 172.21.15.125:0/3742773746 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660804e910 con 0x7f66080ae240 2023-10-17T06:08:54.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.118+0000 7f65effff700 1 -- 172.21.15.125:0/3742773746 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f65fc016460 con 0x7f66080ae240 2023-10-17T06:08:54.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.118+0000 7f65effff700 1 --2- 172.21.15.125:0/3742773746 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f65f4065720 0x7f65f4067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:54.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.122+0000 7f65effff700 1 -- 172.21.15.125:0/3742773746 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f65fc0834b0 con 0x7f66080ae240 2023-10-17T06:08:54.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.122+0000 7f6606ffd700 1 --2- 172.21.15.125:0/3742773746 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f65f4065720 0x7f65f4067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:54.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.122+0000 7f6606ffd700 1 --2- 172.21.15.125:0/3742773746 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f65f4065720 0x7f65f4067be0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f65f8001930 tx=0x7f65f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:54.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.126+0000 7f65effff700 1 -- 172.21.15.125:0/3742773746 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f65fc050ec0 con 0x7f66080ae240 2023-10-17T06:08:54.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.358+0000 7f6607fff700 1 -- 172.21.15.125:0/3742773746 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f660806d3e0 con 0x7f66080ae240 2023-10-17T06:08:54.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.906+0000 7f65effff700 1 -- 172.21.15.125:0/3742773746 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f65fc0544e0 con 0x7f66080ae240 2023-10-17T06:08:54.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.910+0000 7f6607fff700 1 -- 172.21.15.125:0/3742773746 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f65f4065720 msgr2=0x7f65f4067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:54.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.910+0000 7f6607fff700 1 --2- 172.21.15.125:0/3742773746 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f65f4065720 0x7f65f4067be0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f65f8001930 tx=0x7f65f8009040 comp rx=0 tx=0).stop 2023-10-17T06:08:54.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.910+0000 7f6607fff700 1 -- 172.21.15.125:0/3742773746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66080ae240 msgr2=0x7f66080ae6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:54.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.910+0000 7f6607fff700 1 --2- 172.21.15.125:0/3742773746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66080ae240 0x7f66080ae6c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f65fc010920 tx=0x7f65fc010ce0 comp rx=0 tx=0).stop 2023-10-17T06:08:54.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.910+0000 7f6607fff700 1 -- 172.21.15.125:0/3742773746 shutdown_connections 2023-10-17T06:08:54.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.910+0000 7f6607fff700 1 --2- 172.21.15.125:0/3742773746 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f65f4065720 0x7f65f4067be0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:54.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.910+0000 7f6607fff700 1 --2- 172.21.15.125:0/3742773746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f660814a030 0x7f660814a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:54.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.910+0000 7f6607fff700 1 --2- 172.21.15.125:0/3742773746 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66080ae240 0x7f66080ae6c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:54.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.910+0000 7f6607fff700 1 --2- 172.21.15.125:0/3742773746 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65f0005230 0x7f660815b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:54.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.910+0000 7f6607fff700 1 -- 172.21.15.125:0/3742773746 >> 172.21.15.125:0/3742773746 conn(0x7f6608069f20 msgr2=0x7f660806f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:54.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.910+0000 7f6607fff700 1 -- 172.21.15.125:0/3742773746 shutdown_connections 2023-10-17T06:08:54.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:54.910+0000 7f6607fff700 1 -- 172.21.15.125:0/3742773746 wait complete. 2023-10-17T06:08:54.939 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-17T06:08:54.941 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:08:55.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.130+0000 7fd67f59e700 1 Processor -- start 2023-10-17T06:08:55.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.130+0000 7fd67f59e700 1 -- start start 2023-10-17T06:08:55.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.134+0000 7fd67f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd68006d090 0x7fd6800b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:55.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.134+0000 7fd67f59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd68006d470 0x7fd680070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:55.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.134+0000 7fd67f59e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68015e990 con 0x7fd680070f50 2023-10-17T06:08:55.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.134+0000 7fd67f59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68015f4f0 con 0x7fd68006d470 2023-10-17T06:08:55.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.134+0000 7fd67f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68015ec50 con 0x7fd68006d090 2023-10-17T06:08:55.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.134+0000 7fd67ed9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd680070f50 0x7fd68015a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49062/0 (socket says 172.21.15.125:49062) 2023-10-17T06:08:55.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.134+0000 7fd67ed9d700 1 -- 172.21.15.125:0/2059122607 learned_addr learned my addr 172.21.15.125:0/2059122607 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:55.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.134+0000 7fd67e59c700 1 --2- 172.21.15.125:0/2059122607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd68006d090 0x7fd6800b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:55.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.134+0000 7fd675d9b700 1 --2- 172.21.15.125:0/2059122607 >> v2:172.21.15.184:3300/0 conn(0x7fd68006d470 0x7fd680070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:55.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.134+0000 7fd67dd9b700 1 -- 172.21.15.125:0/2059122607 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823486288 0 0) 0x7fd68015e990 con 0x7fd680070f50 2023-10-17T06:08:55.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.134+0000 7fd67dd9b700 1 -- 172.21.15.125:0/2059122607 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd66c0035d0 con 0x7fd680070f50 2023-10-17T06:08:55.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.134+0000 7fd67e59c700 1 -- 172.21.15.125:0/2059122607 >> v2:172.21.15.184:3300/0 conn(0x7fd68006d470 msgr2=0x7fd680070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:55.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.134+0000 7fd67e59c700 1 --2- 172.21.15.125:0/2059122607 >> v2:172.21.15.184:3300/0 conn(0x7fd68006d470 0x7fd680070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:55.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.134+0000 7fd67e59c700 1 -- 172.21.15.125:0/2059122607 >> v1:172.21.15.125:6789/0 conn(0x7fd680070f50 legacy=0x7fd68015a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:55.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.134+0000 7fd67e59c700 1 -- 172.21.15.125:0/2059122607 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68015ef30 con 0x7fd68006d090 2023-10-17T06:08:55.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.134+0000 7fd67e59c700 1 --2- 172.21.15.125:0/2059122607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd68006d090 0x7fd6800b2590 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd670009d90 tx=0x7fd67000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9d85050e9a3763c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:55.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.134+0000 7fd67dd9b700 1 -- 172.21.15.125:0/2059122607 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67000e070 con 0x7fd68006d090 2023-10-17T06:08:55.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.134+0000 7fd67dd9b700 1 -- 172.21.15.125:0/2059122607 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67000bb20 con 0x7fd68006d090 2023-10-17T06:08:55.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.134+0000 7fd67dd9b700 1 -- 172.21.15.125:0/2059122607 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670012430 con 0x7fd68006d090 2023-10-17T06:08:55.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.138+0000 7fd67f59e700 1 -- 172.21.15.125:0/2059122607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd68006d090 msgr2=0x7fd6800b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:55.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.138+0000 7fd67f59e700 1 --2- 172.21.15.125:0/2059122607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd68006d090 0x7fd6800b2590 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd670009d90 tx=0x7fd67000b330 comp rx=0 tx=0).stop 2023-10-17T06:08:55.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.138+0000 7fd67f59e700 1 -- 172.21.15.125:0/2059122607 shutdown_connections 2023-10-17T06:08:55.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.138+0000 7fd67f59e700 1 --2- 172.21.15.125:0/2059122607 >> v2:172.21.15.184:3300/0 conn(0x7fd68006d470 0x7fd680070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:55.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.138+0000 7fd67f59e700 1 --2- 172.21.15.125:0/2059122607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd68006d090 0x7fd6800b2590 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:55.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.138+0000 7fd67f59e700 1 -- 172.21.15.125:0/2059122607 >> 172.21.15.125:0/2059122607 conn(0x7fd6800ce5c0 msgr2=0x7fd6800ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:55.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.138+0000 7fd67f59e700 1 -- 172.21.15.125:0/2059122607 shutdown_connections 2023-10-17T06:08:55.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.138+0000 7fd67f59e700 1 -- 172.21.15.125:0/2059122607 wait complete. 2023-10-17T06:08:55.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.142+0000 7fd67f59e700 1 Processor -- start 2023-10-17T06:08:55.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.142+0000 7fd67f59e700 1 -- start start 2023-10-17T06:08:55.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.142+0000 7fd67f59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd68006d090 0x7fd68014cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:55.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.142+0000 7fd67f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd68006d470 0x7fd68015c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:55.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.142+0000 7fd67f59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd680070f50 0x7fd68015c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:55.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.142+0000 7fd67f59e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd680151650 con 0x7fd68006d090 2023-10-17T06:08:55.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.142+0000 7fd67f59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68014d2e0 con 0x7fd680070f50 2023-10-17T06:08:55.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.142+0000 7fd67f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68014e0f0 con 0x7fd68006d470 2023-10-17T06:08:55.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.142+0000 7fd67e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd68006d090 0x7fd68014cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:55.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.142+0000 7fd67e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd68006d090 0x7fd68014cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41854/0 (socket says 172.21.15.125:41854) 2023-10-17T06:08:55.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.142+0000 7fd67e59c700 1 -- 172.21.15.125:0/3510053040 learned_addr learned my addr 172.21.15.125:0/3510053040 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:55.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.146+0000 7fd67ed9d700 1 --2- 172.21.15.125:0/3510053040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd680070f50 0x7fd68015c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:55.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.142+0000 7fd675d9b700 1 --2- 172.21.15.125:0/3510053040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd68006d470 0x7fd68015c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:55.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.146+0000 7fd67e59c700 1 -- 172.21.15.125:0/3510053040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd68006d470 msgr2=0x7fd68015c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:55.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.146+0000 7fd67e59c700 1 --2- 172.21.15.125:0/3510053040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd68006d470 0x7fd68015c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:55.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.146+0000 7fd67e59c700 1 -- 172.21.15.125:0/3510053040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd680070f50 msgr2=0x7fd68015c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:55.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.146+0000 7fd67e59c700 1 --2- 172.21.15.125:0/3510053040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd680070f50 0x7fd68015c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:55.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.146+0000 7fd67e59c700 1 -- 172.21.15.125:0/3510053040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd670009a70 con 0x7fd68006d090 2023-10-17T06:08:55.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.146+0000 7fd67e59c700 1 --2- 172.21.15.125:0/3510053040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd68006d090 0x7fd68014cda0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd670014040 tx=0x7fd670004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:55.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.146+0000 7fd6777fe700 1 -- 172.21.15.125:0/3510053040 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670012430 con 0x7fd68006d090 2023-10-17T06:08:55.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.146+0000 7fd67f59e700 1 -- 172.21.15.125:0/3510053040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68014d7d0 con 0x7fd68006d090 2023-10-17T06:08:55.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.146+0000 7fd6777fe700 1 -- 172.21.15.125:0/3510053040 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd670020070 con 0x7fd68006d090 2023-10-17T06:08:55.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.146+0000 7fd6777fe700 1 -- 172.21.15.125:0/3510053040 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670004280 con 0x7fd68006d090 2023-10-17T06:08:55.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.146+0000 7fd67f59e700 1 -- 172.21.15.125:0/3510053040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6800cda60 con 0x7fd68006d090 2023-10-17T06:08:55.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.146+0000 7fd67f59e700 1 -- 172.21.15.125:0/3510053040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6800c9aa0 con 0x7fd68006d090 2023-10-17T06:08:55.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.150+0000 7fd6777fe700 1 -- 172.21.15.125:0/3510053040 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd6700043e0 con 0x7fd68006d090 2023-10-17T06:08:55.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.150+0000 7fd6777fe700 1 --2- 172.21.15.125:0/3510053040 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd6600656f0 0x7fd660067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:55.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.150+0000 7fd6777fe700 1 -- 172.21.15.125:0/3510053040 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd670022070 con 0x7fd68006d090 2023-10-17T06:08:55.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.150+0000 7fd675d9b700 1 --2- 172.21.15.125:0/3510053040 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd6600656f0 0x7fd660067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:55.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.150+0000 7fd675d9b700 1 --2- 172.21.15.125:0/3510053040 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd6600656f0 0x7fd660067bb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd680157b70 tx=0x7fd668008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:55.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.158+0000 7fd6777fe700 1 -- 172.21.15.125:0/3510053040 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fd670086e60 con 0x7fd68006d090 2023-10-17T06:08:55.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.382+0000 7fd67f59e700 1 -- 172.21.15.125:0/3510053040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd680073f00 con 0x7fd68006d090 2023-10-17T06:08:55.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.386+0000 7fd6777fe700 1 -- 172.21.15.125:0/3510053040 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4887 (secure 0 0 0) 0x7fd670052590 con 0x7fd68006d090 2023-10-17T06:08:55.389 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:55.389 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:08:51.328615+0000","modified":"2023-10-17T06:08:54.897934+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.125:6837/2351050168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2351050168},{"type":"v1","addr":"172.21.15.125:6837","nonce":2351050168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-17T06:08:55.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.386+0000 7fd67f59e700 1 -- 172.21.15.125:0/3510053040 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd6600656f0 msgr2=0x7fd660067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:55.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.386+0000 7fd67f59e700 1 --2- 172.21.15.125:0/3510053040 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd6600656f0 0x7fd660067bb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd680157b70 tx=0x7fd668008040 comp rx=0 tx=0).stop 2023-10-17T06:08:55.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.386+0000 7fd67f59e700 1 -- 172.21.15.125:0/3510053040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd68006d090 msgr2=0x7fd68014cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:55.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.386+0000 7fd67f59e700 1 --2- 172.21.15.125:0/3510053040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd68006d090 0x7fd68014cda0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd670014040 tx=0x7fd670004af0 comp rx=0 tx=0).stop 2023-10-17T06:08:55.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.386+0000 7fd67f59e700 1 -- 172.21.15.125:0/3510053040 shutdown_connections 2023-10-17T06:08:55.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.386+0000 7fd67f59e700 1 --2- 172.21.15.125:0/3510053040 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd6600656f0 0x7fd660067bb0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:55.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.386+0000 7fd67f59e700 1 --2- 172.21.15.125:0/3510053040 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd680070f50 0x7fd68015c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:55.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.386+0000 7fd67f59e700 1 --2- 172.21.15.125:0/3510053040 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd68006d470 0x7fd68015c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:55.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.386+0000 7fd67f59e700 1 --2- 172.21.15.125:0/3510053040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd68006d090 0x7fd68014cda0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:55.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.386+0000 7fd67f59e700 1 -- 172.21.15.125:0/3510053040 >> 172.21.15.125:0/3510053040 conn(0x7fd6800ce5c0 msgr2=0x7fd680154b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:55.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.386+0000 7fd67f59e700 1 -- 172.21.15.125:0/3510053040 shutdown_connections 2023-10-17T06:08:55.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.386+0000 7fd67f59e700 1 -- 172.21.15.125:0/3510053040 wait complete. 2023-10-17T06:08:55.395 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 17 2023-10-17T06:08:55.413 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:08:55.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.578+0000 7f148ae78700 1 Processor -- start 2023-10-17T06:08:55.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.578+0000 7f148ae78700 1 -- start start 2023-10-17T06:08:55.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.582+0000 7f148ae78700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f14840ce320 0x7f14840cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:55.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.582+0000 7f148ae78700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14840cbc80 con 0x7f1484155420 2023-10-17T06:08:55.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.582+0000 7f148ae78700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14840cb9a0 con 0x7f148415bf00 2023-10-17T06:08:55.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.582+0000 7f148ae78700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1484155800 con 0x7f14840ce320 2023-10-17T06:08:55.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.582+0000 7f1488c14700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1484155420 0x7f14840cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49076/0 (socket says 172.21.15.125:49076) 2023-10-17T06:08:55.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.582+0000 7f1488c14700 1 -- 172.21.15.125:0/3544489681 learned_addr learned my addr 172.21.15.125:0/3544489681 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:55.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.582+0000 7f1489415700 1 --2- 172.21.15.125:0/3544489681 >> v2:172.21.15.125:3300/0 conn(0x7f14840ce320 0x7f14840cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:55.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.582+0000 7f14837fe700 1 -- 172.21.15.125:0/3544489681 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891446065 0 0) 0x7f14840cb9a0 con 0x7f148415bf00 2023-10-17T06:08:55.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.582+0000 7f14837fe700 1 -- 172.21.15.125:0/3544489681 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14740035d0 con 0x7f148415bf00 2023-10-17T06:08:55.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.582+0000 7f1489415700 1 -- 172.21.15.125:0/3544489681 >> v1:172.21.15.184:6789/0 conn(0x7f148415bf00 legacy=0x7f14840cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:55.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.582+0000 7f1489415700 1 -- 172.21.15.125:0/3544489681 >> v1:172.21.15.125:6789/0 conn(0x7f1484155420 legacy=0x7f14840cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:55.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.582+0000 7f14837fe700 1 -- 172.21.15.125:0/3544489681 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116464957 0 0) 0x7f14840cbc80 con 0x7f1484155420 2023-10-17T06:08:55.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.582+0000 7f1489415700 1 -- 172.21.15.125:0/3544489681 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148415b420 con 0x7f14840ce320 2023-10-17T06:08:55.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.586+0000 7f1489415700 1 --2- 172.21.15.125:0/3544489681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14840ce320 0x7f14840cc680 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f147c009850 tx=0x7f147c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da6fdbcc61ed8c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:55.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.586+0000 7f14837fe700 1 -- 172.21.15.125:0/3544489681 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c011830 con 0x7f14840ce320 2023-10-17T06:08:55.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.586+0000 7f14837fe700 1 -- 172.21.15.125:0/3544489681 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c011990 con 0x7f14840ce320 2023-10-17T06:08:55.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.586+0000 7f14837fe700 1 -- 172.21.15.125:0/3544489681 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c011d40 con 0x7f14840ce320 2023-10-17T06:08:55.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.586+0000 7f148ae78700 1 -- 172.21.15.125:0/3544489681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14840ce320 msgr2=0x7f14840cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:55.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.586+0000 7f148ae78700 1 --2- 172.21.15.125:0/3544489681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14840ce320 0x7f14840cc680 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f147c009850 tx=0x7f147c009b60 comp rx=0 tx=0).stop 2023-10-17T06:08:55.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.586+0000 7f148ae78700 1 -- 172.21.15.125:0/3544489681 shutdown_connections 2023-10-17T06:08:55.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.586+0000 7f148ae78700 1 --2- 172.21.15.125:0/3544489681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14840ce320 0x7f14840cc680 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:55.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.586+0000 7f148ae78700 1 -- 172.21.15.125:0/3544489681 >> 172.21.15.125:0/3544489681 conn(0x7f148406a340 msgr2=0x7f14840b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:55.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.586+0000 7f148ae78700 1 -- 172.21.15.125:0/3544489681 shutdown_connections 2023-10-17T06:08:55.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.586+0000 7f148ae78700 1 -- 172.21.15.125:0/3544489681 wait complete. 2023-10-17T06:08:55.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.590+0000 7f148ae78700 1 Processor -- start 2023-10-17T06:08:55.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.590+0000 7f148ae78700 1 -- start start 2023-10-17T06:08:55.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f148ae78700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14840ce320 0x7f14840b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:55.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f148ae78700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1484155420 0x7f14841382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:55.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f148ae78700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f148415bf00 0x7f1484137510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:55.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f148ae78700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1484138c60 con 0x7f14840ce320 2023-10-17T06:08:55.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f148ae78700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14840a7f60 con 0x7f1484155420 2023-10-17T06:08:55.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f148ae78700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14840a8240 con 0x7f148415bf00 2023-10-17T06:08:55.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f1488c14700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14840ce320 0x7f14840b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:55.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f1488c14700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14840ce320 0x7f14840b2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41872/0 (socket says 172.21.15.125:41872) 2023-10-17T06:08:55.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f1488c14700 1 -- 172.21.15.125:0/873068623 learned_addr learned my addr 172.21.15.125:0/873068623 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:55.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f1483fff700 1 --2- 172.21.15.125:0/873068623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1484155420 0x7f14841382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:55.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f1489415700 1 --2- 172.21.15.125:0/873068623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f148415bf00 0x7f1484137510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:55.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f1488c14700 1 -- 172.21.15.125:0/873068623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f148415bf00 msgr2=0x7f1484137510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f1488c14700 1 --2- 172.21.15.125:0/873068623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f148415bf00 0x7f1484137510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f1488c14700 1 -- 172.21.15.125:0/873068623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1484155420 msgr2=0x7f14841382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f1488c14700 1 --2- 172.21.15.125:0/873068623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1484155420 0x7f14841382c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f1488c14700 1 -- 172.21.15.125:0/873068623 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c0094b0 con 0x7f14840ce320 2023-10-17T06:08:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f1489415700 1 --2- 172.21.15.125:0/873068623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f148415bf00 0x7f1484137510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f1483fff700 1 --2- 172.21.15.125:0/873068623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1484155420 0x7f14841382c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f1488c14700 1 --2- 172.21.15.125:0/873068623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14840ce320 0x7f14840b2ae0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1478001f80 tx=0x7f147800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f14817fa700 1 -- 172.21.15.125:0/873068623 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147800ad80 con 0x7f14840ce320 2023-10-17T06:08:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f14817fa700 1 -- 172.21.15.125:0/873068623 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14780070d0 con 0x7f14840ce320 2023-10-17T06:08:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f148ae78700 1 -- 172.21.15.125:0/873068623 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14840a8520 con 0x7f14840ce320 2023-10-17T06:08:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f14817fa700 1 -- 172.21.15.125:0/873068623 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478007480 con 0x7f14840ce320 2023-10-17T06:08:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f148ae78700 1 -- 172.21.15.125:0/873068623 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14840b3020 con 0x7f14840ce320 2023-10-17T06:08:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.594+0000 7f148ae78700 1 -- 172.21.15.125:0/873068623 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14840a8a40 con 0x7f14840ce320 2023-10-17T06:08:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.598+0000 7f14817fa700 1 -- 172.21.15.125:0/873068623 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f14780075e0 con 0x7f14840ce320 2023-10-17T06:08:55.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.598+0000 7f14817fa700 1 --2- 172.21.15.125:0/873068623 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f14680656f0 0x7f1468067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:55.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.598+0000 7f14817fa700 1 -- 172.21.15.125:0/873068623 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1478082e30 con 0x7f14840ce320 2023-10-17T06:08:55.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.598+0000 7f1483fff700 1 --2- 172.21.15.125:0/873068623 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f14680656f0 0x7f1468067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:55.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.598+0000 7f1483fff700 1 --2- 172.21.15.125:0/873068623 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f14680656f0 0x7f1468067bb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f14840b2530 tx=0x7f1470009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:55.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.606+0000 7f14817fa700 1 -- 172.21.15.125:0/873068623 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f14780507b0 con 0x7f14840ce320 2023-10-17T06:08:55.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.782+0000 7f148ae78700 1 -- 172.21.15.125:0/873068623 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1484072e60 con 0x7f14840ce320 2023-10-17T06:08:55.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.786+0000 7f14817fa700 1 -- 172.21.15.125:0/873068623 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18536 (secure 0 0 0) 0x7f1478018090 con 0x7f14840ce320 2023-10-17T06:08:55.790 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:55.791 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":43,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:08:52.592555+0000","last_up_change":"2023-10-17T06:06:54.658926+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:08:48.973490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-17T06:08:50.385778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6801","nonce":128096809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6803","nonce":128096809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6807","nonce":128096809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":128096809},{"type":"v1","addr":"172.21.15.125:6805","nonce":128096809}]},"public_addr":"172.21.15.125:6801/128096809","cluster_addr":"172.21.15.125:6803/128096809","heartbeat_back_addr":"172.21.15.125:6807/128096809","heartbeat_front_addr":"172.21.15.125:6805/128096809","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:08:55.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.786+0000 7f148ae78700 1 -- 172.21.15.125:0/873068623 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f14680656f0 msgr2=0x7f1468067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:55.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.786+0000 7f148ae78700 1 --2- 172.21.15.125:0/873068623 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f14680656f0 0x7f1468067bb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f14840b2530 tx=0x7f1470009040 comp rx=0 tx=0).stop 2023-10-17T06:08:55.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.786+0000 7f148ae78700 1 -- 172.21.15.125:0/873068623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14840ce320 msgr2=0x7f14840b2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:55.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.786+0000 7f148ae78700 1 --2- 172.21.15.125:0/873068623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14840ce320 0x7f14840b2ae0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1478001f80 tx=0x7f147800a340 comp rx=0 tx=0).stop 2023-10-17T06:08:55.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.790+0000 7f148ae78700 1 -- 172.21.15.125:0/873068623 shutdown_connections 2023-10-17T06:08:55.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.790+0000 7f148ae78700 1 --2- 172.21.15.125:0/873068623 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f14680656f0 0x7f1468067bb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:55.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.790+0000 7f148ae78700 1 --2- 172.21.15.125:0/873068623 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f148415bf00 0x7f1484137510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:55.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.790+0000 7f148ae78700 1 --2- 172.21.15.125:0/873068623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1484155420 0x7f14841382c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:55.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.790+0000 7f148ae78700 1 --2- 172.21.15.125:0/873068623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14840ce320 0x7f14840b2ae0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:55.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.790+0000 7f148ae78700 1 -- 172.21.15.125:0/873068623 >> 172.21.15.125:0/873068623 conn(0x7f148406a340 msgr2=0x7f1484144220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:55.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.790+0000 7f148ae78700 1 -- 172.21.15.125:0/873068623 shutdown_connections 2023-10-17T06:08:55.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.790+0000 7f148ae78700 1 -- 172.21.15.125:0/873068623 wait complete. 2023-10-17T06:08:55.816 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-17T06:08:55.817 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-17T06:08:55.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.986+0000 7f00c533e700 1 Processor -- start 2023-10-17T06:08:55.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.986+0000 7f00c533e700 1 -- start start 2023-10-17T06:08:55.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.990+0000 7f00c533e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c0159750 0x7f00c0070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:55.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.990+0000 7f00c533e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c0070f00 con 0x7f00c00ce040 2023-10-17T06:08:55.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.990+0000 7f00c533e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c00b14f0 con 0x7f00c0070aa0 2023-10-17T06:08:55.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.990+0000 7f00c533e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c00c9aa0 con 0x7f00c0159750 2023-10-17T06:08:55.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.990+0000 7f00c4b3d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f00c00ce040 0x7f00c006cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49082/0 (socket says 172.21.15.125:49082) 2023-10-17T06:08:55.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.990+0000 7f00c4b3d700 1 -- 172.21.15.125:0/4271762801 learned_addr learned my addr 172.21.15.125:0/4271762801 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:55.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.990+0000 7f00bffff700 1 --2- 172.21.15.125:0/4271762801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c0159750 0x7f00c0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:55.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.990+0000 7f00bf7fe700 1 -- 172.21.15.125:0/4271762801 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307718490 0 0) 0x7f00c0070f00 con 0x7f00c00ce040 2023-10-17T06:08:55.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.994+0000 7f00bf7fe700 1 -- 172.21.15.125:0/4271762801 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00ac0057e0 con 0x7f00c00ce040 2023-10-17T06:08:55.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.994+0000 7f00bf7fe700 1 -- 172.21.15.125:0/4271762801 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3929093570 0 0) 0x7f00c00b14f0 con 0x7f00c0070aa0 2023-10-17T06:08:55.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.994+0000 7f00bf7fe700 1 -- 172.21.15.125:0/4271762801 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00c0070f00 con 0x7f00c0070aa0 2023-10-17T06:08:55.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.994+0000 7f00bffff700 1 -- 172.21.15.125:0/4271762801 >> v1:172.21.15.184:6789/0 conn(0x7f00c0070aa0 legacy=0x7f00c00cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:55.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.994+0000 7f00bffff700 1 -- 172.21.15.125:0/4271762801 >> v1:172.21.15.125:6789/0 conn(0x7f00c00ce040 legacy=0x7f00c006cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:55.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.994+0000 7f00bffff700 1 -- 172.21.15.125:0/4271762801 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c015d590 con 0x7f00c0159750 2023-10-17T06:08:56.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.994+0000 7f00bffff700 1 --2- 172.21.15.125:0/4271762801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c0159750 0x7f00c0070560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009880 tx=0x7f00b0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=995a76759ec708f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:56.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.994+0000 7f00bf7fe700 1 -- 172.21.15.125:0/4271762801 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b0004230 con 0x7f00c0159750 2023-10-17T06:08:56.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.994+0000 7f00bf7fe700 1 -- 172.21.15.125:0/4271762801 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b0004390 con 0x7f00c0159750 2023-10-17T06:08:56.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.994+0000 7f00bf7fe700 1 -- 172.21.15.125:0/4271762801 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b00036c0 con 0x7f00c0159750 2023-10-17T06:08:56.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.994+0000 7f00c533e700 1 -- 172.21.15.125:0/4271762801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c0159750 msgr2=0x7f00c0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:56.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.994+0000 7f00c533e700 1 --2- 172.21.15.125:0/4271762801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c0159750 0x7f00c0070560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009880 tx=0x7f00b0009b90 comp rx=0 tx=0).stop 2023-10-17T06:08:56.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.994+0000 7f00c533e700 1 -- 172.21.15.125:0/4271762801 shutdown_connections 2023-10-17T06:08:56.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.994+0000 7f00c533e700 1 --2- 172.21.15.125:0/4271762801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c0159750 0x7f00c0070560 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:56.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.994+0000 7f00c533e700 1 -- 172.21.15.125:0/4271762801 >> 172.21.15.125:0/4271762801 conn(0x7f00c00ce5c0 msgr2=0x7f00c00ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:56.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.994+0000 7f00c533e700 1 -- 172.21.15.125:0/4271762801 shutdown_connections 2023-10-17T06:08:56.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.994+0000 7f00c533e700 1 -- 172.21.15.125:0/4271762801 wait complete. 2023-10-17T06:08:56.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.998+0000 7f00c533e700 1 Processor -- start 2023-10-17T06:08:56.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.998+0000 7f00c533e700 1 -- start start 2023-10-17T06:08:56.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.998+0000 7f00c533e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00c0070aa0 0x7f00c0151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:56.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.998+0000 7f00c533e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00c00ce040 0x7f00c01581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:56.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.998+0000 7f00c533e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c0159750 0x7f00c0158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:56.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.998+0000 7f00c533e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c0154230 con 0x7f00c00ce040 2023-10-17T06:08:56.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.998+0000 7f00c533e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c0143d30 con 0x7f00c0070aa0 2023-10-17T06:08:56.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:55.998+0000 7f00c533e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c0153be0 con 0x7f00c0159750 2023-10-17T06:08:56.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.002+0000 7f00b7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00c00ce040 0x7f00c01581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:56.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.002+0000 7f00b7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00c00ce040 0x7f00c01581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41882/0 (socket says 172.21.15.125:41882) 2023-10-17T06:08:56.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.002+0000 7f00b7fff700 1 -- 172.21.15.125:0/3367128354 learned_addr learned my addr 172.21.15.125:0/3367128354 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:56.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.002+0000 7f00c4b3d700 1 --2- 172.21.15.125:0/3367128354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c0159750 0x7f00c0158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:56.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.002+0000 7f00bffff700 1 --2- 172.21.15.125:0/3367128354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00c0070aa0 0x7f00c0151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:56.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.002+0000 7f00b7fff700 1 -- 172.21.15.125:0/3367128354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c0159750 msgr2=0x7f00c0158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:56.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.002+0000 7f00b7fff700 1 --2- 172.21.15.125:0/3367128354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c0159750 0x7f00c0158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:56.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.002+0000 7f00b7fff700 1 -- 172.21.15.125:0/3367128354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00c0070aa0 msgr2=0x7f00c0151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:56.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.002+0000 7f00b7fff700 1 --2- 172.21.15.125:0/3367128354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00c0070aa0 0x7f00c0151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:56.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.002+0000 7f00b7fff700 1 -- 172.21.15.125:0/3367128354 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b00094b0 con 0x7f00c00ce040 2023-10-17T06:08:56.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.002+0000 7f00b7fff700 1 --2- 172.21.15.125:0/3367128354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00c00ce040 0x7f00c01581f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f00a800c450 tx=0x7f00a800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:56.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.002+0000 7f00bd7fa700 1 -- 172.21.15.125:0/3367128354 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a80054e0 con 0x7f00c00ce040 2023-10-17T06:08:56.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.002+0000 7f00bd7fa700 1 -- 172.21.15.125:0/3367128354 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a800ce60 con 0x7f00c00ce040 2023-10-17T06:08:56.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.002+0000 7f00bd7fa700 1 -- 172.21.15.125:0/3367128354 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a80038e0 con 0x7f00c00ce040 2023-10-17T06:08:56.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.002+0000 7f00c533e700 1 -- 172.21.15.125:0/3367128354 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c0153ec0 con 0x7f00c00ce040 2023-10-17T06:08:56.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.002+0000 7f00c533e700 1 -- 172.21.15.125:0/3367128354 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c01546c0 con 0x7f00c00ce040 2023-10-17T06:08:56.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.006+0000 7f00c533e700 1 -- 172.21.15.125:0/3367128354 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c0154940 con 0x7f00c00ce040 2023-10-17T06:08:56.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.006+0000 7f00bd7fa700 1 -- 172.21.15.125:0/3367128354 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f00a8003a40 con 0x7f00c00ce040 2023-10-17T06:08:56.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.006+0000 7f00bd7fa700 1 --2- 172.21.15.125:0/3367128354 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f00a00656f0 0x7f00a0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:56.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.006+0000 7f00bd7fa700 1 -- 172.21.15.125:0/3367128354 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f00a80822e0 con 0x7f00c00ce040 2023-10-17T06:08:56.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.006+0000 7f00bffff700 1 --2- 172.21.15.125:0/3367128354 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f00a00656f0 0x7f00a0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:56.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.006+0000 7f00bffff700 1 --2- 172.21.15.125:0/3367128354 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f00a00656f0 0x7f00a0067bb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009880 tx=0x7f00b0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:56.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.014+0000 7f00bd7fa700 1 -- 172.21.15.125:0/3367128354 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f00c0154940 con 0x7f00c00ce040 2023-10-17T06:08:56.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.186+0000 7f00c533e700 1 -- 172.21.15.125:0/3367128354 --> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00c0153a70 con 0x7f00a00656f0 2023-10-17T06:08:56.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.206+0000 7f00bd7fa700 1 -- 172.21.15.125:0/3367128354 <== mgr.4107 v2:172.21.15.125:6832/2516570548 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309367 (secure 0 0 0) 0x7f00c0153a70 con 0x7f00a00656f0 2023-10-17T06:08:56.214 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:56.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.214+0000 7f00c533e700 1 -- 172.21.15.125:0/3367128354 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f00a00656f0 msgr2=0x7f00a0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:56.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.214+0000 7f00c533e700 1 --2- 172.21.15.125:0/3367128354 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f00a00656f0 0x7f00a0067bb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009880 tx=0x7f00b0008030 comp rx=0 tx=0).stop 2023-10-17T06:08:56.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.214+0000 7f00c533e700 1 -- 172.21.15.125:0/3367128354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00c00ce040 msgr2=0x7f00c01581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:56.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.214+0000 7f00c533e700 1 --2- 172.21.15.125:0/3367128354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00c00ce040 0x7f00c01581f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f00a800c450 tx=0x7f00a800c760 comp rx=0 tx=0).stop 2023-10-17T06:08:56.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.214+0000 7f00c533e700 1 -- 172.21.15.125:0/3367128354 shutdown_connections 2023-10-17T06:08:56.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.214+0000 7f00c533e700 1 --2- 172.21.15.125:0/3367128354 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f00a00656f0 0x7f00a0067bb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:56.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.214+0000 7f00c533e700 1 --2- 172.21.15.125:0/3367128354 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f00c0159750 0x7f00c0158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:56.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.214+0000 7f00c533e700 1 --2- 172.21.15.125:0/3367128354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00c00ce040 0x7f00c01581f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:56.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.214+0000 7f00c533e700 1 --2- 172.21.15.125:0/3367128354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00c0070aa0 0x7f00c0151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:56.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.214+0000 7f00c533e700 1 -- 172.21.15.125:0/3367128354 >> 172.21.15.125:0/3367128354 conn(0x7f00c00ce5c0 msgr2=0x7f00c01559e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:56.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.214+0000 7f00c533e700 1 -- 172.21.15.125:0/3367128354 shutdown_connections 2023-10-17T06:08:56.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.214+0000 7f00c533e700 1 -- 172.21.15.125:0/3367128354 wait complete. 2023-10-17T06:08:56.221 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-17T06:08:56.241 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2023-10-17T06:08:55.982758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221236,"kb_used_data":5036,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753484,"statfs":{"total":773094113280,"available":772867567616,"internally_reserved":0,"allocated":5156864,"data_stored":2937099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001835"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510161+0000","last_change":"2023-10-17T06:08:51.629196+0000","last_active":"2023-10-17T06:08:53.510161+0000","last_peered":"2023-10-17T06:08:53.510161+0000","last_clean":"2023-10-17T06:08:53.510161+0000","last_became_active":"2023-10-17T06:08:51.628923+0000","last_became_peered":"2023-10-17T06:08:51.628923+0000","last_unstale":"2023-10-17T06:08:53.510161+0000","last_undegraded":"2023-10-17T06:08:53.510161+0000","last_fullsized":"2023-10-17T06:08:53.510161+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:18:40.713686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605825+0000","last_change":"2023-10-17T06:08:51.621968+0000","last_active":"2023-10-17T06:08:52.605825+0000","last_peered":"2023-10-17T06:08:52.605825+0000","last_clean":"2023-10-17T06:08:52.605825+0000","last_became_active":"2023-10-17T06:08:51.621682+0000","last_became_peered":"2023-10-17T06:08:51.621682+0000","last_unstale":"2023-10-17T06:08:52.605825+0000","last_undegraded":"2023-10-17T06:08:52.605825+0000","last_fullsized":"2023-10-17T06:08:52.605825+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:01:34.692467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.604859+0000","last_change":"2023-10-17T06:08:51.629655+0000","last_active":"2023-10-17T06:08:52.604859+0000","last_peered":"2023-10-17T06:08:52.604859+0000","last_clean":"2023-10-17T06:08:52.604859+0000","last_became_active":"2023-10-17T06:08:51.629374+0000","last_became_peered":"2023-10-17T06:08:51.629374+0000","last_unstale":"2023-10-17T06:08:52.604859+0000","last_undegraded":"2023-10-17T06:08:52.604859+0000","last_fullsized":"2023-10-17T06:08:52.604859+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:38:47.612387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508655+0000","last_change":"2023-10-17T06:08:51.630045+0000","last_active":"2023-10-17T06:08:53.508655+0000","last_peered":"2023-10-17T06:08:53.508655+0000","last_clean":"2023-10-17T06:08:53.508655+0000","last_became_active":"2023-10-17T06:08:51.629769+0000","last_became_peered":"2023-10-17T06:08:51.629769+0000","last_unstale":"2023-10-17T06:08:53.508655+0000","last_undegraded":"2023-10-17T06:08:53.508655+0000","last_fullsized":"2023-10-17T06:08:53.508655+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:47:37.941469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.604859+0000","last_change":"2023-10-17T06:08:51.621487+0000","last_active":"2023-10-17T06:08:52.604859+0000","last_peered":"2023-10-17T06:08:52.604859+0000","last_clean":"2023-10-17T06:08:52.604859+0000","last_became_active":"2023-10-17T06:08:51.620991+0000","last_became_peered":"2023-10-17T06:08:51.620991+0000","last_unstale":"2023-10-17T06:08:52.604859+0000","last_undegraded":"2023-10-17T06:08:52.604859+0000","last_fullsized":"2023-10-17T06:08:52.604859+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:58.485288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.328467+0000","last_change":"2023-10-17T06:08:51.617626+0000","last_active":"2023-10-17T06:08:53.328467+0000","last_peered":"2023-10-17T06:08:53.328467+0000","last_clean":"2023-10-17T06:08:53.328467+0000","last_became_active":"2023-10-17T06:08:51.617323+0000","last_became_peered":"2023-10-17T06:08:51.617323+0000","last_unstale":"2023-10-17T06:08:53.328467+0000","last_undegraded":"2023-10-17T06:08:53.328467+0000","last_fullsized":"2023-10-17T06:08:53.328467+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:45:13.765610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509245+0000","last_change":"2023-10-17T06:08:51.612532+0000","last_active":"2023-10-17T06:08:53.509245+0000","last_peered":"2023-10-17T06:08:53.509245+0000","last_clean":"2023-10-17T06:08:53.509245+0000","last_became_active":"2023-10-17T06:08:51.610367+0000","last_became_peered":"2023-10-17T06:08:51.610367+0000","last_unstale":"2023-10-17T06:08:53.509245+0000","last_undegraded":"2023-10-17T06:08:53.509245+0000","last_fullsized":"2023-10-17T06:08:53.509245+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:45:43.421168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508011+0000","last_change":"2023-10-17T06:08:51.628669+0000","last_active":"2023-10-17T06:08:53.508011+0000","last_peered":"2023-10-17T06:08:53.508011+0000","last_clean":"2023-10-17T06:08:53.508011+0000","last_became_active":"2023-10-17T06:08:51.628382+0000","last_became_peered":"2023-10-17T06:08:51.628382+0000","last_unstale":"2023-10-17T06:08:53.508011+0000","last_undegraded":"2023-10-17T06:08:53.508011+0000","last_fullsized":"2023-10-17T06:08:53.508011+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:34:18.599657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508995+0000","last_change":"2023-10-17T06:08:51.631881+0000","last_active":"2023-10-17T06:08:53.508995+0000","last_peered":"2023-10-17T06:08:53.508995+0000","last_clean":"2023-10-17T06:08:53.508995+0000","last_became_active":"2023-10-17T06:08:51.630325+0000","last_became_peered":"2023-10-17T06:08:51.630325+0000","last_unstale":"2023-10-17T06:08:53.508995+0000","last_undegraded":"2023-10-17T06:08:53.508995+0000","last_fullsized":"2023-10-17T06:08:53.508995+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:14:09.150773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509347+0000","last_change":"2023-10-17T06:08:51.631404+0000","last_active":"2023-10-17T06:08:53.509347+0000","last_peered":"2023-10-17T06:08:53.509347+0000","last_clean":"2023-10-17T06:08:53.509347+0000","last_became_active":"2023-10-17T06:08:51.626295+0000","last_became_peered":"2023-10-17T06:08:51.626295+0000","last_unstale":"2023-10-17T06:08:53.509347+0000","last_undegraded":"2023-10-17T06:08:53.509347+0000","last_fullsized":"2023-10-17T06:08:53.509347+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:10:27.800237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508386+0000","last_change":"2023-10-17T06:08:51.625154+0000","last_active":"2023-10-17T06:08:53.508386+0000","last_peered":"2023-10-17T06:08:53.508386+0000","last_clean":"2023-10-17T06:08:53.508386+0000","last_became_active":"2023-10-17T06:08:51.624858+0000","last_became_peered":"2023-10-17T06:08:51.624858+0000","last_unstale":"2023-10-17T06:08:53.508386+0000","last_undegraded":"2023-10-17T06:08:53.508386+0000","last_fullsized":"2023-10-17T06:08:53.508386+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:02:43.206108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605138+0000","last_change":"2023-10-17T06:08:51.631821+0000","last_active":"2023-10-17T06:08:52.605138+0000","last_peered":"2023-10-17T06:08:52.605138+0000","last_clean":"2023-10-17T06:08:52.605138+0000","last_became_active":"2023-10-17T06:08:51.631560+0000","last_became_peered":"2023-10-17T06:08:51.631560+0000","last_unstale":"2023-10-17T06:08:52.605138+0000","last_undegraded":"2023-10-17T06:08:52.605138+0000","last_fullsized":"2023-10-17T06:08:52.605138+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:22:55.982594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.021316+0000","last_change":"2023-10-17T06:08:51.632024+0000","last_active":"2023-10-17T06:08:53.021316+0000","last_peered":"2023-10-17T06:08:53.021316+0000","last_clean":"2023-10-17T06:08:53.021316+0000","last_became_active":"2023-10-17T06:08:51.631684+0000","last_became_peered":"2023-10-17T06:08:51.631684+0000","last_unstale":"2023-10-17T06:08:53.021316+0000","last_undegraded":"2023-10-17T06:08:53.021316+0000","last_fullsized":"2023-10-17T06:08:53.021316+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:37:14.658836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508163+0000","last_change":"2023-10-17T06:08:51.619752+0000","last_active":"2023-10-17T06:08:53.508163+0000","last_peered":"2023-10-17T06:08:53.508163+0000","last_clean":"2023-10-17T06:08:53.508163+0000","last_became_active":"2023-10-17T06:08:51.618831+0000","last_became_peered":"2023-10-17T06:08:51.618831+0000","last_unstale":"2023-10-17T06:08:53.508163+0000","last_undegraded":"2023-10-17T06:08:53.508163+0000","last_fullsized":"2023-10-17T06:08:53.508163+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:40:25.048147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.328383+0000","last_change":"2023-10-17T06:08:51.633872+0000","last_active":"2023-10-17T06:08:53.328383+0000","last_peered":"2023-10-17T06:08:53.328383+0000","last_clean":"2023-10-17T06:08:53.328383+0000","last_became_active":"2023-10-17T06:08:51.633529+0000","last_became_peered":"2023-10-17T06:08:51.633529+0000","last_unstale":"2023-10-17T06:08:53.328383+0000","last_undegraded":"2023-10-17T06:08:53.328383+0000","last_fullsized":"2023-10-17T06:08:53.328383+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:03:39.181151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509537+0000","last_change":"2023-10-17T06:08:51.632595+0000","last_active":"2023-10-17T06:08:53.509537+0000","last_peered":"2023-10-17T06:08:53.509537+0000","last_clean":"2023-10-17T06:08:53.509537+0000","last_became_active":"2023-10-17T06:08:51.632064+0000","last_became_peered":"2023-10-17T06:08:51.632064+0000","last_unstale":"2023-10-17T06:08:53.509537+0000","last_undegraded":"2023-10-17T06:08:53.509537+0000","last_fullsized":"2023-10-17T06:08:53.509537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:49:21.755263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605333+0000","last_change":"2023-10-17T06:08:51.622246+0000","last_active":"2023-10-17T06:08:52.605333+0000","last_peered":"2023-10-17T06:08:52.605333+0000","last_clean":"2023-10-17T06:08:52.605333+0000","last_became_active":"2023-10-17T06:08:51.621970+0000","last_became_peered":"2023-10-17T06:08:51.621970+0000","last_unstale":"2023-10-17T06:08:52.605333+0000","last_undegraded":"2023-10-17T06:08:52.605333+0000","last_fullsized":"2023-10-17T06:08:52.605333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:06:32.039655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605236+0000","last_change":"2023-10-17T06:08:51.624474+0000","last_active":"2023-10-17T06:08:52.605236+0000","last_peered":"2023-10-17T06:08:52.605236+0000","last_clean":"2023-10-17T06:08:52.605236+0000","last_became_active":"2023-10-17T06:08:51.624038+0000","last_became_peered":"2023-10-17T06:08:51.624038+0000","last_unstale":"2023-10-17T06:08:52.605236+0000","last_undegraded":"2023-10-17T06:08:52.605236+0000","last_fullsized":"2023-10-17T06:08:52.605236+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:15:10.532688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510877+0000","last_change":"2023-10-17T06:08:51.631090+0000","last_active":"2023-10-17T06:08:53.510877+0000","last_peered":"2023-10-17T06:08:53.510877+0000","last_clean":"2023-10-17T06:08:53.510877+0000","last_became_active":"2023-10-17T06:08:51.630845+0000","last_became_peered":"2023-10-17T06:08:51.630845+0000","last_unstale":"2023-10-17T06:08:53.510877+0000","last_undegraded":"2023-10-17T06:08:53.510877+0000","last_fullsized":"2023-10-17T06:08:53.510877+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:41:57.496238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.021376+0000","last_change":"2023-10-17T06:08:51.637677+0000","last_active":"2023-10-17T06:08:53.021376+0000","last_peered":"2023-10-17T06:08:53.021376+0000","last_clean":"2023-10-17T06:08:53.021376+0000","last_became_active":"2023-10-17T06:08:51.637430+0000","last_became_peered":"2023-10-17T06:08:51.637430+0000","last_unstale":"2023-10-17T06:08:53.021376+0000","last_undegraded":"2023-10-17T06:08:53.021376+0000","last_fullsized":"2023-10-17T06:08:53.021376+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:12:18.796696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.328640+0000","last_change":"2023-10-17T06:08:51.627443+0000","last_active":"2023-10-17T06:08:53.328640+0000","last_peered":"2023-10-17T06:08:53.328640+0000","last_clean":"2023-10-17T06:08:53.328640+0000","last_became_active":"2023-10-17T06:08:51.627159+0000","last_became_peered":"2023-10-17T06:08:51.627159+0000","last_unstale":"2023-10-17T06:08:53.328640+0000","last_undegraded":"2023-10-17T06:08:53.328640+0000","last_fullsized":"2023-10-17T06:08:53.328640+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:14:04.789413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509232+0000","last_change":"2023-10-17T06:08:51.627734+0000","last_active":"2023-10-17T06:08:53.509232+0000","last_peered":"2023-10-17T06:08:53.509232+0000","last_clean":"2023-10-17T06:08:53.509232+0000","last_became_active":"2023-10-17T06:08:51.627461+0000","last_became_peered":"2023-10-17T06:08:51.627461+0000","last_unstale":"2023-10-17T06:08:53.509232+0000","last_undegraded":"2023-10-17T06:08:53.509232+0000","last_fullsized":"2023-10-17T06:08:53.509232+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:11:00.650093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510282+0000","last_change":"2023-10-17T06:08:51.618887+0000","last_active":"2023-10-17T06:08:53.510282+0000","last_peered":"2023-10-17T06:08:53.510282+0000","last_clean":"2023-10-17T06:08:53.510282+0000","last_became_active":"2023-10-17T06:08:51.618518+0000","last_became_peered":"2023-10-17T06:08:51.618518+0000","last_unstale":"2023-10-17T06:08:53.510282+0000","last_undegraded":"2023-10-17T06:08:53.510282+0000","last_fullsized":"2023-10-17T06:08:53.510282+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:19.280288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509803+0000","last_change":"2023-10-17T06:08:51.619002+0000","last_active":"2023-10-17T06:08:53.509803+0000","last_peered":"2023-10-17T06:08:53.509803+0000","last_clean":"2023-10-17T06:08:53.509803+0000","last_became_active":"2023-10-17T06:08:51.618539+0000","last_became_peered":"2023-10-17T06:08:51.618539+0000","last_unstale":"2023-10-17T06:08:53.509803+0000","last_undegraded":"2023-10-17T06:08:53.509803+0000","last_fullsized":"2023-10-17T06:08:53.509803+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:23:17.310536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.511124+0000","last_change":"2023-10-17T06:08:51.622873+0000","last_active":"2023-10-17T06:08:53.511124+0000","last_peered":"2023-10-17T06:08:53.511124+0000","last_clean":"2023-10-17T06:08:53.511124+0000","last_became_active":"2023-10-17T06:08:51.622574+0000","last_became_peered":"2023-10-17T06:08:51.622574+0000","last_unstale":"2023-10-17T06:08:53.511124+0000","last_undegraded":"2023-10-17T06:08:53.511124+0000","last_fullsized":"2023-10-17T06:08:53.511124+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:37:12.104667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.021616+0000","last_change":"2023-10-17T06:08:51.623308+0000","last_active":"2023-10-17T06:08:53.021616+0000","last_peered":"2023-10-17T06:08:53.021616+0000","last_clean":"2023-10-17T06:08:53.021616+0000","last_became_active":"2023-10-17T06:08:51.623039+0000","last_became_peered":"2023-10-17T06:08:51.623039+0000","last_unstale":"2023-10-17T06:08:53.021616+0000","last_undegraded":"2023-10-17T06:08:53.021616+0000","last_fullsized":"2023-10-17T06:08:53.021616+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:28:27.418674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605082+0000","last_change":"2023-10-17T06:08:51.621575+0000","last_active":"2023-10-17T06:08:52.605082+0000","last_peered":"2023-10-17T06:08:52.605082+0000","last_clean":"2023-10-17T06:08:52.605082+0000","last_became_active":"2023-10-17T06:08:51.612129+0000","last_became_peered":"2023-10-17T06:08:51.612129+0000","last_unstale":"2023-10-17T06:08:52.605082+0000","last_undegraded":"2023-10-17T06:08:52.605082+0000","last_fullsized":"2023-10-17T06:08:52.605082+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:15:10.255909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605333+0000","last_change":"2023-10-17T06:08:51.621188+0000","last_active":"2023-10-17T06:08:52.605333+0000","last_peered":"2023-10-17T06:08:52.605333+0000","last_clean":"2023-10-17T06:08:52.605333+0000","last_became_active":"2023-10-17T06:08:51.620920+0000","last_became_peered":"2023-10-17T06:08:51.620920+0000","last_unstale":"2023-10-17T06:08:52.605333+0000","last_undegraded":"2023-10-17T06:08:52.605333+0000","last_fullsized":"2023-10-17T06:08:52.605333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:52:43.048979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510163+0000","last_change":"2023-10-17T06:08:51.626032+0000","last_active":"2023-10-17T06:08:53.510163+0000","last_peered":"2023-10-17T06:08:53.510163+0000","last_clean":"2023-10-17T06:08:53.510163+0000","last_became_active":"2023-10-17T06:08:51.625821+0000","last_became_peered":"2023-10-17T06:08:51.625821+0000","last_unstale":"2023-10-17T06:08:53.510163+0000","last_undegraded":"2023-10-17T06:08:53.510163+0000","last_fullsized":"2023-10-17T06:08:53.510163+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:26:35.864225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.603944+0000","last_change":"2023-10-17T06:08:51.629022+0000","last_active":"2023-10-17T06:08:52.603944+0000","last_peered":"2023-10-17T06:08:52.603944+0000","last_clean":"2023-10-17T06:08:52.603944+0000","last_became_active":"2023-10-17T06:08:51.628733+0000","last_became_peered":"2023-10-17T06:08:51.628733+0000","last_unstale":"2023-10-17T06:08:52.603944+0000","last_undegraded":"2023-10-17T06:08:52.603944+0000","last_fullsized":"2023-10-17T06:08:52.603944+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:20:21.920047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.328606+0000","last_change":"2023-10-17T06:08:51.613583+0000","last_active":"2023-10-17T06:08:53.328606+0000","last_peered":"2023-10-17T06:08:53.328606+0000","last_clean":"2023-10-17T06:08:53.328606+0000","last_became_active":"2023-10-17T06:08:51.613323+0000","last_became_peered":"2023-10-17T06:08:51.613323+0000","last_unstale":"2023-10-17T06:08:53.328606+0000","last_undegraded":"2023-10-17T06:08:53.328606+0000","last_fullsized":"2023-10-17T06:08:53.328606+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:30:46.066994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.021016+0000","last_change":"2023-10-17T06:08:51.634234+0000","last_active":"2023-10-17T06:08:53.021016+0000","last_peered":"2023-10-17T06:08:53.021016+0000","last_clean":"2023-10-17T06:08:53.021016+0000","last_became_active":"2023-10-17T06:08:51.633590+0000","last_became_peered":"2023-10-17T06:08:51.633590+0000","last_unstale":"2023-10-17T06:08:53.021016+0000","last_undegraded":"2023-10-17T06:08:53.021016+0000","last_fullsized":"2023-10-17T06:08:53.021016+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:59:33.208984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.603158+0000","last_change":"2023-10-17T06:08:51.618021+0000","last_active":"2023-10-17T06:08:52.603158+0000","last_peered":"2023-10-17T06:08:52.603158+0000","last_clean":"2023-10-17T06:08:52.603158+0000","last_became_active":"2023-10-17T06:08:51.617761+0000","last_became_peered":"2023-10-17T06:08:51.617761+0000","last_unstale":"2023-10-17T06:08:52.603158+0000","last_undegraded":"2023-10-17T06:08:52.603158+0000","last_fullsized":"2023-10-17T06:08:52.603158+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:42:48.342596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"42'4","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.329464+0000","last_change":"2023-10-17T06:08:50.886681+0000","last_active":"2023-10-17T06:08:53.329464+0000","last_peered":"2023-10-17T06:08:53.329464+0000","last_clean":"2023-10-17T06:08:53.329464+0000","last_became_active":"2023-10-17T06:08:50.886412+0000","last_became_peered":"2023-10-17T06:08:50.886412+0000","last_unstale":"2023-10-17T06:08:53.329464+0000","last_undegraded":"2023-10-17T06:08:53.329464+0000","last_fullsized":"2023-10-17T06:08:53.329464+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:14:43.707960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.511208+0000","last_change":"2023-10-17T06:08:51.635139+0000","last_active":"2023-10-17T06:08:53.511208+0000","last_peered":"2023-10-17T06:08:53.511208+0000","last_clean":"2023-10-17T06:08:53.511208+0000","last_became_active":"2023-10-17T06:08:51.634267+0000","last_became_peered":"2023-10-17T06:08:51.634267+0000","last_unstale":"2023-10-17T06:08:53.511208+0000","last_undegraded":"2023-10-17T06:08:53.511208+0000","last_fullsized":"2023-10-17T06:08:53.511208+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:10:13.009375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605534+0000","last_change":"2023-10-17T06:08:50.892172+0000","last_active":"2023-10-17T06:08:52.605534+0000","last_peered":"2023-10-17T06:08:52.605534+0000","last_clean":"2023-10-17T06:08:52.605534+0000","last_became_active":"2023-10-17T06:08:50.891910+0000","last_became_peered":"2023-10-17T06:08:50.891910+0000","last_unstale":"2023-10-17T06:08:52.605534+0000","last_undegraded":"2023-10-17T06:08:52.605534+0000","last_fullsized":"2023-10-17T06:08:52.605534+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:39:34.148579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605283+0000","last_change":"2023-10-17T06:08:51.614154+0000","last_active":"2023-10-17T06:08:52.605283+0000","last_peered":"2023-10-17T06:08:52.605283+0000","last_clean":"2023-10-17T06:08:52.605283+0000","last_became_active":"2023-10-17T06:08:51.613892+0000","last_became_peered":"2023-10-17T06:08:51.613892+0000","last_unstale":"2023-10-17T06:08:52.605283+0000","last_undegraded":"2023-10-17T06:08:52.605283+0000","last_fullsized":"2023-10-17T06:08:52.605283+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T18:03:55.348763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.602905+0000","last_change":"2023-10-17T06:08:50.889901+0000","last_active":"2023-10-17T06:08:52.602905+0000","last_peered":"2023-10-17T06:08:52.602905+0000","last_clean":"2023-10-17T06:08:52.602905+0000","last_became_active":"2023-10-17T06:08:50.889627+0000","last_became_peered":"2023-10-17T06:08:50.889627+0000","last_unstale":"2023-10-17T06:08:52.602905+0000","last_undegraded":"2023-10-17T06:08:52.602905+0000","last_fullsized":"2023-10-17T06:08:52.602905+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:03:32.282969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.602804+0000","last_change":"2023-10-17T06:08:51.627094+0000","last_active":"2023-10-17T06:08:52.602804+0000","last_peered":"2023-10-17T06:08:52.602804+0000","last_clean":"2023-10-17T06:08:52.602804+0000","last_became_active":"2023-10-17T06:08:51.626800+0000","last_became_peered":"2023-10-17T06:08:51.626800+0000","last_unstale":"2023-10-17T06:08:52.602804+0000","last_undegraded":"2023-10-17T06:08:52.602804+0000","last_fullsized":"2023-10-17T06:08:52.602804+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:49:25.310685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509553+0000","last_change":"2023-10-17T06:08:50.885854+0000","last_active":"2023-10-17T06:08:53.509553+0000","last_peered":"2023-10-17T06:08:53.509553+0000","last_clean":"2023-10-17T06:08:53.509553+0000","last_became_active":"2023-10-17T06:08:50.885564+0000","last_became_peered":"2023-10-17T06:08:50.885564+0000","last_unstale":"2023-10-17T06:08:53.509553+0000","last_undegraded":"2023-10-17T06:08:53.509553+0000","last_fullsized":"2023-10-17T06:08:53.509553+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:56:24.752937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.604437+0000","last_change":"2023-10-17T06:08:51.622330+0000","last_active":"2023-10-17T06:08:52.604437+0000","last_peered":"2023-10-17T06:08:52.604437+0000","last_clean":"2023-10-17T06:08:52.604437+0000","last_became_active":"2023-10-17T06:08:51.622029+0000","last_became_peered":"2023-10-17T06:08:51.622029+0000","last_unstale":"2023-10-17T06:08:52.604437+0000","last_undegraded":"2023-10-17T06:08:52.604437+0000","last_fullsized":"2023-10-17T06:08:52.604437+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:19:18.271954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.328995+0000","last_change":"2023-10-17T06:08:50.883965+0000","last_active":"2023-10-17T06:08:53.328995+0000","last_peered":"2023-10-17T06:08:53.328995+0000","last_clean":"2023-10-17T06:08:53.328995+0000","last_became_active":"2023-10-17T06:08:50.883498+0000","last_became_peered":"2023-10-17T06:08:50.883498+0000","last_unstale":"2023-10-17T06:08:53.328995+0000","last_undegraded":"2023-10-17T06:08:53.328995+0000","last_fullsized":"2023-10-17T06:08:53.328995+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:08:46.227092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508585+0000","last_change":"2023-10-17T06:08:51.630542+0000","last_active":"2023-10-17T06:08:53.508585+0000","last_peered":"2023-10-17T06:08:53.508585+0000","last_clean":"2023-10-17T06:08:53.508585+0000","last_became_active":"2023-10-17T06:08:51.630258+0000","last_became_peered":"2023-10-17T06:08:51.630258+0000","last_unstale":"2023-10-17T06:08:53.508585+0000","last_undegraded":"2023-10-17T06:08:53.508585+0000","last_fullsized":"2023-10-17T06:08:53.508585+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:40:04.891353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605058+0000","last_change":"2023-10-17T06:08:50.889306+0000","last_active":"2023-10-17T06:08:52.605058+0000","last_peered":"2023-10-17T06:08:52.605058+0000","last_clean":"2023-10-17T06:08:52.605058+0000","last_became_active":"2023-10-17T06:08:50.889019+0000","last_became_peered":"2023-10-17T06:08:50.889019+0000","last_unstale":"2023-10-17T06:08:52.605058+0000","last_undegraded":"2023-10-17T06:08:52.605058+0000","last_fullsized":"2023-10-17T06:08:52.605058+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:01:17.079480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508268+0000","last_change":"2023-10-17T06:08:51.632827+0000","last_active":"2023-10-17T06:08:53.508268+0000","last_peered":"2023-10-17T06:08:53.508268+0000","last_clean":"2023-10-17T06:08:53.508268+0000","last_became_active":"2023-10-17T06:08:51.626253+0000","last_became_peered":"2023-10-17T06:08:51.626253+0000","last_unstale":"2023-10-17T06:08:53.508268+0000","last_undegraded":"2023-10-17T06:08:53.508268+0000","last_fullsized":"2023-10-17T06:08:53.508268+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:14:34.782427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.604279+0000","last_change":"2023-10-17T06:08:50.882729+0000","last_active":"2023-10-17T06:08:52.604279+0000","last_peered":"2023-10-17T06:08:52.604279+0000","last_clean":"2023-10-17T06:08:52.604279+0000","last_became_active":"2023-10-17T06:08:50.882371+0000","last_became_peered":"2023-10-17T06:08:50.882371+0000","last_unstale":"2023-10-17T06:08:52.604279+0000","last_undegraded":"2023-10-17T06:08:52.604279+0000","last_fullsized":"2023-10-17T06:08:52.604279+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:45:12.749557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509877+0000","last_change":"2023-10-17T06:08:51.620451+0000","last_active":"2023-10-17T06:08:53.509877+0000","last_peered":"2023-10-17T06:08:53.509877+0000","last_clean":"2023-10-17T06:08:53.509877+0000","last_became_active":"2023-10-17T06:08:51.620045+0000","last_became_peered":"2023-10-17T06:08:51.620045+0000","last_unstale":"2023-10-17T06:08:53.509877+0000","last_undegraded":"2023-10-17T06:08:53.509877+0000","last_fullsized":"2023-10-17T06:08:53.509877+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:41:20.033234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508331+0000","last_change":"2023-10-17T06:08:50.886390+0000","last_active":"2023-10-17T06:08:53.508331+0000","last_peered":"2023-10-17T06:08:53.508331+0000","last_clean":"2023-10-17T06:08:53.508331+0000","last_became_active":"2023-10-17T06:08:50.885751+0000","last_became_peered":"2023-10-17T06:08:50.885751+0000","last_unstale":"2023-10-17T06:08:53.508331+0000","last_undegraded":"2023-10-17T06:08:53.508331+0000","last_fullsized":"2023-10-17T06:08:53.508331+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:44:00.802207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605446+0000","last_change":"2023-10-17T06:08:51.623590+0000","last_active":"2023-10-17T06:08:52.605446+0000","last_peered":"2023-10-17T06:08:52.605446+0000","last_clean":"2023-10-17T06:08:52.605446+0000","last_became_active":"2023-10-17T06:08:51.623290+0000","last_became_peered":"2023-10-17T06:08:51.623290+0000","last_unstale":"2023-10-17T06:08:52.605446+0000","last_undegraded":"2023-10-17T06:08:52.605446+0000","last_fullsized":"2023-10-17T06:08:52.605446+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:55:18.172686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.606707+0000","last_change":"2023-10-17T06:08:50.880938+0000","last_active":"2023-10-17T06:08:52.606707+0000","last_peered":"2023-10-17T06:08:52.606707+0000","last_clean":"2023-10-17T06:08:52.606707+0000","last_became_active":"2023-10-17T06:08:50.880602+0000","last_became_peered":"2023-10-17T06:08:50.880602+0000","last_unstale":"2023-10-17T06:08:52.606707+0000","last_undegraded":"2023-10-17T06:08:52.606707+0000","last_fullsized":"2023-10-17T06:08:52.606707+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:22.293897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510721+0000","last_change":"2023-10-17T06:08:51.614309+0000","last_active":"2023-10-17T06:08:53.510721+0000","last_peered":"2023-10-17T06:08:53.510721+0000","last_clean":"2023-10-17T06:08:53.510721+0000","last_became_active":"2023-10-17T06:08:51.614051+0000","last_became_peered":"2023-10-17T06:08:51.614051+0000","last_unstale":"2023-10-17T06:08:53.510721+0000","last_undegraded":"2023-10-17T06:08:53.510721+0000","last_fullsized":"2023-10-17T06:08:53.510721+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:44:42.704352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509358+0000","last_change":"2023-10-17T06:08:50.891078+0000","last_active":"2023-10-17T06:08:53.509358+0000","last_peered":"2023-10-17T06:08:53.509358+0000","last_clean":"2023-10-17T06:08:53.509358+0000","last_became_active":"2023-10-17T06:08:50.890821+0000","last_became_peered":"2023-10-17T06:08:50.890821+0000","last_unstale":"2023-10-17T06:08:53.509358+0000","last_undegraded":"2023-10-17T06:08:53.509358+0000","last_fullsized":"2023-10-17T06:08:53.509358+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:33:17.754770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.328993+0000","last_change":"2023-10-17T06:08:51.623939+0000","last_active":"2023-10-17T06:08:53.328993+0000","last_peered":"2023-10-17T06:08:53.328993+0000","last_clean":"2023-10-17T06:08:53.328993+0000","last_became_active":"2023-10-17T06:08:51.623669+0000","last_became_peered":"2023-10-17T06:08:51.623669+0000","last_unstale":"2023-10-17T06:08:53.328993+0000","last_undegraded":"2023-10-17T06:08:53.328993+0000","last_fullsized":"2023-10-17T06:08:53.328993+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:22:55.982594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"42'3","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510246+0000","last_change":"2023-10-17T06:08:50.892071+0000","last_active":"2023-10-17T06:08:53.510246+0000","last_peered":"2023-10-17T06:08:53.510246+0000","last_clean":"2023-10-17T06:08:53.510246+0000","last_became_active":"2023-10-17T06:08:50.891824+0000","last_became_peered":"2023-10-17T06:08:50.891824+0000","last_unstale":"2023-10-17T06:08:53.510246+0000","last_undegraded":"2023-10-17T06:08:53.510246+0000","last_fullsized":"2023-10-17T06:08:53.510246+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:09:38.183380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509821+0000","last_change":"2023-10-17T06:08:51.610911+0000","last_active":"2023-10-17T06:08:53.509821+0000","last_peered":"2023-10-17T06:08:53.509821+0000","last_clean":"2023-10-17T06:08:53.509821+0000","last_became_active":"2023-10-17T06:08:51.610627+0000","last_became_peered":"2023-10-17T06:08:51.610627+0000","last_unstale":"2023-10-17T06:08:53.509821+0000","last_undegraded":"2023-10-17T06:08:53.509821+0000","last_fullsized":"2023-10-17T06:08:53.509821+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:18:10.932837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"42'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.021396+0000","last_change":"2023-10-17T06:08:50.882827+0000","last_active":"2023-10-17T06:08:53.021396+0000","last_peered":"2023-10-17T06:08:53.021396+0000","last_clean":"2023-10-17T06:08:53.021396+0000","last_became_active":"2023-10-17T06:08:50.882547+0000","last_became_peered":"2023-10-17T06:08:50.882547+0000","last_unstale":"2023-10-17T06:08:53.021396+0000","last_undegraded":"2023-10-17T06:08:53.021396+0000","last_fullsized":"2023-10-17T06:08:53.021396+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:56:20.711351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510143+0000","last_change":"2023-10-17T06:08:51.620735+0000","last_active":"2023-10-17T06:08:53.510143+0000","last_peered":"2023-10-17T06:08:53.510143+0000","last_clean":"2023-10-17T06:08:53.510143+0000","last_became_active":"2023-10-17T06:08:51.620385+0000","last_became_peered":"2023-10-17T06:08:51.620385+0000","last_unstale":"2023-10-17T06:08:53.510143+0000","last_undegraded":"2023-10-17T06:08:53.510143+0000","last_fullsized":"2023-10-17T06:08:53.510143+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T18:07:23.616835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.329433+0000","last_change":"2023-10-17T06:08:50.891535+0000","last_active":"2023-10-17T06:08:53.329433+0000","last_peered":"2023-10-17T06:08:53.329433+0000","last_clean":"2023-10-17T06:08:53.329433+0000","last_became_active":"2023-10-17T06:08:50.891285+0000","last_became_peered":"2023-10-17T06:08:50.891285+0000","last_unstale":"2023-10-17T06:08:53.329433+0000","last_undegraded":"2023-10-17T06:08:53.329433+0000","last_fullsized":"2023-10-17T06:08:53.329433+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:58:57.841812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508143+0000","last_change":"2023-10-17T06:08:51.620830+0000","last_active":"2023-10-17T06:08:53.508143+0000","last_peered":"2023-10-17T06:08:53.508143+0000","last_clean":"2023-10-17T06:08:53.508143+0000","last_became_active":"2023-10-17T06:08:51.620495+0000","last_became_peered":"2023-10-17T06:08:51.620495+0000","last_unstale":"2023-10-17T06:08:53.508143+0000","last_undegraded":"2023-10-17T06:08:53.508143+0000","last_fullsized":"2023-10-17T06:08:53.508143+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:20.626158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509183+0000","last_change":"2023-10-17T06:08:50.881913+0000","last_active":"2023-10-17T06:08:53.509183+0000","last_peered":"2023-10-17T06:08:53.509183+0000","last_clean":"2023-10-17T06:08:53.509183+0000","last_became_active":"2023-10-17T06:08:50.881580+0000","last_became_peered":"2023-10-17T06:08:50.881580+0000","last_unstale":"2023-10-17T06:08:53.509183+0000","last_undegraded":"2023-10-17T06:08:53.509183+0000","last_fullsized":"2023-10-17T06:08:53.509183+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:26:57.859537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.328238+0000","last_change":"2023-10-17T06:08:51.632271+0000","last_active":"2023-10-17T06:08:53.328238+0000","last_peered":"2023-10-17T06:08:53.328238+0000","last_clean":"2023-10-17T06:08:53.328238+0000","last_became_active":"2023-10-17T06:08:51.631974+0000","last_became_peered":"2023-10-17T06:08:51.631974+0000","last_unstale":"2023-10-17T06:08:53.328238+0000","last_undegraded":"2023-10-17T06:08:53.328238+0000","last_fullsized":"2023-10-17T06:08:53.328238+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:39:12.635597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.328920+0000","last_change":"2023-10-17T06:08:50.885270+0000","last_active":"2023-10-17T06:08:53.328920+0000","last_peered":"2023-10-17T06:08:53.328920+0000","last_clean":"2023-10-17T06:08:53.328920+0000","last_became_active":"2023-10-17T06:08:50.885002+0000","last_became_peered":"2023-10-17T06:08:50.885002+0000","last_unstale":"2023-10-17T06:08:53.328920+0000","last_undegraded":"2023-10-17T06:08:53.328920+0000","last_fullsized":"2023-10-17T06:08:53.328920+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:11:19.516296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509142+0000","last_change":"2023-10-17T06:08:51.619616+0000","last_active":"2023-10-17T06:08:53.509142+0000","last_peered":"2023-10-17T06:08:53.509142+0000","last_clean":"2023-10-17T06:08:53.509142+0000","last_became_active":"2023-10-17T06:08:51.619069+0000","last_became_peered":"2023-10-17T06:08:51.619069+0000","last_unstale":"2023-10-17T06:08:53.509142+0000","last_undegraded":"2023-10-17T06:08:53.509142+0000","last_fullsized":"2023-10-17T06:08:53.509142+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:15:47.678075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"42'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508933+0000","last_change":"2023-10-17T06:08:50.889812+0000","last_active":"2023-10-17T06:08:53.508933+0000","last_peered":"2023-10-17T06:08:53.508933+0000","last_clean":"2023-10-17T06:08:53.508933+0000","last_became_active":"2023-10-17T06:08:50.889503+0000","last_became_peered":"2023-10-17T06:08:50.889503+0000","last_unstale":"2023-10-17T06:08:53.508933+0000","last_undegraded":"2023-10-17T06:08:53.508933+0000","last_fullsized":"2023-10-17T06:08:53.508933+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:38.190681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.021561+0000","last_change":"2023-10-17T06:08:51.630549+0000","last_active":"2023-10-17T06:08:53.021561+0000","last_peered":"2023-10-17T06:08:53.021561+0000","last_clean":"2023-10-17T06:08:53.021561+0000","last_became_active":"2023-10-17T06:08:51.629516+0000","last_became_peered":"2023-10-17T06:08:51.629516+0000","last_unstale":"2023-10-17T06:08:53.021561+0000","last_undegraded":"2023-10-17T06:08:53.021561+0000","last_fullsized":"2023-10-17T06:08:53.021561+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:13:46.230861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.021633+0000","last_change":"2023-10-17T06:08:50.876113+0000","last_active":"2023-10-17T06:08:53.021633+0000","last_peered":"2023-10-17T06:08:53.021633+0000","last_clean":"2023-10-17T06:08:53.021633+0000","last_became_active":"2023-10-17T06:08:50.875838+0000","last_became_peered":"2023-10-17T06:08:50.875838+0000","last_unstale":"2023-10-17T06:08:53.021633+0000","last_undegraded":"2023-10-17T06:08:53.021633+0000","last_fullsized":"2023-10-17T06:08:53.021633+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:52:41.686561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509142+0000","last_change":"2023-10-17T06:08:51.622643+0000","last_active":"2023-10-17T06:08:53.509142+0000","last_peered":"2023-10-17T06:08:53.509142+0000","last_clean":"2023-10-17T06:08:53.509142+0000","last_became_active":"2023-10-17T06:08:51.622160+0000","last_became_peered":"2023-10-17T06:08:51.622160+0000","last_unstale":"2023-10-17T06:08:53.509142+0000","last_undegraded":"2023-10-17T06:08:53.509142+0000","last_fullsized":"2023-10-17T06:08:53.509142+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:08:06.249722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605566+0000","last_change":"2023-10-17T06:08:50.880729+0000","last_active":"2023-10-17T06:08:52.605566+0000","last_peered":"2023-10-17T06:08:52.605566+0000","last_clean":"2023-10-17T06:08:52.605566+0000","last_became_active":"2023-10-17T06:08:50.880409+0000","last_became_peered":"2023-10-17T06:08:50.880409+0000","last_unstale":"2023-10-17T06:08:52.605566+0000","last_undegraded":"2023-10-17T06:08:52.605566+0000","last_fullsized":"2023-10-17T06:08:52.605566+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:06:27.421438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510903+0000","last_change":"2023-10-17T06:08:51.629855+0000","last_active":"2023-10-17T06:08:53.510903+0000","last_peered":"2023-10-17T06:08:53.510903+0000","last_clean":"2023-10-17T06:08:53.510903+0000","last_became_active":"2023-10-17T06:08:51.629376+0000","last_became_peered":"2023-10-17T06:08:51.629376+0000","last_unstale":"2023-10-17T06:08:53.510903+0000","last_undegraded":"2023-10-17T06:08:53.510903+0000","last_fullsized":"2023-10-17T06:08:53.510903+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:38:40.954417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.604975+0000","last_change":"2023-10-17T06:08:50.885401+0000","last_active":"2023-10-17T06:08:52.604975+0000","last_peered":"2023-10-17T06:08:52.604975+0000","last_clean":"2023-10-17T06:08:52.604975+0000","last_became_active":"2023-10-17T06:08:50.885069+0000","last_became_peered":"2023-10-17T06:08:50.885069+0000","last_unstale":"2023-10-17T06:08:52.604975+0000","last_undegraded":"2023-10-17T06:08:52.604975+0000","last_fullsized":"2023-10-17T06:08:52.604975+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:08:46.227092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510721+0000","last_change":"2023-10-17T06:08:51.623538+0000","last_active":"2023-10-17T06:08:53.510721+0000","last_peered":"2023-10-17T06:08:53.510721+0000","last_clean":"2023-10-17T06:08:53.510721+0000","last_became_active":"2023-10-17T06:08:51.622453+0000","last_became_peered":"2023-10-17T06:08:51.622453+0000","last_unstale":"2023-10-17T06:08:53.510721+0000","last_undegraded":"2023-10-17T06:08:53.510721+0000","last_fullsized":"2023-10-17T06:08:53.510721+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:34:08.138670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.329079+0000","last_change":"2023-10-17T06:08:50.892712+0000","last_active":"2023-10-17T06:08:53.329079+0000","last_peered":"2023-10-17T06:08:53.329079+0000","last_clean":"2023-10-17T06:08:53.329079+0000","last_became_active":"2023-10-17T06:08:50.892420+0000","last_became_peered":"2023-10-17T06:08:50.892420+0000","last_unstale":"2023-10-17T06:08:53.329079+0000","last_undegraded":"2023-10-17T06:08:53.329079+0000","last_fullsized":"2023-10-17T06:08:53.329079+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:52:42.032927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.328452+0000","last_change":"2023-10-17T06:08:51.620443+0000","last_active":"2023-10-17T06:08:53.328452+0000","last_peered":"2023-10-17T06:08:53.328452+0000","last_clean":"2023-10-17T06:08:53.328452+0000","last_became_active":"2023-10-17T06:08:51.620170+0000","last_became_peered":"2023-10-17T06:08:51.620170+0000","last_unstale":"2023-10-17T06:08:53.328452+0000","last_undegraded":"2023-10-17T06:08:53.328452+0000","last_fullsized":"2023-10-17T06:08:53.328452+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:50:50.668888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.329304+0000","last_change":"2023-10-17T06:08:50.883762+0000","last_active":"2023-10-17T06:08:53.329304+0000","last_peered":"2023-10-17T06:08:53.329304+0000","last_clean":"2023-10-17T06:08:53.329304+0000","last_became_active":"2023-10-17T06:08:50.883129+0000","last_became_peered":"2023-10-17T06:08:50.883129+0000","last_unstale":"2023-10-17T06:08:53.329304+0000","last_undegraded":"2023-10-17T06:08:53.329304+0000","last_fullsized":"2023-10-17T06:08:53.329304+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:33:46.793483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.602292+0000","last_change":"2023-10-17T06:08:51.616031+0000","last_active":"2023-10-17T06:08:52.602292+0000","last_peered":"2023-10-17T06:08:52.602292+0000","last_clean":"2023-10-17T06:08:52.602292+0000","last_became_active":"2023-10-17T06:08:51.615697+0000","last_became_peered":"2023-10-17T06:08:51.615697+0000","last_unstale":"2023-10-17T06:08:52.602292+0000","last_undegraded":"2023-10-17T06:08:52.602292+0000","last_fullsized":"2023-10-17T06:08:52.602292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:35:57.731152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.604279+0000","last_change":"2023-10-17T06:08:50.895934+0000","last_active":"2023-10-17T06:08:52.604279+0000","last_peered":"2023-10-17T06:08:52.604279+0000","last_clean":"2023-10-17T06:08:52.604279+0000","last_became_active":"2023-10-17T06:08:50.895590+0000","last_became_peered":"2023-10-17T06:08:50.895590+0000","last_unstale":"2023-10-17T06:08:52.604279+0000","last_undegraded":"2023-10-17T06:08:52.604279+0000","last_fullsized":"2023-10-17T06:08:52.604279+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:50:49.652835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.021210+0000","last_change":"2023-10-17T06:08:51.629154+0000","last_active":"2023-10-17T06:08:53.021210+0000","last_peered":"2023-10-17T06:08:53.021210+0000","last_clean":"2023-10-17T06:08:53.021210+0000","last_became_active":"2023-10-17T06:08:51.622432+0000","last_became_peered":"2023-10-17T06:08:51.622432+0000","last_unstale":"2023-10-17T06:08:53.021210+0000","last_undegraded":"2023-10-17T06:08:53.021210+0000","last_fullsized":"2023-10-17T06:08:53.021210+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:37:13.721684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508666+0000","last_change":"2023-10-17T06:08:50.890104+0000","last_active":"2023-10-17T06:08:53.508666+0000","last_peered":"2023-10-17T06:08:53.508666+0000","last_clean":"2023-10-17T06:08:53.508666+0000","last_became_active":"2023-10-17T06:08:50.889803+0000","last_became_peered":"2023-10-17T06:08:50.889803+0000","last_unstale":"2023-10-17T06:08:53.508666+0000","last_undegraded":"2023-10-17T06:08:53.508666+0000","last_fullsized":"2023-10-17T06:08:53.508666+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:02:45.401699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508167+0000","last_change":"2023-10-17T06:08:51.625246+0000","last_active":"2023-10-17T06:08:53.508167+0000","last_peered":"2023-10-17T06:08:53.508167+0000","last_clean":"2023-10-17T06:08:53.508167+0000","last_became_active":"2023-10-17T06:08:51.624934+0000","last_became_peered":"2023-10-17T06:08:51.624934+0000","last_unstale":"2023-10-17T06:08:53.508167+0000","last_undegraded":"2023-10-17T06:08:53.508167+0000","last_fullsized":"2023-10-17T06:08:53.508167+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:56:36.521426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509011+0000","last_change":"2023-10-17T06:08:50.884156+0000","last_active":"2023-10-17T06:08:53.509011+0000","last_peered":"2023-10-17T06:08:53.509011+0000","last_clean":"2023-10-17T06:08:53.509011+0000","last_became_active":"2023-10-17T06:08:50.883413+0000","last_became_peered":"2023-10-17T06:08:50.883413+0000","last_unstale":"2023-10-17T06:08:53.509011+0000","last_undegraded":"2023-10-17T06:08:53.509011+0000","last_fullsized":"2023-10-17T06:08:53.509011+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:05:53.606534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.329072+0000","last_change":"2023-10-17T06:08:51.615114+0000","last_active":"2023-10-17T06:08:53.329072+0000","last_peered":"2023-10-17T06:08:53.329072+0000","last_clean":"2023-10-17T06:08:53.329072+0000","last_became_active":"2023-10-17T06:08:51.614844+0000","last_became_peered":"2023-10-17T06:08:51.614844+0000","last_unstale":"2023-10-17T06:08:53.329072+0000","last_undegraded":"2023-10-17T06:08:53.329072+0000","last_fullsized":"2023-10-17T06:08:53.329072+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T18:03:55.348763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509910+0000","last_change":"2023-10-17T06:08:50.889772+0000","last_active":"2023-10-17T06:08:53.509910+0000","last_peered":"2023-10-17T06:08:53.509910+0000","last_clean":"2023-10-17T06:08:53.509910+0000","last_became_active":"2023-10-17T06:08:50.889476+0000","last_became_peered":"2023-10-17T06:08:50.889476+0000","last_unstale":"2023-10-17T06:08:53.509910+0000","last_undegraded":"2023-10-17T06:08:53.509910+0000","last_fullsized":"2023-10-17T06:08:53.509910+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:37:56.512532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.511405+0000","last_change":"2023-10-17T06:07:02.749481+0000","last_active":"2023-10-17T06:08:53.511405+0000","last_peered":"2023-10-17T06:08:53.511405+0000","last_clean":"2023-10-17T06:08:53.511405+0000","last_became_active":"2023-10-17T06:07:02.748983+0000","last_became_peered":"2023-10-17T06:07:02.748983+0000","last_unstale":"2023-10-17T06:08:53.511405+0000","last_undegraded":"2023-10-17T06:08:53.511405+0000","last_fullsized":"2023-10-17T06:08:53.511405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:26:38.406806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.328834+0000","last_change":"2023-10-17T06:08:51.633045+0000","last_active":"2023-10-17T06:08:53.328834+0000","last_peered":"2023-10-17T06:08:53.328834+0000","last_clean":"2023-10-17T06:08:53.328834+0000","last_became_active":"2023-10-17T06:08:51.632787+0000","last_became_peered":"2023-10-17T06:08:51.632787+0000","last_unstale":"2023-10-17T06:08:53.328834+0000","last_undegraded":"2023-10-17T06:08:53.328834+0000","last_fullsized":"2023-10-17T06:08:53.328834+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:58.485288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605262+0000","last_change":"2023-10-17T06:08:50.874757+0000","last_active":"2023-10-17T06:08:52.605262+0000","last_peered":"2023-10-17T06:08:52.605262+0000","last_clean":"2023-10-17T06:08:52.605262+0000","last_became_active":"2023-10-17T06:08:50.874406+0000","last_became_peered":"2023-10-17T06:08:50.874406+0000","last_unstale":"2023-10-17T06:08:52.605262+0000","last_undegraded":"2023-10-17T06:08:52.605262+0000","last_fullsized":"2023-10-17T06:08:52.605262+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:37:04.461520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.603190+0000","last_change":"2023-10-17T06:07:02.746809+0000","last_active":"2023-10-17T06:08:52.603190+0000","last_peered":"2023-10-17T06:08:52.603190+0000","last_clean":"2023-10-17T06:08:52.603190+0000","last_became_active":"2023-10-17T06:07:02.746404+0000","last_became_peered":"2023-10-17T06:07:02.746404+0000","last_unstale":"2023-10-17T06:08:52.603190+0000","last_undegraded":"2023-10-17T06:08:52.603190+0000","last_fullsized":"2023-10-17T06:08:52.603190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:59:36.522271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.604369+0000","last_change":"2023-10-17T06:08:51.610733+0000","last_active":"2023-10-17T06:08:52.604369+0000","last_peered":"2023-10-17T06:08:52.604369+0000","last_clean":"2023-10-17T06:08:52.604369+0000","last_became_active":"2023-10-17T06:08:51.610442+0000","last_became_peered":"2023-10-17T06:08:51.610442+0000","last_unstale":"2023-10-17T06:08:52.604369+0000","last_undegraded":"2023-10-17T06:08:52.604369+0000","last_fullsized":"2023-10-17T06:08:52.604369+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:30:46.066994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.602201+0000","last_change":"2023-10-17T06:08:50.895276+0000","last_active":"2023-10-17T06:08:52.602201+0000","last_peered":"2023-10-17T06:08:52.602201+0000","last_clean":"2023-10-17T06:08:52.602201+0000","last_became_active":"2023-10-17T06:08:50.895028+0000","last_became_peered":"2023-10-17T06:08:50.895028+0000","last_unstale":"2023-10-17T06:08:52.602201+0000","last_undegraded":"2023-10-17T06:08:52.602201+0000","last_fullsized":"2023-10-17T06:08:52.602201+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:14:50.959291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510310+0000","last_change":"2023-10-17T06:07:02.943274+0000","last_active":"2023-10-17T06:08:53.510310+0000","last_peered":"2023-10-17T06:08:53.510310+0000","last_clean":"2023-10-17T06:08:53.510310+0000","last_became_active":"2023-10-17T06:07:02.942674+0000","last_became_peered":"2023-10-17T06:07:02.942674+0000","last_unstale":"2023-10-17T06:08:53.510310+0000","last_undegraded":"2023-10-17T06:08:53.510310+0000","last_fullsized":"2023-10-17T06:08:53.510310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:22:35.511370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.603760+0000","last_change":"2023-10-17T06:08:51.628882+0000","last_active":"2023-10-17T06:08:52.603760+0000","last_peered":"2023-10-17T06:08:52.603760+0000","last_clean":"2023-10-17T06:08:52.603760+0000","last_became_active":"2023-10-17T06:08:51.628591+0000","last_became_peered":"2023-10-17T06:08:51.628591+0000","last_unstale":"2023-10-17T06:08:52.603760+0000","last_undegraded":"2023-10-17T06:08:52.603760+0000","last_fullsized":"2023-10-17T06:08:52.603760+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:08:25.822120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508909+0000","last_change":"2023-10-17T06:08:50.891017+0000","last_active":"2023-10-17T06:08:53.508909+0000","last_peered":"2023-10-17T06:08:53.508909+0000","last_clean":"2023-10-17T06:08:53.508909+0000","last_became_active":"2023-10-17T06:08:50.890683+0000","last_became_peered":"2023-10-17T06:08:50.890683+0000","last_unstale":"2023-10-17T06:08:53.508909+0000","last_undegraded":"2023-10-17T06:08:53.508909+0000","last_fullsized":"2023-10-17T06:08:53.508909+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:15.453331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.602467+0000","last_change":"2023-10-17T06:07:02.943009+0000","last_active":"2023-10-17T06:08:52.602467+0000","last_peered":"2023-10-17T06:08:52.602467+0000","last_clean":"2023-10-17T06:08:52.602467+0000","last_became_active":"2023-10-17T06:07:02.942298+0000","last_became_peered":"2023-10-17T06:07:02.942298+0000","last_unstale":"2023-10-17T06:08:52.602467+0000","last_undegraded":"2023-10-17T06:08:52.602467+0000","last_fullsized":"2023-10-17T06:08:52.602467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:10:46.425574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.511347+0000","last_change":"2023-10-17T06:08:51.631688+0000","last_active":"2023-10-17T06:08:53.511347+0000","last_peered":"2023-10-17T06:08:53.511347+0000","last_clean":"2023-10-17T06:08:53.511347+0000","last_became_active":"2023-10-17T06:08:51.631422+0000","last_became_peered":"2023-10-17T06:08:51.631422+0000","last_unstale":"2023-10-17T06:08:53.511347+0000","last_undegraded":"2023-10-17T06:08:53.511347+0000","last_fullsized":"2023-10-17T06:08:53.511347+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:45:52.254974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.329256+0000","last_change":"2023-10-17T06:08:50.881923+0000","last_active":"2023-10-17T06:08:53.329256+0000","last_peered":"2023-10-17T06:08:53.329256+0000","last_clean":"2023-10-17T06:08:53.329256+0000","last_became_active":"2023-10-17T06:08:50.881636+0000","last_became_peered":"2023-10-17T06:08:50.881636+0000","last_unstale":"2023-10-17T06:08:53.329256+0000","last_undegraded":"2023-10-17T06:08:53.329256+0000","last_fullsized":"2023-10-17T06:08:53.329256+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:01:33.676414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.604577+0000","last_change":"2023-10-17T06:07:02.747287+0000","last_active":"2023-10-17T06:08:52.604577+0000","last_peered":"2023-10-17T06:08:52.604577+0000","last_clean":"2023-10-17T06:08:52.604577+0000","last_became_active":"2023-10-17T06:07:02.746659+0000","last_became_peered":"2023-10-17T06:07:02.746659+0000","last_unstale":"2023-10-17T06:08:52.604577+0000","last_undegraded":"2023-10-17T06:08:52.604577+0000","last_fullsized":"2023-10-17T06:08:52.604577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:12:15.649980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509057+0000","last_change":"2023-10-17T06:08:51.635250+0000","last_active":"2023-10-17T06:08:53.509057+0000","last_peered":"2023-10-17T06:08:53.509057+0000","last_clean":"2023-10-17T06:08:53.509057+0000","last_became_active":"2023-10-17T06:08:51.634940+0000","last_became_peered":"2023-10-17T06:08:51.634940+0000","last_unstale":"2023-10-17T06:08:53.509057+0000","last_undegraded":"2023-10-17T06:08:53.509057+0000","last_fullsized":"2023-10-17T06:08:53.509057+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:11:45.618014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510185+0000","last_change":"2023-10-17T06:08:50.887360+0000","last_active":"2023-10-17T06:08:53.510185+0000","last_peered":"2023-10-17T06:08:53.510185+0000","last_clean":"2023-10-17T06:08:53.510185+0000","last_became_active":"2023-10-17T06:08:50.886985+0000","last_became_peered":"2023-10-17T06:08:50.886985+0000","last_unstale":"2023-10-17T06:08:53.510185+0000","last_undegraded":"2023-10-17T06:08:53.510185+0000","last_fullsized":"2023-10-17T06:08:53.510185+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:09:30.715349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.020850+0000","last_change":"2023-10-17T06:07:02.746785+0000","last_active":"2023-10-17T06:08:53.020850+0000","last_peered":"2023-10-17T06:08:53.020850+0000","last_clean":"2023-10-17T06:08:53.020850+0000","last_became_active":"2023-10-17T06:07:02.746431+0000","last_became_peered":"2023-10-17T06:07:02.746431+0000","last_unstale":"2023-10-17T06:08:53.020850+0000","last_undegraded":"2023-10-17T06:08:53.020850+0000","last_fullsized":"2023-10-17T06:08:53.020850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:09:19.524022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510015+0000","last_change":"2023-10-17T06:08:51.632802+0000","last_active":"2023-10-17T06:08:53.510015+0000","last_peered":"2023-10-17T06:08:53.510015+0000","last_clean":"2023-10-17T06:08:53.510015+0000","last_became_active":"2023-10-17T06:08:51.632551+0000","last_became_peered":"2023-10-17T06:08:51.632551+0000","last_unstale":"2023-10-17T06:08:53.510015+0000","last_undegraded":"2023-10-17T06:08:53.510015+0000","last_fullsized":"2023-10-17T06:08:53.510015+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:21:53.523337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.602519+0000","last_change":"2023-10-17T06:08:50.886606+0000","last_active":"2023-10-17T06:08:52.602519+0000","last_peered":"2023-10-17T06:08:52.602519+0000","last_clean":"2023-10-17T06:08:52.602519+0000","last_became_active":"2023-10-17T06:08:50.886309+0000","last_became_peered":"2023-10-17T06:08:50.886309+0000","last_unstale":"2023-10-17T06:08:52.602519+0000","last_undegraded":"2023-10-17T06:08:52.602519+0000","last_fullsized":"2023-10-17T06:08:52.602519+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:32:03.949802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509294+0000","last_change":"2023-10-17T06:07:02.746953+0000","last_active":"2023-10-17T06:08:53.509294+0000","last_peered":"2023-10-17T06:08:53.509294+0000","last_clean":"2023-10-17T06:08:53.509294+0000","last_became_active":"2023-10-17T06:07:02.746344+0000","last_became_peered":"2023-10-17T06:07:02.746344+0000","last_unstale":"2023-10-17T06:08:53.509294+0000","last_undegraded":"2023-10-17T06:08:53.509294+0000","last_fullsized":"2023-10-17T06:08:53.509294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:50:42.035196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509249+0000","last_change":"2023-10-17T06:08:51.619915+0000","last_active":"2023-10-17T06:08:53.509249+0000","last_peered":"2023-10-17T06:08:53.509249+0000","last_clean":"2023-10-17T06:08:53.509249+0000","last_became_active":"2023-10-17T06:08:51.619596+0000","last_became_peered":"2023-10-17T06:08:51.619596+0000","last_unstale":"2023-10-17T06:08:53.509249+0000","last_undegraded":"2023-10-17T06:08:53.509249+0000","last_fullsized":"2023-10-17T06:08:53.509249+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:28:02.150411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.606042+0000","last_change":"2023-10-17T06:08:50.889323+0000","last_active":"2023-10-17T06:08:52.606042+0000","last_peered":"2023-10-17T06:08:52.606042+0000","last_clean":"2023-10-17T06:08:52.606042+0000","last_became_active":"2023-10-17T06:08:50.888998+0000","last_became_peered":"2023-10-17T06:08:50.888998+0000","last_unstale":"2023-10-17T06:08:52.606042+0000","last_undegraded":"2023-10-17T06:08:52.606042+0000","last_fullsized":"2023-10-17T06:08:52.606042+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:33:46.793483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.604828+0000","last_change":"2023-10-17T06:07:02.747957+0000","last_active":"2023-10-17T06:08:52.604828+0000","last_peered":"2023-10-17T06:08:52.604828+0000","last_clean":"2023-10-17T06:08:52.604828+0000","last_became_active":"2023-10-17T06:07:02.747569+0000","last_became_peered":"2023-10-17T06:07:02.747569+0000","last_unstale":"2023-10-17T06:08:52.604828+0000","last_undegraded":"2023-10-17T06:08:52.604828+0000","last_fullsized":"2023-10-17T06:08:52.604828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:09:31.392916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":211,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509241+0000","last_change":"2023-10-17T06:06:55.916050+0000","last_active":"2023-10-17T06:08:53.509241+0000","last_peered":"2023-10-17T06:08:53.509241+0000","last_clean":"2023-10-17T06:08:53.509241+0000","last_became_active":"2023-10-17T06:06:55.914009+0000","last_became_peered":"2023-10-17T06:06:55.914009+0000","last_unstale":"2023-10-17T06:08:53.509241+0000","last_undegraded":"2023-10-17T06:08:53.509241+0000","last_fullsized":"2023-10-17T06:08:53.509241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:06:54.658926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:06:54.658926+0000","last_clean_scrub_stamp":"2023-10-17T06:06:54.658926+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:47:31.450687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509466,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":499712,"data_stored":221607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":1.139},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.78100000000000003}]},{"osd":1,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.94399999999999995}]},{"osd":2,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.0900000000000001}]},{"osd":3,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.90100000000000002}]},{"osd":4,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":1.506},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.1739999999999999}]},{"osd":5,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.198},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.393}]},{"osd":7,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.466}]}]},{"osd":5,"up_from":15,"seq":64424509467,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":495616,"data_stored":221005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":5.2919999999999998,"5min":5.2919999999999998,"15min":5.2919999999999998},"last":1.2050000000000001}]},{"osd":1,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.3819999999999999}]},{"osd":2,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.597,"15min":1.597},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":5.3700000000000001,"5min":5.3700000000000001,"15min":5.3700000000000001},"last":1.571},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.155}]},{"osd":3,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.998,"5min":0.998,"15min":0.998},"max":{"1min":5.3230000000000004,"5min":5.3230000000000004,"15min":5.3230000000000004},"last":1.248}]},{"osd":4,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.653,"5min":2.653,"15min":2.653},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":3.3820000000000001,"5min":3.3820000000000001,"15min":3.3820000000000001},"last":1.508}]},{"osd":6,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":2.702,"5min":2.702,"15min":2.702},"last":1.4830000000000001}]},{"osd":7,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":2.544,"5min":2.544,"15min":2.544},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":2.8929999999999998},"last":1.4530000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509466,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":503808,"data_stored":222547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:07:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.474},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.0429999999999999}]},{"osd":1,"last update":"Tue Oct 17 06:07:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.145},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.377}]},{"osd":2,"last update":"Tue Oct 17 06:07:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.1970000000000001}]},{"osd":3,"last update":"Tue Oct 17 06:07:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.431},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.4079999999999999}]},{"osd":5,"last update":"Tue Oct 17 06:07:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.518}]},{"osd":6,"last update":"Tue Oct 17 06:07:57 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":3.2120000000000002,"5min":3.2120000000000002,"15min":3.2120000000000002},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.6279999999999999}]},{"osd":7,"last update":"Tue Oct 17 06:07:57 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.3380000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1089536,"data_stored":811393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.80600000000000005}]},{"osd":1,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":5.0519999999999996,"5min":5.0519999999999996,"15min":5.0519999999999996},"last":1.296},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.254}]},{"osd":2,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.149},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.3720000000000001}]},{"osd":3,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":5.1269999999999998,"5min":5.1269999999999998,"15min":5.1269999999999998},"last":1.1839999999999999}]},{"osd":4,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.92000000000000004}]},{"osd":5,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.86499999999999999}]},{"osd":6,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":1.056},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.4330000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":214600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":4.6760000000000002,"5min":4.6760000000000002,"15min":4.6760000000000002},"last":1.597},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.68500000000000005}]},{"osd":1,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":4.3719999999999999,"5min":4.3719999999999999,"15min":4.3719999999999999},"last":1.091},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":4.2359999999999998,"5min":4.2359999999999998,"15min":4.2359999999999998},"last":0.92200000000000004}]},{"osd":2,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":4.4660000000000002,"5min":4.4660000000000002,"15min":4.4660000000000002},"last":1.232},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":3.798,"5min":3.798,"15min":3.798},"last":1.518}]},{"osd":4,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":4.907,"5min":4.907,"15min":4.907},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.0760000000000001}]},{"osd":5,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":4.5549999999999997,"5min":4.5549999999999997,"15min":4.5549999999999997},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":5.0789999999999997,"5min":5.0789999999999997,"15min":5.0789999999999997},"last":1.425}]},{"osd":6,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":4.5190000000000001,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":1.556}]},{"osd":7,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.47},{"interface":"front","average":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":4.5899999999999999,"5min":4.5899999999999999,"15min":4.5899999999999999},"last":1.6699999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":222569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":1.181},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.80700000000000005}]},{"osd":1,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":0.58199999999999996}]},{"osd":3,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.97599999999999998}]},{"osd":4,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.089},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.272}]},{"osd":5,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.492},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.206}]},{"osd":6,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.643},{"interface":"front","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.1359999999999999}]},{"osd":7,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.9809999999999999,"5min":2.9809999999999999,"15min":2.9809999999999999},"last":1.552},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.371}]}]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":495616,"data_stored":221005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.629},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.94099999999999995}]},{"osd":2,"last update":"Tue Oct 17 06:07:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":0.60399999999999998}]},{"osd":3,"last update":"Tue Oct 17 06:07:58 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":4.6920000000000002,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.86199999999999999}]},{"osd":4,"last update":"Tue Oct 17 06:07:58 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.03},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.871,"5min":2.871,"15min":2.871},"last":1.145}]},{"osd":5,"last update":"Tue Oct 17 06:07:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":3.032,"5min":3.032,"15min":3.032},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":4.819,"5min":4.819,"15min":4.819},"last":1.097}]},{"osd":6,"last update":"Tue Oct 17 06:07:58 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":4.9900000000000002,"5min":4.9900000000000002,"15min":4.9900000000000002},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.177}]},{"osd":7,"last update":"Tue Oct 17 06:07:58 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":2.677,"5min":2.677,"15min":2.677},"last":1.24},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":1.202}]}]},{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1073152,"data_stored":802373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.292},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.3340000000000001,"5min":2.3340000000000001,"15min":2.3340000000000001},"last":0.88900000000000001}]},{"osd":2,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":4.407,"5min":4.407,"15min":4.407},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.5659999999999998,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":0.82199999999999995}]},{"osd":3,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.093},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":4.4269999999999996,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":0.98099999999999998}]},{"osd":4,"last update":"Tue Oct 17 06:07:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":3.4820000000000002,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":3.8079999999999998,"5min":3.8079999999999998,"15min":3.8079999999999998},"last":1.4059999999999999}]},{"osd":5,"last update":"Tue Oct 17 06:07:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":3.2120000000000002,"5min":3.2120000000000002,"15min":3.2120000000000002},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"max":{"1min":4.3849999999999998,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":1.258}]},{"osd":6,"last update":"Tue Oct 17 06:07:59 2023","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":4.3499999999999996,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":1.337},{"interface":"front","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.143}]},{"osd":7,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.377},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":1.083,"5min":1.083,"15min":1.083},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":1.5189999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-17T06:08:56.248 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-17T06:08:56.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.454+0000 7f19e482b700 1 Processor -- start 2023-10-17T06:08:56.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.454+0000 7f19e482b700 1 -- start start 2023-10-17T06:08:56.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.454+0000 7f19e482b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19e00b3d40 0x7f19e00cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:56.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.454+0000 7f19e482b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e00ca4c0 con 0x7f19e006ce20 2023-10-17T06:08:56.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.454+0000 7f19e482b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e00ca7a0 con 0x7f19e0164a20 2023-10-17T06:08:56.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.454+0000 7f19e482b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e006e2d0 con 0x7f19e00b3d40 2023-10-17T06:08:56.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.454+0000 7f19ded9d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19e00b3d40 0x7f19e00cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:56.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.454+0000 7f19de59c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f19e0164a20 0x7f19e00c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:38138/0 (socket says 172.21.15.125:38138) 2023-10-17T06:08:56.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.454+0000 7f19de59c700 1 -- 172.21.15.125:0/2843280434 learned_addr learned my addr 172.21.15.125:0/2843280434 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:56.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.454+0000 7f19ded9d700 1 -- 172.21.15.125:0/2843280434 >> v1:172.21.15.184:6789/0 conn(0x7f19e0164a20 legacy=0x7f19e00c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:56.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.454+0000 7f19ded9d700 1 -- 172.21.15.125:0/2843280434 >> v1:172.21.15.125:6789/0 conn(0x7f19e006ce20 legacy=0x7f19e006f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:56.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.454+0000 7f19ded9d700 1 -- 172.21.15.125:0/2843280434 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e00caa80 con 0x7f19e00b3d40 2023-10-17T06:08:56.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.458+0000 7f19ded9d700 1 --2- 172.21.15.125:0/2843280434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19e00b3d40 0x7f19e00cc190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009850 tx=0x7f19d0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc2fc111d59dda05 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:56.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.458+0000 7f19ddd9b700 1 -- 172.21.15.125:0/2843280434 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0011830 con 0x7f19e00b3d40 2023-10-17T06:08:56.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.458+0000 7f19ddd9b700 1 -- 172.21.15.125:0/2843280434 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d0011990 con 0x7f19e00b3d40 2023-10-17T06:08:56.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.458+0000 7f19ddd9b700 1 -- 172.21.15.125:0/2843280434 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0011d20 con 0x7f19e00b3d40 2023-10-17T06:08:56.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.458+0000 7f19e482b700 1 -- 172.21.15.125:0/2843280434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19e00b3d40 msgr2=0x7f19e00cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:56.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.458+0000 7f19e482b700 1 --2- 172.21.15.125:0/2843280434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19e00b3d40 0x7f19e00cc190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009850 tx=0x7f19d0009b60 comp rx=0 tx=0).stop 2023-10-17T06:08:56.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.458+0000 7f19e482b700 1 -- 172.21.15.125:0/2843280434 shutdown_connections 2023-10-17T06:08:56.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.458+0000 7f19e482b700 1 --2- 172.21.15.125:0/2843280434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19e00b3d40 0x7f19e00cc190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:56.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.458+0000 7f19e482b700 1 -- 172.21.15.125:0/2843280434 >> 172.21.15.125:0/2843280434 conn(0x7f19e00ce5c0 msgr2=0x7f19e00ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:56.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.458+0000 7f19e482b700 1 -- 172.21.15.125:0/2843280434 shutdown_connections 2023-10-17T06:08:56.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.458+0000 7f19e482b700 1 -- 172.21.15.125:0/2843280434 wait complete. 2023-10-17T06:08:56.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.462+0000 7f19e482b700 1 Processor -- start 2023-10-17T06:08:56.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.462+0000 7f19e482b700 1 -- start start 2023-10-17T06:08:56.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.462+0000 7f19e482b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19e006ce20 0x7f19e01eafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:56.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.462+0000 7f19e482b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19e00b3d40 0x7f19e015ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:56.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.462+0000 7f19e482b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19e0164a20 0x7f19e015d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:56.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19e482b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e015da10 con 0x7f19e006ce20 2023-10-17T06:08:56.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19e482b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e01e9c10 con 0x7f19e00b3d40 2023-10-17T06:08:56.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19e482b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e01ea1d0 con 0x7f19e0164a20 2023-10-17T06:08:56.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19ded9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19e006ce20 0x7f19e01eafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:56.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19ded9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19e006ce20 0x7f19e01eafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41886/0 (socket says 172.21.15.125:41886) 2023-10-17T06:08:56.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19ded9d700 1 -- 172.21.15.125:0/2387454997 learned_addr learned my addr 172.21.15.125:0/2387454997 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:56.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19df59e700 1 --2- 172.21.15.125:0/2387454997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19e0164a20 0x7f19e015d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:56.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19de59c700 1 --2- 172.21.15.125:0/2387454997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19e00b3d40 0x7f19e015ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:56.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19ded9d700 1 -- 172.21.15.125:0/2387454997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19e0164a20 msgr2=0x7f19e015d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:56.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19ded9d700 1 --2- 172.21.15.125:0/2387454997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19e0164a20 0x7f19e015d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:56.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19ded9d700 1 -- 172.21.15.125:0/2387454997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19e00b3d40 msgr2=0x7f19e015ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:56.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19ded9d700 1 --2- 172.21.15.125:0/2387454997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19e00b3d40 0x7f19e015ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:56.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19ded9d700 1 -- 172.21.15.125:0/2387454997 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d00094b0 con 0x7f19e006ce20 2023-10-17T06:08:56.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19de59c700 1 --2- 172.21.15.125:0/2387454997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19e00b3d40 0x7f19e015ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:56.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19ded9d700 1 --2- 172.21.15.125:0/2387454997 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19e006ce20 0x7f19e01eafa0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009f60 tx=0x7f19d0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:56.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19c77fe700 1 -- 172.21.15.125:0/2387454997 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d00036c0 con 0x7f19e006ce20 2023-10-17T06:08:56.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19c77fe700 1 -- 172.21.15.125:0/2387454997 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d001f070 con 0x7f19e006ce20 2023-10-17T06:08:56.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19e482b700 1 -- 172.21.15.125:0/2387454997 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e01eb630 con 0x7f19e006ce20 2023-10-17T06:08:56.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19c77fe700 1 -- 172.21.15.125:0/2387454997 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0003a60 con 0x7f19e006ce20 2023-10-17T06:08:56.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19e482b700 1 -- 172.21.15.125:0/2387454997 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e01e9e60 con 0x7f19e006ce20 2023-10-17T06:08:56.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.466+0000 7f19e482b700 1 -- 172.21.15.125:0/2387454997 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e01ebb50 con 0x7f19e006ce20 2023-10-17T06:08:56.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.470+0000 7f19c77fe700 1 -- 172.21.15.125:0/2387454997 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f19d0003bc0 con 0x7f19e006ce20 2023-10-17T06:08:56.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.470+0000 7f19c77fe700 1 --2- 172.21.15.125:0/2387454997 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19cc0656f0 0x7f19cc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:56.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.470+0000 7f19c77fe700 1 -- 172.21.15.125:0/2387454997 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f19d0021070 con 0x7f19e006ce20 2023-10-17T06:08:56.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.470+0000 7f19de59c700 1 --2- 172.21.15.125:0/2387454997 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19cc0656f0 0x7f19cc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:56.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.470+0000 7f19de59c700 1 --2- 172.21.15.125:0/2387454997 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19cc0656f0 0x7f19cc067bb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f19e00cbf30 tx=0x7f19d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:56.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.478+0000 7f19c77fe700 1 -- 172.21.15.125:0/2387454997 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f19d0052390 con 0x7f19e006ce20 2023-10-17T06:08:56.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.646+0000 7f19e482b700 1 -- 172.21.15.125:0/2387454997 --> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f19e006f450 con 0x7f19cc0656f0 2023-10-17T06:08:56.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.662+0000 7f19c77fe700 1 -- 172.21.15.125:0/2387454997 <== mgr.4107 v2:172.21.15.125:6832/2516570548 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309367 (secure 0 0 0) 0x7f19d4005980 con 0x7f19cc0656f0 2023-10-17T06:08:56.668 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:56.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.670+0000 7f19e482b700 1 -- 172.21.15.125:0/2387454997 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19cc0656f0 msgr2=0x7f19cc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:56.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.670+0000 7f19e482b700 1 --2- 172.21.15.125:0/2387454997 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19cc0656f0 0x7f19cc067bb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f19e00cbf30 tx=0x7f19d4009040 comp rx=0 tx=0).stop 2023-10-17T06:08:56.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.670+0000 7f19e482b700 1 -- 172.21.15.125:0/2387454997 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19e006ce20 msgr2=0x7f19e01eafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:56.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.670+0000 7f19e482b700 1 --2- 172.21.15.125:0/2387454997 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19e006ce20 0x7f19e01eafa0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009f60 tx=0x7f19d0004770 comp rx=0 tx=0).stop 2023-10-17T06:08:56.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.670+0000 7f19e482b700 1 -- 172.21.15.125:0/2387454997 shutdown_connections 2023-10-17T06:08:56.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.670+0000 7f19e482b700 1 --2- 172.21.15.125:0/2387454997 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19cc0656f0 0x7f19cc067bb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:56.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.670+0000 7f19e482b700 1 --2- 172.21.15.125:0/2387454997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f19e0164a20 0x7f19e015d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:56.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.670+0000 7f19e482b700 1 --2- 172.21.15.125:0/2387454997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f19e00b3d40 0x7f19e015ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:56.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.670+0000 7f19e482b700 1 --2- 172.21.15.125:0/2387454997 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19e006ce20 0x7f19e01eafa0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:56.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.670+0000 7f19e482b700 1 -- 172.21.15.125:0/2387454997 >> 172.21.15.125:0/2387454997 conn(0x7f19e00ce5c0 msgr2=0x7f19e00cc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:56.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.670+0000 7f19e482b700 1 -- 172.21.15.125:0/2387454997 shutdown_connections 2023-10-17T06:08:56.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.670+0000 7f19e482b700 1 -- 172.21.15.125:0/2387454997 wait complete. 2023-10-17T06:08:56.676 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-17T06:08:56.695 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2023-10-17T06:08:55.982758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221236,"kb_used_data":5036,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753484,"statfs":{"total":773094113280,"available":772867567616,"internally_reserved":0,"allocated":5156864,"data_stored":2937099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001835"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510161+0000","last_change":"2023-10-17T06:08:51.629196+0000","last_active":"2023-10-17T06:08:53.510161+0000","last_peered":"2023-10-17T06:08:53.510161+0000","last_clean":"2023-10-17T06:08:53.510161+0000","last_became_active":"2023-10-17T06:08:51.628923+0000","last_became_peered":"2023-10-17T06:08:51.628923+0000","last_unstale":"2023-10-17T06:08:53.510161+0000","last_undegraded":"2023-10-17T06:08:53.510161+0000","last_fullsized":"2023-10-17T06:08:53.510161+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:18:40.713686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605825+0000","last_change":"2023-10-17T06:08:51.621968+0000","last_active":"2023-10-17T06:08:52.605825+0000","last_peered":"2023-10-17T06:08:52.605825+0000","last_clean":"2023-10-17T06:08:52.605825+0000","last_became_active":"2023-10-17T06:08:51.621682+0000","last_became_peered":"2023-10-17T06:08:51.621682+0000","last_unstale":"2023-10-17T06:08:52.605825+0000","last_undegraded":"2023-10-17T06:08:52.605825+0000","last_fullsized":"2023-10-17T06:08:52.605825+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:01:34.692467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.604859+0000","last_change":"2023-10-17T06:08:51.629655+0000","last_active":"2023-10-17T06:08:52.604859+0000","last_peered":"2023-10-17T06:08:52.604859+0000","last_clean":"2023-10-17T06:08:52.604859+0000","last_became_active":"2023-10-17T06:08:51.629374+0000","last_became_peered":"2023-10-17T06:08:51.629374+0000","last_unstale":"2023-10-17T06:08:52.604859+0000","last_undegraded":"2023-10-17T06:08:52.604859+0000","last_fullsized":"2023-10-17T06:08:52.604859+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:38:47.612387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508655+0000","last_change":"2023-10-17T06:08:51.630045+0000","last_active":"2023-10-17T06:08:53.508655+0000","last_peered":"2023-10-17T06:08:53.508655+0000","last_clean":"2023-10-17T06:08:53.508655+0000","last_became_active":"2023-10-17T06:08:51.629769+0000","last_became_peered":"2023-10-17T06:08:51.629769+0000","last_unstale":"2023-10-17T06:08:53.508655+0000","last_undegraded":"2023-10-17T06:08:53.508655+0000","last_fullsized":"2023-10-17T06:08:53.508655+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:47:37.941469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.604859+0000","last_change":"2023-10-17T06:08:51.621487+0000","last_active":"2023-10-17T06:08:52.604859+0000","last_peered":"2023-10-17T06:08:52.604859+0000","last_clean":"2023-10-17T06:08:52.604859+0000","last_became_active":"2023-10-17T06:08:51.620991+0000","last_became_peered":"2023-10-17T06:08:51.620991+0000","last_unstale":"2023-10-17T06:08:52.604859+0000","last_undegraded":"2023-10-17T06:08:52.604859+0000","last_fullsized":"2023-10-17T06:08:52.604859+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:58.485288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.328467+0000","last_change":"2023-10-17T06:08:51.617626+0000","last_active":"2023-10-17T06:08:53.328467+0000","last_peered":"2023-10-17T06:08:53.328467+0000","last_clean":"2023-10-17T06:08:53.328467+0000","last_became_active":"2023-10-17T06:08:51.617323+0000","last_became_peered":"2023-10-17T06:08:51.617323+0000","last_unstale":"2023-10-17T06:08:53.328467+0000","last_undegraded":"2023-10-17T06:08:53.328467+0000","last_fullsized":"2023-10-17T06:08:53.328467+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:45:13.765610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509245+0000","last_change":"2023-10-17T06:08:51.612532+0000","last_active":"2023-10-17T06:08:53.509245+0000","last_peered":"2023-10-17T06:08:53.509245+0000","last_clean":"2023-10-17T06:08:53.509245+0000","last_became_active":"2023-10-17T06:08:51.610367+0000","last_became_peered":"2023-10-17T06:08:51.610367+0000","last_unstale":"2023-10-17T06:08:53.509245+0000","last_undegraded":"2023-10-17T06:08:53.509245+0000","last_fullsized":"2023-10-17T06:08:53.509245+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:45:43.421168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508011+0000","last_change":"2023-10-17T06:08:51.628669+0000","last_active":"2023-10-17T06:08:53.508011+0000","last_peered":"2023-10-17T06:08:53.508011+0000","last_clean":"2023-10-17T06:08:53.508011+0000","last_became_active":"2023-10-17T06:08:51.628382+0000","last_became_peered":"2023-10-17T06:08:51.628382+0000","last_unstale":"2023-10-17T06:08:53.508011+0000","last_undegraded":"2023-10-17T06:08:53.508011+0000","last_fullsized":"2023-10-17T06:08:53.508011+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:34:18.599657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508995+0000","last_change":"2023-10-17T06:08:51.631881+0000","last_active":"2023-10-17T06:08:53.508995+0000","last_peered":"2023-10-17T06:08:53.508995+0000","last_clean":"2023-10-17T06:08:53.508995+0000","last_became_active":"2023-10-17T06:08:51.630325+0000","last_became_peered":"2023-10-17T06:08:51.630325+0000","last_unstale":"2023-10-17T06:08:53.508995+0000","last_undegraded":"2023-10-17T06:08:53.508995+0000","last_fullsized":"2023-10-17T06:08:53.508995+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:14:09.150773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509347+0000","last_change":"2023-10-17T06:08:51.631404+0000","last_active":"2023-10-17T06:08:53.509347+0000","last_peered":"2023-10-17T06:08:53.509347+0000","last_clean":"2023-10-17T06:08:53.509347+0000","last_became_active":"2023-10-17T06:08:51.626295+0000","last_became_peered":"2023-10-17T06:08:51.626295+0000","last_unstale":"2023-10-17T06:08:53.509347+0000","last_undegraded":"2023-10-17T06:08:53.509347+0000","last_fullsized":"2023-10-17T06:08:53.509347+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:10:27.800237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508386+0000","last_change":"2023-10-17T06:08:51.625154+0000","last_active":"2023-10-17T06:08:53.508386+0000","last_peered":"2023-10-17T06:08:53.508386+0000","last_clean":"2023-10-17T06:08:53.508386+0000","last_became_active":"2023-10-17T06:08:51.624858+0000","last_became_peered":"2023-10-17T06:08:51.624858+0000","last_unstale":"2023-10-17T06:08:53.508386+0000","last_undegraded":"2023-10-17T06:08:53.508386+0000","last_fullsized":"2023-10-17T06:08:53.508386+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:02:43.206108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605138+0000","last_change":"2023-10-17T06:08:51.631821+0000","last_active":"2023-10-17T06:08:52.605138+0000","last_peered":"2023-10-17T06:08:52.605138+0000","last_clean":"2023-10-17T06:08:52.605138+0000","last_became_active":"2023-10-17T06:08:51.631560+0000","last_became_peered":"2023-10-17T06:08:51.631560+0000","last_unstale":"2023-10-17T06:08:52.605138+0000","last_undegraded":"2023-10-17T06:08:52.605138+0000","last_fullsized":"2023-10-17T06:08:52.605138+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:22:55.982594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.021316+0000","last_change":"2023-10-17T06:08:51.632024+0000","last_active":"2023-10-17T06:08:53.021316+0000","last_peered":"2023-10-17T06:08:53.021316+0000","last_clean":"2023-10-17T06:08:53.021316+0000","last_became_active":"2023-10-17T06:08:51.631684+0000","last_became_peered":"2023-10-17T06:08:51.631684+0000","last_unstale":"2023-10-17T06:08:53.021316+0000","last_undegraded":"2023-10-17T06:08:53.021316+0000","last_fullsized":"2023-10-17T06:08:53.021316+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:37:14.658836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508163+0000","last_change":"2023-10-17T06:08:51.619752+0000","last_active":"2023-10-17T06:08:53.508163+0000","last_peered":"2023-10-17T06:08:53.508163+0000","last_clean":"2023-10-17T06:08:53.508163+0000","last_became_active":"2023-10-17T06:08:51.618831+0000","last_became_peered":"2023-10-17T06:08:51.618831+0000","last_unstale":"2023-10-17T06:08:53.508163+0000","last_undegraded":"2023-10-17T06:08:53.508163+0000","last_fullsized":"2023-10-17T06:08:53.508163+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:40:25.048147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.328383+0000","last_change":"2023-10-17T06:08:51.633872+0000","last_active":"2023-10-17T06:08:53.328383+0000","last_peered":"2023-10-17T06:08:53.328383+0000","last_clean":"2023-10-17T06:08:53.328383+0000","last_became_active":"2023-10-17T06:08:51.633529+0000","last_became_peered":"2023-10-17T06:08:51.633529+0000","last_unstale":"2023-10-17T06:08:53.328383+0000","last_undegraded":"2023-10-17T06:08:53.328383+0000","last_fullsized":"2023-10-17T06:08:53.328383+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:03:39.181151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509537+0000","last_change":"2023-10-17T06:08:51.632595+0000","last_active":"2023-10-17T06:08:53.509537+0000","last_peered":"2023-10-17T06:08:53.509537+0000","last_clean":"2023-10-17T06:08:53.509537+0000","last_became_active":"2023-10-17T06:08:51.632064+0000","last_became_peered":"2023-10-17T06:08:51.632064+0000","last_unstale":"2023-10-17T06:08:53.509537+0000","last_undegraded":"2023-10-17T06:08:53.509537+0000","last_fullsized":"2023-10-17T06:08:53.509537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:49:21.755263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605333+0000","last_change":"2023-10-17T06:08:51.622246+0000","last_active":"2023-10-17T06:08:52.605333+0000","last_peered":"2023-10-17T06:08:52.605333+0000","last_clean":"2023-10-17T06:08:52.605333+0000","last_became_active":"2023-10-17T06:08:51.621970+0000","last_became_peered":"2023-10-17T06:08:51.621970+0000","last_unstale":"2023-10-17T06:08:52.605333+0000","last_undegraded":"2023-10-17T06:08:52.605333+0000","last_fullsized":"2023-10-17T06:08:52.605333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:06:32.039655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605236+0000","last_change":"2023-10-17T06:08:51.624474+0000","last_active":"2023-10-17T06:08:52.605236+0000","last_peered":"2023-10-17T06:08:52.605236+0000","last_clean":"2023-10-17T06:08:52.605236+0000","last_became_active":"2023-10-17T06:08:51.624038+0000","last_became_peered":"2023-10-17T06:08:51.624038+0000","last_unstale":"2023-10-17T06:08:52.605236+0000","last_undegraded":"2023-10-17T06:08:52.605236+0000","last_fullsized":"2023-10-17T06:08:52.605236+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:15:10.532688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510877+0000","last_change":"2023-10-17T06:08:51.631090+0000","last_active":"2023-10-17T06:08:53.510877+0000","last_peered":"2023-10-17T06:08:53.510877+0000","last_clean":"2023-10-17T06:08:53.510877+0000","last_became_active":"2023-10-17T06:08:51.630845+0000","last_became_peered":"2023-10-17T06:08:51.630845+0000","last_unstale":"2023-10-17T06:08:53.510877+0000","last_undegraded":"2023-10-17T06:08:53.510877+0000","last_fullsized":"2023-10-17T06:08:53.510877+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:41:57.496238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.021376+0000","last_change":"2023-10-17T06:08:51.637677+0000","last_active":"2023-10-17T06:08:53.021376+0000","last_peered":"2023-10-17T06:08:53.021376+0000","last_clean":"2023-10-17T06:08:53.021376+0000","last_became_active":"2023-10-17T06:08:51.637430+0000","last_became_peered":"2023-10-17T06:08:51.637430+0000","last_unstale":"2023-10-17T06:08:53.021376+0000","last_undegraded":"2023-10-17T06:08:53.021376+0000","last_fullsized":"2023-10-17T06:08:53.021376+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:12:18.796696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.328640+0000","last_change":"2023-10-17T06:08:51.627443+0000","last_active":"2023-10-17T06:08:53.328640+0000","last_peered":"2023-10-17T06:08:53.328640+0000","last_clean":"2023-10-17T06:08:53.328640+0000","last_became_active":"2023-10-17T06:08:51.627159+0000","last_became_peered":"2023-10-17T06:08:51.627159+0000","last_unstale":"2023-10-17T06:08:53.328640+0000","last_undegraded":"2023-10-17T06:08:53.328640+0000","last_fullsized":"2023-10-17T06:08:53.328640+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:14:04.789413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509232+0000","last_change":"2023-10-17T06:08:51.627734+0000","last_active":"2023-10-17T06:08:53.509232+0000","last_peered":"2023-10-17T06:08:53.509232+0000","last_clean":"2023-10-17T06:08:53.509232+0000","last_became_active":"2023-10-17T06:08:51.627461+0000","last_became_peered":"2023-10-17T06:08:51.627461+0000","last_unstale":"2023-10-17T06:08:53.509232+0000","last_undegraded":"2023-10-17T06:08:53.509232+0000","last_fullsized":"2023-10-17T06:08:53.509232+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:11:00.650093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510282+0000","last_change":"2023-10-17T06:08:51.618887+0000","last_active":"2023-10-17T06:08:53.510282+0000","last_peered":"2023-10-17T06:08:53.510282+0000","last_clean":"2023-10-17T06:08:53.510282+0000","last_became_active":"2023-10-17T06:08:51.618518+0000","last_became_peered":"2023-10-17T06:08:51.618518+0000","last_unstale":"2023-10-17T06:08:53.510282+0000","last_undegraded":"2023-10-17T06:08:53.510282+0000","last_fullsized":"2023-10-17T06:08:53.510282+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:43:19.280288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509803+0000","last_change":"2023-10-17T06:08:51.619002+0000","last_active":"2023-10-17T06:08:53.509803+0000","last_peered":"2023-10-17T06:08:53.509803+0000","last_clean":"2023-10-17T06:08:53.509803+0000","last_became_active":"2023-10-17T06:08:51.618539+0000","last_became_peered":"2023-10-17T06:08:51.618539+0000","last_unstale":"2023-10-17T06:08:53.509803+0000","last_undegraded":"2023-10-17T06:08:53.509803+0000","last_fullsized":"2023-10-17T06:08:53.509803+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:23:17.310536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.511124+0000","last_change":"2023-10-17T06:08:51.622873+0000","last_active":"2023-10-17T06:08:53.511124+0000","last_peered":"2023-10-17T06:08:53.511124+0000","last_clean":"2023-10-17T06:08:53.511124+0000","last_became_active":"2023-10-17T06:08:51.622574+0000","last_became_peered":"2023-10-17T06:08:51.622574+0000","last_unstale":"2023-10-17T06:08:53.511124+0000","last_undegraded":"2023-10-17T06:08:53.511124+0000","last_fullsized":"2023-10-17T06:08:53.511124+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:37:12.104667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.021616+0000","last_change":"2023-10-17T06:08:51.623308+0000","last_active":"2023-10-17T06:08:53.021616+0000","last_peered":"2023-10-17T06:08:53.021616+0000","last_clean":"2023-10-17T06:08:53.021616+0000","last_became_active":"2023-10-17T06:08:51.623039+0000","last_became_peered":"2023-10-17T06:08:51.623039+0000","last_unstale":"2023-10-17T06:08:53.021616+0000","last_undegraded":"2023-10-17T06:08:53.021616+0000","last_fullsized":"2023-10-17T06:08:53.021616+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:28:27.418674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605082+0000","last_change":"2023-10-17T06:08:51.621575+0000","last_active":"2023-10-17T06:08:52.605082+0000","last_peered":"2023-10-17T06:08:52.605082+0000","last_clean":"2023-10-17T06:08:52.605082+0000","last_became_active":"2023-10-17T06:08:51.612129+0000","last_became_peered":"2023-10-17T06:08:51.612129+0000","last_unstale":"2023-10-17T06:08:52.605082+0000","last_undegraded":"2023-10-17T06:08:52.605082+0000","last_fullsized":"2023-10-17T06:08:52.605082+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:15:10.255909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605333+0000","last_change":"2023-10-17T06:08:51.621188+0000","last_active":"2023-10-17T06:08:52.605333+0000","last_peered":"2023-10-17T06:08:52.605333+0000","last_clean":"2023-10-17T06:08:52.605333+0000","last_became_active":"2023-10-17T06:08:51.620920+0000","last_became_peered":"2023-10-17T06:08:51.620920+0000","last_unstale":"2023-10-17T06:08:52.605333+0000","last_undegraded":"2023-10-17T06:08:52.605333+0000","last_fullsized":"2023-10-17T06:08:52.605333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:52:43.048979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510163+0000","last_change":"2023-10-17T06:08:51.626032+0000","last_active":"2023-10-17T06:08:53.510163+0000","last_peered":"2023-10-17T06:08:53.510163+0000","last_clean":"2023-10-17T06:08:53.510163+0000","last_became_active":"2023-10-17T06:08:51.625821+0000","last_became_peered":"2023-10-17T06:08:51.625821+0000","last_unstale":"2023-10-17T06:08:53.510163+0000","last_undegraded":"2023-10-17T06:08:53.510163+0000","last_fullsized":"2023-10-17T06:08:53.510163+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:26:35.864225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.603944+0000","last_change":"2023-10-17T06:08:51.629022+0000","last_active":"2023-10-17T06:08:52.603944+0000","last_peered":"2023-10-17T06:08:52.603944+0000","last_clean":"2023-10-17T06:08:52.603944+0000","last_became_active":"2023-10-17T06:08:51.628733+0000","last_became_peered":"2023-10-17T06:08:51.628733+0000","last_unstale":"2023-10-17T06:08:52.603944+0000","last_undegraded":"2023-10-17T06:08:52.603944+0000","last_fullsized":"2023-10-17T06:08:52.603944+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:20:21.920047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.328606+0000","last_change":"2023-10-17T06:08:51.613583+0000","last_active":"2023-10-17T06:08:53.328606+0000","last_peered":"2023-10-17T06:08:53.328606+0000","last_clean":"2023-10-17T06:08:53.328606+0000","last_became_active":"2023-10-17T06:08:51.613323+0000","last_became_peered":"2023-10-17T06:08:51.613323+0000","last_unstale":"2023-10-17T06:08:53.328606+0000","last_undegraded":"2023-10-17T06:08:53.328606+0000","last_fullsized":"2023-10-17T06:08:53.328606+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:30:46.066994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.021016+0000","last_change":"2023-10-17T06:08:51.634234+0000","last_active":"2023-10-17T06:08:53.021016+0000","last_peered":"2023-10-17T06:08:53.021016+0000","last_clean":"2023-10-17T06:08:53.021016+0000","last_became_active":"2023-10-17T06:08:51.633590+0000","last_became_peered":"2023-10-17T06:08:51.633590+0000","last_unstale":"2023-10-17T06:08:53.021016+0000","last_undegraded":"2023-10-17T06:08:53.021016+0000","last_fullsized":"2023-10-17T06:08:53.021016+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:59:33.208984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.603158+0000","last_change":"2023-10-17T06:08:51.618021+0000","last_active":"2023-10-17T06:08:52.603158+0000","last_peered":"2023-10-17T06:08:52.603158+0000","last_clean":"2023-10-17T06:08:52.603158+0000","last_became_active":"2023-10-17T06:08:51.617761+0000","last_became_peered":"2023-10-17T06:08:51.617761+0000","last_unstale":"2023-10-17T06:08:52.603158+0000","last_undegraded":"2023-10-17T06:08:52.603158+0000","last_fullsized":"2023-10-17T06:08:52.603158+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:42:48.342596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"42'4","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.329464+0000","last_change":"2023-10-17T06:08:50.886681+0000","last_active":"2023-10-17T06:08:53.329464+0000","last_peered":"2023-10-17T06:08:53.329464+0000","last_clean":"2023-10-17T06:08:53.329464+0000","last_became_active":"2023-10-17T06:08:50.886412+0000","last_became_peered":"2023-10-17T06:08:50.886412+0000","last_unstale":"2023-10-17T06:08:53.329464+0000","last_undegraded":"2023-10-17T06:08:53.329464+0000","last_fullsized":"2023-10-17T06:08:53.329464+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:14:43.707960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.511208+0000","last_change":"2023-10-17T06:08:51.635139+0000","last_active":"2023-10-17T06:08:53.511208+0000","last_peered":"2023-10-17T06:08:53.511208+0000","last_clean":"2023-10-17T06:08:53.511208+0000","last_became_active":"2023-10-17T06:08:51.634267+0000","last_became_peered":"2023-10-17T06:08:51.634267+0000","last_unstale":"2023-10-17T06:08:53.511208+0000","last_undegraded":"2023-10-17T06:08:53.511208+0000","last_fullsized":"2023-10-17T06:08:53.511208+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:10:13.009375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605534+0000","last_change":"2023-10-17T06:08:50.892172+0000","last_active":"2023-10-17T06:08:52.605534+0000","last_peered":"2023-10-17T06:08:52.605534+0000","last_clean":"2023-10-17T06:08:52.605534+0000","last_became_active":"2023-10-17T06:08:50.891910+0000","last_became_peered":"2023-10-17T06:08:50.891910+0000","last_unstale":"2023-10-17T06:08:52.605534+0000","last_undegraded":"2023-10-17T06:08:52.605534+0000","last_fullsized":"2023-10-17T06:08:52.605534+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:39:34.148579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605283+0000","last_change":"2023-10-17T06:08:51.614154+0000","last_active":"2023-10-17T06:08:52.605283+0000","last_peered":"2023-10-17T06:08:52.605283+0000","last_clean":"2023-10-17T06:08:52.605283+0000","last_became_active":"2023-10-17T06:08:51.613892+0000","last_became_peered":"2023-10-17T06:08:51.613892+0000","last_unstale":"2023-10-17T06:08:52.605283+0000","last_undegraded":"2023-10-17T06:08:52.605283+0000","last_fullsized":"2023-10-17T06:08:52.605283+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T18:03:55.348763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.602905+0000","last_change":"2023-10-17T06:08:50.889901+0000","last_active":"2023-10-17T06:08:52.602905+0000","last_peered":"2023-10-17T06:08:52.602905+0000","last_clean":"2023-10-17T06:08:52.602905+0000","last_became_active":"2023-10-17T06:08:50.889627+0000","last_became_peered":"2023-10-17T06:08:50.889627+0000","last_unstale":"2023-10-17T06:08:52.602905+0000","last_undegraded":"2023-10-17T06:08:52.602905+0000","last_fullsized":"2023-10-17T06:08:52.602905+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:03:32.282969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.602804+0000","last_change":"2023-10-17T06:08:51.627094+0000","last_active":"2023-10-17T06:08:52.602804+0000","last_peered":"2023-10-17T06:08:52.602804+0000","last_clean":"2023-10-17T06:08:52.602804+0000","last_became_active":"2023-10-17T06:08:51.626800+0000","last_became_peered":"2023-10-17T06:08:51.626800+0000","last_unstale":"2023-10-17T06:08:52.602804+0000","last_undegraded":"2023-10-17T06:08:52.602804+0000","last_fullsized":"2023-10-17T06:08:52.602804+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:49:25.310685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509553+0000","last_change":"2023-10-17T06:08:50.885854+0000","last_active":"2023-10-17T06:08:53.509553+0000","last_peered":"2023-10-17T06:08:53.509553+0000","last_clean":"2023-10-17T06:08:53.509553+0000","last_became_active":"2023-10-17T06:08:50.885564+0000","last_became_peered":"2023-10-17T06:08:50.885564+0000","last_unstale":"2023-10-17T06:08:53.509553+0000","last_undegraded":"2023-10-17T06:08:53.509553+0000","last_fullsized":"2023-10-17T06:08:53.509553+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:56:24.752937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.604437+0000","last_change":"2023-10-17T06:08:51.622330+0000","last_active":"2023-10-17T06:08:52.604437+0000","last_peered":"2023-10-17T06:08:52.604437+0000","last_clean":"2023-10-17T06:08:52.604437+0000","last_became_active":"2023-10-17T06:08:51.622029+0000","last_became_peered":"2023-10-17T06:08:51.622029+0000","last_unstale":"2023-10-17T06:08:52.604437+0000","last_undegraded":"2023-10-17T06:08:52.604437+0000","last_fullsized":"2023-10-17T06:08:52.604437+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:19:18.271954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.328995+0000","last_change":"2023-10-17T06:08:50.883965+0000","last_active":"2023-10-17T06:08:53.328995+0000","last_peered":"2023-10-17T06:08:53.328995+0000","last_clean":"2023-10-17T06:08:53.328995+0000","last_became_active":"2023-10-17T06:08:50.883498+0000","last_became_peered":"2023-10-17T06:08:50.883498+0000","last_unstale":"2023-10-17T06:08:53.328995+0000","last_undegraded":"2023-10-17T06:08:53.328995+0000","last_fullsized":"2023-10-17T06:08:53.328995+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:08:46.227092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508585+0000","last_change":"2023-10-17T06:08:51.630542+0000","last_active":"2023-10-17T06:08:53.508585+0000","last_peered":"2023-10-17T06:08:53.508585+0000","last_clean":"2023-10-17T06:08:53.508585+0000","last_became_active":"2023-10-17T06:08:51.630258+0000","last_became_peered":"2023-10-17T06:08:51.630258+0000","last_unstale":"2023-10-17T06:08:53.508585+0000","last_undegraded":"2023-10-17T06:08:53.508585+0000","last_fullsized":"2023-10-17T06:08:53.508585+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:40:04.891353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605058+0000","last_change":"2023-10-17T06:08:50.889306+0000","last_active":"2023-10-17T06:08:52.605058+0000","last_peered":"2023-10-17T06:08:52.605058+0000","last_clean":"2023-10-17T06:08:52.605058+0000","last_became_active":"2023-10-17T06:08:50.889019+0000","last_became_peered":"2023-10-17T06:08:50.889019+0000","last_unstale":"2023-10-17T06:08:52.605058+0000","last_undegraded":"2023-10-17T06:08:52.605058+0000","last_fullsized":"2023-10-17T06:08:52.605058+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:01:17.079480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508268+0000","last_change":"2023-10-17T06:08:51.632827+0000","last_active":"2023-10-17T06:08:53.508268+0000","last_peered":"2023-10-17T06:08:53.508268+0000","last_clean":"2023-10-17T06:08:53.508268+0000","last_became_active":"2023-10-17T06:08:51.626253+0000","last_became_peered":"2023-10-17T06:08:51.626253+0000","last_unstale":"2023-10-17T06:08:53.508268+0000","last_undegraded":"2023-10-17T06:08:53.508268+0000","last_fullsized":"2023-10-17T06:08:53.508268+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:14:34.782427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.604279+0000","last_change":"2023-10-17T06:08:50.882729+0000","last_active":"2023-10-17T06:08:52.604279+0000","last_peered":"2023-10-17T06:08:52.604279+0000","last_clean":"2023-10-17T06:08:52.604279+0000","last_became_active":"2023-10-17T06:08:50.882371+0000","last_became_peered":"2023-10-17T06:08:50.882371+0000","last_unstale":"2023-10-17T06:08:52.604279+0000","last_undegraded":"2023-10-17T06:08:52.604279+0000","last_fullsized":"2023-10-17T06:08:52.604279+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:45:12.749557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509877+0000","last_change":"2023-10-17T06:08:51.620451+0000","last_active":"2023-10-17T06:08:53.509877+0000","last_peered":"2023-10-17T06:08:53.509877+0000","last_clean":"2023-10-17T06:08:53.509877+0000","last_became_active":"2023-10-17T06:08:51.620045+0000","last_became_peered":"2023-10-17T06:08:51.620045+0000","last_unstale":"2023-10-17T06:08:53.509877+0000","last_undegraded":"2023-10-17T06:08:53.509877+0000","last_fullsized":"2023-10-17T06:08:53.509877+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:41:20.033234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508331+0000","last_change":"2023-10-17T06:08:50.886390+0000","last_active":"2023-10-17T06:08:53.508331+0000","last_peered":"2023-10-17T06:08:53.508331+0000","last_clean":"2023-10-17T06:08:53.508331+0000","last_became_active":"2023-10-17T06:08:50.885751+0000","last_became_peered":"2023-10-17T06:08:50.885751+0000","last_unstale":"2023-10-17T06:08:53.508331+0000","last_undegraded":"2023-10-17T06:08:53.508331+0000","last_fullsized":"2023-10-17T06:08:53.508331+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:44:00.802207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605446+0000","last_change":"2023-10-17T06:08:51.623590+0000","last_active":"2023-10-17T06:08:52.605446+0000","last_peered":"2023-10-17T06:08:52.605446+0000","last_clean":"2023-10-17T06:08:52.605446+0000","last_became_active":"2023-10-17T06:08:51.623290+0000","last_became_peered":"2023-10-17T06:08:51.623290+0000","last_unstale":"2023-10-17T06:08:52.605446+0000","last_undegraded":"2023-10-17T06:08:52.605446+0000","last_fullsized":"2023-10-17T06:08:52.605446+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:55:18.172686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.606707+0000","last_change":"2023-10-17T06:08:50.880938+0000","last_active":"2023-10-17T06:08:52.606707+0000","last_peered":"2023-10-17T06:08:52.606707+0000","last_clean":"2023-10-17T06:08:52.606707+0000","last_became_active":"2023-10-17T06:08:50.880602+0000","last_became_peered":"2023-10-17T06:08:50.880602+0000","last_unstale":"2023-10-17T06:08:52.606707+0000","last_undegraded":"2023-10-17T06:08:52.606707+0000","last_fullsized":"2023-10-17T06:08:52.606707+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:22.293897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510721+0000","last_change":"2023-10-17T06:08:51.614309+0000","last_active":"2023-10-17T06:08:53.510721+0000","last_peered":"2023-10-17T06:08:53.510721+0000","last_clean":"2023-10-17T06:08:53.510721+0000","last_became_active":"2023-10-17T06:08:51.614051+0000","last_became_peered":"2023-10-17T06:08:51.614051+0000","last_unstale":"2023-10-17T06:08:53.510721+0000","last_undegraded":"2023-10-17T06:08:53.510721+0000","last_fullsized":"2023-10-17T06:08:53.510721+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:44:42.704352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509358+0000","last_change":"2023-10-17T06:08:50.891078+0000","last_active":"2023-10-17T06:08:53.509358+0000","last_peered":"2023-10-17T06:08:53.509358+0000","last_clean":"2023-10-17T06:08:53.509358+0000","last_became_active":"2023-10-17T06:08:50.890821+0000","last_became_peered":"2023-10-17T06:08:50.890821+0000","last_unstale":"2023-10-17T06:08:53.509358+0000","last_undegraded":"2023-10-17T06:08:53.509358+0000","last_fullsized":"2023-10-17T06:08:53.509358+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:33:17.754770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.328993+0000","last_change":"2023-10-17T06:08:51.623939+0000","last_active":"2023-10-17T06:08:53.328993+0000","last_peered":"2023-10-17T06:08:53.328993+0000","last_clean":"2023-10-17T06:08:53.328993+0000","last_became_active":"2023-10-17T06:08:51.623669+0000","last_became_peered":"2023-10-17T06:08:51.623669+0000","last_unstale":"2023-10-17T06:08:53.328993+0000","last_undegraded":"2023-10-17T06:08:53.328993+0000","last_fullsized":"2023-10-17T06:08:53.328993+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:22:55.982594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"42'3","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510246+0000","last_change":"2023-10-17T06:08:50.892071+0000","last_active":"2023-10-17T06:08:53.510246+0000","last_peered":"2023-10-17T06:08:53.510246+0000","last_clean":"2023-10-17T06:08:53.510246+0000","last_became_active":"2023-10-17T06:08:50.891824+0000","last_became_peered":"2023-10-17T06:08:50.891824+0000","last_unstale":"2023-10-17T06:08:53.510246+0000","last_undegraded":"2023-10-17T06:08:53.510246+0000","last_fullsized":"2023-10-17T06:08:53.510246+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:09:38.183380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509821+0000","last_change":"2023-10-17T06:08:51.610911+0000","last_active":"2023-10-17T06:08:53.509821+0000","last_peered":"2023-10-17T06:08:53.509821+0000","last_clean":"2023-10-17T06:08:53.509821+0000","last_became_active":"2023-10-17T06:08:51.610627+0000","last_became_peered":"2023-10-17T06:08:51.610627+0000","last_unstale":"2023-10-17T06:08:53.509821+0000","last_undegraded":"2023-10-17T06:08:53.509821+0000","last_fullsized":"2023-10-17T06:08:53.509821+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:18:10.932837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"42'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.021396+0000","last_change":"2023-10-17T06:08:50.882827+0000","last_active":"2023-10-17T06:08:53.021396+0000","last_peered":"2023-10-17T06:08:53.021396+0000","last_clean":"2023-10-17T06:08:53.021396+0000","last_became_active":"2023-10-17T06:08:50.882547+0000","last_became_peered":"2023-10-17T06:08:50.882547+0000","last_unstale":"2023-10-17T06:08:53.021396+0000","last_undegraded":"2023-10-17T06:08:53.021396+0000","last_fullsized":"2023-10-17T06:08:53.021396+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:56:20.711351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510143+0000","last_change":"2023-10-17T06:08:51.620735+0000","last_active":"2023-10-17T06:08:53.510143+0000","last_peered":"2023-10-17T06:08:53.510143+0000","last_clean":"2023-10-17T06:08:53.510143+0000","last_became_active":"2023-10-17T06:08:51.620385+0000","last_became_peered":"2023-10-17T06:08:51.620385+0000","last_unstale":"2023-10-17T06:08:53.510143+0000","last_undegraded":"2023-10-17T06:08:53.510143+0000","last_fullsized":"2023-10-17T06:08:53.510143+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T18:07:23.616835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.329433+0000","last_change":"2023-10-17T06:08:50.891535+0000","last_active":"2023-10-17T06:08:53.329433+0000","last_peered":"2023-10-17T06:08:53.329433+0000","last_clean":"2023-10-17T06:08:53.329433+0000","last_became_active":"2023-10-17T06:08:50.891285+0000","last_became_peered":"2023-10-17T06:08:50.891285+0000","last_unstale":"2023-10-17T06:08:53.329433+0000","last_undegraded":"2023-10-17T06:08:53.329433+0000","last_fullsized":"2023-10-17T06:08:53.329433+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:58:57.841812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508143+0000","last_change":"2023-10-17T06:08:51.620830+0000","last_active":"2023-10-17T06:08:53.508143+0000","last_peered":"2023-10-17T06:08:53.508143+0000","last_clean":"2023-10-17T06:08:53.508143+0000","last_became_active":"2023-10-17T06:08:51.620495+0000","last_became_peered":"2023-10-17T06:08:51.620495+0000","last_unstale":"2023-10-17T06:08:53.508143+0000","last_undegraded":"2023-10-17T06:08:53.508143+0000","last_fullsized":"2023-10-17T06:08:53.508143+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:09:20.626158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509183+0000","last_change":"2023-10-17T06:08:50.881913+0000","last_active":"2023-10-17T06:08:53.509183+0000","last_peered":"2023-10-17T06:08:53.509183+0000","last_clean":"2023-10-17T06:08:53.509183+0000","last_became_active":"2023-10-17T06:08:50.881580+0000","last_became_peered":"2023-10-17T06:08:50.881580+0000","last_unstale":"2023-10-17T06:08:53.509183+0000","last_undegraded":"2023-10-17T06:08:53.509183+0000","last_fullsized":"2023-10-17T06:08:53.509183+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:26:57.859537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.328238+0000","last_change":"2023-10-17T06:08:51.632271+0000","last_active":"2023-10-17T06:08:53.328238+0000","last_peered":"2023-10-17T06:08:53.328238+0000","last_clean":"2023-10-17T06:08:53.328238+0000","last_became_active":"2023-10-17T06:08:51.631974+0000","last_became_peered":"2023-10-17T06:08:51.631974+0000","last_unstale":"2023-10-17T06:08:53.328238+0000","last_undegraded":"2023-10-17T06:08:53.328238+0000","last_fullsized":"2023-10-17T06:08:53.328238+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:39:12.635597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.328920+0000","last_change":"2023-10-17T06:08:50.885270+0000","last_active":"2023-10-17T06:08:53.328920+0000","last_peered":"2023-10-17T06:08:53.328920+0000","last_clean":"2023-10-17T06:08:53.328920+0000","last_became_active":"2023-10-17T06:08:50.885002+0000","last_became_peered":"2023-10-17T06:08:50.885002+0000","last_unstale":"2023-10-17T06:08:53.328920+0000","last_undegraded":"2023-10-17T06:08:53.328920+0000","last_fullsized":"2023-10-17T06:08:53.328920+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:11:19.516296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509142+0000","last_change":"2023-10-17T06:08:51.619616+0000","last_active":"2023-10-17T06:08:53.509142+0000","last_peered":"2023-10-17T06:08:53.509142+0000","last_clean":"2023-10-17T06:08:53.509142+0000","last_became_active":"2023-10-17T06:08:51.619069+0000","last_became_peered":"2023-10-17T06:08:51.619069+0000","last_unstale":"2023-10-17T06:08:53.509142+0000","last_undegraded":"2023-10-17T06:08:53.509142+0000","last_fullsized":"2023-10-17T06:08:53.509142+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:15:47.678075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"42'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508933+0000","last_change":"2023-10-17T06:08:50.889812+0000","last_active":"2023-10-17T06:08:53.508933+0000","last_peered":"2023-10-17T06:08:53.508933+0000","last_clean":"2023-10-17T06:08:53.508933+0000","last_became_active":"2023-10-17T06:08:50.889503+0000","last_became_peered":"2023-10-17T06:08:50.889503+0000","last_unstale":"2023-10-17T06:08:53.508933+0000","last_undegraded":"2023-10-17T06:08:53.508933+0000","last_fullsized":"2023-10-17T06:08:53.508933+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:09:38.190681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.021561+0000","last_change":"2023-10-17T06:08:51.630549+0000","last_active":"2023-10-17T06:08:53.021561+0000","last_peered":"2023-10-17T06:08:53.021561+0000","last_clean":"2023-10-17T06:08:53.021561+0000","last_became_active":"2023-10-17T06:08:51.629516+0000","last_became_peered":"2023-10-17T06:08:51.629516+0000","last_unstale":"2023-10-17T06:08:53.021561+0000","last_undegraded":"2023-10-17T06:08:53.021561+0000","last_fullsized":"2023-10-17T06:08:53.021561+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:13:46.230861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.021633+0000","last_change":"2023-10-17T06:08:50.876113+0000","last_active":"2023-10-17T06:08:53.021633+0000","last_peered":"2023-10-17T06:08:53.021633+0000","last_clean":"2023-10-17T06:08:53.021633+0000","last_became_active":"2023-10-17T06:08:50.875838+0000","last_became_peered":"2023-10-17T06:08:50.875838+0000","last_unstale":"2023-10-17T06:08:53.021633+0000","last_undegraded":"2023-10-17T06:08:53.021633+0000","last_fullsized":"2023-10-17T06:08:53.021633+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:52:41.686561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509142+0000","last_change":"2023-10-17T06:08:51.622643+0000","last_active":"2023-10-17T06:08:53.509142+0000","last_peered":"2023-10-17T06:08:53.509142+0000","last_clean":"2023-10-17T06:08:53.509142+0000","last_became_active":"2023-10-17T06:08:51.622160+0000","last_became_peered":"2023-10-17T06:08:51.622160+0000","last_unstale":"2023-10-17T06:08:53.509142+0000","last_undegraded":"2023-10-17T06:08:53.509142+0000","last_fullsized":"2023-10-17T06:08:53.509142+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:08:06.249722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605566+0000","last_change":"2023-10-17T06:08:50.880729+0000","last_active":"2023-10-17T06:08:52.605566+0000","last_peered":"2023-10-17T06:08:52.605566+0000","last_clean":"2023-10-17T06:08:52.605566+0000","last_became_active":"2023-10-17T06:08:50.880409+0000","last_became_peered":"2023-10-17T06:08:50.880409+0000","last_unstale":"2023-10-17T06:08:52.605566+0000","last_undegraded":"2023-10-17T06:08:52.605566+0000","last_fullsized":"2023-10-17T06:08:52.605566+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:06:27.421438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510903+0000","last_change":"2023-10-17T06:08:51.629855+0000","last_active":"2023-10-17T06:08:53.510903+0000","last_peered":"2023-10-17T06:08:53.510903+0000","last_clean":"2023-10-17T06:08:53.510903+0000","last_became_active":"2023-10-17T06:08:51.629376+0000","last_became_peered":"2023-10-17T06:08:51.629376+0000","last_unstale":"2023-10-17T06:08:53.510903+0000","last_undegraded":"2023-10-17T06:08:53.510903+0000","last_fullsized":"2023-10-17T06:08:53.510903+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:38:40.954417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.604975+0000","last_change":"2023-10-17T06:08:50.885401+0000","last_active":"2023-10-17T06:08:52.604975+0000","last_peered":"2023-10-17T06:08:52.604975+0000","last_clean":"2023-10-17T06:08:52.604975+0000","last_became_active":"2023-10-17T06:08:50.885069+0000","last_became_peered":"2023-10-17T06:08:50.885069+0000","last_unstale":"2023-10-17T06:08:52.604975+0000","last_undegraded":"2023-10-17T06:08:52.604975+0000","last_fullsized":"2023-10-17T06:08:52.604975+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:08:46.227092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510721+0000","last_change":"2023-10-17T06:08:51.623538+0000","last_active":"2023-10-17T06:08:53.510721+0000","last_peered":"2023-10-17T06:08:53.510721+0000","last_clean":"2023-10-17T06:08:53.510721+0000","last_became_active":"2023-10-17T06:08:51.622453+0000","last_became_peered":"2023-10-17T06:08:51.622453+0000","last_unstale":"2023-10-17T06:08:53.510721+0000","last_undegraded":"2023-10-17T06:08:53.510721+0000","last_fullsized":"2023-10-17T06:08:53.510721+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:34:08.138670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.329079+0000","last_change":"2023-10-17T06:08:50.892712+0000","last_active":"2023-10-17T06:08:53.329079+0000","last_peered":"2023-10-17T06:08:53.329079+0000","last_clean":"2023-10-17T06:08:53.329079+0000","last_became_active":"2023-10-17T06:08:50.892420+0000","last_became_peered":"2023-10-17T06:08:50.892420+0000","last_unstale":"2023-10-17T06:08:53.329079+0000","last_undegraded":"2023-10-17T06:08:53.329079+0000","last_fullsized":"2023-10-17T06:08:53.329079+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:52:42.032927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.328452+0000","last_change":"2023-10-17T06:08:51.620443+0000","last_active":"2023-10-17T06:08:53.328452+0000","last_peered":"2023-10-17T06:08:53.328452+0000","last_clean":"2023-10-17T06:08:53.328452+0000","last_became_active":"2023-10-17T06:08:51.620170+0000","last_became_peered":"2023-10-17T06:08:51.620170+0000","last_unstale":"2023-10-17T06:08:53.328452+0000","last_undegraded":"2023-10-17T06:08:53.328452+0000","last_fullsized":"2023-10-17T06:08:53.328452+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:50:50.668888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.329304+0000","last_change":"2023-10-17T06:08:50.883762+0000","last_active":"2023-10-17T06:08:53.329304+0000","last_peered":"2023-10-17T06:08:53.329304+0000","last_clean":"2023-10-17T06:08:53.329304+0000","last_became_active":"2023-10-17T06:08:50.883129+0000","last_became_peered":"2023-10-17T06:08:50.883129+0000","last_unstale":"2023-10-17T06:08:53.329304+0000","last_undegraded":"2023-10-17T06:08:53.329304+0000","last_fullsized":"2023-10-17T06:08:53.329304+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:33:46.793483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.602292+0000","last_change":"2023-10-17T06:08:51.616031+0000","last_active":"2023-10-17T06:08:52.602292+0000","last_peered":"2023-10-17T06:08:52.602292+0000","last_clean":"2023-10-17T06:08:52.602292+0000","last_became_active":"2023-10-17T06:08:51.615697+0000","last_became_peered":"2023-10-17T06:08:51.615697+0000","last_unstale":"2023-10-17T06:08:52.602292+0000","last_undegraded":"2023-10-17T06:08:52.602292+0000","last_fullsized":"2023-10-17T06:08:52.602292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:35:57.731152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.604279+0000","last_change":"2023-10-17T06:08:50.895934+0000","last_active":"2023-10-17T06:08:52.604279+0000","last_peered":"2023-10-17T06:08:52.604279+0000","last_clean":"2023-10-17T06:08:52.604279+0000","last_became_active":"2023-10-17T06:08:50.895590+0000","last_became_peered":"2023-10-17T06:08:50.895590+0000","last_unstale":"2023-10-17T06:08:52.604279+0000","last_undegraded":"2023-10-17T06:08:52.604279+0000","last_fullsized":"2023-10-17T06:08:52.604279+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:50:49.652835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.021210+0000","last_change":"2023-10-17T06:08:51.629154+0000","last_active":"2023-10-17T06:08:53.021210+0000","last_peered":"2023-10-17T06:08:53.021210+0000","last_clean":"2023-10-17T06:08:53.021210+0000","last_became_active":"2023-10-17T06:08:51.622432+0000","last_became_peered":"2023-10-17T06:08:51.622432+0000","last_unstale":"2023-10-17T06:08:53.021210+0000","last_undegraded":"2023-10-17T06:08:53.021210+0000","last_fullsized":"2023-10-17T06:08:53.021210+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:37:13.721684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508666+0000","last_change":"2023-10-17T06:08:50.890104+0000","last_active":"2023-10-17T06:08:53.508666+0000","last_peered":"2023-10-17T06:08:53.508666+0000","last_clean":"2023-10-17T06:08:53.508666+0000","last_became_active":"2023-10-17T06:08:50.889803+0000","last_became_peered":"2023-10-17T06:08:50.889803+0000","last_unstale":"2023-10-17T06:08:53.508666+0000","last_undegraded":"2023-10-17T06:08:53.508666+0000","last_fullsized":"2023-10-17T06:08:53.508666+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:02:45.401699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508167+0000","last_change":"2023-10-17T06:08:51.625246+0000","last_active":"2023-10-17T06:08:53.508167+0000","last_peered":"2023-10-17T06:08:53.508167+0000","last_clean":"2023-10-17T06:08:53.508167+0000","last_became_active":"2023-10-17T06:08:51.624934+0000","last_became_peered":"2023-10-17T06:08:51.624934+0000","last_unstale":"2023-10-17T06:08:53.508167+0000","last_undegraded":"2023-10-17T06:08:53.508167+0000","last_fullsized":"2023-10-17T06:08:53.508167+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:56:36.521426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509011+0000","last_change":"2023-10-17T06:08:50.884156+0000","last_active":"2023-10-17T06:08:53.509011+0000","last_peered":"2023-10-17T06:08:53.509011+0000","last_clean":"2023-10-17T06:08:53.509011+0000","last_became_active":"2023-10-17T06:08:50.883413+0000","last_became_peered":"2023-10-17T06:08:50.883413+0000","last_unstale":"2023-10-17T06:08:53.509011+0000","last_undegraded":"2023-10-17T06:08:53.509011+0000","last_fullsized":"2023-10-17T06:08:53.509011+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:05:53.606534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.329072+0000","last_change":"2023-10-17T06:08:51.615114+0000","last_active":"2023-10-17T06:08:53.329072+0000","last_peered":"2023-10-17T06:08:53.329072+0000","last_clean":"2023-10-17T06:08:53.329072+0000","last_became_active":"2023-10-17T06:08:51.614844+0000","last_became_peered":"2023-10-17T06:08:51.614844+0000","last_unstale":"2023-10-17T06:08:53.329072+0000","last_undegraded":"2023-10-17T06:08:53.329072+0000","last_fullsized":"2023-10-17T06:08:53.329072+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T18:03:55.348763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509910+0000","last_change":"2023-10-17T06:08:50.889772+0000","last_active":"2023-10-17T06:08:53.509910+0000","last_peered":"2023-10-17T06:08:53.509910+0000","last_clean":"2023-10-17T06:08:53.509910+0000","last_became_active":"2023-10-17T06:08:50.889476+0000","last_became_peered":"2023-10-17T06:08:50.889476+0000","last_unstale":"2023-10-17T06:08:53.509910+0000","last_undegraded":"2023-10-17T06:08:53.509910+0000","last_fullsized":"2023-10-17T06:08:53.509910+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:37:56.512532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.511405+0000","last_change":"2023-10-17T06:07:02.749481+0000","last_active":"2023-10-17T06:08:53.511405+0000","last_peered":"2023-10-17T06:08:53.511405+0000","last_clean":"2023-10-17T06:08:53.511405+0000","last_became_active":"2023-10-17T06:07:02.748983+0000","last_became_peered":"2023-10-17T06:07:02.748983+0000","last_unstale":"2023-10-17T06:08:53.511405+0000","last_undegraded":"2023-10-17T06:08:53.511405+0000","last_fullsized":"2023-10-17T06:08:53.511405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:26:38.406806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.328834+0000","last_change":"2023-10-17T06:08:51.633045+0000","last_active":"2023-10-17T06:08:53.328834+0000","last_peered":"2023-10-17T06:08:53.328834+0000","last_clean":"2023-10-17T06:08:53.328834+0000","last_became_active":"2023-10-17T06:08:51.632787+0000","last_became_peered":"2023-10-17T06:08:51.632787+0000","last_unstale":"2023-10-17T06:08:53.328834+0000","last_undegraded":"2023-10-17T06:08:53.328834+0000","last_fullsized":"2023-10-17T06:08:53.328834+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:48:58.485288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.605262+0000","last_change":"2023-10-17T06:08:50.874757+0000","last_active":"2023-10-17T06:08:52.605262+0000","last_peered":"2023-10-17T06:08:52.605262+0000","last_clean":"2023-10-17T06:08:52.605262+0000","last_became_active":"2023-10-17T06:08:50.874406+0000","last_became_peered":"2023-10-17T06:08:50.874406+0000","last_unstale":"2023-10-17T06:08:52.605262+0000","last_undegraded":"2023-10-17T06:08:52.605262+0000","last_fullsized":"2023-10-17T06:08:52.605262+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:37:04.461520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.603190+0000","last_change":"2023-10-17T06:07:02.746809+0000","last_active":"2023-10-17T06:08:52.603190+0000","last_peered":"2023-10-17T06:08:52.603190+0000","last_clean":"2023-10-17T06:08:52.603190+0000","last_became_active":"2023-10-17T06:07:02.746404+0000","last_became_peered":"2023-10-17T06:07:02.746404+0000","last_unstale":"2023-10-17T06:08:52.603190+0000","last_undegraded":"2023-10-17T06:08:52.603190+0000","last_fullsized":"2023-10-17T06:08:52.603190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:59:36.522271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.604369+0000","last_change":"2023-10-17T06:08:51.610733+0000","last_active":"2023-10-17T06:08:52.604369+0000","last_peered":"2023-10-17T06:08:52.604369+0000","last_clean":"2023-10-17T06:08:52.604369+0000","last_became_active":"2023-10-17T06:08:51.610442+0000","last_became_peered":"2023-10-17T06:08:51.610442+0000","last_unstale":"2023-10-17T06:08:52.604369+0000","last_undegraded":"2023-10-17T06:08:52.604369+0000","last_fullsized":"2023-10-17T06:08:52.604369+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:30:46.066994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.602201+0000","last_change":"2023-10-17T06:08:50.895276+0000","last_active":"2023-10-17T06:08:52.602201+0000","last_peered":"2023-10-17T06:08:52.602201+0000","last_clean":"2023-10-17T06:08:52.602201+0000","last_became_active":"2023-10-17T06:08:50.895028+0000","last_became_peered":"2023-10-17T06:08:50.895028+0000","last_unstale":"2023-10-17T06:08:52.602201+0000","last_undegraded":"2023-10-17T06:08:52.602201+0000","last_fullsized":"2023-10-17T06:08:52.602201+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:14:50.959291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510310+0000","last_change":"2023-10-17T06:07:02.943274+0000","last_active":"2023-10-17T06:08:53.510310+0000","last_peered":"2023-10-17T06:08:53.510310+0000","last_clean":"2023-10-17T06:08:53.510310+0000","last_became_active":"2023-10-17T06:07:02.942674+0000","last_became_peered":"2023-10-17T06:07:02.942674+0000","last_unstale":"2023-10-17T06:08:53.510310+0000","last_undegraded":"2023-10-17T06:08:53.510310+0000","last_fullsized":"2023-10-17T06:08:53.510310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T08:22:35.511370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.603760+0000","last_change":"2023-10-17T06:08:51.628882+0000","last_active":"2023-10-17T06:08:52.603760+0000","last_peered":"2023-10-17T06:08:52.603760+0000","last_clean":"2023-10-17T06:08:52.603760+0000","last_became_active":"2023-10-17T06:08:51.628591+0000","last_became_peered":"2023-10-17T06:08:51.628591+0000","last_unstale":"2023-10-17T06:08:52.603760+0000","last_undegraded":"2023-10-17T06:08:52.603760+0000","last_fullsized":"2023-10-17T06:08:52.603760+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:08:25.822120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.508909+0000","last_change":"2023-10-17T06:08:50.891017+0000","last_active":"2023-10-17T06:08:53.508909+0000","last_peered":"2023-10-17T06:08:53.508909+0000","last_clean":"2023-10-17T06:08:53.508909+0000","last_became_active":"2023-10-17T06:08:50.890683+0000","last_became_peered":"2023-10-17T06:08:50.890683+0000","last_unstale":"2023-10-17T06:08:53.508909+0000","last_undegraded":"2023-10-17T06:08:53.508909+0000","last_fullsized":"2023-10-17T06:08:53.508909+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:49:15.453331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.602467+0000","last_change":"2023-10-17T06:07:02.943009+0000","last_active":"2023-10-17T06:08:52.602467+0000","last_peered":"2023-10-17T06:08:52.602467+0000","last_clean":"2023-10-17T06:08:52.602467+0000","last_became_active":"2023-10-17T06:07:02.942298+0000","last_became_peered":"2023-10-17T06:07:02.942298+0000","last_unstale":"2023-10-17T06:08:52.602467+0000","last_undegraded":"2023-10-17T06:08:52.602467+0000","last_fullsized":"2023-10-17T06:08:52.602467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:10:46.425574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.511347+0000","last_change":"2023-10-17T06:08:51.631688+0000","last_active":"2023-10-17T06:08:53.511347+0000","last_peered":"2023-10-17T06:08:53.511347+0000","last_clean":"2023-10-17T06:08:53.511347+0000","last_became_active":"2023-10-17T06:08:51.631422+0000","last_became_peered":"2023-10-17T06:08:51.631422+0000","last_unstale":"2023-10-17T06:08:53.511347+0000","last_undegraded":"2023-10-17T06:08:53.511347+0000","last_fullsized":"2023-10-17T06:08:53.511347+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:45:52.254974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.329256+0000","last_change":"2023-10-17T06:08:50.881923+0000","last_active":"2023-10-17T06:08:53.329256+0000","last_peered":"2023-10-17T06:08:53.329256+0000","last_clean":"2023-10-17T06:08:53.329256+0000","last_became_active":"2023-10-17T06:08:50.881636+0000","last_became_peered":"2023-10-17T06:08:50.881636+0000","last_unstale":"2023-10-17T06:08:53.329256+0000","last_undegraded":"2023-10-17T06:08:53.329256+0000","last_fullsized":"2023-10-17T06:08:53.329256+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:01:33.676414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.604577+0000","last_change":"2023-10-17T06:07:02.747287+0000","last_active":"2023-10-17T06:08:52.604577+0000","last_peered":"2023-10-17T06:08:52.604577+0000","last_clean":"2023-10-17T06:08:52.604577+0000","last_became_active":"2023-10-17T06:07:02.746659+0000","last_became_peered":"2023-10-17T06:07:02.746659+0000","last_unstale":"2023-10-17T06:08:52.604577+0000","last_undegraded":"2023-10-17T06:08:52.604577+0000","last_fullsized":"2023-10-17T06:08:52.604577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:12:15.649980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509057+0000","last_change":"2023-10-17T06:08:51.635250+0000","last_active":"2023-10-17T06:08:53.509057+0000","last_peered":"2023-10-17T06:08:53.509057+0000","last_clean":"2023-10-17T06:08:53.509057+0000","last_became_active":"2023-10-17T06:08:51.634940+0000","last_became_peered":"2023-10-17T06:08:51.634940+0000","last_unstale":"2023-10-17T06:08:53.509057+0000","last_undegraded":"2023-10-17T06:08:53.509057+0000","last_fullsized":"2023-10-17T06:08:53.509057+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:11:45.618014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510185+0000","last_change":"2023-10-17T06:08:50.887360+0000","last_active":"2023-10-17T06:08:53.510185+0000","last_peered":"2023-10-17T06:08:53.510185+0000","last_clean":"2023-10-17T06:08:53.510185+0000","last_became_active":"2023-10-17T06:08:50.886985+0000","last_became_peered":"2023-10-17T06:08:50.886985+0000","last_unstale":"2023-10-17T06:08:53.510185+0000","last_undegraded":"2023-10-17T06:08:53.510185+0000","last_fullsized":"2023-10-17T06:08:53.510185+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T10:09:30.715349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":55,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.020850+0000","last_change":"2023-10-17T06:07:02.746785+0000","last_active":"2023-10-17T06:08:53.020850+0000","last_peered":"2023-10-17T06:08:53.020850+0000","last_clean":"2023-10-17T06:08:53.020850+0000","last_became_active":"2023-10-17T06:07:02.746431+0000","last_became_peered":"2023-10-17T06:07:02.746431+0000","last_unstale":"2023-10-17T06:08:53.020850+0000","last_undegraded":"2023-10-17T06:08:53.020850+0000","last_fullsized":"2023-10-17T06:08:53.020850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:09:19.524022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.510015+0000","last_change":"2023-10-17T06:08:51.632802+0000","last_active":"2023-10-17T06:08:53.510015+0000","last_peered":"2023-10-17T06:08:53.510015+0000","last_clean":"2023-10-17T06:08:53.510015+0000","last_became_active":"2023-10-17T06:08:51.632551+0000","last_became_peered":"2023-10-17T06:08:51.632551+0000","last_unstale":"2023-10-17T06:08:53.510015+0000","last_undegraded":"2023-10-17T06:08:53.510015+0000","last_fullsized":"2023-10-17T06:08:53.510015+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:21:53.523337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.602519+0000","last_change":"2023-10-17T06:08:50.886606+0000","last_active":"2023-10-17T06:08:52.602519+0000","last_peered":"2023-10-17T06:08:52.602519+0000","last_clean":"2023-10-17T06:08:52.602519+0000","last_became_active":"2023-10-17T06:08:50.886309+0000","last_became_peered":"2023-10-17T06:08:50.886309+0000","last_unstale":"2023-10-17T06:08:52.602519+0000","last_undegraded":"2023-10-17T06:08:52.602519+0000","last_fullsized":"2023-10-17T06:08:52.602519+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:32:03.949802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509294+0000","last_change":"2023-10-17T06:07:02.746953+0000","last_active":"2023-10-17T06:08:53.509294+0000","last_peered":"2023-10-17T06:08:53.509294+0000","last_clean":"2023-10-17T06:08:53.509294+0000","last_became_active":"2023-10-17T06:07:02.746344+0000","last_became_peered":"2023-10-17T06:07:02.746344+0000","last_unstale":"2023-10-17T06:08:53.509294+0000","last_undegraded":"2023-10-17T06:08:53.509294+0000","last_fullsized":"2023-10-17T06:08:53.509294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:50:42.035196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509249+0000","last_change":"2023-10-17T06:08:51.619915+0000","last_active":"2023-10-17T06:08:53.509249+0000","last_peered":"2023-10-17T06:08:53.509249+0000","last_clean":"2023-10-17T06:08:53.509249+0000","last_became_active":"2023-10-17T06:08:51.619596+0000","last_became_peered":"2023-10-17T06:08:51.619596+0000","last_unstale":"2023-10-17T06:08:53.509249+0000","last_undegraded":"2023-10-17T06:08:53.509249+0000","last_fullsized":"2023-10-17T06:08:53.509249+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:50.845310+0000","last_clean_scrub_stamp":"2023-10-17T06:08:50.845310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:28:02.150411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.606042+0000","last_change":"2023-10-17T06:08:50.889323+0000","last_active":"2023-10-17T06:08:52.606042+0000","last_peered":"2023-10-17T06:08:52.606042+0000","last_clean":"2023-10-17T06:08:52.606042+0000","last_became_active":"2023-10-17T06:08:50.888998+0000","last_became_peered":"2023-10-17T06:08:50.888998+0000","last_unstale":"2023-10-17T06:08:52.606042+0000","last_undegraded":"2023-10-17T06:08:52.606042+0000","last_fullsized":"2023-10-17T06:08:52.606042+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:08:49.829257+0000","last_clean_scrub_stamp":"2023-10-17T06:08:49.829257+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:33:46.793483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:52.604828+0000","last_change":"2023-10-17T06:07:02.747957+0000","last_active":"2023-10-17T06:08:52.604828+0000","last_peered":"2023-10-17T06:08:52.604828+0000","last_clean":"2023-10-17T06:08:52.604828+0000","last_became_active":"2023-10-17T06:07:02.747569+0000","last_became_peered":"2023-10-17T06:07:02.747569+0000","last_unstale":"2023-10-17T06:08:52.604828+0000","last_undegraded":"2023-10-17T06:08:52.604828+0000","last_fullsized":"2023-10-17T06:08:52.604828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:09:31.392916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":211,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-17T06:08:53.509241+0000","last_change":"2023-10-17T06:06:55.916050+0000","last_active":"2023-10-17T06:08:53.509241+0000","last_peered":"2023-10-17T06:08:53.509241+0000","last_clean":"2023-10-17T06:08:53.509241+0000","last_became_active":"2023-10-17T06:06:55.914009+0000","last_became_peered":"2023-10-17T06:06:55.914009+0000","last_unstale":"2023-10-17T06:08:53.509241+0000","last_undegraded":"2023-10-17T06:08:53.509241+0000","last_fullsized":"2023-10-17T06:08:53.509241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:06:54.658926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:06:54.658926+0000","last_clean_scrub_stamp":"2023-10-17T06:06:54.658926+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T07:47:31.450687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509466,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":499712,"data_stored":221607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":1.139},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.78100000000000003}]},{"osd":1,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.94399999999999995}]},{"osd":2,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.0900000000000001}]},{"osd":3,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.0739999999999998,"5min":2.0739999999999998,"15min":2.0739999999999998},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.90100000000000002}]},{"osd":4,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":1.506},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.1739999999999999}]},{"osd":5,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.198},{"interface":"front","average":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"min":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":1.393}]},{"osd":7,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":2.1989999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":1.466}]}]},{"osd":5,"up_from":15,"seq":64424509467,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":495616,"data_stored":221005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":5.2919999999999998,"5min":5.2919999999999998,"15min":5.2919999999999998},"last":1.2050000000000001}]},{"osd":1,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.3819999999999999}]},{"osd":2,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.597,"15min":1.597},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":5.3700000000000001,"5min":5.3700000000000001,"15min":5.3700000000000001},"last":1.571},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.155}]},{"osd":3,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.998,"5min":0.998,"15min":0.998},"max":{"1min":5.3230000000000004,"5min":5.3230000000000004,"15min":5.3230000000000004},"last":1.248}]},{"osd":4,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.653,"5min":2.653,"15min":2.653},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":3.3820000000000001,"5min":3.3820000000000001,"15min":3.3820000000000001},"last":1.508}]},{"osd":6,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":2.702,"5min":2.702,"15min":2.702},"last":1.4830000000000001}]},{"osd":7,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.639,"5min":1.639,"15min":1.639},"min":{"1min":1.129,"5min":1.129,"15min":1.129},"max":{"1min":2.544,"5min":2.544,"15min":2.544},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":2.8929999999999998},"last":1.4530000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509466,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":503808,"data_stored":222547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:07:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.474},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":1.0429999999999999}]},{"osd":1,"last update":"Tue Oct 17 06:07:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.145},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.377}]},{"osd":2,"last update":"Tue Oct 17 06:07:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.1970000000000001}]},{"osd":3,"last update":"Tue Oct 17 06:07:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.431},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.4079999999999999}]},{"osd":5,"last update":"Tue Oct 17 06:07:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":1.518}]},{"osd":6,"last update":"Tue Oct 17 06:07:57 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":3.2120000000000002,"5min":3.2120000000000002,"15min":3.2120000000000002},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"max":{"1min":2.1099999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.6279999999999999}]},{"osd":7,"last update":"Tue Oct 17 06:07:57 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"max":{"1min":2.3079999999999998,"5min":2.3079999999999998,"15min":2.3079999999999998},"last":1.3380000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1089536,"data_stored":811393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.80600000000000005}]},{"osd":1,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":5.0519999999999996,"5min":5.0519999999999996,"15min":5.0519999999999996},"last":1.296},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.254}]},{"osd":2,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.149},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.3720000000000001}]},{"osd":3,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":2.1349999999999998},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":5.1269999999999998,"5min":5.1269999999999998,"15min":5.1269999999999998},"last":1.1839999999999999}]},{"osd":4,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.857,"5min":1.857,"15min":1.857},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":2.1499999999999999,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.92000000000000004}]},{"osd":5,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.86499999999999999}]},{"osd":6,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":1.056},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.4330000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":214600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":4.6760000000000002,"5min":4.6760000000000002,"15min":4.6760000000000002},"last":1.597},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.68500000000000005}]},{"osd":1,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":4.3719999999999999,"5min":4.3719999999999999,"15min":4.3719999999999999},"last":1.091},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":4.2359999999999998,"5min":4.2359999999999998,"15min":4.2359999999999998},"last":0.92200000000000004}]},{"osd":2,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":4.4660000000000002,"5min":4.4660000000000002,"15min":4.4660000000000002},"last":1.232},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":3.798,"5min":3.798,"15min":3.798},"last":1.518}]},{"osd":4,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":4.907,"5min":4.907,"15min":4.907},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"last":1.0760000000000001}]},{"osd":5,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":4.5549999999999997,"5min":4.5549999999999997,"15min":4.5549999999999997},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":5.0789999999999997,"5min":5.0789999999999997,"15min":5.0789999999999997},"last":1.425}]},{"osd":6,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":4.5190000000000001,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":1.556}]},{"osd":7,"last update":"Tue Oct 17 06:07:56 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.1190000000000002,"5min":2.1190000000000002,"15min":2.1190000000000002},"last":1.47},{"interface":"front","average":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":4.5899999999999999,"5min":4.5899999999999999,"15min":4.5899999999999999},"last":1.6699999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":222569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":1.181},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.80700000000000005}]},{"osd":1,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":0.58199999999999996}]},{"osd":3,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.97599999999999998}]},{"osd":4,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.089},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.272}]},{"osd":5,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.492},{"interface":"front","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.206}]},{"osd":6,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.643},{"interface":"front","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.1359999999999999}]},{"osd":7,"last update":"Tue Oct 17 06:07:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.9809999999999999,"5min":2.9809999999999999,"15min":2.9809999999999999},"last":1.552},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.371}]}]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":495616,"data_stored":221005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:07:58 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.629},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":0.94099999999999995}]},{"osd":2,"last update":"Tue Oct 17 06:07:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.468,"5min":2.468,"15min":2.468},"last":0.60399999999999998}]},{"osd":3,"last update":"Tue Oct 17 06:07:58 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":4.6920000000000002,"5min":4.6920000000000002,"15min":4.6920000000000002},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.86199999999999999}]},{"osd":4,"last update":"Tue Oct 17 06:07:58 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.03},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":2.871,"5min":2.871,"15min":2.871},"last":1.145}]},{"osd":5,"last update":"Tue Oct 17 06:07:58 2023","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":3.032,"5min":3.032,"15min":3.032},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":4.819,"5min":4.819,"15min":4.819},"last":1.097}]},{"osd":6,"last update":"Tue Oct 17 06:07:58 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":4.9900000000000002,"5min":4.9900000000000002,"15min":4.9900000000000002},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.177}]},{"osd":7,"last update":"Tue Oct 17 06:07:58 2023","interfaces":[{"interface":"back","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":2.677,"5min":2.677,"15min":2.677},"last":1.24},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":2.9529999999999998,"5min":2.9529999999999998,"15min":2.9529999999999998},"last":1.202}]}]},{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1073152,"data_stored":802373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.292},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.3340000000000001,"5min":2.3340000000000001,"15min":2.3340000000000001},"last":0.88900000000000001}]},{"osd":2,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":4.407,"5min":4.407,"15min":4.407},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.5659999999999998,"5min":2.5659999999999998,"15min":2.5659999999999998},"last":0.82199999999999995}]},{"osd":3,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.093},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":4.4269999999999996,"5min":4.4269999999999996,"15min":4.4269999999999996},"last":0.98099999999999998}]},{"osd":4,"last update":"Tue Oct 17 06:07:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":3.4820000000000002,"5min":3.4820000000000002,"15min":3.4820000000000002},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":3.8079999999999998,"5min":3.8079999999999998,"15min":3.8079999999999998},"last":1.4059999999999999}]},{"osd":5,"last update":"Tue Oct 17 06:07:59 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":3.2120000000000002,"5min":3.2120000000000002,"15min":3.2120000000000002},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"max":{"1min":4.3849999999999998,"5min":4.3849999999999998,"15min":4.3849999999999998},"last":1.258}]},{"osd":6,"last update":"Tue Oct 17 06:07:59 2023","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":4.3499999999999996,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":1.337},{"interface":"front","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.143}]},{"osd":7,"last update":"Tue Oct 17 06:07:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.377},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":1.083,"5min":1.083,"15min":1.083},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":1.5189999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-17T06:08:56.701 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-17T06:08:56.702 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-17T06:08:56.783 INFO:tasks.ceph.mds.c.smithi125.stderr:2023-10-17T06:08:56.778+0000 7f0a072e7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-17T06:08:56.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.914+0000 7f6d62fef700 1 Processor -- start 2023-10-17T06:08:56.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.918+0000 7f6d62fef700 1 -- start start 2023-10-17T06:08:56.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.918+0000 7f6d62fef700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d5c144150 0x7f6d5c0cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:56.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.918+0000 7f6d62fef700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6d5c0ce1a0 0x7f6d5c0cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:56.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.918+0000 7f6d62fef700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5c070de0 con 0x7f6d5c0cbde0 2023-10-17T06:08:56.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.918+0000 7f6d62fef700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d5c0cc270 con 0x7f6d5c0ce1a0 2023-10-17T06:08:56.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.918+0000 7f6d62fef700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c0701d0 con 0x7f6d5c144150 2023-10-17T06:08:56.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.922+0000 7f6d617ec700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6d5c0ce1a0 0x7f6d5c0cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:56.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.922+0000 7f6d61fed700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d5c144150 0x7f6d5c0cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:56.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.922+0000 7f6d617ec700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6d5c0ce1a0 0x7f6d5c0cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41898/0 (socket says 172.21.15.125:41898) 2023-10-17T06:08:56.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.922+0000 7f6d617ec700 1 -- 172.21.15.125:0/1533620386 learned_addr learned my addr 172.21.15.125:0/1533620386 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:56.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.922+0000 7f6d617ec700 1 -- 172.21.15.125:0/1533620386 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d5c144150 msgr2=0x7f6d5c0cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:56.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.922+0000 7f6d617ec700 1 --2- 172.21.15.125:0/1533620386 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d5c144150 0x7f6d5c0cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:56.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.922+0000 7f6d617ec700 1 -- 172.21.15.125:0/1533620386 >> v1:172.21.15.184:6789/0 conn(0x7f6d5c0cbde0 legacy=0x7f6d5c15e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:56.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.922+0000 7f6d617ec700 1 -- 172.21.15.125:0/1533620386 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c0704b0 con 0x7f6d5c0ce1a0 2023-10-17T06:08:56.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.922+0000 7f6d617ec700 1 --2- 172.21.15.125:0/1533620386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d5c0ce1a0 0x7f6d5c0cb8a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009910 tx=0x7f6d4c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c58e34d6e031e1a server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:56.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.922+0000 7f6d60feb700 1 -- 172.21.15.125:0/1533620386 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c004230 con 0x7f6d5c0ce1a0 2023-10-17T06:08:56.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.922+0000 7f6d60feb700 1 -- 172.21.15.125:0/1533620386 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4c004390 con 0x7f6d5c0ce1a0 2023-10-17T06:08:56.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.922+0000 7f6d60feb700 1 -- 172.21.15.125:0/1533620386 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c0036c0 con 0x7f6d5c0ce1a0 2023-10-17T06:08:56.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.922+0000 7f6d62fef700 1 -- 172.21.15.125:0/1533620386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d5c0ce1a0 msgr2=0x7f6d5c0cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:56.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.922+0000 7f6d62fef700 1 --2- 172.21.15.125:0/1533620386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d5c0ce1a0 0x7f6d5c0cb8a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009910 tx=0x7f6d4c009c20 comp rx=0 tx=0).stop 2023-10-17T06:08:56.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.922+0000 7f6d62fef700 1 -- 172.21.15.125:0/1533620386 shutdown_connections 2023-10-17T06:08:56.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.922+0000 7f6d62fef700 1 --2- 172.21.15.125:0/1533620386 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d5c0ce1a0 0x7f6d5c0cb8a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:56.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.922+0000 7f6d62fef700 1 --2- 172.21.15.125:0/1533620386 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d5c144150 0x7f6d5c0cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:56.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.922+0000 7f6d62fef700 1 -- 172.21.15.125:0/1533620386 >> 172.21.15.125:0/1533620386 conn(0x7f6d5c0b0bf0 msgr2=0x7f6d5c0ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:56.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.922+0000 7f6d62fef700 1 -- 172.21.15.125:0/1533620386 shutdown_connections 2023-10-17T06:08:56.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.922+0000 7f6d62fef700 1 -- 172.21.15.125:0/1533620386 wait complete. 2023-10-17T06:08:56.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.926+0000 7f6d62fef700 1 Processor -- start 2023-10-17T06:08:56.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.926+0000 7f6d62fef700 1 -- start start 2023-10-17T06:08:56.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.926+0000 7f6d62fef700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d5c0cbde0 0x7f6d5c138990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:56.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.926+0000 7f6d62fef700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d5c0ce1a0 0x7f6d5c15d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:56.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.926+0000 7f6d62fef700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d5c144150 0x7f6d5c14acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:56.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.926+0000 7f6d62fef700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c149d20 con 0x7f6d5c0ce1a0 2023-10-17T06:08:56.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.926+0000 7f6d62fef700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c149f30 con 0x7f6d5c144150 2023-10-17T06:08:56.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.926+0000 7f6d62fef700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c14a210 con 0x7f6d5c0cbde0 2023-10-17T06:08:56.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.926+0000 7f6d617ec700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d5c0ce1a0 0x7f6d5c15d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:56.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.926+0000 7f6d617ec700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d5c0ce1a0 0x7f6d5c15d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41900/0 (socket says 172.21.15.125:41900) 2023-10-17T06:08:56.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.926+0000 7f6d617ec700 1 -- 172.21.15.125:0/2813046204 learned_addr learned my addr 172.21.15.125:0/2813046204 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:56.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.926+0000 7f6d61fed700 1 --2- 172.21.15.125:0/2813046204 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d5c0cbde0 0x7f6d5c138990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:56.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.926+0000 7f6d627ee700 1 --2- 172.21.15.125:0/2813046204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d5c144150 0x7f6d5c14acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:56.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.926+0000 7f6d617ec700 1 -- 172.21.15.125:0/2813046204 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d5c0cbde0 msgr2=0x7f6d5c138990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:56.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.926+0000 7f6d617ec700 1 --2- 172.21.15.125:0/2813046204 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d5c0cbde0 0x7f6d5c138990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:56.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.926+0000 7f6d617ec700 1 -- 172.21.15.125:0/2813046204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d5c144150 msgr2=0x7f6d5c14acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:56.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.926+0000 7f6d617ec700 1 --2- 172.21.15.125:0/2813046204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d5c144150 0x7f6d5c14acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:56.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.926+0000 7f6d617ec700 1 -- 172.21.15.125:0/2813046204 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c009570 con 0x7f6d5c0ce1a0 2023-10-17T06:08:56.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.926+0000 7f6d627ee700 1 --2- 172.21.15.125:0/2813046204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d5c144150 0x7f6d5c14acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:56.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.930+0000 7f6d617ec700 1 --2- 172.21.15.125:0/2813046204 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d5c0ce1a0 0x7f6d5c15d6f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c004000 tx=0x7f6d4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:56.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.930+0000 7f6d527fc700 1 -- 172.21.15.125:0/2813046204 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c011630 con 0x7f6d5c0ce1a0 2023-10-17T06:08:56.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.930+0000 7f6d527fc700 1 -- 172.21.15.125:0/2813046204 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4c011790 con 0x7f6d5c0ce1a0 2023-10-17T06:08:56.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.930+0000 7f6d527fc700 1 -- 172.21.15.125:0/2813046204 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c011b40 con 0x7f6d5c0ce1a0 2023-10-17T06:08:56.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.930+0000 7f6d62fef700 1 -- 172.21.15.125:0/2813046204 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5c14a4f0 con 0x7f6d5c0ce1a0 2023-10-17T06:08:56.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.930+0000 7f6d62fef700 1 -- 172.21.15.125:0/2813046204 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5c15dc30 con 0x7f6d5c0ce1a0 2023-10-17T06:08:56.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.930+0000 7f6d62fef700 1 -- 172.21.15.125:0/2813046204 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5c04e910 con 0x7f6d5c0ce1a0 2023-10-17T06:08:56.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.934+0000 7f6d527fc700 1 -- 172.21.15.125:0/2813046204 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6d4c011ca0 con 0x7f6d5c0ce1a0 2023-10-17T06:08:56.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.934+0000 7f6d527fc700 1 --2- 172.21.15.125:0/2813046204 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6d400656f0 0x7f6d40067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:56.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.934+0000 7f6d527fc700 1 -- 172.21.15.125:0/2813046204 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6d4c084650 con 0x7f6d5c0ce1a0 2023-10-17T06:08:56.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.934+0000 7f6d61fed700 1 --2- 172.21.15.125:0/2813046204 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6d400656f0 0x7f6d40067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:56.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.934+0000 7f6d61fed700 1 --2- 172.21.15.125:0/2813046204 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6d400656f0 0x7f6d40067bb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009b50 tx=0x7f6d58009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:56.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:56.942+0000 7f6d527fc700 1 -- 172.21.15.125:0/2813046204 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f6d4c051fc0 con 0x7f6d5c0ce1a0 2023-10-17T06:08:57.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.246+0000 7f6d62fef700 1 -- 172.21.15.125:0/2813046204 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6d5c0ccb50 con 0x7f6d5c0ce1a0 2023-10-17T06:08:57.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.258+0000 7f6d527fc700 1 -- 172.21.15.125:0/2813046204 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f6d4c0555e0 con 0x7f6d5c0ce1a0 2023-10-17T06:08:57.263 INFO:teuthology.orchestra.run.smithi125.stdout:[client.0] 2023-10-17T06:08:57.263 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBNJC5lWPILAhAAvN089kyq+D6h+L1E8T+LQA== 2023-10-17T06:08:57.263 INFO:teuthology.orchestra.run.smithi125.stdout: caps mds = "allow" 2023-10-17T06:08:57.264 INFO:teuthology.orchestra.run.smithi125.stdout: caps mon = "allow r" 2023-10-17T06:08:57.264 INFO:teuthology.orchestra.run.smithi125.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-17T06:08:57.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.262+0000 7f6d62fef700 1 -- 172.21.15.125:0/2813046204 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6d400656f0 msgr2=0x7f6d40067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:57.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.262+0000 7f6d62fef700 1 --2- 172.21.15.125:0/2813046204 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6d400656f0 0x7f6d40067bb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009b50 tx=0x7f6d58009240 comp rx=0 tx=0).stop 2023-10-17T06:08:57.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.262+0000 7f6d62fef700 1 -- 172.21.15.125:0/2813046204 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d5c0ce1a0 msgr2=0x7f6d5c15d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:57.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.262+0000 7f6d62fef700 1 --2- 172.21.15.125:0/2813046204 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d5c0ce1a0 0x7f6d5c15d6f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c004000 tx=0x7f6d4c004770 comp rx=0 tx=0).stop 2023-10-17T06:08:57.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.262+0000 7f6d62fef700 1 -- 172.21.15.125:0/2813046204 shutdown_connections 2023-10-17T06:08:57.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.262+0000 7f6d62fef700 1 --2- 172.21.15.125:0/2813046204 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6d400656f0 0x7f6d40067bb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:57.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.262+0000 7f6d62fef700 1 --2- 172.21.15.125:0/2813046204 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d5c144150 0x7f6d5c14acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:57.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.262+0000 7f6d62fef700 1 --2- 172.21.15.125:0/2813046204 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d5c0ce1a0 0x7f6d5c15d6f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:57.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.262+0000 7f6d62fef700 1 --2- 172.21.15.125:0/2813046204 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d5c0cbde0 0x7f6d5c138990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:57.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.262+0000 7f6d62fef700 1 -- 172.21.15.125:0/2813046204 >> 172.21.15.125:0/2813046204 conn(0x7f6d5c0b0bf0 msgr2=0x7f6d5c0af780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:57.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.262+0000 7f6d62fef700 1 -- 172.21.15.125:0/2813046204 shutdown_connections 2023-10-17T06:08:57.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.262+0000 7f6d62fef700 1 -- 172.21.15.125:0/2813046204 wait complete. 2023-10-17T06:08:57.268 INFO:teuthology.orchestra.run.smithi125.stderr:updated caps for client.0 2023-10-17T06:08:57.286 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:08:57.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.506+0000 7f845b49e700 1 Processor -- start 2023-10-17T06:08:57.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.510+0000 7f845b49e700 1 -- start start 2023-10-17T06:08:57.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.510+0000 7f845b49e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f845406e8a0 0x7f84540caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:57.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.510+0000 7f845b49e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845406f450 con 0x7f84540cb470 2023-10-17T06:08:57.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.510+0000 7f845b49e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84540cb8a0 con 0x7f845415ee50 2023-10-17T06:08:57.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.510+0000 7f845b49e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845406d4e0 con 0x7f845406e8a0 2023-10-17T06:08:57.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.510+0000 7f8459a3b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f84540cb470 0x7f845406f8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49098/0 (socket says 172.21.15.125:49098) 2023-10-17T06:08:57.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.510+0000 7f8459a3b700 1 -- 172.21.15.125:0/2404628648 learned_addr learned my addr 172.21.15.125:0/2404628648 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:57.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.514+0000 7f8458a39700 1 --2- 172.21.15.125:0/2404628648 >> v2:172.21.15.184:3300/0 conn(0x7f845406e8a0 0x7f84540caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:57.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.514+0000 7f844bfff700 1 -- 172.21.15.125:0/2404628648 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275774072 0 0) 0x7f845406f450 con 0x7f84540cb470 2023-10-17T06:08:57.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.514+0000 7f844bfff700 1 -- 172.21.15.125:0/2404628648 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84400035d0 con 0x7f84540cb470 2023-10-17T06:08:57.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.514+0000 7f844bfff700 1 -- 172.21.15.125:0/2404628648 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32395608 0 0) 0x7f84540cb8a0 con 0x7f845415ee50 2023-10-17T06:08:57.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.514+0000 7f844bfff700 1 -- 172.21.15.125:0/2404628648 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f845406f450 con 0x7f845415ee50 2023-10-17T06:08:57.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.514+0000 7f8458a39700 1 -- 172.21.15.125:0/2404628648 >> v1:172.21.15.184:6789/0 conn(0x7f845415ee50 legacy=0x7f84540cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:57.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.514+0000 7f8458a39700 1 -- 172.21.15.125:0/2404628648 >> v1:172.21.15.125:6789/0 conn(0x7f84540cb470 legacy=0x7f845406f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:57.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.514+0000 7f8458a39700 1 -- 172.21.15.125:0/2404628648 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84541624a0 con 0x7f845406e8a0 2023-10-17T06:08:57.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.514+0000 7f8458a39700 1 --2- 172.21.15.125:0/2404628648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f845406e8a0 0x7f84540caf30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8444009850 tx=0x7f8444009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ce07b64180a32f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:57.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.514+0000 7f844bfff700 1 -- 172.21.15.125:0/2404628648 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444011830 con 0x7f845406e8a0 2023-10-17T06:08:57.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.514+0000 7f844bfff700 1 -- 172.21.15.125:0/2404628648 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8444011990 con 0x7f845406e8a0 2023-10-17T06:08:57.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.514+0000 7f844bfff700 1 -- 172.21.15.125:0/2404628648 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444011d40 con 0x7f845406e8a0 2023-10-17T06:08:57.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.514+0000 7f845b49e700 1 -- 172.21.15.125:0/2404628648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f845406e8a0 msgr2=0x7f84540caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:57.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.514+0000 7f845b49e700 1 --2- 172.21.15.125:0/2404628648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f845406e8a0 0x7f84540caf30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8444009850 tx=0x7f8444009b60 comp rx=0 tx=0).stop 2023-10-17T06:08:57.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.514+0000 7f845b49e700 1 -- 172.21.15.125:0/2404628648 shutdown_connections 2023-10-17T06:08:57.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.514+0000 7f845b49e700 1 --2- 172.21.15.125:0/2404628648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f845406e8a0 0x7f84540caf30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:57.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.514+0000 7f845b49e700 1 -- 172.21.15.125:0/2404628648 >> 172.21.15.125:0/2404628648 conn(0x7f845406a340 msgr2=0x7f84540b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:57.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.514+0000 7f845b49e700 1 -- 172.21.15.125:0/2404628648 shutdown_connections 2023-10-17T06:08:57.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.514+0000 7f845b49e700 1 -- 172.21.15.125:0/2404628648 wait complete. 2023-10-17T06:08:57.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.518+0000 7f845b49e700 1 Processor -- start 2023-10-17T06:08:57.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.518+0000 7f845b49e700 1 -- start start 2023-10-17T06:08:57.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.518+0000 7f845b49e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f845406e8a0 0x7f84541f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:57.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.518+0000 7f845b49e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84540cb470 0x7f84541faae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:57.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.518+0000 7f845b49e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f845415ee50 0x7f84541497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:57.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.518+0000 7f845b49e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84541f7000 con 0x7f845406e8a0 2023-10-17T06:08:57.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.518+0000 7f845b49e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8454149540 con 0x7f84540cb470 2023-10-17T06:08:57.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.518+0000 7f845b49e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84541fb020 con 0x7f845415ee50 2023-10-17T06:08:57.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.518+0000 7f845923a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f845406e8a0 0x7f84541f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:57.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.518+0000 7f845923a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f845406e8a0 0x7f84541f6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41914/0 (socket says 172.21.15.125:41914) 2023-10-17T06:08:57.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.518+0000 7f845923a700 1 -- 172.21.15.125:0/2189979343 learned_addr learned my addr 172.21.15.125:0/2189979343 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:57.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.522+0000 7f8459a3b700 1 --2- 172.21.15.125:0/2189979343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f845415ee50 0x7f84541497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:57.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.522+0000 7f8458a39700 1 --2- 172.21.15.125:0/2189979343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84540cb470 0x7f84541faae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:57.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.522+0000 7f845923a700 1 -- 172.21.15.125:0/2189979343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f845415ee50 msgr2=0x7f84541497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:57.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.522+0000 7f845923a700 1 --2- 172.21.15.125:0/2189979343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f845415ee50 0x7f84541497d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:57.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.522+0000 7f845923a700 1 -- 172.21.15.125:0/2189979343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84540cb470 msgr2=0x7f84541faae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:57.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.522+0000 7f845923a700 1 --2- 172.21.15.125:0/2189979343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84540cb470 0x7f84541faae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:57.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.522+0000 7f845923a700 1 -- 172.21.15.125:0/2189979343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84440094b0 con 0x7f845406e8a0 2023-10-17T06:08:57.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.522+0000 7f845923a700 1 --2- 172.21.15.125:0/2189979343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f845406e8a0 0x7f84541f6ac0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f845000c730 tx=0x7f845000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:57.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.522+0000 7f8449ffb700 1 -- 172.21.15.125:0/2189979343 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84500052d0 con 0x7f845406e8a0 2023-10-17T06:08:57.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.522+0000 7f8449ffb700 1 -- 172.21.15.125:0/2189979343 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8450005430 con 0x7f845406e8a0 2023-10-17T06:08:57.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.522+0000 7f8449ffb700 1 -- 172.21.15.125:0/2189979343 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84500055a0 con 0x7f845406e8a0 2023-10-17T06:08:57.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.522+0000 7f845b49e700 1 -- 172.21.15.125:0/2189979343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84541f7a90 con 0x7f845406e8a0 2023-10-17T06:08:57.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.522+0000 7f845b49e700 1 -- 172.21.15.125:0/2189979343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84541f77b0 con 0x7f845406e8a0 2023-10-17T06:08:57.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.522+0000 7f845b49e700 1 -- 172.21.15.125:0/2189979343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8454072e60 con 0x7f845406e8a0 2023-10-17T06:08:57.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.526+0000 7f8449ffb700 1 -- 172.21.15.125:0/2189979343 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f84500038e0 con 0x7f845406e8a0 2023-10-17T06:08:57.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.526+0000 7f8449ffb700 1 --2- 172.21.15.125:0/2189979343 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f84380656f0 0x7f8438067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:57.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.526+0000 7f8449ffb700 1 -- 172.21.15.125:0/2189979343 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8450082400 con 0x7f845406e8a0 2023-10-17T06:08:57.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.526+0000 7f8458a39700 1 --2- 172.21.15.125:0/2189979343 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f84380656f0 0x7f8438067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:57.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.526+0000 7f8458a39700 1 --2- 172.21.15.125:0/2189979343 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f84380656f0 0x7f8438067bb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f84440090b0 tx=0x7f844401c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:57.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.530+0000 7f8449ffb700 1 -- 172.21.15.125:0/2189979343 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f845004fe10 con 0x7f845406e8a0 2023-10-17T06:08:57.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.766+0000 7f845b49e700 1 -- 172.21.15.125:0/2189979343 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84540ce3f0 con 0x7f845406e8a0 2023-10-17T06:08:57.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.766+0000 7f8449ffb700 1 -- 172.21.15.125:0/2189979343 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4887 (secure 0 0 0) 0x7f8450053430 con 0x7f845406e8a0 2023-10-17T06:08:57.770 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:08:57.770 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:08:51.328615+0000","modified":"2023-10-17T06:08:54.897934+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.125:6837/2351050168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2351050168},{"type":"v1","addr":"172.21.15.125:6837","nonce":2351050168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-17T06:08:57.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.766+0000 7f845b49e700 1 -- 172.21.15.125:0/2189979343 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f84380656f0 msgr2=0x7f8438067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:57.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.766+0000 7f845b49e700 1 --2- 172.21.15.125:0/2189979343 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f84380656f0 0x7f8438067bb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f84440090b0 tx=0x7f844401c040 comp rx=0 tx=0).stop 2023-10-17T06:08:57.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.766+0000 7f845b49e700 1 -- 172.21.15.125:0/2189979343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f845406e8a0 msgr2=0x7f84541f6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:57.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.766+0000 7f845b49e700 1 --2- 172.21.15.125:0/2189979343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f845406e8a0 0x7f84541f6ac0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f845000c730 tx=0x7f845000caf0 comp rx=0 tx=0).stop 2023-10-17T06:08:57.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.766+0000 7f845b49e700 1 -- 172.21.15.125:0/2189979343 shutdown_connections 2023-10-17T06:08:57.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.770+0000 7f845b49e700 1 --2- 172.21.15.125:0/2189979343 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f84380656f0 0x7f8438067bb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:57.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.770+0000 7f845b49e700 1 --2- 172.21.15.125:0/2189979343 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f845415ee50 0x7f84541497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:57.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.770+0000 7f845b49e700 1 --2- 172.21.15.125:0/2189979343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84540cb470 0x7f84541faae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:57.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.770+0000 7f845b49e700 1 --2- 172.21.15.125:0/2189979343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f845406e8a0 0x7f84541f6ac0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:57.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.770+0000 7f845b49e700 1 -- 172.21.15.125:0/2189979343 >> 172.21.15.125:0/2189979343 conn(0x7f845406a340 msgr2=0x7f84540af560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:57.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.770+0000 7f845b49e700 1 -- 172.21.15.125:0/2189979343 shutdown_connections 2023-10-17T06:08:57.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:57.770+0000 7f845b49e700 1 -- 172.21.15.125:0/2189979343 wait complete. 2023-10-17T06:08:57.775 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 17 2023-10-17T06:08:58.196 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-17T06:08:51.328615+0000', 'modified': '2023-10-17T06:08:54.897934+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5535}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5535': {'gid': 5535, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.125:6837/2351050168', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6836', 'nonce': 2351050168}, {'type': 'v1', 'addr': '172.21.15.125:6837', 'nonce': 2351050168}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-17T06:08:58.196 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-17T06:08:58.197 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-17T06:08:58.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.378+0000 7f75deab6700 1 Processor -- start 2023-10-17T06:08:58.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.378+0000 7f75deab6700 1 -- start start 2023-10-17T06:08:58.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.378+0000 7f75deab6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75d815cbd0 0x7f75d80b6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.378+0000 7f75deab6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f75d806b0e0 0x7f75d80b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.378+0000 7f75deab6700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d806e390 con 0x7f75d80b5ae0 2023-10-17T06:08:58.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.378+0000 7f75deab6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d815cfb0 con 0x7f75d806b0e0 2023-10-17T06:08:58.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.378+0000 7f75deab6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d80b6050 con 0x7f75d815cbd0 2023-10-17T06:08:58.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75de2b5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f75d806b0e0 0x7f75d80b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75ddab4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75d815cbd0 0x7f75d80b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75ddab4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75d815cbd0 0x7f75d80b6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:36938/0 (socket says 172.21.15.125:36938) 2023-10-17T06:08:58.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75ddab4700 1 -- 172.21.15.125:0/4159943690 learned_addr learned my addr 172.21.15.125:0/4159943690 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:58.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75de2b5700 1 -- 172.21.15.125:0/4159943690 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75d815cbd0 msgr2=0x7f75d80b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:58.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75de2b5700 1 --2- 172.21.15.125:0/4159943690 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75d815cbd0 0x7f75d80b6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75de2b5700 1 -- 172.21.15.125:0/4159943690 >> v1:172.21.15.184:6789/0 conn(0x7f75d80b5ae0 legacy=0x7f75d8160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:58.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75de2b5700 1 -- 172.21.15.125:0/4159943690 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d806e5e0 con 0x7f75d806b0e0 2023-10-17T06:08:58.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75ddab4700 1 --2- 172.21.15.125:0/4159943690 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75d815cbd0 0x7f75d80b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:08:58.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75de2b5700 1 --2- 172.21.15.125:0/4159943690 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75d806b0e0 0x7f75d80b6aa0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f75d0009d90 tx=0x7f75d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3753cef961243cac server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:58.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75dcab2700 1 -- 172.21.15.125:0/4159943690 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d000e070 con 0x7f75d806b0e0 2023-10-17T06:08:58.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75dcab2700 1 -- 172.21.15.125:0/4159943690 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d000bb20 con 0x7f75d806b0e0 2023-10-17T06:08:58.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75dcab2700 1 -- 172.21.15.125:0/4159943690 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d0012430 con 0x7f75d806b0e0 2023-10-17T06:08:58.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75deab6700 1 -- 172.21.15.125:0/4159943690 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75d806b0e0 msgr2=0x7f75d80b6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:58.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75deab6700 1 --2- 172.21.15.125:0/4159943690 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75d806b0e0 0x7f75d80b6aa0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f75d0009d90 tx=0x7f75d000b330 comp rx=0 tx=0).stop 2023-10-17T06:08:58.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75deab6700 1 -- 172.21.15.125:0/4159943690 shutdown_connections 2023-10-17T06:08:58.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75deab6700 1 --2- 172.21.15.125:0/4159943690 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75d806b0e0 0x7f75d80b6aa0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75deab6700 1 --2- 172.21.15.125:0/4159943690 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75d815cbd0 0x7f75d80b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75deab6700 1 -- 172.21.15.125:0/4159943690 >> 172.21.15.125:0/4159943690 conn(0x7f75d806f450 msgr2=0x7f75d806f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:58.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75deab6700 1 -- 172.21.15.125:0/4159943690 shutdown_connections 2023-10-17T06:08:58.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.382+0000 7f75deab6700 1 -- 172.21.15.125:0/4159943690 wait complete. 2023-10-17T06:08:58.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.386+0000 7f75deab6700 1 Processor -- start 2023-10-17T06:08:58.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.386+0000 7f75deab6700 1 -- start start 2023-10-17T06:08:58.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.386+0000 7f75deab6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75d806b0e0 0x7f75d8159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.386+0000 7f75deab6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75d80b5ae0 0x7f75d814d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.386+0000 7f75deab6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75d815cbd0 0x7f75d8153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.386+0000 7f75deab6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d8154560 con 0x7f75d806b0e0 2023-10-17T06:08:58.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.386+0000 7f75deab6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d814e4a0 con 0x7f75d815cbd0 2023-10-17T06:08:58.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.386+0000 7f75deab6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d814e780 con 0x7f75d80b5ae0 2023-10-17T06:08:58.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.390+0000 7f75ddab4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75d806b0e0 0x7f75d8159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.390+0000 7f75ddab4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75d806b0e0 0x7f75d8159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41926/0 (socket says 172.21.15.125:41926) 2023-10-17T06:08:58.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.390+0000 7f75ddab4700 1 -- 172.21.15.125:0/390293948 learned_addr learned my addr 172.21.15.125:0/390293948 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:58.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.390+0000 7f75dd2b3700 1 --2- 172.21.15.125:0/390293948 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75d80b5ae0 0x7f75d814d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.390+0000 7f75de2b5700 1 --2- 172.21.15.125:0/390293948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75d815cbd0 0x7f75d8153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.390+0000 7f75ddab4700 1 -- 172.21.15.125:0/390293948 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75d80b5ae0 msgr2=0x7f75d814d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:58.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.390+0000 7f75ddab4700 1 --2- 172.21.15.125:0/390293948 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75d80b5ae0 0x7f75d814d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.390+0000 7f75ddab4700 1 -- 172.21.15.125:0/390293948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75d815cbd0 msgr2=0x7f75d8153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:58.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.390+0000 7f75ddab4700 1 --2- 172.21.15.125:0/390293948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75d815cbd0 0x7f75d8153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.390+0000 7f75ddab4700 1 -- 172.21.15.125:0/390293948 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d4009570 con 0x7f75d806b0e0 2023-10-17T06:08:58.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.390+0000 7f75ddab4700 1 --2- 172.21.15.125:0/390293948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75d806b0e0 0x7f75d8159630 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f75d400e9d0 tx=0x7f75d400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:58.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.390+0000 7f75ce7fc700 1 -- 172.21.15.125:0/390293948 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d400ee70 con 0x7f75d806b0e0 2023-10-17T06:08:58.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.390+0000 7f75ce7fc700 1 -- 172.21.15.125:0/390293948 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d400c850 con 0x7f75d806b0e0 2023-10-17T06:08:58.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.390+0000 7f75ce7fc700 1 -- 172.21.15.125:0/390293948 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d400cbc0 con 0x7f75d806b0e0 2023-10-17T06:08:58.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.390+0000 7f75deab6700 1 -- 172.21.15.125:0/390293948 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d0009a70 con 0x7f75d806b0e0 2023-10-17T06:08:58.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.390+0000 7f75deab6700 1 -- 172.21.15.125:0/390293948 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d814ed40 con 0x7f75d806b0e0 2023-10-17T06:08:58.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.394+0000 7f75ce7fc700 1 -- 172.21.15.125:0/390293948 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f75d400cd20 con 0x7f75d806b0e0 2023-10-17T06:08:58.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.394+0000 7f75ce7fc700 1 --2- 172.21.15.125:0/390293948 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f75bc0656f0 0x7f75bc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.394+0000 7f75ce7fc700 1 -- 172.21.15.125:0/390293948 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f75d4082ff0 con 0x7f75d806b0e0 2023-10-17T06:08:58.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.394+0000 7f75dd2b3700 1 --2- 172.21.15.125:0/390293948 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f75bc0656f0 0x7f75bc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75dd2b3700 1 --2- 172.21.15.125:0/390293948 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f75bc0656f0 0x7f75bc067bb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f75c8000f60 tx=0x7f75c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:58.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75e2faf740 1 Processor -- start 2023-10-17T06:08:58.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75e2faf740 1 -- start start 2023-10-17T06:08:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75e2faf740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x22fe880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75e2faf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2327ad0 0x2327eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75e2faf740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2344d30 0x2345110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75e2faf740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x2270f90 con 0x22fe4a0 2023-10-17T06:08:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75e2faf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x226e680 con 0x2327ad0 2023-10-17T06:08:58.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75e2faf740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x2269f70 con 0x2344d30 2023-10-17T06:08:58.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75ddab4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x22fe880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75ddab4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x22fe880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41940/0 (socket says 172.21.15.125:41940) 2023-10-17T06:08:58.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75ddab4700 1 -- 172.21.15.125:0/1925753807 learned_addr learned my addr 172.21.15.125:0/1925753807 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:58.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75de2b5700 1 --2- 172.21.15.125:0/1925753807 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2344d30 0x2345110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75dd2b3700 1 --2- 172.21.15.125:0/1925753807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2327ad0 0x2327eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75ddab4700 1 -- 172.21.15.125:0/1925753807 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2344d30 msgr2=0x2345110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:58.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75ddab4700 1 --2- 172.21.15.125:0/1925753807 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2344d30 0x2345110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75ddab4700 1 -- 172.21.15.125:0/1925753807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2327ad0 msgr2=0x2327eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:58.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75ddab4700 1 --2- 172.21.15.125:0/1925753807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2327ad0 0x2327eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75ddab4700 1 -- 172.21.15.125:0/1925753807 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x228f1a0 con 0x22fe4a0 2023-10-17T06:08:58.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75de2b5700 1 --2- 172.21.15.125:0/1925753807 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2344d30 0x2345110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:58.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.398+0000 7f75dd2b3700 1 --2- 172.21.15.125:0/1925753807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2327ad0 0x2327eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:58.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.402+0000 7f75ddab4700 1 --2- 172.21.15.125:0/1925753807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x22fe880 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f75d405bd70 tx=0x7f75d4054200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c498677cd11abf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:58.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.402+0000 7f75bb7fe700 1 -- 172.21.15.125:0/1925753807 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4058170 con 0x22fe4a0 2023-10-17T06:08:58.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.402+0000 7f75bb7fe700 1 -- 172.21.15.125:0/1925753807 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d4052930 con 0x22fe4a0 2023-10-17T06:08:58.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.402+0000 7f75bb7fe700 1 -- 172.21.15.125:0/1925753807 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4053a80 con 0x22fe4a0 2023-10-17T06:08:58.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.402+0000 7f75e2faf740 1 -- 172.21.15.125:0/1925753807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 msgr2=0x22fe880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:58.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.402+0000 7f75e2faf740 1 --2- 172.21.15.125:0/1925753807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x22fe880 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f75d405bd70 tx=0x7f75d4054200 comp rx=0 tx=0).stop 2023-10-17T06:08:58.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.402+0000 7f75e2faf740 1 -- 172.21.15.125:0/1925753807 shutdown_connections 2023-10-17T06:08:58.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.402+0000 7f75e2faf740 1 --2- 172.21.15.125:0/1925753807 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2344d30 0x2345110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.402+0000 7f75e2faf740 1 --2- 172.21.15.125:0/1925753807 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2327ad0 0x2327eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.402+0000 7f75e2faf740 1 --2- 172.21.15.125:0/1925753807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x22fe880 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.402+0000 7f75e2faf740 1 -- 172.21.15.125:0/1925753807 >> 172.21.15.125:0/1925753807 conn(0x2090550 msgr2=0x232ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:58.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.402+0000 7f75e2faf740 1 -- 172.21.15.125:0/1925753807 shutdown_connections 2023-10-17T06:08:58.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.402+0000 7f75e2faf740 1 -- 172.21.15.125:0/1925753807 wait complete. 2023-10-17T06:08:58.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.402+0000 7f75e2faf740 1 -- start start 2023-10-17T06:08:58.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.402+0000 7f75e2faf740 1 Processor -- start 2023-10-17T06:08:58.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75e2faf740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x232c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75e2faf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2327ad0 0x2302630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75e2faf740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2344d30 0x2301520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75e2faf740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x222ab00 con 0x22fe4a0 2023-10-17T06:08:58.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75e2faf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x2229470 con 0x2327ad0 2023-10-17T06:08:58.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75e2faf740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x2114b20 con 0x2344d30 2023-10-17T06:08:58.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75e2faf740 10 client.0 _ll_register_callbacks cb 0x2263810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-17T06:08:58.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75ddab4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x232c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75ddab4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x232c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41944/0 (socket says 172.21.15.125:41944) 2023-10-17T06:08:58.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75ddab4700 1 -- 172.21.15.125:0/2112431668 learned_addr learned my addr 172.21.15.125:0/2112431668 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:58.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75de2b5700 1 --2- 172.21.15.125:0/2112431668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2344d30 0x2301520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75dd2b3700 1 --2- 172.21.15.125:0/2112431668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2327ad0 0x2302630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75ddab4700 1 -- 172.21.15.125:0/2112431668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2344d30 msgr2=0x2301520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:58.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75ddab4700 1 --2- 172.21.15.125:0/2112431668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2344d30 0x2301520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75ddab4700 1 -- 172.21.15.125:0/2112431668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2327ad0 msgr2=0x2302630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:58.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75ddab4700 1 --2- 172.21.15.125:0/2112431668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2327ad0 0x2302630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75ddab4700 1 -- 172.21.15.125:0/2112431668 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d814ed40 con 0x22fe4a0 2023-10-17T06:08:58.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75dd2b3700 1 --2- 172.21.15.125:0/2112431668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2327ad0 0x2302630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:08:58.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75ddab4700 1 --2- 172.21.15.125:0/2112431668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x232c3c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f75d4050a90 tx=0x7f75d400efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905f9ea2a9d468c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:58.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75b8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-17T06:08:58.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75b8ff9700 1 -- 172.21.15.125:0/2112431668 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d405c010 con 0x22fe4a0 2023-10-17T06:08:58.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75b8ff9700 1 -- 172.21.15.125:0/2112431668 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f75d4014dc0 con 0x22fe4a0 2023-10-17T06:08:58.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75e2faf740 1 -- 172.21.15.125:0/2112431668 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2262f50 con 0x22fe4a0 2023-10-17T06:08:58.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75b8ff9700 1 -- 172.21.15.125:0/2112431668 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75d40508d0 con 0x22fe4a0 2023-10-17T06:08:58.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75e2faf740 10 client.5721 fetch_fsmap learned FSMap version 17 2023-10-17T06:08:58.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75e2faf740 1 -- 172.21.15.125:0/2112431668 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x20db9e0 con 0x22fe4a0 2023-10-17T06:08:58.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75b8ff9700 1 -- 172.21.15.125:0/2112431668 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2262f50 con 0x22fe4a0 2023-10-17T06:08:58.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75b8ff9700 1 -- 172.21.15.125:0/2112431668 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f75d4067b50 con 0x22fe4a0 2023-10-17T06:08:58.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75e2faf740 10 client.5721 fetch_fsmap finished waiting for FSMap version 17 2023-10-17T06:08:58.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75e2faf740 10 client.5721 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-17T06:08:58.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75e2faf740 20 client.5721 populate_metadata read hostname 'smithi125' 2023-10-17T06:08:58.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75e2faf740 1 --2- 172.21.15.125:0/2112431668 >> [v2:172.21.15.125:6836/2351050168,v1:172.21.15.125:6837/2351050168] conn(0x2301a60 0x2352530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75e2faf740 4 client.5721 mds_command: new command op to 5535 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-17T06:08:58.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75e2faf740 1 -- 172.21.15.125:0/2112431668 --> [v2:172.21.15.125:6836/2351050168,v1:172.21.15.125:6837/2351050168] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2262c70 con 0x2301a60 2023-10-17T06:08:58.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.406+0000 7f75dd2b3700 1 --2- 172.21.15.125:0/2112431668 >> [v2:172.21.15.125:6836/2351050168,v1:172.21.15.125:6837/2351050168] conn(0x2301a60 0x2352530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.410+0000 7f75b8ff9700 10 client.5721 ms_handle_connect on v2:172.21.15.125:6836/2351050168 2023-10-17T06:08:58.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.410+0000 7f75dd2b3700 1 --2- 172.21.15.125:0/2112431668 >> [v2:172.21.15.125:6836/2351050168,v1:172.21.15.125:6837/2351050168] conn(0x2301a60 0x2352530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8718f581d2da920d server_cookie=a4c19a723201b124 in_seq=0 out_seq=0 2023-10-17T06:08:58.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.410+0000 7f75b8ff9700 1 -- 172.21.15.125:0/2112431668 <== mds.0 v2:172.21.15.125:6836/2351050168 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x2262c70 con 0x2301a60 2023-10-17T06:08:58.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.410+0000 7f75b8ff9700 10 client.5721 handle_command_reply: tid=0 2023-10-17T06:08:58.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.410+0000 7f75e2faf740 1 client.5721 shutdown 2023-10-17T06:08:58.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.410+0000 7f75e2faf740 1 -- 172.21.15.125:0/2112431668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 msgr2=0x232c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:58.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.410+0000 7f75e2faf740 1 --2- 172.21.15.125:0/2112431668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x232c3c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f75d4050a90 tx=0x7f75d400efd0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.410+0000 7f75e2faf740 1 -- 172.21.15.125:0/2112431668 shutdown_connections 2023-10-17T06:08:58.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.410+0000 7f75e2faf740 1 --2- 172.21.15.125:0/2112431668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2344d30 0x2301520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.410+0000 7f75e2faf740 1 --2- 172.21.15.125:0/2112431668 >> [v2:172.21.15.125:6836/2351050168,v1:172.21.15.125:6837/2351050168] conn(0x2301a60 0x2352530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.410+0000 7f75e2faf740 1 --2- 172.21.15.125:0/2112431668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2327ad0 0x2302630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.410+0000 7f75e2faf740 1 --2- 172.21.15.125:0/2112431668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x232c3c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.410+0000 7f75b8ff9700 0 client.5721 ms_handle_reset on v2:172.21.15.125:6836/2351050168 2023-10-17T06:08:58.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.410+0000 7f75e2faf740 1 -- 172.21.15.125:0/2112431668 >> 172.21.15.125:0/2112431668 conn(0x2090550 msgr2=0x22fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:58.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.410+0000 7f75e2faf740 1 -- 172.21.15.125:0/2112431668 shutdown_connections 2023-10-17T06:08:58.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.410+0000 7f75e2faf740 1 -- 172.21.15.125:0/2112431668 wait complete. 2023-10-17T06:08:58.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.410+0000 7f75e2faf740 20 client.5721 trim_cache size 0 max 16384 2023-10-17T06:08:58.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.430+0000 7f75e2faf740 1 Processor -- start 2023-10-17T06:08:58.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.430+0000 7f75e2faf740 1 -- start start 2023-10-17T06:08:58.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.430+0000 7f75e2faf740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x22fd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.430+0000 7f75e2faf740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2327ad0 0x22fca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.430+0000 7f75e2faf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2344d30 0x22fcf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.430+0000 7f75e2faf740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x2268e00 con 0x22fe4a0 2023-10-17T06:08:58.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.430+0000 7f75e2faf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x222ab00 con 0x2344d30 2023-10-17T06:08:58.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.430+0000 7f75e2faf740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x2273c30 con 0x2327ad0 2023-10-17T06:08:58.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.430+0000 7f75dd2b3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2327ad0 0x22fca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.430+0000 7f75ddab4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x22fd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.430+0000 7f75dd2b3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2327ad0 0x22fca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:36970/0 (socket says 172.21.15.125:36970) 2023-10-17T06:08:58.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.430+0000 7f75dd2b3700 1 -- 172.21.15.125:0/1723297481 learned_addr learned my addr 172.21.15.125:0/1723297481 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:58.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75de2b5700 1 --2- 172.21.15.125:0/1723297481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2344d30 0x22fcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75dd2b3700 1 -- 172.21.15.125:0/1723297481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2344d30 msgr2=0x22fcf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:58.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75dd2b3700 1 --2- 172.21.15.125:0/1723297481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2344d30 0x22fcf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75dd2b3700 1 -- 172.21.15.125:0/1723297481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 msgr2=0x22fd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:58.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75dd2b3700 1 --2- 172.21.15.125:0/1723297481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x22fd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75dd2b3700 1 -- 172.21.15.125:0/1723297481 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d806d890 con 0x2327ad0 2023-10-17T06:08:58.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75dd2b3700 1 --2- 172.21.15.125:0/1723297481 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2327ad0 0x22fca10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x2344b10 tx=0x7f75c8012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1514c91e3aed1598 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:58.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75bbfff700 1 -- 172.21.15.125:0/1723297481 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c80015e0 con 0x2327ad0 2023-10-17T06:08:58.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75bbfff700 1 -- 172.21.15.125:0/1723297481 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c800fa30 con 0x2327ad0 2023-10-17T06:08:58.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75bbfff700 1 -- 172.21.15.125:0/1723297481 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c800fba0 con 0x2327ad0 2023-10-17T06:08:58.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75e2faf740 1 -- 172.21.15.125:0/1723297481 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2327ad0 msgr2=0x22fca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:58.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75e2faf740 1 --2- 172.21.15.125:0/1723297481 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2327ad0 0x22fca10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x2344b10 tx=0x7f75c8012000 comp rx=0 tx=0).stop 2023-10-17T06:08:58.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75e2faf740 1 -- 172.21.15.125:0/1723297481 shutdown_connections 2023-10-17T06:08:58.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75e2faf740 1 --2- 172.21.15.125:0/1723297481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2344d30 0x22fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75e2faf740 1 --2- 172.21.15.125:0/1723297481 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2327ad0 0x22fca10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75e2faf740 1 --2- 172.21.15.125:0/1723297481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x22fd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75e2faf740 1 -- 172.21.15.125:0/1723297481 >> 172.21.15.125:0/1723297481 conn(0x2090550 msgr2=0x23582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:58.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75e2faf740 1 -- 172.21.15.125:0/1723297481 shutdown_connections 2023-10-17T06:08:58.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75e2faf740 1 -- 172.21.15.125:0/1723297481 wait complete. 2023-10-17T06:08:58.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75e2faf740 1 -- start start 2023-10-17T06:08:58.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.434+0000 7f75e2faf740 1 Processor -- start 2023-10-17T06:08:58.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75e2faf740 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x235f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75e2faf740 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2327ad0 0x23a6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75e2faf740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2344d30 0x23a6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75e2faf740 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x226df70 con 0x22fe4a0 2023-10-17T06:08:58.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75e2faf740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x226f820 con 0x2344d30 2023-10-17T06:08:58.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75e2faf740 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x2237d50 con 0x2327ad0 2023-10-17T06:08:58.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75e2faf740 10 client.0 _ll_register_callbacks cb 0x2216120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-17T06:08:58.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75ddab4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x235f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75dd2b3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2327ad0 0x23a6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75ddab4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x235f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41952/0 (socket says 172.21.15.125:41952) 2023-10-17T06:08:58.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75ddab4700 1 -- 172.21.15.125:0/3844896914 learned_addr learned my addr 172.21.15.125:0/3844896914 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:58.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75de2b5700 1 --2- 172.21.15.125:0/3844896914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2344d30 0x23a6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75ddab4700 1 -- 172.21.15.125:0/3844896914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2327ad0 msgr2=0x23a6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:58.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75ddab4700 1 --2- 172.21.15.125:0/3844896914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2327ad0 0x23a6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75ddab4700 1 -- 172.21.15.125:0/3844896914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2344d30 msgr2=0x23a6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:08:58.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75ddab4700 1 --2- 172.21.15.125:0/3844896914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2344d30 0x23a6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75ddab4700 1 -- 172.21.15.125:0/3844896914 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c8019040 con 0x22fe4a0 2023-10-17T06:08:58.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75de2b5700 1 --2- 172.21.15.125:0/3844896914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2344d30 0x23a6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:58.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75ddab4700 1 --2- 172.21.15.125:0/3844896914 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x235f620 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f75d4081120 tx=0x7f75d4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80c80aa39778cd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:58.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75b8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-17T06:08:58.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75b8ff9700 1 -- 172.21.15.125:0/3844896914 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4050580 con 0x22fe4a0 2023-10-17T06:08:58.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75b8ff9700 1 -- 172.21.15.125:0/3844896914 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f75d40506e0 con 0x22fe4a0 2023-10-17T06:08:58.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75e2faf740 1 -- 172.21.15.125:0/3844896914 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f75d4052930 con 0x22fe4a0 2023-10-17T06:08:58.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75b8ff9700 1 -- 172.21.15.125:0/3844896914 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75d4054c20 con 0x22fe4a0 2023-10-17T06:08:58.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75e2faf740 10 client.5727 fetch_fsmap learned FSMap version 17 2023-10-17T06:08:58.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75e2faf740 1 -- 172.21.15.125:0/3844896914 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x222e250 con 0x22fe4a0 2023-10-17T06:08:58.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75b8ff9700 1 -- 172.21.15.125:0/3844896914 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d4060070 con 0x22fe4a0 2023-10-17T06:08:58.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75b8ff9700 1 -- 172.21.15.125:0/3844896914 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f75d40534f0 con 0x22fe4a0 2023-10-17T06:08:58.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75e2faf740 10 client.5727 fetch_fsmap finished waiting for FSMap version 17 2023-10-17T06:08:58.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75e2faf740 10 client.5727 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-17T06:08:58.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75e2faf740 20 client.5727 populate_metadata read hostname 'smithi125' 2023-10-17T06:08:58.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75e2faf740 1 --2- 172.21.15.125:0/3844896914 >> [v2:172.21.15.125:6836/2351050168,v1:172.21.15.125:6837/2351050168] conn(0x2360870 0x235d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75e2faf740 4 client.5727 mds_command: new command op to 5535 tid=0[{"prefix": "status"}] 2023-10-17T06:08:58.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.438+0000 7f75e2faf740 1 -- 172.21.15.125:0/3844896914 --> [v2:172.21.15.125:6836/2351050168,v1:172.21.15.125:6837/2351050168] -- command(tid 0: {"prefix": "status"}) v1 -- 0x20e74e0 con 0x2360870 2023-10-17T06:08:58.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75dd2b3700 1 --2- 172.21.15.125:0/3844896914 >> [v2:172.21.15.125:6836/2351050168,v1:172.21.15.125:6837/2351050168] conn(0x2360870 0x235d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75dd2b3700 1 --2- 172.21.15.125:0/3844896914 >> [v2:172.21.15.125:6836/2351050168,v1:172.21.15.125:6837/2351050168] conn(0x2360870 0x235d9d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ad9333647fec2fb server_cookie=22bad524a513f0f9 in_seq=0 out_seq=0 2023-10-17T06:08:58.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75b8ff9700 10 client.5727 ms_handle_connect on v2:172.21.15.125:6836/2351050168 2023-10-17T06:08:58.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75b8ff9700 1 -- 172.21.15.125:0/3844896914 <== mds.0 v2:172.21.15.125:6836/2351050168 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x20e74e0 con 0x2360870 2023-10-17T06:08:58.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75b8ff9700 10 client.5727 handle_command_reply: tid=0 2023-10-17T06:08:58.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75e2faf740 1 client.5727 shutdown 2023-10-17T06:08:58.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75e2faf740 1 -- 172.21.15.125:0/3844896914 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 msgr2=0x235f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:58.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75e2faf740 1 --2- 172.21.15.125:0/3844896914 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x235f620 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f75d4081120 tx=0x7f75d4004770 comp rx=0 tx=0).stop 2023-10-17T06:08:58.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75e2faf740 1 -- 172.21.15.125:0/3844896914 shutdown_connections 2023-10-17T06:08:58.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75e2faf740 1 --2- 172.21.15.125:0/3844896914 >> [v2:172.21.15.125:6836/2351050168,v1:172.21.15.125:6837/2351050168] conn(0x2360870 0x235d9d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75e2faf740 1 --2- 172.21.15.125:0/3844896914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x2344d30 0x23a6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75e2faf740 1 --2- 172.21.15.125:0/3844896914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x2327ad0 0x23a6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75b8ff9700 0 client.5727 ms_handle_reset on v2:172.21.15.125:6836/2351050168 2023-10-17T06:08:58.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75e2faf740 1 --2- 172.21.15.125:0/3844896914 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x22fe4a0 0x235f620 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75e2faf740 1 -- 172.21.15.125:0/3844896914 >> 172.21.15.125:0/3844896914 conn(0x2090550 msgr2=0x2342b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:58.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75e2faf740 1 -- 172.21.15.125:0/3844896914 shutdown_connections 2023-10-17T06:08:58.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75e2faf740 1 -- 172.21.15.125:0/3844896914 wait complete. 2023-10-17T06:08:58.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75e2faf740 20 client.5727 trim_cache size 0 max 16384 2023-10-17T06:08:58.460 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-17T06:08:58.460 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_fsid": "c779df02-0ec4-47de-a0f3-2371e60a2dde", 2023-10-17T06:08:58.460 INFO:teuthology.orchestra.run.smithi125.stdout: "whoami": 0, 2023-10-17T06:08:58.460 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 5535, 2023-10-17T06:08:58.460 INFO:teuthology.orchestra.run.smithi125.stdout: "want_state": "up:active", 2023-10-17T06:08:58.461 INFO:teuthology.orchestra.run.smithi125.stdout: "state": "up:active", 2023-10-17T06:08:58.461 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs", 2023-10-17T06:08:58.461 INFO:teuthology.orchestra.run.smithi125.stdout: "rank_uptime": 6.5729724359999997, 2023-10-17T06:08:58.461 INFO:teuthology.orchestra.run.smithi125.stdout: "mdsmap_epoch": 17, 2023-10-17T06:08:58.461 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch": 43, 2023-10-17T06:08:58.462 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch_barrier": 43, 2023-10-17T06:08:58.462 INFO:teuthology.orchestra.run.smithi125.stdout: "uptime": 17.450467573000001 2023-10-17T06:08:58.462 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-17T06:08:58.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75deab6700 1 -- 172.21.15.125:0/390293948 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f75bc0656f0 msgr2=0x7f75bc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:58.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75deab6700 1 --2- 172.21.15.125:0/390293948 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f75bc0656f0 0x7f75bc067bb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f75c8000f60 tx=0x7f75c8009040 comp rx=0 tx=0).stop 2023-10-17T06:08:58.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75deab6700 1 -- 172.21.15.125:0/390293948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75d806b0e0 msgr2=0x7f75d8159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:58.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75deab6700 1 --2- 172.21.15.125:0/390293948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75d806b0e0 0x7f75d8159630 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f75d400e9d0 tx=0x7f75d400ece0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75deab6700 1 -- 172.21.15.125:0/390293948 shutdown_connections 2023-10-17T06:08:58.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75deab6700 1 --2- 172.21.15.125:0/390293948 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f75bc0656f0 0x7f75bc067bb0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75deab6700 1 --2- 172.21.15.125:0/390293948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75d815cbd0 0x7f75d8153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75deab6700 1 --2- 172.21.15.125:0/390293948 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f75d80b5ae0 0x7f75d814d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75deab6700 1 --2- 172.21.15.125:0/390293948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75d806b0e0 0x7f75d8159630 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75deab6700 1 -- 172.21.15.125:0/390293948 >> 172.21.15.125:0/390293948 conn(0x7f75d806f450 msgr2=0x7f75d81578c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:58.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75deab6700 1 -- 172.21.15.125:0/390293948 shutdown_connections 2023-10-17T06:08:58.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.442+0000 7f75deab6700 1 -- 172.21.15.125:0/390293948 wait complete. 2023-10-17T06:08:58.469 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-17T06:08:58.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.642+0000 7fe2b2a20700 1 Processor -- start 2023-10-17T06:08:58.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.642+0000 7fe2b2a20700 1 -- start start 2023-10-17T06:08:58.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.642+0000 7fe2b2a20700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2ac15ac00 0x7fe2ac070180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.642+0000 7fe2b2a20700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ac06f450 con 0x7fe2ac0cb0b0 2023-10-17T06:08:58.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.642+0000 7fe2b2a20700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2ac0cbb70 con 0x7fe2ac0b2950 2023-10-17T06:08:58.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.642+0000 7fe2b2a20700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac15afe0 con 0x7fe2ac15ac00 2023-10-17T06:08:58.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.646+0000 7fe2b121d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe2ac0cb0b0 0x7fe2ac0b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49108/0 (socket says 172.21.15.125:49108) 2023-10-17T06:08:58.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.646+0000 7fe2b121d700 1 -- 172.21.15.125:0/3530119918 learned_addr learned my addr 172.21.15.125:0/3530119918 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:08:58.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.646+0000 7fe2b1a1e700 1 --2- 172.21.15.125:0/3530119918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2ac15ac00 0x7fe2ac070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.646+0000 7fe2b1a1e700 1 -- 172.21.15.125:0/3530119918 >> v1:172.21.15.184:6789/0 conn(0x7fe2ac0b2950 legacy=0x7fe2ac0ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:58.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.646+0000 7fe2b1a1e700 1 -- 172.21.15.125:0/3530119918 >> v1:172.21.15.125:6789/0 conn(0x7fe2ac0cb0b0 legacy=0x7fe2ac0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:58.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.646+0000 7fe2b1a1e700 1 -- 172.21.15.125:0/3530119918 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ac06f6a0 con 0x7fe2ac15ac00 2023-10-17T06:08:58.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.646+0000 7fe2b0a1c700 1 -- 172.21.15.125:0/3530119918 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452738955 0 0) 0x7fe2ac06f450 con 0x7fe2ac0cb0b0 2023-10-17T06:08:58.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.646+0000 7fe2b1a1e700 1 --2- 172.21.15.125:0/3530119918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2ac15ac00 0x7fe2ac070180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009880 tx=0x7fe2a8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5d0b170b922934b server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:58.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.646+0000 7fe2b0a1c700 1 -- 172.21.15.125:0/3530119918 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8011830 con 0x7fe2ac15ac00 2023-10-17T06:08:58.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.646+0000 7fe2b0a1c700 1 -- 172.21.15.125:0/3530119918 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a8011990 con 0x7fe2ac15ac00 2023-10-17T06:08:58.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.646+0000 7fe2b0a1c700 1 -- 172.21.15.125:0/3530119918 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8011d20 con 0x7fe2ac15ac00 2023-10-17T06:08:58.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.646+0000 7fe2b2a20700 1 -- 172.21.15.125:0/3530119918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2ac15ac00 msgr2=0x7fe2ac070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:58.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.646+0000 7fe2b2a20700 1 --2- 172.21.15.125:0/3530119918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2ac15ac00 0x7fe2ac070180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009880 tx=0x7fe2a8009b90 comp rx=0 tx=0).stop 2023-10-17T06:08:58.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.646+0000 7fe2b2a20700 1 -- 172.21.15.125:0/3530119918 shutdown_connections 2023-10-17T06:08:58.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.646+0000 7fe2b2a20700 1 --2- 172.21.15.125:0/3530119918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2ac15ac00 0x7fe2ac070180 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.646+0000 7fe2b2a20700 1 -- 172.21.15.125:0/3530119918 >> 172.21.15.125:0/3530119918 conn(0x7fe2ac0cd240 msgr2=0x7fe2ac0cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:58.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.646+0000 7fe2b2a20700 1 -- 172.21.15.125:0/3530119918 shutdown_connections 2023-10-17T06:08:58.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.646+0000 7fe2b2a20700 1 -- 172.21.15.125:0/3530119918 wait complete. 2023-10-17T06:08:58.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.650+0000 7fe2b2a20700 1 Processor -- start 2023-10-17T06:08:58.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.650+0000 7fe2b2a20700 1 -- start start 2023-10-17T06:08:58.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2b2a20700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2ac0b2950 0x7fe2ac14bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2b2a20700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2ac0cb0b0 0x7fe2ac0b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2b2a20700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2ac15ac00 0x7fe2ac0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2b2a20700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac14edf0 con 0x7fe2ac0cb0b0 2023-10-17T06:08:58.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2b2a20700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac1f33b0 con 0x7fe2ac15ac00 2023-10-17T06:08:58.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2b2a20700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2ac14e4c0 con 0x7fe2ac0b2950 2023-10-17T06:08:58.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2b121d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2ac0cb0b0 0x7fe2ac0b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2b121d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2ac0cb0b0 0x7fe2ac0b4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41966/0 (socket says 172.21.15.125:41966) 2023-10-17T06:08:58.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2b121d700 1 -- 172.21.15.125:0/1537245538 learned_addr learned my addr 172.21.15.125:0/1537245538 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:08:58.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2b1a1e700 1 --2- 172.21.15.125:0/1537245538 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2ac0b2950 0x7fe2ac14bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2b221f700 1 --2- 172.21.15.125:0/1537245538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2ac15ac00 0x7fe2ac0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2b121d700 1 -- 172.21.15.125:0/1537245538 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2ac0b2950 msgr2=0x7fe2ac14bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:58.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2b121d700 1 --2- 172.21.15.125:0/1537245538 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2ac0b2950 0x7fe2ac14bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2b121d700 1 -- 172.21.15.125:0/1537245538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2ac15ac00 msgr2=0x7fe2ac0b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:58.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2b121d700 1 --2- 172.21.15.125:0/1537245538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2ac15ac00 0x7fe2ac0b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:58.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2b121d700 1 -- 172.21.15.125:0/1537245538 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a80094b0 con 0x7fe2ac0cb0b0 2023-10-17T06:08:58.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2b221f700 1 --2- 172.21.15.125:0/1537245538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2ac15ac00 0x7fe2ac0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:08:58.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2b121d700 1 --2- 172.21.15.125:0/1537245538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2ac0cb0b0 0x7fe2ac0b4780 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00c550 tx=0x7fe29c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:58.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2a27fc700 1 -- 172.21.15.125:0/1537245538 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c004ca0 con 0x7fe2ac0cb0b0 2023-10-17T06:08:58.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2a27fc700 1 -- 172.21.15.125:0/1537245538 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c004e00 con 0x7fe2ac0cb0b0 2023-10-17T06:08:58.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2b2a20700 1 -- 172.21.15.125:0/1537245538 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ac14e7a0 con 0x7fe2ac0cb0b0 2023-10-17T06:08:58.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2a27fc700 1 -- 172.21.15.125:0/1537245538 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c007310 con 0x7fe2ac0cb0b0 2023-10-17T06:08:58.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.654+0000 7fe2b2a20700 1 -- 172.21.15.125:0/1537245538 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ac14f280 con 0x7fe2ac0cb0b0 2023-10-17T06:08:58.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.658+0000 7fe2b2a20700 1 -- 172.21.15.125:0/1537245538 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ac0b5f60 con 0x7fe2ac0cb0b0 2023-10-17T06:08:58.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.658+0000 7fe2a27fc700 1 -- 172.21.15.125:0/1537245538 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe29c007470 con 0x7fe2ac0cb0b0 2023-10-17T06:08:58.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.658+0000 7fe2a27fc700 1 --2- 172.21.15.125:0/1537245538 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe2900656f0 0x7fe290067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:08:58.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.662+0000 7fe2a27fc700 1 -- 172.21.15.125:0/1537245538 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe29c082c90 con 0x7fe2ac0cb0b0 2023-10-17T06:08:58.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.662+0000 7fe2b1a1e700 1 --2- 172.21.15.125:0/1537245538 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe2900656f0 0x7fe290067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:08:58.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.662+0000 7fe2b1a1e700 1 --2- 172.21.15.125:0/1537245538 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe2900656f0 0x7fe290067bb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80097d0 tx=0x7fe2a8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:08:58.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.666+0000 7fe2a27fc700 1 -- 172.21.15.125:0/1537245538 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe29c050570 con 0x7fe2ac0cb0b0 2023-10-17T06:08:59.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.998+0000 7fe2b2a20700 1 -- 172.21.15.125:0/1537245538 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe2ac0b65b0 con 0x7fe2ac0cb0b0 2023-10-17T06:08:59.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:58.998+0000 7fe2a27fc700 1 -- 172.21.15.125:0/1537245538 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe29c007720 con 0x7fe2ac0cb0b0 2023-10-17T06:08:59.003 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-17T06:08:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:59.002+0000 7fe2b2a20700 1 -- 172.21.15.125:0/1537245538 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe2900656f0 msgr2=0x7fe290067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:59.002+0000 7fe2b2a20700 1 --2- 172.21.15.125:0/1537245538 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe2900656f0 0x7fe290067bb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80097d0 tx=0x7fe2a8008030 comp rx=0 tx=0).stop 2023-10-17T06:08:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:59.002+0000 7fe2b2a20700 1 -- 172.21.15.125:0/1537245538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2ac0cb0b0 msgr2=0x7fe2ac0b4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:08:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:59.002+0000 7fe2b2a20700 1 --2- 172.21.15.125:0/1537245538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2ac0cb0b0 0x7fe2ac0b4780 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00c550 tx=0x7fe29c00c860 comp rx=0 tx=0).stop 2023-10-17T06:08:59.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:59.002+0000 7fe2b2a20700 1 -- 172.21.15.125:0/1537245538 shutdown_connections 2023-10-17T06:08:59.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:59.002+0000 7fe2b2a20700 1 --2- 172.21.15.125:0/1537245538 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe2900656f0 0x7fe290067bb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:59.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:59.002+0000 7fe2b2a20700 1 --2- 172.21.15.125:0/1537245538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2ac15ac00 0x7fe2ac0b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:59.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:59.002+0000 7fe2b2a20700 1 --2- 172.21.15.125:0/1537245538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2ac0cb0b0 0x7fe2ac0b4780 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:59.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:59.002+0000 7fe2b2a20700 1 --2- 172.21.15.125:0/1537245538 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2ac0b2950 0x7fe2ac14bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:08:59.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:59.002+0000 7fe2b2a20700 1 -- 172.21.15.125:0/1537245538 >> 172.21.15.125:0/1537245538 conn(0x7fe2ac0cd240 msgr2=0x7fe2ac0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:08:59.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:59.002+0000 7fe2b2a20700 1 -- 172.21.15.125:0/1537245538 shutdown_connections 2023-10-17T06:08:59.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:08:59.002+0000 7fe2b2a20700 1 -- 172.21.15.125:0/1537245538 wait complete. 2023-10-17T06:08:59.029 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-17T06:08:59.030 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-17T06:08:59.030 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-10-17T06:08:59.030 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-17T06:08:59.031 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-17T06:08:59.031 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-17T06:08:59.031 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-17T06:08:59.032 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-17T06:08:59.032 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-17T06:08:59.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:08:59.033 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-10-17T06:08:59.048 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-17T06:08:59.048 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-17T06:08:59.049 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-10-17T06:08:59.049 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:08:59.049 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-10-17T06:08:59.049 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:08:59.050 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:08:59.050 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:08:59.050 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f0 2023-10-17T06:08:59.050 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:08:59.050 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:08:59.051 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f1 2023-10-17T06:08:59.051 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:08:59.051 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:08:59.051 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-17T06:08:59.051 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:08:59.052 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-17T06:08:59.052 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42309sec preferred_lft 42309sec 2023-10-17T06:08:59.052 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::ec4:7aff:fe8f:d739/64 scope link 2023-10-17T06:08:59.052 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:08:59.052 INFO:teuthology.orchestra.run.smithi125.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-17T06:08:59.053 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 02:42:72:b2:4f:6c brd ff:ff:ff:ff:ff:ff 2023-10-17T06:08:59.053 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-17T06:08:59.053 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:08:59.053 INFO:teuthology.orchestra.run.smithi125.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-17T06:08:59.053 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 12:09:8b:4c:94:dd brd ff:ff:ff:ff:ff:ff 2023-10-17T06:08:59.053 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-17T06:08:59.054 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:08:59.054 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::5cb5:97ff:fe65:f7ee/64 scope link 2023-10-17T06:08:59.054 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:08:59.054 INFO:teuthology.orchestra.run.smithi125.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-17T06:08:59.054 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 86:a3:a0:1e:b3:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-17T06:08:59.055 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::84a3:a0ff:fe1e:b310/64 scope link 2023-10-17T06:08:59.055 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:08:59.055 INFO:teuthology.orchestra.run.smithi125.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-17T06:08:59.055 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 12:09:8b:4c:94:dd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-17T06:08:59.055 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::1009:8bff:fe4c:94dd/64 scope link 2023-10-17T06:08:59.056 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:08:59.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:08:59.057 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-17T06:08:59.136 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-10-17T06:08:59.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:08:59.139 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-10-17T06:08:59.201 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-10-17T06:08:59.202 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-17T06:08:59.202 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-17T06:08:59.202 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-17T06:08:59.203 INFO:teuthology.orchestra.run.smithi125.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-17T06:08:59.203 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-17T06:08:59.203 INFO:teuthology.orchestra.run.smithi125.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-17T06:08:59.203 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-17T06:08:59.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:08:59.204 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-17T06:08:59.205 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-17T06:08:59.205 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-17T06:08:59.205 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-17T06:08:59.206 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-17T06:08:59.206 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-17T06:08:59.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:08:59.331 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-10-17T06:08:59.350 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-17T06:08:59.351 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-17T06:08:59.352 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-17T06:08:59.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:08:59.352 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2023-10-17T06:08:59.427 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-17T06:08:59.428 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-17T06:08:59.489 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-17T06:08:59.490 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-17T06:08:59.490 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-17T06:08:59.551 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-17T06:08:59.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:08:59.552 DEBUG:teuthology.orchestra.run.smithi125:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:08:59.686 INFO:teuthology.orchestra.run.smithi125.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:08:59.686 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-17T06:08:59.712 INFO:teuthology.orchestra.run.smithi125.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:08:59.712 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-17T06:08:59.712 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: resolved to: "172.21.15.125:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-10-17T06:08:59.712 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: trying mount with new device syntax: 0@c779df02-0ec4-47de-a0f3-2371e60a2dde.cephfs=/ 2023-10-17T06:08:59.713 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.125:3300/172.21.15.184:3300/172.21.15.184:3301" will pass to kernel 2023-10-17T06:08:59.720 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-17T06:08:59.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:08:59.721 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-17T06:08:59.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:08:59.754 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-17T06:08:59.836 INFO:teuthology.orchestra.run.smithi125.stdout:client5213 2023-10-17T06:08:59.837 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:08:59.837 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:08:59.901 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-17T06:09:00.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.114+0000 7fee664b5700 1 Processor -- start 2023-10-17T06:09:00.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.114+0000 7fee664b5700 1 -- start start 2023-10-17T06:09:00.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.118+0000 7fee664b5700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fee6006b830 0x7fee60160960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:00.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.118+0000 7fee664b5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee60160ea0 0x7fee600cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:00.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.118+0000 7fee664b5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6006a790 con 0x7fee6015cd20 2023-10-17T06:09:00.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.118+0000 7fee664b5700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee60161310 con 0x7fee6006b830 2023-10-17T06:09:00.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.118+0000 7fee664b5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6006aa70 con 0x7fee60160ea0 2023-10-17T06:09:00.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.118+0000 7fee5ffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fee6015cd20 0x7fee600cefb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49110/0 (socket says 172.21.15.125:49110) 2023-10-17T06:09:00.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.118+0000 7fee5ffff700 1 -- 172.21.15.125:0/260992311 learned_addr learned my addr 172.21.15.125:0/260992311 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:09:00.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.118+0000 7fee577fe700 1 --2- 172.21.15.125:0/260992311 >> v2:172.21.15.184:3300/0 conn(0x7fee6006b830 0x7fee60160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:00.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.118+0000 7fee64a52700 1 --2- 172.21.15.125:0/260992311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee60160ea0 0x7fee600cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:00.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.118+0000 7fee5f7fe700 1 -- 172.21.15.125:0/260992311 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971877933 0 0) 0x7fee6006a790 con 0x7fee6015cd20 2023-10-17T06:09:00.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.118+0000 7fee5f7fe700 1 -- 172.21.15.125:0/260992311 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee400035d0 con 0x7fee6015cd20 2023-10-17T06:09:00.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.118+0000 7fee577fe700 1 -- 172.21.15.125:0/260992311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee60160ea0 msgr2=0x7fee600cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:09:00.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.118+0000 7fee577fe700 1 --2- 172.21.15.125:0/260992311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee60160ea0 0x7fee600cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:00.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.118+0000 7fee577fe700 1 -- 172.21.15.125:0/260992311 >> v1:172.21.15.125:6789/0 conn(0x7fee6015cd20 legacy=0x7fee600cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:00.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.118+0000 7fee577fe700 1 -- 172.21.15.125:0/260992311 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6006ad50 con 0x7fee6006b830 2023-10-17T06:09:00.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.118+0000 7fee577fe700 1 --2- 172.21.15.125:0/260992311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee6006b830 0x7fee60160960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fee48009850 tx=0x7fee48009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f63d71749ed537e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:09:00.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.122+0000 7fee5f7fe700 1 -- 172.21.15.125:0/260992311 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee48011830 con 0x7fee6006b830 2023-10-17T06:09:00.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.122+0000 7fee5f7fe700 1 -- 172.21.15.125:0/260992311 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee48011990 con 0x7fee6006b830 2023-10-17T06:09:00.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.122+0000 7fee5f7fe700 1 -- 172.21.15.125:0/260992311 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee48011d40 con 0x7fee6006b830 2023-10-17T06:09:00.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.122+0000 7fee664b5700 1 -- 172.21.15.125:0/260992311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee6006b830 msgr2=0x7fee60160960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:00.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.122+0000 7fee664b5700 1 --2- 172.21.15.125:0/260992311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee6006b830 0x7fee60160960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fee48009850 tx=0x7fee48009b60 comp rx=0 tx=0).stop 2023-10-17T06:09:00.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.122+0000 7fee664b5700 1 -- 172.21.15.125:0/260992311 shutdown_connections 2023-10-17T06:09:00.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.122+0000 7fee664b5700 1 --2- 172.21.15.125:0/260992311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee60160ea0 0x7fee600cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:00.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.122+0000 7fee664b5700 1 --2- 172.21.15.125:0/260992311 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee6006b830 0x7fee60160960 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:00.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.122+0000 7fee664b5700 1 -- 172.21.15.125:0/260992311 >> 172.21.15.125:0/260992311 conn(0x7fee600d09f0 msgr2=0x7fee600d0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:09:00.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.122+0000 7fee664b5700 1 -- 172.21.15.125:0/260992311 shutdown_connections 2023-10-17T06:09:00.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.122+0000 7fee664b5700 1 -- 172.21.15.125:0/260992311 wait complete. 2023-10-17T06:09:00.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.122+0000 7fee664b5700 1 Processor -- start 2023-10-17T06:09:00.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee664b5700 1 -- start start 2023-10-17T06:09:00.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee664b5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee6006b830 0x7fee601f6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:00.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee664b5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee6015cd20 0x7fee6015d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:00.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee664b5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee60160ea0 0x7fee600cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:00.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee664b5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6015d7e0 con 0x7fee6006b830 2023-10-17T06:09:00.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee664b5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6015dac0 con 0x7fee6015cd20 2023-10-17T06:09:00.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee664b5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6015dda0 con 0x7fee60160ea0 2023-10-17T06:09:00.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee5ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee6006b830 0x7fee601f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:00.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee5ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee6006b830 0x7fee601f6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41982/0 (socket says 172.21.15.125:41982) 2023-10-17T06:09:00.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee5ffff700 1 -- 172.21.15.125:0/3099105421 learned_addr learned my addr 172.21.15.125:0/3099105421 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:09:00.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee577fe700 1 --2- 172.21.15.125:0/3099105421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee6015cd20 0x7fee6015d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:00.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee64a52700 1 --2- 172.21.15.125:0/3099105421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee60160ea0 0x7fee600cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:00.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee5ffff700 1 -- 172.21.15.125:0/3099105421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee60160ea0 msgr2=0x7fee600cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:00.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee5ffff700 1 --2- 172.21.15.125:0/3099105421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee60160ea0 0x7fee600cc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:00.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee5ffff700 1 -- 172.21.15.125:0/3099105421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee6015cd20 msgr2=0x7fee6015d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:00.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee5ffff700 1 --2- 172.21.15.125:0/3099105421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee6015cd20 0x7fee6015d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:00.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee5ffff700 1 -- 172.21.15.125:0/3099105421 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee480094b0 con 0x7fee6006b830 2023-10-17T06:09:00.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee5ffff700 1 --2- 172.21.15.125:0/3099105421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee6006b830 0x7fee601f6740 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fee5000c700 tx=0x7fee5000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:09:00.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee5d7fa700 1 -- 172.21.15.125:0/3099105421 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50005d90 con 0x7fee6006b830 2023-10-17T06:09:00.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee5d7fa700 1 -- 172.21.15.125:0/3099105421 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee500070d0 con 0x7fee6006b830 2023-10-17T06:09:00.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee664b5700 1 -- 172.21.15.125:0/3099105421 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6015e080 con 0x7fee6006b830 2023-10-17T06:09:00.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee5d7fa700 1 -- 172.21.15.125:0/3099105421 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50007480 con 0x7fee6006b830 2023-10-17T06:09:00.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.126+0000 7fee664b5700 1 -- 172.21.15.125:0/3099105421 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee600cc820 con 0x7fee6006b830 2023-10-17T06:09:00.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.130+0000 7fee664b5700 1 -- 172.21.15.125:0/3099105421 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee60072e60 con 0x7fee6006b830 2023-10-17T06:09:00.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.130+0000 7fee5d7fa700 1 -- 172.21.15.125:0/3099105421 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fee500075e0 con 0x7fee6006b830 2023-10-17T06:09:00.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.130+0000 7fee5d7fa700 1 --2- 172.21.15.125:0/3099105421 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fee440656f0 0x7fee44067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:00.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.134+0000 7fee5d7fa700 1 -- 172.21.15.125:0/3099105421 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fee500823c0 con 0x7fee6006b830 2023-10-17T06:09:00.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.134+0000 7fee577fe700 1 --2- 172.21.15.125:0/3099105421 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fee440656f0 0x7fee44067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:00.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.134+0000 7fee577fe700 1 --2- 172.21.15.125:0/3099105421 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fee440656f0 0x7fee44067bb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fee480090b0 tx=0x7fee48008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:09:00.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.138+0000 7fee5d7fa700 1 -- 172.21.15.125:0/3099105421 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fee5004fd30 con 0x7fee6006b830 2023-10-17T06:09:00.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.470+0000 7fee664b5700 1 -- 172.21.15.125:0/3099105421 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fee600c42a0 con 0x7fee6006b830 2023-10-17T06:09:00.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.470+0000 7fee5d7fa700 1 -- 172.21.15.125:0/3099105421 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fee50017070 con 0x7fee6006b830 2023-10-17T06:09:00.475 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-17T06:09:00.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.474+0000 7fee664b5700 1 -- 172.21.15.125:0/3099105421 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fee440656f0 msgr2=0x7fee44067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:00.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.474+0000 7fee664b5700 1 --2- 172.21.15.125:0/3099105421 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fee440656f0 0x7fee44067bb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fee480090b0 tx=0x7fee48008030 comp rx=0 tx=0).stop 2023-10-17T06:09:00.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.474+0000 7fee664b5700 1 -- 172.21.15.125:0/3099105421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee6006b830 msgr2=0x7fee601f6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:00.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.474+0000 7fee664b5700 1 --2- 172.21.15.125:0/3099105421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee6006b830 0x7fee601f6740 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fee5000c700 tx=0x7fee5000ca10 comp rx=0 tx=0).stop 2023-10-17T06:09:00.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.474+0000 7fee664b5700 1 -- 172.21.15.125:0/3099105421 shutdown_connections 2023-10-17T06:09:00.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.474+0000 7fee664b5700 1 --2- 172.21.15.125:0/3099105421 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fee440656f0 0x7fee44067bb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:00.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.474+0000 7fee664b5700 1 --2- 172.21.15.125:0/3099105421 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fee60160ea0 0x7fee600cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:00.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.474+0000 7fee664b5700 1 --2- 172.21.15.125:0/3099105421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fee6015cd20 0x7fee6015d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:00.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.474+0000 7fee664b5700 1 --2- 172.21.15.125:0/3099105421 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee6006b830 0x7fee601f6740 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:00.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.474+0000 7fee664b5700 1 -- 172.21.15.125:0/3099105421 >> 172.21.15.125:0/3099105421 conn(0x7fee600d09f0 msgr2=0x7fee600c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:09:00.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.474+0000 7fee664b5700 1 -- 172.21.15.125:0/3099105421 shutdown_connections 2023-10-17T06:09:00.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:00.474+0000 7fee664b5700 1 -- 172.21.15.125:0/3099105421 wait complete. 2023-10-17T06:09:00.499 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-17T06:09:00.500 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-17T06:09:00.500 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-10-17T06:09:00.500 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-17T06:09:00.501 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-17T06:09:00.501 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-17T06:09:00.501 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-17T06:09:00.502 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-17T06:09:00.502 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-17T06:09:00.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:09:00.503 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-10-17T06:09:00.523 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-17T06:09:00.524 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-17T06:09:00.524 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-10-17T06:09:00.524 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:09:00.524 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-10-17T06:09:00.524 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:09:00.525 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:09:00.525 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:09:00.525 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2023-10-17T06:09:00.525 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:09:00.525 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:09:00.526 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2023-10-17T06:09:00.526 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:09:00.526 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-10-17T06:09:00.526 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-17T06:09:00.526 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-10-17T06:09:00.527 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-17T06:09:00.527 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42311sec preferred_lft 42311sec 2023-10-17T06:09:00.527 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2023-10-17T06:09:00.527 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:09:00.527 INFO:teuthology.orchestra.run.smithi184.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-17T06:09:00.528 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 02:42:64:45:c8:05 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:09:00.528 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-17T06:09:00.528 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:09:00.528 INFO:teuthology.orchestra.run.smithi184.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-17T06:09:00.528 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 36:65:c0:53:e3:0e brd ff:ff:ff:ff:ff:ff 2023-10-17T06:09:00.529 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-17T06:09:00.529 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:09:00.529 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::5805:71ff:fefd:36ab/64 scope link 2023-10-17T06:09:00.529 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:09:00.529 INFO:teuthology.orchestra.run.smithi184.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-17T06:09:00.530 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 36:65:c0:53:e3:0e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-17T06:09:00.530 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::3465:c0ff:fe53:e30e/64 scope link 2023-10-17T06:09:00.530 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:09:00.530 INFO:teuthology.orchestra.run.smithi184.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-17T06:09:00.530 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether fa:09:e8:8b:fa:3a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-17T06:09:00.530 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::f809:e8ff:fe8b:fa3a/64 scope link 2023-10-17T06:09:00.531 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:09:00.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:09:00.532 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-17T06:09:00.613 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-10-17T06:09:00.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:09:00.617 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-10-17T06:09:00.678 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-10-17T06:09:00.678 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-17T06:09:00.679 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-17T06:09:00.679 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-17T06:09:00.679 INFO:teuthology.orchestra.run.smithi184.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-17T06:09:00.679 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-17T06:09:00.679 INFO:teuthology.orchestra.run.smithi184.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-17T06:09:00.680 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-17T06:09:00.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:09:00.681 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-10-17T06:09:00.681 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-10-17T06:09:00.682 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-17T06:09:00.682 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-17T06:09:00.683 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-17T06:09:00.683 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-10-17T06:09:00.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:09:00.811 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-17T06:09:00.829 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-17T06:09:00.829 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-17T06:09:00.830 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-17T06:09:00.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:09:00.831 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-10-17T06:09:00.913 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-17T06:09:00.914 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-17T06:09:00.975 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-17T06:09:00.976 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-17T06:09:00.976 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-17T06:09:01.036 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-17T06:09:01.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:09:01.037 DEBUG:teuthology.orchestra.run.smithi184:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:09:01.171 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:09:01.171 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-17T06:09:01.198 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:09:01.199 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-17T06:09:01.199 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.125:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-10-17T06:09:01.199 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: trying mount with new device syntax: 1@c779df02-0ec4-47de-a0f3-2371e60a2dde.cephfs=/ 2023-10-17T06:09:01.199 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.125:3300/172.21.15.184:3300/172.21.15.184:3301" will pass to kernel 2023-10-17T06:09:01.205 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-17T06:09:01.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:09:01.206 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-17T06:09:01.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:09:01.238 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-17T06:09:01.309 INFO:teuthology.orchestra.run.smithi184.stdout:client5557 2023-10-17T06:09:01.310 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:09:01.310 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:09:01.374 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:09:01.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.553+0000 7fe46ffff700 1 Processor -- start 2023-10-17T06:09:01.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.553+0000 7fe46ffff700 1 -- start start 2023-10-17T06:09:01.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.557+0000 7fe46ffff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe4700d2e00 0x7fe4700b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:01.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.557+0000 7fe46ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe4700b5ae0 0x7fe47006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:01.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.557+0000 7fe46ffff700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47015d0d0 con 0x7fe470160710 2023-10-17T06:09:01.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.557+0000 7fe46ffff700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47015df90 con 0x7fe4700b5ae0 2023-10-17T06:09:01.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.557+0000 7fe46ffff700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47006f0f0 con 0x7fe4700d2e00 2023-10-17T06:09:01.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.557+0000 7fe46f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe4700b5ae0 0x7fe47006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:01.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.557+0000 7fe46f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe4700b5ae0 0x7fe47006db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41994/0 (socket says 172.21.15.125:41994) 2023-10-17T06:09:01.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.557+0000 7fe46f7fe700 1 -- 172.21.15.125:0/1798655276 learned_addr learned my addr 172.21.15.125:0/1798655276 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:09:01.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.557+0000 7fe46effd700 1 --2- 172.21.15.125:0/1798655276 >> v2:172.21.15.184:3300/0 conn(0x7fe4700d2e00 0x7fe4700b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:01.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.557+0000 7fe46f7fe700 1 -- 172.21.15.125:0/1798655276 >> v2:172.21.15.184:3300/0 conn(0x7fe4700d2e00 msgr2=0x7fe4700b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:09:01.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.557+0000 7fe46f7fe700 1 --2- 172.21.15.125:0/1798655276 >> v2:172.21.15.184:3300/0 conn(0x7fe4700d2e00 0x7fe4700b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:01.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.557+0000 7fe46f7fe700 1 -- 172.21.15.125:0/1798655276 >> v1:172.21.15.184:6789/0 conn(0x7fe470160710 legacy=0x7fe4700d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:01.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.557+0000 7fe46f7fe700 1 -- 172.21.15.125:0/1798655276 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47015d310 con 0x7fe4700b5ae0 2023-10-17T06:09:01.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.557+0000 7fe46f7fe700 1 --2- 172.21.15.125:0/1798655276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4700b5ae0 0x7fe47006db60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe470070660 tx=0x7fe46800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43103dfc326b2a3b server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:09:01.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.557+0000 7fe46dffb700 1 -- 172.21.15.125:0/1798655276 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46800e070 con 0x7fe4700b5ae0 2023-10-17T06:09:01.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.557+0000 7fe46dffb700 1 -- 172.21.15.125:0/1798655276 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46800b910 con 0x7fe4700b5ae0 2023-10-17T06:09:01.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.557+0000 7fe46dffb700 1 -- 172.21.15.125:0/1798655276 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46800bcc0 con 0x7fe4700b5ae0 2023-10-17T06:09:01.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.557+0000 7fe46ffff700 1 -- 172.21.15.125:0/1798655276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4700b5ae0 msgr2=0x7fe47006db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:01.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.557+0000 7fe46ffff700 1 --2- 172.21.15.125:0/1798655276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4700b5ae0 0x7fe47006db60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe470070660 tx=0x7fe46800b330 comp rx=0 tx=0).stop 2023-10-17T06:09:01.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.561+0000 7fe46ffff700 1 -- 172.21.15.125:0/1798655276 shutdown_connections 2023-10-17T06:09:01.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.561+0000 7fe46ffff700 1 --2- 172.21.15.125:0/1798655276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4700b5ae0 0x7fe47006db60 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:01.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.561+0000 7fe46ffff700 1 --2- 172.21.15.125:0/1798655276 >> v2:172.21.15.184:3300/0 conn(0x7fe4700d2e00 0x7fe4700b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:01.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.561+0000 7fe46ffff700 1 -- 172.21.15.125:0/1798655276 >> 172.21.15.125:0/1798655276 conn(0x7fe470069f20 msgr2=0x7fe47006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:09:01.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.561+0000 7fe46ffff700 1 -- 172.21.15.125:0/1798655276 shutdown_connections 2023-10-17T06:09:01.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.561+0000 7fe46ffff700 1 -- 172.21.15.125:0/1798655276 wait complete. 2023-10-17T06:09:01.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.561+0000 7fe46ffff700 1 Processor -- start 2023-10-17T06:09:01.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.561+0000 7fe46ffff700 1 -- start start 2023-10-17T06:09:01.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe46ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4700b5ae0 0x7fe4701f6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:01.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe46ffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4700d2e00 0x7fe47015af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:01.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe46ffff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe470160710 0x7fe4701f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:01.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe46ffff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47015aaf0 con 0x7fe4700b5ae0 2023-10-17T06:09:01.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe46ffff700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4701f6990 con 0x7fe470160710 2023-10-17T06:09:01.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe46ffff700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47015b4c0 con 0x7fe4700d2e00 2023-10-17T06:09:01.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe46effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4700b5ae0 0x7fe4701f6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:01.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe46effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4700b5ae0 0x7fe4701f6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42008/0 (socket says 172.21.15.125:42008) 2023-10-17T06:09:01.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe46effd700 1 -- 172.21.15.125:0/60382674 learned_addr learned my addr 172.21.15.125:0/60382674 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:09:01.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe46f7fe700 1 --2- 172.21.15.125:0/60382674 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe470160710 0x7fe4701f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:01.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe46e7fc700 1 --2- 172.21.15.125:0/60382674 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4700d2e00 0x7fe47015af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:01.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe46effd700 1 -- 172.21.15.125:0/60382674 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4700d2e00 msgr2=0x7fe47015af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:01.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe46effd700 1 --2- 172.21.15.125:0/60382674 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4700d2e00 0x7fe47015af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:01.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe46effd700 1 -- 172.21.15.125:0/60382674 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe470160710 msgr2=0x7fe4701f1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:01.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe46effd700 1 --2- 172.21.15.125:0/60382674 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe470160710 0x7fe4701f1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:01.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe46effd700 1 -- 172.21.15.125:0/60382674 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe468009b30 con 0x7fe4700b5ae0 2023-10-17T06:09:01.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe46effd700 1 --2- 172.21.15.125:0/60382674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4700b5ae0 0x7fe4701f6450 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe46000e840 tx=0x7fe46000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:09:01.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe4577fe700 1 -- 172.21.15.125:0/60382674 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4600095a0 con 0x7fe4700b5ae0 2023-10-17T06:09:01.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe4577fe700 1 -- 172.21.15.125:0/60382674 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46000c690 con 0x7fe4700b5ae0 2023-10-17T06:09:01.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe4577fe700 1 -- 172.21.15.125:0/60382674 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46000ca00 con 0x7fe4700b5ae0 2023-10-17T06:09:01.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.565+0000 7fe46ffff700 1 -- 172.21.15.125:0/60382674 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe470159ee0 con 0x7fe4700b5ae0 2023-10-17T06:09:01.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.569+0000 7fe46ffff700 1 -- 172.21.15.125:0/60382674 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47015a4a0 con 0x7fe4700b5ae0 2023-10-17T06:09:01.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.569+0000 7fe46ffff700 1 -- 172.21.15.125:0/60382674 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe470072e60 con 0x7fe4700b5ae0 2023-10-17T06:09:01.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.569+0000 7fe4577fe700 1 -- 172.21.15.125:0/60382674 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe46000cb60 con 0x7fe4700b5ae0 2023-10-17T06:09:01.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.573+0000 7fe4577fe700 1 --2- 172.21.15.125:0/60382674 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe45c0656f0 0x7fe45c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:01.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.573+0000 7fe4577fe700 1 -- 172.21.15.125:0/60382674 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe460082f50 con 0x7fe4700b5ae0 2023-10-17T06:09:01.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.573+0000 7fe46e7fc700 1 --2- 172.21.15.125:0/60382674 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe45c0656f0 0x7fe45c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:01.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.573+0000 7fe46e7fc700 1 --2- 172.21.15.125:0/60382674 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe45c0656f0 0x7fe45c067bb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe470152f10 tx=0x7fe464009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:09:01.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.577+0000 7fe4577fe700 1 -- 172.21.15.125:0/60382674 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe4600508d0 con 0x7fe4700b5ae0 2023-10-17T06:09:01.618 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:09:01.625 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:09:01.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.817+0000 7fe46ffff700 1 -- 172.21.15.125:0/60382674 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe47006d3e0 con 0x7fe4700b5ae0 2023-10-17T06:09:01.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.817+0000 7fe4577fe700 1 -- 172.21.15.125:0/60382674 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4887 (secure 0 0 0) 0x7fe460053ef0 con 0x7fe4700b5ae0 2023-10-17T06:09:01.823 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:09:01.824 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:08:51.328615+0000","modified":"2023-10-17T06:08:54.897934+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.125:6837/2351050168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2351050168},{"type":"v1","addr":"172.21.15.125:6837","nonce":2351050168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-17T06:09:01.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.821+0000 7fe46ffff700 1 -- 172.21.15.125:0/60382674 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe45c0656f0 msgr2=0x7fe45c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:01.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.821+0000 7fe46ffff700 1 --2- 172.21.15.125:0/60382674 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe45c0656f0 0x7fe45c067bb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe470152f10 tx=0x7fe464009040 comp rx=0 tx=0).stop 2023-10-17T06:09:01.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.821+0000 7fe46ffff700 1 -- 172.21.15.125:0/60382674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4700b5ae0 msgr2=0x7fe4701f6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:01.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.821+0000 7fe46ffff700 1 --2- 172.21.15.125:0/60382674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4700b5ae0 0x7fe4701f6450 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe46000e840 tx=0x7fe46000ec00 comp rx=0 tx=0).stop 2023-10-17T06:09:01.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.821+0000 7fe46ffff700 1 -- 172.21.15.125:0/60382674 shutdown_connections 2023-10-17T06:09:01.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.821+0000 7fe46ffff700 1 --2- 172.21.15.125:0/60382674 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe45c0656f0 0x7fe45c067bb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:01.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.821+0000 7fe46ffff700 1 --2- 172.21.15.125:0/60382674 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe470160710 0x7fe4701f1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:01.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.821+0000 7fe46ffff700 1 --2- 172.21.15.125:0/60382674 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe4700d2e00 0x7fe47015af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:01.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.821+0000 7fe46ffff700 1 --2- 172.21.15.125:0/60382674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4700b5ae0 0x7fe4701f6450 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:01.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.821+0000 7fe46ffff700 1 -- 172.21.15.125:0/60382674 >> 172.21.15.125:0/60382674 conn(0x7fe470069f20 msgr2=0x7fe4700b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:09:01.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.821+0000 7fe46ffff700 1 -- 172.21.15.125:0/60382674 shutdown_connections 2023-10-17T06:09:01.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:01.821+0000 7fe46ffff700 1 -- 172.21.15.125:0/60382674 wait complete. 2023-10-17T06:09:01.829 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 17 2023-10-17T06:09:01.850 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_defer_session_stale false 2023-10-17T06:09:02.029 INFO:teuthology.orchestra.run.smithi125.stdout:{"success":"mds_defer_session_stale = 'false' (not observed, change may require restart) "} 2023-10-17T06:09:02.030 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_defer_session_stale = 'false' (not observed, change may require restart) " } 2023-10-17T06:09:02.031 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds defer_client_eviction_on_laggy_osds true 2023-10-17T06:09:02.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.205+0000 7f8441daf700 1 Processor -- start 2023-10-17T06:09:02.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.205+0000 7f8441daf700 1 -- start start 2023-10-17T06:09:02.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.205+0000 7f8441daf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f843c0d2e00 0x7f843c0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:02.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.205+0000 7f8441daf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f843c0b5ae0 0x7f843c06db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:02.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.205+0000 7f8441daf700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843c15d0d0 con 0x7f843c160710 2023-10-17T06:09:02.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.205+0000 7f8441daf700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843c15df90 con 0x7f843c0d2e00 2023-10-17T06:09:02.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.205+0000 7f8441daf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c06f0f0 con 0x7f843c0b5ae0 2023-10-17T06:09:02.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.209+0000 7f8440dad700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f843c0d2e00 0x7f843c0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:02.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.209+0000 7f8440dad700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f843c0d2e00 0x7f843c0b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42020/0 (socket says 172.21.15.125:42020) 2023-10-17T06:09:02.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.209+0000 7f8440dad700 1 -- 172.21.15.125:0/3454740311 learned_addr learned my addr 172.21.15.125:0/3454740311 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:09:02.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.209+0000 7f84415ae700 1 --2- 172.21.15.125:0/3454740311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f843c0b5ae0 0x7f843c06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:02.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.209+0000 7f8440dad700 1 -- 172.21.15.125:0/3454740311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f843c0b5ae0 msgr2=0x7f843c06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:09:02.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.209+0000 7f8440dad700 1 --2- 172.21.15.125:0/3454740311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f843c0b5ae0 0x7f843c06db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.209+0000 7f8440dad700 1 -- 172.21.15.125:0/3454740311 >> v1:172.21.15.184:6789/0 conn(0x7f843c160710 legacy=0x7f843c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:02.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.209+0000 7f8440dad700 1 -- 172.21.15.125:0/3454740311 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c15d310 con 0x7f843c0d2e00 2023-10-17T06:09:02.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.209+0000 7f8440dad700 1 --2- 172.21.15.125:0/3454740311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f843c0d2e00 0x7f843c0b6e00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8430009e50 tx=0x7f843000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd85ba82371c8769 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:09:02.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.209+0000 7f843b7fe700 1 -- 172.21.15.125:0/3454740311 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843000e070 con 0x7f843c0d2e00 2023-10-17T06:09:02.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.209+0000 7f843b7fe700 1 -- 172.21.15.125:0/3454740311 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843000b910 con 0x7f843c0d2e00 2023-10-17T06:09:02.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.209+0000 7f843b7fe700 1 -- 172.21.15.125:0/3454740311 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843000bcc0 con 0x7f843c0d2e00 2023-10-17T06:09:02.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.209+0000 7f8441daf700 1 -- 172.21.15.125:0/3454740311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f843c0d2e00 msgr2=0x7f843c0b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:02.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.209+0000 7f8441daf700 1 --2- 172.21.15.125:0/3454740311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f843c0d2e00 0x7f843c0b6e00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8430009e50 tx=0x7f843000b330 comp rx=0 tx=0).stop 2023-10-17T06:09:02.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.209+0000 7f8441daf700 1 -- 172.21.15.125:0/3454740311 shutdown_connections 2023-10-17T06:09:02.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.209+0000 7f8441daf700 1 --2- 172.21.15.125:0/3454740311 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f843c0b5ae0 0x7f843c06db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.209+0000 7f8441daf700 1 --2- 172.21.15.125:0/3454740311 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f843c0d2e00 0x7f843c0b6e00 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.209+0000 7f8441daf700 1 -- 172.21.15.125:0/3454740311 >> 172.21.15.125:0/3454740311 conn(0x7f843c069f20 msgr2=0x7f843c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:09:02.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.209+0000 7f8441daf700 1 -- 172.21.15.125:0/3454740311 shutdown_connections 2023-10-17T06:09:02.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.209+0000 7f8441daf700 1 -- 172.21.15.125:0/3454740311 wait complete. 2023-10-17T06:09:02.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.213+0000 7f8441daf700 1 Processor -- start 2023-10-17T06:09:02.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.213+0000 7f8441daf700 1 -- start start 2023-10-17T06:09:02.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f8441daf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f843c0b5ae0 0x7f843c0b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:02.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f8441daf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f843c0d2e00 0x7f843c08cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:02.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f8441daf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f843c160710 0x7f843c08d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:02.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f8441daf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c08acf0 con 0x7f843c0b5ae0 2023-10-17T06:09:02.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f8441daf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c08afd0 con 0x7f843c160710 2023-10-17T06:09:02.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f8441daf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c08b2b0 con 0x7f843c0d2e00 2023-10-17T06:09:02.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f8440dad700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f843c0b5ae0 0x7f843c0b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:02.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f8440dad700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f843c0b5ae0 0x7f843c0b1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42030/0 (socket says 172.21.15.125:42030) 2023-10-17T06:09:02.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f8440dad700 1 -- 172.21.15.125:0/1034369331 learned_addr learned my addr 172.21.15.125:0/1034369331 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:09:02.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f84415ae700 1 --2- 172.21.15.125:0/1034369331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f843c160710 0x7f843c08d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:02.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f843bfff700 1 --2- 172.21.15.125:0/1034369331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f843c0d2e00 0x7f843c08cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:02.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f8440dad700 1 -- 172.21.15.125:0/1034369331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f843c0d2e00 msgr2=0x7f843c08cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:02.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f8440dad700 1 --2- 172.21.15.125:0/1034369331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f843c0d2e00 0x7f843c08cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f8440dad700 1 -- 172.21.15.125:0/1034369331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f843c160710 msgr2=0x7f843c08d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:02.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f8440dad700 1 --2- 172.21.15.125:0/1034369331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f843c160710 0x7f843c08d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f8440dad700 1 -- 172.21.15.125:0/1034369331 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8430009b30 con 0x7f843c0b5ae0 2023-10-17T06:09:02.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f84415ae700 1 --2- 172.21.15.125:0/1034369331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f843c160710 0x7f843c08d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:09:02.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f8440dad700 1 --2- 172.21.15.125:0/1034369331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f843c0b5ae0 0x7f843c0b1500 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f843000b370 tx=0x7f8430004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:09:02.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f84397fa700 1 -- 172.21.15.125:0/1034369331 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430004960 con 0x7f843c0b5ae0 2023-10-17T06:09:02.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f84397fa700 1 -- 172.21.15.125:0/1034369331 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84300092e0 con 0x7f843c0b5ae0 2023-10-17T06:09:02.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f84397fa700 1 -- 172.21.15.125:0/1034369331 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843001b690 con 0x7f843c0b5ae0 2023-10-17T06:09:02.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f8441daf700 1 -- 172.21.15.125:0/1034369331 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843c08b590 con 0x7f843c0b5ae0 2023-10-17T06:09:02.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.217+0000 7f8441daf700 1 -- 172.21.15.125:0/1034369331 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843c08a000 con 0x7f843c0b5ae0 2023-10-17T06:09:02.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.221+0000 7f8441daf700 1 -- 172.21.15.125:0/1034369331 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843c04e910 con 0x7f843c0b5ae0 2023-10-17T06:09:02.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.221+0000 7f84397fa700 1 -- 172.21.15.125:0/1034369331 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f843001b7f0 con 0x7f843c0b5ae0 2023-10-17T06:09:02.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.225+0000 7f84397fa700 1 --2- 172.21.15.125:0/1034369331 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f84200656f0 0x7f8420067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:02.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.225+0000 7f84397fa700 1 -- 172.21.15.125:0/1034369331 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f84300845d0 con 0x7f843c0b5ae0 2023-10-17T06:09:02.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.225+0000 7f843bfff700 1 --2- 172.21.15.125:0/1034369331 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f84200656f0 0x7f8420067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:02.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.225+0000 7f843bfff700 1 --2- 172.21.15.125:0/1034369331 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f84200656f0 0x7f8420067bb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f843c08e2a0 tx=0x7f8428009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:09:02.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.229+0000 7f84397fa700 1 -- 172.21.15.125:0/1034369331 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f8430051f40 con 0x7f843c0b5ae0 2023-10-17T06:09:02.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.465+0000 7f8441daf700 1 -- 172.21.15.125:0/1034369331 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command([{prefix=config set, name=defer_client_eviction_on_laggy_osds}] v 0) v1 -- 0x7f843c06d3e0 con 0x7f843c0b5ae0 2023-10-17T06:09:02.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.473+0000 7f84397fa700 1 -- 172.21.15.125:0/1034369331 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{prefix=config set, name=defer_client_eviction_on_laggy_osds}]=0 v11)=0 v11) v1 ==== 136+0+0 (secure 0 0 0) 0x7f8430055560 con 0x7f843c0b5ae0 2023-10-17T06:09:02.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.477+0000 7f8441daf700 1 -- 172.21.15.125:0/1034369331 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f84200656f0 msgr2=0x7f8420067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:02.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.477+0000 7f8441daf700 1 --2- 172.21.15.125:0/1034369331 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f84200656f0 0x7f8420067bb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f843c08e2a0 tx=0x7f8428009040 comp rx=0 tx=0).stop 2023-10-17T06:09:02.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.477+0000 7f8441daf700 1 -- 172.21.15.125:0/1034369331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f843c0b5ae0 msgr2=0x7f843c0b1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:02.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.477+0000 7f8441daf700 1 --2- 172.21.15.125:0/1034369331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f843c0b5ae0 0x7f843c0b1500 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f843000b370 tx=0x7f8430004af0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.477+0000 7f8441daf700 1 -- 172.21.15.125:0/1034369331 shutdown_connections 2023-10-17T06:09:02.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.477+0000 7f8441daf700 1 --2- 172.21.15.125:0/1034369331 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f84200656f0 0x7f8420067bb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.477+0000 7f8441daf700 1 --2- 172.21.15.125:0/1034369331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f843c160710 0x7f843c08d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.477+0000 7f8441daf700 1 --2- 172.21.15.125:0/1034369331 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f843c0d2e00 0x7f843c08cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.477+0000 7f8441daf700 1 --2- 172.21.15.125:0/1034369331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f843c0b5ae0 0x7f843c0b1500 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.477+0000 7f8441daf700 1 -- 172.21.15.125:0/1034369331 >> 172.21.15.125:0/1034369331 conn(0x7f843c069f20 msgr2=0x7f843c0b2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:09:02.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.477+0000 7f8441daf700 1 -- 172.21.15.125:0/1034369331 shutdown_connections 2023-10-17T06:09:02.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.477+0000 7f8441daf700 1 -- 172.21.15.125:0/1034369331 wait complete. 2023-10-17T06:09:02.502 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds defer_client_eviction_on_laggy_osds 2023-10-17T06:09:02.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.673+0000 7f7eb81ed700 1 Processor -- start 2023-10-17T06:09:02.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.673+0000 7f7eb81ed700 1 -- start start 2023-10-17T06:09:02.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb81ed700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7eb00ccfe0 0x7f7eb006f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:02.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb81ed700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb015b1d0 con 0x7f7eb006f990 2023-10-17T06:09:02.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb81ed700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb00ce600 con 0x7f7eb015adf0 2023-10-17T06:09:02.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb81ed700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb00ca590 con 0x7f7eb00ccfe0 2023-10-17T06:09:02.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb678a700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7eb006f990 0x7f7eb006fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49122/0 (socket says 172.21.15.125:49122) 2023-10-17T06:09:02.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb678a700 1 -- 172.21.15.125:0/1372129872 learned_addr learned my addr 172.21.15.125:0/1372129872 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:09:02.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb5788700 1 --2- 172.21.15.125:0/1372129872 >> v2:172.21.15.184:3300/0 conn(0x7f7eb00ccfe0 0x7f7eb006f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:02.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb4f87700 1 -- 172.21.15.125:0/1372129872 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394141150 0 0) 0x7f7ea8001490 con 0x7f7eb006f990 2023-10-17T06:09:02.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb4f87700 1 -- 172.21.15.125:0/1372129872 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e9c0035d0 con 0x7f7eb006f990 2023-10-17T06:09:02.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb4f87700 1 -- 172.21.15.125:0/1372129872 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 642417171 0 0) 0x7f7eb00ce600 con 0x7f7eb015adf0 2023-10-17T06:09:02.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb4f87700 1 -- 172.21.15.125:0/1372129872 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ea8001490 con 0x7f7eb015adf0 2023-10-17T06:09:02.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb4f87700 1 -- 172.21.15.125:0/1372129872 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3651219888 0 0) 0x7f7e9c0035d0 con 0x7f7eb006f990 2023-10-17T06:09:02.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb4f87700 1 -- 172.21.15.125:0/1372129872 >> v2:172.21.15.184:3300/0 conn(0x7f7eb00ccfe0 msgr2=0x7f7eb006f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:09:02.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb4f87700 1 --2- 172.21.15.125:0/1372129872 >> v2:172.21.15.184:3300/0 conn(0x7f7eb00ccfe0 0x7f7eb006f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb4f87700 1 -- 172.21.15.125:0/1372129872 >> v1:172.21.15.184:6789/0 conn(0x7f7eb015adf0 legacy=0x7f7eb00cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:02.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb4f87700 1 -- 172.21.15.125:0/1372129872 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb00cd580 con 0x7f7eb006f990 2023-10-17T06:09:02.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb4f87700 1 -- 172.21.15.125:0/1372129872 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1524966551 0 0) 0x7f7ea8001b80 con 0x7f7eb006f990 2023-10-17T06:09:02.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb4f87700 1 -- 172.21.15.125:0/1372129872 >> v1:172.21.15.125:6789/0 conn(0x7f7eb006f990 legacy=0x7f7eb006fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:02.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb4f87700 1 --2- 172.21.15.125:0/1372129872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e9c003c20 0x7f7e9c004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:02.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb4f87700 1 --2- 172.21.15.125:0/1372129872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e9c004870 0x7f7e9c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:02.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb4f87700 1 --2- 172.21.15.125:0/1372129872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e9c005350 0x7f7e9c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:02.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb4f87700 1 -- 172.21.15.125:0/1372129872 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c00c240 con 0x7f7e9c003c20 2023-10-17T06:09:02.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb4f87700 1 -- 172.21.15.125:0/1372129872 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c00c3b0 con 0x7f7e9c004870 2023-10-17T06:09:02.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb4f87700 1 -- 172.21.15.125:0/1372129872 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c00c570 con 0x7f7e9c005350 2023-10-17T06:09:02.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.677+0000 7f7eb5f89700 1 --2- 172.21.15.125:0/1372129872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e9c003c20 0x7f7e9c004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:02.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.681+0000 7f7eb5788700 1 --2- 172.21.15.125:0/1372129872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e9c004870 0x7f7e9c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:02.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.681+0000 7f7eb678a700 1 --2- 172.21.15.125:0/1372129872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e9c005350 0x7f7e9c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:02.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.681+0000 7f7eb5f89700 1 -- 172.21.15.125:0/1372129872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e9c005350 msgr2=0x7f7e9c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:09:02.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.681+0000 7f7eb5f89700 1 --2- 172.21.15.125:0/1372129872 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e9c005350 0x7f7e9c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.681+0000 7f7eb5f89700 1 -- 172.21.15.125:0/1372129872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e9c004870 msgr2=0x7f7e9c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:09:02.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.681+0000 7f7eb5f89700 1 --2- 172.21.15.125:0/1372129872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e9c004870 0x7f7e9c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.681+0000 7f7eb5f89700 1 -- 172.21.15.125:0/1372129872 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c0035d0 con 0x7f7e9c003c20 2023-10-17T06:09:02.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.681+0000 7f7eb678a700 1 -- 172.21.15.125:0/1372129872 reap_dead start 2023-10-17T06:09:02.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.681+0000 7f7eb5f89700 1 --2- 172.21.15.125:0/1372129872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e9c003c20 0x7f7e9c004020 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7eac001960 tx=0x7f7e9c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c2009764658291 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:09:02.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.681+0000 7f7eb4f87700 1 -- 172.21.15.125:0/1372129872 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac001450 con 0x7f7e9c003c20 2023-10-17T06:09:02.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.681+0000 7f7eb4f87700 1 -- 172.21.15.125:0/1372129872 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac0052f0 con 0x7f7e9c003c20 2023-10-17T06:09:02.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.681+0000 7f7eb4f87700 1 -- 172.21.15.125:0/1372129872 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac0036a0 con 0x7f7e9c003c20 2023-10-17T06:09:02.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.681+0000 7f7eb81ed700 1 -- 172.21.15.125:0/1372129872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e9c003c20 msgr2=0x7f7e9c004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:02.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.681+0000 7f7eb81ed700 1 --2- 172.21.15.125:0/1372129872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e9c003c20 0x7f7e9c004020 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7eac001960 tx=0x7f7e9c0058a0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.681+0000 7f7eb81ed700 1 -- 172.21.15.125:0/1372129872 shutdown_connections 2023-10-17T06:09:02.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.681+0000 7f7eb81ed700 1 --2- 172.21.15.125:0/1372129872 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e9c003c20 0x7f7e9c004020 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.681+0000 7f7eb81ed700 1 -- 172.21.15.125:0/1372129872 >> 172.21.15.125:0/1372129872 conn(0x7f7eb00ce820 msgr2=0x7f7eb00cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:09:02.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.681+0000 7f7eb81ed700 1 -- 172.21.15.125:0/1372129872 shutdown_connections 2023-10-17T06:09:02.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.681+0000 7f7eb81ed700 1 -- 172.21.15.125:0/1372129872 wait complete. 2023-10-17T06:09:02.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.685+0000 7f7eb81ed700 1 Processor -- start 2023-10-17T06:09:02.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.685+0000 7f7eb81ed700 1 -- start start 2023-10-17T06:09:02.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.685+0000 7f7eb81ed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e9c003c20 0x7f7eb006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:02.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.685+0000 7f7eb81ed700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7eb0158530 0x7f7eb014fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:02.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.685+0000 7f7eb81ed700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7eb00c3f90 0x7f7eb00af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:02.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.685+0000 7f7eb81ed700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb0159060 con 0x7f7e9c003c20 2023-10-17T06:09:02.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.685+0000 7f7eb81ed700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb006d450 con 0x7f7eb00c3f90 2023-10-17T06:09:02.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.685+0000 7f7eb81ed700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb006de20 con 0x7f7eb0158530 2023-10-17T06:09:02.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.689+0000 7f7eb5f89700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e9c003c20 0x7f7eb006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:02.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.689+0000 7f7eb5f89700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e9c003c20 0x7f7eb006d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42046/0 (socket says 172.21.15.125:42046) 2023-10-17T06:09:02.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.689+0000 7f7eb5f89700 1 -- 172.21.15.125:0/892738491 learned_addr learned my addr 172.21.15.125:0/892738491 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:09:02.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.689+0000 7f7eb5788700 1 --2- 172.21.15.125:0/892738491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7eb0158530 0x7f7eb014fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:02.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.689+0000 7f7eb678a700 1 --2- 172.21.15.125:0/892738491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7eb00c3f90 0x7f7eb00af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:02.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.689+0000 7f7eb5f89700 1 -- 172.21.15.125:0/892738491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7eb0158530 msgr2=0x7f7eb014fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:02.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.689+0000 7f7eb5f89700 1 --2- 172.21.15.125:0/892738491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7eb0158530 0x7f7eb014fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.689+0000 7f7eb5f89700 1 -- 172.21.15.125:0/892738491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7eb00c3f90 msgr2=0x7f7eb00af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:02.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.689+0000 7f7eb5f89700 1 --2- 172.21.15.125:0/892738491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7eb00c3f90 0x7f7eb00af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.689+0000 7f7eb5f89700 1 -- 172.21.15.125:0/892738491 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb0158aa0 con 0x7f7e9c003c20 2023-10-17T06:09:02.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.689+0000 7f7eb5788700 1 --2- 172.21.15.125:0/892738491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7eb0158530 0x7f7eb014fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:09:02.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.689+0000 7f7eb5f89700 1 --2- 172.21.15.125:0/892738491 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e9c003c20 0x7f7eb006d8e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7eac005040 tx=0x7f7eac0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:09:02.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.689+0000 7f7ea67fc700 1 -- 172.21.15.125:0/892738491 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac001450 con 0x7f7e9c003c20 2023-10-17T06:09:02.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.689+0000 7f7ea67fc700 1 -- 172.21.15.125:0/892738491 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac006a90 con 0x7f7e9c003c20 2023-10-17T06:09:02.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.689+0000 7f7ea67fc700 1 -- 172.21.15.125:0/892738491 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac006e20 con 0x7f7e9c003c20 2023-10-17T06:09:02.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.689+0000 7f7eb81ed700 1 -- 172.21.15.125:0/892738491 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb0158d80 con 0x7f7e9c003c20 2023-10-17T06:09:02.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.689+0000 7f7eb81ed700 1 -- 172.21.15.125:0/892738491 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb0150380 con 0x7f7e9c003c20 2023-10-17T06:09:02.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.693+0000 7f7eb81ed700 1 -- 172.21.15.125:0/892738491 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb006cf40 con 0x7f7e9c003c20 2023-10-17T06:09:02.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.693+0000 7f7ea67fc700 1 -- 172.21.15.125:0/892738491 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7eac007040 con 0x7f7e9c003c20 2023-10-17T06:09:02.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.693+0000 7f7ea67fc700 1 --2- 172.21.15.125:0/892738491 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7e940656f0 0x7f7e94067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:02.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.693+0000 7f7ea67fc700 1 -- 172.21.15.125:0/892738491 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7eac083780 con 0x7f7e9c003c20 2023-10-17T06:09:02.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.697+0000 7f7eb5788700 1 --2- 172.21.15.125:0/892738491 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7e940656f0 0x7f7e94067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:02.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.697+0000 7f7eb5788700 1 --2- 172.21.15.125:0/892738491 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7e940656f0 0x7f7e94067bb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0153c00 tx=0x7f7ea0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:09:02.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.701+0000 7f7ea67fc700 1 -- 172.21.15.125:0/892738491 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f7eb006cf40 con 0x7f7e9c003c20 2023-10-17T06:09:02.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.905+0000 7f7eb81ed700 1 -- 172.21.15.125:0/892738491 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "defer_client_eviction_on_laggy_osds"} v 0) v1 -- 0x7f7eb006cf40 con 0x7f7e9c003c20 2023-10-17T06:09:02.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.905+0000 7f7ea67fc700 1 -- 172.21.15.125:0/892738491 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "defer_client_eviction_on_laggy_osds"}]=0 v11) v1 ==== 118+0+5 (secure 0 0 0) 0x7f7eb006cf40 con 0x7f7e9c003c20 2023-10-17T06:09:02.911 INFO:teuthology.orchestra.run.smithi125.stdout:true 2023-10-17T06:09:02.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.909+0000 7f7eb81ed700 1 -- 172.21.15.125:0/892738491 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7e940656f0 msgr2=0x7f7e94067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:02.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.909+0000 7f7eb81ed700 1 --2- 172.21.15.125:0/892738491 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7e940656f0 0x7f7e94067bb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0153c00 tx=0x7f7ea0008040 comp rx=0 tx=0).stop 2023-10-17T06:09:02.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.909+0000 7f7eb81ed700 1 -- 172.21.15.125:0/892738491 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e9c003c20 msgr2=0x7f7eb006d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:02.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.909+0000 7f7eb81ed700 1 --2- 172.21.15.125:0/892738491 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e9c003c20 0x7f7eb006d8e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7eac005040 tx=0x7f7eac0012d0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.909+0000 7f7eb81ed700 1 -- 172.21.15.125:0/892738491 shutdown_connections 2023-10-17T06:09:02.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.909+0000 7f7eb81ed700 1 --2- 172.21.15.125:0/892738491 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7e940656f0 0x7f7e94067bb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.909+0000 7f7eb81ed700 1 --2- 172.21.15.125:0/892738491 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7eb00c3f90 0x7f7eb00af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.909+0000 7f7eb81ed700 1 --2- 172.21.15.125:0/892738491 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7eb0158530 0x7f7eb014fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.909+0000 7f7eb81ed700 1 --2- 172.21.15.125:0/892738491 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e9c003c20 0x7f7eb006d8e0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:02.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.909+0000 7f7eb81ed700 1 -- 172.21.15.125:0/892738491 >> 172.21.15.125:0/892738491 conn(0x7f7eb00ce820 msgr2=0x7f7eb00c49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:09:02.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.909+0000 7f7eb81ed700 1 -- 172.21.15.125:0/892738491 shutdown_connections 2023-10-17T06:09:02.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:02.909+0000 7f7eb81ed700 1 -- 172.21.15.125:0/892738491 wait complete. 2023-10-17T06:09:02.937 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2023-10-17T06:09:03.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.113+0000 7fefdf324700 1 Processor -- start 2023-10-17T06:09:03.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.113+0000 7fefdf324700 1 -- start start 2023-10-17T06:09:03.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.113+0000 7fefdf324700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefd815a410 0x7fefd815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:03.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.113+0000 7fefdf324700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd8071120 con 0x7fefd806d090 2023-10-17T06:09:03.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.113+0000 7fefdf324700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd815e990 con 0x7fefd806d470 2023-10-17T06:09:03.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.113+0000 7fefdf324700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd815f4f0 con 0x7fefd815a410 2023-10-17T06:09:03.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.117+0000 7fefde322700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fefd806d090 0x7fefd80b2590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49126/0 (socket says 172.21.15.125:49126) 2023-10-17T06:09:03.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.117+0000 7fefde322700 1 -- 172.21.15.125:0/3754905987 learned_addr learned my addr 172.21.15.125:0/3754905987 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:09:03.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.117+0000 7fefdeb23700 1 --2- 172.21.15.125:0/3754905987 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefd815a410 0x7fefd815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:03.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.117+0000 7fefdd320700 1 -- 172.21.15.125:0/3754905987 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988225243 0 0) 0x7fefd8071120 con 0x7fefd806d090 2023-10-17T06:09:03.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.117+0000 7fefdd320700 1 -- 172.21.15.125:0/3754905987 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefc40035d0 con 0x7fefd806d090 2023-10-17T06:09:03.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.117+0000 7fefdd320700 1 -- 172.21.15.125:0/3754905987 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907425564 0 0) 0x7fefd815e990 con 0x7fefd806d470 2023-10-17T06:09:03.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.117+0000 7fefdeb23700 1 -- 172.21.15.125:0/3754905987 >> v1:172.21.15.184:6789/0 conn(0x7fefd806d470 legacy=0x7fefd8070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:03.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.117+0000 7fefdeb23700 1 -- 172.21.15.125:0/3754905987 >> v1:172.21.15.125:6789/0 conn(0x7fefd806d090 legacy=0x7fefd80b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:03.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.117+0000 7fefdeb23700 1 -- 172.21.15.125:0/3754905987 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd815ec50 con 0x7fefd815a410 2023-10-17T06:09:03.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.117+0000 7fefdeb23700 1 --2- 172.21.15.125:0/3754905987 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefd815a410 0x7fefd815a8c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009dc0 tx=0x7fefd000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1822774f9d0485e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:09:03.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.117+0000 7fefdd320700 1 -- 172.21.15.125:0/3754905987 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd000e070 con 0x7fefd815a410 2023-10-17T06:09:03.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.117+0000 7fefdd320700 1 -- 172.21.15.125:0/3754905987 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd000bb20 con 0x7fefd815a410 2023-10-17T06:09:03.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.117+0000 7fefdd320700 1 -- 172.21.15.125:0/3754905987 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd000bed0 con 0x7fefd815a410 2023-10-17T06:09:03.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.121+0000 7fefdf324700 1 -- 172.21.15.125:0/3754905987 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefd815a410 msgr2=0x7fefd815a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:03.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.121+0000 7fefdf324700 1 --2- 172.21.15.125:0/3754905987 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefd815a410 0x7fefd815a8c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009dc0 tx=0x7fefd000b330 comp rx=0 tx=0).stop 2023-10-17T06:09:03.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.121+0000 7fefdf324700 1 -- 172.21.15.125:0/3754905987 shutdown_connections 2023-10-17T06:09:03.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.121+0000 7fefdf324700 1 --2- 172.21.15.125:0/3754905987 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefd815a410 0x7fefd815a8c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:03.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.121+0000 7fefdf324700 1 -- 172.21.15.125:0/3754905987 >> 172.21.15.125:0/3754905987 conn(0x7fefd80ce5c0 msgr2=0x7fefd80ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:09:03.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.121+0000 7fefdf324700 1 -- 172.21.15.125:0/3754905987 shutdown_connections 2023-10-17T06:09:03.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.121+0000 7fefdf324700 1 -- 172.21.15.125:0/3754905987 wait complete. 2023-10-17T06:09:03.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.121+0000 7fefdf324700 1 Processor -- start 2023-10-17T06:09:03.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.121+0000 7fefdf324700 1 -- start start 2023-10-17T06:09:03.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefdf324700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefd806d090 0x7fefd814d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:03.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefdf324700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefd806d470 0x7fefd80c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:03.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefdf324700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefd815a410 0x7fefd81f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:03.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefdf324700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd80ccaf0 con 0x7fefd806d470 2023-10-17T06:09:03.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefdf324700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd80c5990 con 0x7fefd815a410 2023-10-17T06:09:03.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefdf324700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd80cc190 con 0x7fefd806d090 2023-10-17T06:09:03.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefddb21700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefd806d470 0x7fefd80c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:03.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefddb21700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefd806d470 0x7fefd80c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42060/0 (socket says 172.21.15.125:42060) 2023-10-17T06:09:03.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefddb21700 1 -- 172.21.15.125:0/3833504026 learned_addr learned my addr 172.21.15.125:0/3833504026 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:09:03.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefde322700 1 --2- 172.21.15.125:0/3833504026 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefd806d090 0x7fefd814d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:03.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefdeb23700 1 --2- 172.21.15.125:0/3833504026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefd815a410 0x7fefd81f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:03.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefddb21700 1 -- 172.21.15.125:0/3833504026 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefd806d090 msgr2=0x7fefd814d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:03.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefddb21700 1 --2- 172.21.15.125:0/3833504026 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefd806d090 0x7fefd814d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:03.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefddb21700 1 -- 172.21.15.125:0/3833504026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefd815a410 msgr2=0x7fefd81f17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:03.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefddb21700 1 --2- 172.21.15.125:0/3833504026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefd815a410 0x7fefd81f17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:03.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefddb21700 1 -- 172.21.15.125:0/3833504026 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd0009a70 con 0x7fefd806d470 2023-10-17T06:09:03.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefdeb23700 1 --2- 172.21.15.125:0/3833504026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefd815a410 0x7fefd81f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:09:03.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefde322700 1 --2- 172.21.15.125:0/3833504026 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefd806d090 0x7fefd814d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:09:03.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefddb21700 1 --2- 172.21.15.125:0/3833504026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefd806d470 0x7fefd80c4850 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fefc80011e0 tx=0x7fefc800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:09:03.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefceffd700 1 -- 172.21.15.125:0/3833504026 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc80054e0 con 0x7fefd806d470 2023-10-17T06:09:03.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefceffd700 1 -- 172.21.15.125:0/3833504026 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc80036a0 con 0x7fefd806d470 2023-10-17T06:09:03.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefceffd700 1 -- 172.21.15.125:0/3833504026 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc8003a50 con 0x7fefd806d470 2023-10-17T06:09:03.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefdf324700 1 -- 172.21.15.125:0/3833504026 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd80c65c0 con 0x7fefd806d470 2023-10-17T06:09:03.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.125+0000 7fefdf324700 1 -- 172.21.15.125:0/3833504026 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd80cc710 con 0x7fefd806d470 2023-10-17T06:09:03.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.129+0000 7fefdf324700 1 -- 172.21.15.125:0/3833504026 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd80ccc30 con 0x7fefd806d470 2023-10-17T06:09:03.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.129+0000 7fefceffd700 1 -- 172.21.15.125:0/3833504026 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fefc8003bb0 con 0x7fefd806d470 2023-10-17T06:09:03.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.133+0000 7fefceffd700 1 --2- 172.21.15.125:0/3833504026 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fefbc0656f0 0x7fefbc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:09:03.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.133+0000 7fefceffd700 1 -- 172.21.15.125:0/3833504026 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fefc8082490 con 0x7fefd806d470 2023-10-17T06:09:03.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.133+0000 7fefde322700 1 --2- 172.21.15.125:0/3833504026 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fefbc0656f0 0x7fefbc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:09:03.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.133+0000 7fefde322700 1 --2- 172.21.15.125:0/3833504026 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fefbc0656f0 0x7fefbc067bb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fefd4005930 tx=0x7fefd4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:09:03.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.137+0000 7fefceffd700 1 -- 172.21.15.125:0/3833504026 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fefd80ccc30 con 0x7fefd806d470 2023-10-17T06:09:03.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.321+0000 7fefdf324700 1 -- 172.21.15.125:0/3833504026 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7fefd80ccc30 con 0x7fefd806d470 2023-10-17T06:09:03.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.325+0000 7fefceffd700 1 -- 172.21.15.125:0/3833504026 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v43) v1 ==== 56+0+3459 (secure 0 0 0) 0x7fefd80ccc30 con 0x7fefd806d470 2023-10-17T06:09:03.330 INFO:teuthology.orchestra.run.smithi125.stdout:epoch 43 2023-10-17T06:09:03.330 INFO:teuthology.orchestra.run.smithi125.stdout:fsid c779df02-0ec4-47de-a0f3-2371e60a2dde 2023-10-17T06:09:03.330 INFO:teuthology.orchestra.run.smithi125.stdout:created 2023-10-17T06:06:41.768866+0000 2023-10-17T06:09:03.330 INFO:teuthology.orchestra.run.smithi125.stdout:modified 2023-10-17T06:08:52.592555+0000 2023-10-17T06:09:03.331 INFO:teuthology.orchestra.run.smithi125.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-10-17T06:09:03.331 INFO:teuthology.orchestra.run.smithi125.stdout:crush_version 6 2023-10-17T06:09:03.331 INFO:teuthology.orchestra.run.smithi125.stdout:full_ratio 0.95 2023-10-17T06:09:03.331 INFO:teuthology.orchestra.run.smithi125.stdout:backfillfull_ratio 0.9 2023-10-17T06:09:03.331 INFO:teuthology.orchestra.run.smithi125.stdout:nearfull_ratio 0.85 2023-10-17T06:09:03.332 INFO:teuthology.orchestra.run.smithi125.stdout:require_min_compat_client luminous 2023-10-17T06:09:03.332 INFO:teuthology.orchestra.run.smithi125.stdout:min_compat_client jewel 2023-10-17T06:09:03.332 INFO:teuthology.orchestra.run.smithi125.stdout:require_osd_release reef 2023-10-17T06:09:03.332 INFO:teuthology.orchestra.run.smithi125.stdout:stretch_mode_enabled false 2023-10-17T06:09:03.332 INFO:teuthology.orchestra.run.smithi125.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2023-10-17T06:09:03.333 INFO:teuthology.orchestra.run.smithi125.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 application rbd read_balance_score 1.99 2023-10-17T06:09:03.333 INFO:teuthology.orchestra.run.smithi125.stdout:pool 6 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 42 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.75 2023-10-17T06:09:03.333 INFO:teuthology.orchestra.run.smithi125.stdout:pool 7 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 43 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.75 2023-10-17T06:09:03.333 INFO:teuthology.orchestra.run.smithi125.stdout:max_osd 8 2023-10-17T06:09:03.333 INFO:teuthology.orchestra.run.smithi125.stdout:osd.0 up in weight 1 up_from 14 up_thru 41 down_at 0 last_clean_interval [0,0) [v2:172.21.15.125:6824/4039629234,v1:172.21.15.125:6825/4039629234] [v2:172.21.15.125:6826/4039629234,v1:172.21.15.125:6827/4039629234] exists,up 6f504062-4853-4e2a-98d4-ca58d83fb96b 2023-10-17T06:09:03.333 INFO:teuthology.orchestra.run.smithi125.stdout:osd.1 up in weight 1 up_from 14 up_thru 41 down_at 0 last_clean_interval [0,0) [v2:172.21.15.125:6809/1606722802,v1:172.21.15.125:6811/1606722802] [v2:172.21.15.125:6813/1606722802,v1:172.21.15.125:6815/1606722802] exists,up 26798ccb-c865-459d-98b7-90a9ce8ab6ce 2023-10-17T06:09:03.334 INFO:teuthology.orchestra.run.smithi125.stdout:osd.2 up in weight 1 up_from 14 up_thru 41 down_at 0 last_clean_interval [0,0) [v2:172.21.15.125:6808/4280413072,v1:172.21.15.125:6810/4280413072] [v2:172.21.15.125:6812/4280413072,v1:172.21.15.125:6814/4280413072] exists,up 997c2657-8b51-437c-85b1-2c2b5ec0b149 2023-10-17T06:09:03.334 INFO:teuthology.orchestra.run.smithi125.stdout:osd.3 up in weight 1 up_from 14 up_thru 41 down_at 0 last_clean_interval [0,0) [v2:172.21.15.125:6800/128096809,v1:172.21.15.125:6801/128096809] [v2:172.21.15.125:6802/128096809,v1:172.21.15.125:6803/128096809] exists,up 49e6bd08-4c16-4eb4-b523-162d4cfe0dd5 2023-10-17T06:09:03.334 INFO:teuthology.orchestra.run.smithi125.stdout:osd.4 up in weight 1 up_from 15 up_thru 41 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6800/514892137,v1:172.21.15.184:6801/514892137] [v2:172.21.15.184:6802/514892137,v1:172.21.15.184:6803/514892137] exists,up d7b21bd2-a06e-4e5e-bce1-4af4bc33d066 2023-10-17T06:09:03.334 INFO:teuthology.orchestra.run.smithi125.stdout:osd.5 up in weight 1 up_from 15 up_thru 41 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6824/3287748739,v1:172.21.15.184:6825/3287748739] [v2:172.21.15.184:6826/3287748739,v1:172.21.15.184:6827/3287748739] exists,up d65d03d2-9afe-4473-8e10-76d8926bbd1c 2023-10-17T06:09:03.334 INFO:teuthology.orchestra.run.smithi125.stdout:osd.6 up in weight 1 up_from 15 up_thru 41 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6816/2471937715,v1:172.21.15.184:6817/2471937715] [v2:172.21.15.184:6818/2471937715,v1:172.21.15.184:6819/2471937715] exists,up 787e64b7-283d-43f8-bb1b-87d47e562be7 2023-10-17T06:09:03.335 INFO:teuthology.orchestra.run.smithi125.stdout:osd.7 up in weight 1 up_from 14 up_thru 41 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6808/1153151577,v1:172.21.15.184:6809/1153151577] [v2:172.21.15.184:6810/1153151577,v1:172.21.15.184:6811/1153151577] exists,up 913cd35a-b9e5-408b-8a63-ca6883ecb020 2023-10-17T06:09:03.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.325+0000 7fefdf324700 1 -- 172.21.15.125:0/3833504026 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fefbc0656f0 msgr2=0x7fefbc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:03.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.325+0000 7fefdf324700 1 --2- 172.21.15.125:0/3833504026 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fefbc0656f0 0x7fefbc067bb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fefd4005930 tx=0x7fefd4009040 comp rx=0 tx=0).stop 2023-10-17T06:09:03.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.325+0000 7fefdf324700 1 -- 172.21.15.125:0/3833504026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefd806d470 msgr2=0x7fefd80c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:09:03.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.325+0000 7fefdf324700 1 --2- 172.21.15.125:0/3833504026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefd806d470 0x7fefd80c4850 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fefc80011e0 tx=0x7fefc800cae0 comp rx=0 tx=0).stop 2023-10-17T06:09:03.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.325+0000 7fefdf324700 1 -- 172.21.15.125:0/3833504026 shutdown_connections 2023-10-17T06:09:03.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.325+0000 7fefdf324700 1 --2- 172.21.15.125:0/3833504026 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fefbc0656f0 0x7fefbc067bb0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:03.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.325+0000 7fefdf324700 1 --2- 172.21.15.125:0/3833504026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefd815a410 0x7fefd81f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:03.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.325+0000 7fefdf324700 1 --2- 172.21.15.125:0/3833504026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefd806d470 0x7fefd80c4850 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:03.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.325+0000 7fefdf324700 1 --2- 172.21.15.125:0/3833504026 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefd806d090 0x7fefd814d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:09:03.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.325+0000 7fefdf324700 1 -- 172.21.15.125:0/3833504026 >> 172.21.15.125:0/3833504026 conn(0x7fefd80ce5c0 msgr2=0x7fefd815d950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:09:03.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.325+0000 7fefdf324700 1 -- 172.21.15.125:0/3833504026 shutdown_connections 2023-10-17T06:09:03.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:09:03.325+0000 7fefdf324700 1 -- 172.21.15.125:0/3833504026 wait complete. 2023-10-17T06:09:03.353 INFO:tasks.cephfs.filesystem.ceph_manager:['osd.0 up in weight 1 up_from 14 up_thru 41 down_at 0 last_clean_interval [0,0) [v2:172.21.15.125:6824/4039629234,v1:172.21.15.125:6825/4039629234] [v2:172.21.15.125:6826/4039629234,v1:172.21.15.125:6827/4039629234] exists,up 6f504062-4853-4e2a-98d4-ca58d83fb96b', 'osd.1 up in weight 1 up_from 14 up_thru 41 down_at 0 last_clean_interval [0,0) [v2:172.21.15.125:6809/1606722802,v1:172.21.15.125:6811/1606722802] [v2:172.21.15.125:6813/1606722802,v1:172.21.15.125:6815/1606722802] exists,up 26798ccb-c865-459d-98b7-90a9ce8ab6ce', 'osd.2 up in weight 1 up_from 14 up_thru 41 down_at 0 last_clean_interval [0,0) [v2:172.21.15.125:6808/4280413072,v1:172.21.15.125:6810/4280413072] [v2:172.21.15.125:6812/4280413072,v1:172.21.15.125:6814/4280413072] exists,up 997c2657-8b51-437c-85b1-2c2b5ec0b149', 'osd.3 up in weight 1 up_from 14 up_thru 41 down_at 0 last_clean_interval [0,0) [v2:172.21.15.125:6800/128096809,v1:172.21.15.125:6801/128096809] [v2:172.21.15.125:6802/128096809,v1:172.21.15.125:6803/128096809] exists,up 49e6bd08-4c16-4eb4-b523-162d4cfe0dd5', 'osd.4 up in weight 1 up_from 15 up_thru 41 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6800/514892137,v1:172.21.15.184:6801/514892137] [v2:172.21.15.184:6802/514892137,v1:172.21.15.184:6803/514892137] exists,up d7b21bd2-a06e-4e5e-bce1-4af4bc33d066', 'osd.5 up in weight 1 up_from 15 up_thru 41 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6824/3287748739,v1:172.21.15.184:6825/3287748739] [v2:172.21.15.184:6826/3287748739,v1:172.21.15.184:6827/3287748739] exists,up d65d03d2-9afe-4473-8e10-76d8926bbd1c', 'osd.6 up in weight 1 up_from 15 up_thru 41 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6816/2471937715,v1:172.21.15.184:6817/2471937715] [v2:172.21.15.184:6818/2471937715,v1:172.21.15.184:6819/2471937715] exists,up 787e64b7-283d-43f8-bb1b-87d47e562be7', 'osd.7 up in weight 1 up_from 14 up_thru 41 down_at 0 last_clean_interval [0,0) [v2:172.21.15.184:6808/1153151577,v1:172.21.15.184:6809/1153151577] [v2:172.21.15.184:6810/1153151577,v1:172.21.15.184:6811/1153151577] exists,up 913cd35a-b9e5-408b-8a63-ca6883ecb020'] 2023-10-17T06:09:03.354 INFO:tasks.ceph.osd.3:Sent signal 19 2023-10-17T06:09:24.670 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-10-17T06:09:24.668+0000 7faf711f3700 -1 osd.4 43 heartbeat_check: no reply from 172.21.15.125:6804 osd.3 since back 2023-10-17T06:09:02.607517+0000 front 2023-10-17T06:09:02.607723+0000 (oldest deadline 2023-10-17T06:09:23.707173+0000) 2023-10-17T06:09:24.836 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-10-17T06:09:24.829+0000 7fb3e2df3700 -1 osd.2 43 heartbeat_check: no reply from 172.21.15.125:6804 osd.3 since back 2023-10-17T06:09:01.718881+0000 front 2023-10-17T06:09:01.719315+0000 (oldest deadline 2023-10-17T06:09:24.018794+0000) 2023-10-17T06:09:25.141 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-17T06:09:25.133+0000 7f8e62ff3700 -1 osd.0 43 heartbeat_check: no reply from 172.21.15.125:6804 osd.3 since back 2023-10-17T06:09:03.096888+0000 front 2023-10-17T06:09:03.097428+0000 (oldest deadline 2023-10-17T06:09:24.196759+0000) 2023-10-17T06:09:25.536 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-10-17T06:09:25.532+0000 7fe33c5f3700 -1 osd.7 43 heartbeat_check: no reply from 172.21.15.125:6804 osd.3 since back 2023-10-17T06:09:01.627562+0000 front 2023-10-17T06:09:01.627321+0000 (oldest deadline 2023-10-17T06:09:25.127252+0000) 2023-10-17T06:09:25.651 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-10-17T06:09:25.648+0000 7faf711f3700 -1 osd.4 43 heartbeat_check: no reply from 172.21.15.125:6804 osd.3 since back 2023-10-17T06:09:02.607517+0000 front 2023-10-17T06:09:02.607723+0000 (oldest deadline 2023-10-17T06:09:23.707173+0000) 2023-10-17T06:09:25.781 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-10-17T06:09:25.776+0000 7f1d299f3700 -1 osd.6 43 heartbeat_check: no reply from 172.21.15.125:6804 osd.3 since back 2023-10-17T06:09:02.672392+0000 front 2023-10-17T06:09:02.672018+0000 (oldest deadline 2023-10-17T06:09:25.572011+0000) 2023-10-17T06:09:25.795 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-10-17T06:09:25.789+0000 7fb3e2df3700 -1 osd.2 43 heartbeat_check: no reply from 172.21.15.125:6804 osd.3 since back 2023-10-17T06:09:01.718881+0000 front 2023-10-17T06:09:01.719315+0000 (oldest deadline 2023-10-17T06:09:24.018794+0000) 2023-10-17T06:09:26.133 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-17T06:09:26.125+0000 7f8e62ff3700 -1 osd.0 43 heartbeat_check: no reply from 172.21.15.125:6804 osd.3 since back 2023-10-17T06:09:03.096888+0000 front 2023-10-17T06:09:03.097428+0000 (oldest deadline 2023-10-17T06:09:24.196759+0000) 2023-10-17T06:09:26.562 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-10-17T06:09:26.560+0000 7fe33c5f3700 -1 osd.7 43 heartbeat_check: no reply from 172.21.15.125:6804 osd.3 since back 2023-10-17T06:09:01.627562+0000 front 2023-10-17T06:09:01.627321+0000 (oldest deadline 2023-10-17T06:09:25.127252+0000) 2023-10-17T06:09:26.747 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-10-17T06:09:26.744+0000 7f1d299f3700 -1 osd.6 43 heartbeat_check: no reply from 172.21.15.125:6804 osd.3 since back 2023-10-17T06:09:02.672392+0000 front 2023-10-17T06:09:02.672018+0000 (oldest deadline 2023-10-17T06:09:25.572011+0000) 2023-10-17T06:09:31.685 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:09:31.693 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:10:01.781 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:10:01.789 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:10:31.886 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:10:31.894 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:11:01.965 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:11:01.973 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:11:03.355 INFO:tasks.ceph.osd.3:Sent signal 18 2023-10-17T06:11:03.356 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:11:03.356 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:11:03.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:11:03.375 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-17T06:11:03.449 INFO:teuthology.orchestra.run.smithi125.stdout:client5213 2023-10-17T06:11:03.449 INFO:tasks.cephfs.mount:Killing connection on ubuntu@smithi125.front.sepia.ceph.com... 2023-10-17T06:11:03.450 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-17T06:11:03.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:11:03.451 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 down 2023-10-17T06:11:03.535 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:11:03.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.759+0000 7f7daae47700 1 Processor -- start 2023-10-17T06:11:03.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.759+0000 7f7daae47700 1 -- start start 2023-10-17T06:11:03.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.763+0000 7f7daae47700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da4161080 0x7f7da40ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:11:03.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.763+0000 7f7daae47700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7da4165710 0x7f7da406a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:11:03.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.763+0000 7f7daae47700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7da40cdbf0 con 0x7f7da406a5f0 2023-10-17T06:11:03.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.763+0000 7f7daae47700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da406aa60 con 0x7f7da4165710 2023-10-17T06:11:03.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.763+0000 7f7daae47700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da40caa30 con 0x7f7da4161080 2023-10-17T06:11:03.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.763+0000 7f7da9e45700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da4161080 0x7f7da40ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:11:03.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.763+0000 7f7da9e45700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da4161080 0x7f7da40ca130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:37804/0 (socket says 172.21.15.125:37804) 2023-10-17T06:11:03.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.763+0000 7f7da9e45700 1 -- 172.21.15.125:0/3089705599 learned_addr learned my addr 172.21.15.125:0/3089705599 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:11:03.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.763+0000 7f7da9644700 1 --2- 172.21.15.125:0/3089705599 >> v2:172.21.15.184:3300/0 conn(0x7f7da4165710 0x7f7da406a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:11:03.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.763+0000 7f7da8e43700 1 -- 172.21.15.125:0/3089705599 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488590415 0 0) 0x7f7da40cdbf0 con 0x7f7da406a5f0 2023-10-17T06:11:03.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.763+0000 7f7da8e43700 1 -- 172.21.15.125:0/3089705599 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d900035d0 con 0x7f7da406a5f0 2023-10-17T06:11:03.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.763+0000 7f7da9644700 1 -- 172.21.15.125:0/3089705599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da4161080 msgr2=0x7f7da40ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:11:03.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.763+0000 7f7da9644700 1 --2- 172.21.15.125:0/3089705599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da4161080 0x7f7da40ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:11:03.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.763+0000 7f7da9644700 1 -- 172.21.15.125:0/3089705599 >> v1:172.21.15.184:6789/0 conn(0x7f7da406a5f0 legacy=0x7f7da406ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:11:03.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.763+0000 7f7da9644700 1 -- 172.21.15.125:0/3089705599 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da40cad10 con 0x7f7da4165710 2023-10-17T06:11:03.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.763+0000 7f7da9e45700 1 --2- 172.21.15.125:0/3089705599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da4161080 0x7f7da40ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:11:03.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.767+0000 7f7da9644700 1 --2- 172.21.15.125:0/3089705599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7da4165710 0x7f7da406a0b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009850 tx=0x7f7d94009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bf77ae3596da741 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:11:03.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.767+0000 7f7da8e43700 1 -- 172.21.15.125:0/3089705599 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d94011830 con 0x7f7da4165710 2023-10-17T06:11:03.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.767+0000 7f7da8e43700 1 -- 172.21.15.125:0/3089705599 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d94011990 con 0x7f7da4165710 2023-10-17T06:11:03.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.767+0000 7f7da8e43700 1 -- 172.21.15.125:0/3089705599 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d94011d40 con 0x7f7da4165710 2023-10-17T06:11:03.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.767+0000 7f7daae47700 1 -- 172.21.15.125:0/3089705599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7da4165710 msgr2=0x7f7da406a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:11:03.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.767+0000 7f7daae47700 1 --2- 172.21.15.125:0/3089705599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7da4165710 0x7f7da406a0b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009850 tx=0x7f7d94009b60 comp rx=0 tx=0).stop 2023-10-17T06:11:03.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.767+0000 7f7daae47700 1 -- 172.21.15.125:0/3089705599 shutdown_connections 2023-10-17T06:11:03.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.767+0000 7f7daae47700 1 --2- 172.21.15.125:0/3089705599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7da4165710 0x7f7da406a0b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:11:03.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.767+0000 7f7daae47700 1 --2- 172.21.15.125:0/3089705599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da4161080 0x7f7da40ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:11:03.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.767+0000 7f7daae47700 1 -- 172.21.15.125:0/3089705599 >> 172.21.15.125:0/3089705599 conn(0x7f7da40cf6b0 msgr2=0x7f7da40cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:11:03.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.767+0000 7f7daae47700 1 -- 172.21.15.125:0/3089705599 shutdown_connections 2023-10-17T06:11:03.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.767+0000 7f7daae47700 1 -- 172.21.15.125:0/3089705599 wait complete. 2023-10-17T06:11:03.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.771+0000 7f7daae47700 1 Processor -- start 2023-10-17T06:11:03.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.771+0000 7f7daae47700 1 -- start start 2023-10-17T06:11:03.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.771+0000 7f7daae47700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7da406a5f0 0x7f7da415bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:11:03.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.771+0000 7f7daae47700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da4161080 0x7f7da40c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:11:03.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.771+0000 7f7daae47700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7da4165710 0x7f7da40c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:11:03.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.771+0000 7f7daae47700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da4163260 con 0x7f7da4165710 2023-10-17T06:11:03.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.771+0000 7f7daae47700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da4162650 con 0x7f7da406a5f0 2023-10-17T06:11:03.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.771+0000 7f7daae47700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da4162930 con 0x7f7da4161080 2023-10-17T06:11:03.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.775+0000 7f7daa646700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7da4165710 0x7f7da40c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:11:03.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.775+0000 7f7daa646700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7da4165710 0x7f7da40c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44762/0 (socket says 172.21.15.125:44762) 2023-10-17T06:11:03.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.775+0000 7f7daa646700 1 -- 172.21.15.125:0/1872317368 learned_addr learned my addr 172.21.15.125:0/1872317368 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:11:03.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.775+0000 7f7da9644700 1 --2- 172.21.15.125:0/1872317368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da4161080 0x7f7da40c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:11:03.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.775+0000 7f7da9e45700 1 --2- 172.21.15.125:0/1872317368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7da406a5f0 0x7f7da415bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:11:03.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.775+0000 7f7daa646700 1 -- 172.21.15.125:0/1872317368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da4161080 msgr2=0x7f7da40c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:11:03.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.775+0000 7f7daa646700 1 --2- 172.21.15.125:0/1872317368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da4161080 0x7f7da40c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:11:03.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.775+0000 7f7daa646700 1 -- 172.21.15.125:0/1872317368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7da406a5f0 msgr2=0x7f7da415bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:11:03.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.775+0000 7f7daa646700 1 --2- 172.21.15.125:0/1872317368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7da406a5f0 0x7f7da415bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:11:03.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.775+0000 7f7daa646700 1 -- 172.21.15.125:0/1872317368 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da0009570 con 0x7f7da4165710 2023-10-17T06:11:03.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.775+0000 7f7daa646700 1 --2- 172.21.15.125:0/1872317368 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7da4165710 0x7f7da40c8cd0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c00cbc0 tx=0x7f7d9c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:11:03.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.775+0000 7f7d9a7fc700 1 -- 172.21.15.125:0/1872317368 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c003c20 con 0x7f7da4165710 2023-10-17T06:11:03.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.775+0000 7f7d9a7fc700 1 -- 172.21.15.125:0/1872317368 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9c003d80 con 0x7f7da4165710 2023-10-17T06:11:03.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.775+0000 7f7daae47700 1 -- 172.21.15.125:0/1872317368 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d940094b0 con 0x7f7da4165710 2023-10-17T06:11:03.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.775+0000 7f7d9a7fc700 1 -- 172.21.15.125:0/1872317368 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c00aae0 con 0x7f7da4165710 2023-10-17T06:11:03.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.775+0000 7f7daae47700 1 -- 172.21.15.125:0/1872317368 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da4162ef0 con 0x7f7da4165710 2023-10-17T06:11:03.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.779+0000 7f7daae47700 1 -- 172.21.15.125:0/1872317368 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da4066d10 con 0x7f7da4165710 2023-10-17T06:11:03.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.779+0000 7f7d9a7fc700 1 -- 172.21.15.125:0/1872317368 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7d9c00ac40 con 0x7f7da4165710 2023-10-17T06:11:03.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.779+0000 7f7d9a7fc700 1 --2- 172.21.15.125:0/1872317368 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7d88065720 0x7f7d88067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:11:03.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.779+0000 7f7d9a7fc700 1 -- 172.21.15.125:0/1872317368 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7d9c082e60 con 0x7f7da4165710 2023-10-17T06:11:03.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.779+0000 7f7da9e45700 1 --2- 172.21.15.125:0/1872317368 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7d88065720 0x7f7d88067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:11:03.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.779+0000 7f7da9e45700 1 --2- 172.21.15.125:0/1872317368 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7d88065720 0x7f7d88067be0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7da40b2720 tx=0x7f7da00092e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:11:03.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:03.791+0000 7f7d9a7fc700 1 -- 172.21.15.125:0/1872317368 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f7d9c0507f0 con 0x7f7da4165710 2023-10-17T06:11:04.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.035+0000 7f7daae47700 1 -- 172.21.15.125:0/1872317368 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7da4072e60 con 0x7f7da4165710 2023-10-17T06:11:04.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.035+0000 7f7d9a7fc700 1 -- 172.21.15.125:0/1872317368 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4887 (secure 0 0 0) 0x7f7d9c053e10 con 0x7f7da4165710 2023-10-17T06:11:04.040 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:11:04.040 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:08:51.328615+0000","modified":"2023-10-17T06:08:54.897934+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.125:6837/2351050168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2351050168},{"type":"v1","addr":"172.21.15.125:6837","nonce":2351050168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-17T06:11:04.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.039+0000 7f7daae47700 1 -- 172.21.15.125:0/1872317368 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7d88065720 msgr2=0x7f7d88067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:11:04.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.039+0000 7f7daae47700 1 --2- 172.21.15.125:0/1872317368 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7d88065720 0x7f7d88067be0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7da40b2720 tx=0x7f7da00092e0 comp rx=0 tx=0).stop 2023-10-17T06:11:04.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.039+0000 7f7daae47700 1 -- 172.21.15.125:0/1872317368 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7da4165710 msgr2=0x7f7da40c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:11:04.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.039+0000 7f7daae47700 1 --2- 172.21.15.125:0/1872317368 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7da4165710 0x7f7da40c8cd0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c00cbc0 tx=0x7f7d9c00ced0 comp rx=0 tx=0).stop 2023-10-17T06:11:04.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.039+0000 7f7daae47700 1 -- 172.21.15.125:0/1872317368 shutdown_connections 2023-10-17T06:11:04.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.039+0000 7f7daae47700 1 --2- 172.21.15.125:0/1872317368 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7d88065720 0x7f7d88067be0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:11:04.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.039+0000 7f7daae47700 1 --2- 172.21.15.125:0/1872317368 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7da4165710 0x7f7da40c8cd0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:11:04.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.039+0000 7f7daae47700 1 --2- 172.21.15.125:0/1872317368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7da4161080 0x7f7da40c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:11:04.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.039+0000 7f7daae47700 1 --2- 172.21.15.125:0/1872317368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7da406a5f0 0x7f7da415bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:11:04.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.039+0000 7f7daae47700 1 -- 172.21.15.125:0/1872317368 >> 172.21.15.125:0/1872317368 conn(0x7f7da40cf6b0 msgr2=0x7f7da40717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:11:04.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.039+0000 7f7daae47700 1 -- 172.21.15.125:0/1872317368 shutdown_connections 2023-10-17T06:11:04.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.039+0000 7f7daae47700 1 -- 172.21.15.125:0/1872317368 wait complete. 2023-10-17T06:11:04.046 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 17 2023-10-17T06:11:04.067 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-10-17T06:11:04.250 INFO:teuthology.orchestra.run.smithi125.stdout:[{"id":5557,"entity":{"name":{"type":"client","num":5557},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":520252958}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":123.045262538,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.75255162433924161,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5557 192.168.0.1:0/520252958","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi184","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}},{"id":5213,"entity":{"name":{"type":"client","num":5213},"addr":{"type":"any","addr":"172.21.15.125:0","nonce":3775054255}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":8,"uptime":124.533229717,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.74997577470607524,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":25,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5213 172.21.15.125:0/3775054255","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi125","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-17T06:11:04.250 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi184", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 520252958, "type": "any" }, "name": { "num": 5557, "type": "client" } }, "id": 5557, "inst": "client.5557 192.168.0.1:0/520252958", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.7525516243392416 }, "state": "open", "uptime": 123.045262538 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "0", "hostname": "smithi125", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.125:0", "nonce": 3775054255, "type": "any" }, "name": { "num": 5213, "type": "client" } }, "id": 5213, "inst": "client.5213 172.21.15.125:0/3775054255", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 25, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.7499757747060752 }, "state": "open", "uptime": 124.533229717 } ] 2023-10-17T06:11:04.251 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:11:04.407 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-10-17T06:11:04.403+0000 7fb3c09f0700 -1 osd.3 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-17T06:11:04.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.419+0000 7f32288de700 1 Processor -- start 2023-10-17T06:11:04.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.419+0000 7f32288de700 1 -- start start 2023-10-17T06:11:04.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.419+0000 7f32288de700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f322406d090 0x7f32240b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:11:04.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.419+0000 7f32288de700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f322406d470 0x7f3224070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:11:04.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.419+0000 7f32288de700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f322415e990 con 0x7f3224070f50 2023-10-17T06:11:04.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.419+0000 7f32288de700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f322415f4f0 con 0x7f322406d090 2023-10-17T06:11:04.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.419+0000 7f32288de700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f322415ec50 con 0x7f322406d470 2023-10-17T06:11:04.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f322359e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3224070f50 0x7f322415a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52628/0 (socket says 172.21.15.125:52628) 2023-10-17T06:11:04.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f322359e700 1 -- 172.21.15.125:0/3344813249 learned_addr learned my addr 172.21.15.125:0/3344813249 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:11:04.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f3222d9d700 1 --2- 172.21.15.125:0/3344813249 >> v2:172.21.15.125:3300/0 conn(0x7f322406d090 0x7f32240b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:11:04.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f322259c700 1 --2- 172.21.15.125:0/3344813249 >> v2:172.21.15.184:3300/0 conn(0x7f322406d470 0x7f3224070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:11:04.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f3221d9b700 1 -- 172.21.15.125:0/3344813249 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771591239 0 0) 0x7f322415e990 con 0x7f3224070f50 2023-10-17T06:11:04.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f3221d9b700 1 -- 172.21.15.125:0/3344813249 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f320c0035d0 con 0x7f3224070f50 2023-10-17T06:11:04.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f3222d9d700 1 -- 172.21.15.125:0/3344813249 >> v2:172.21.15.184:3300/0 conn(0x7f322406d470 msgr2=0x7f3224070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:11:04.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f3222d9d700 1 --2- 172.21.15.125:0/3344813249 >> v2:172.21.15.184:3300/0 conn(0x7f322406d470 0x7f3224070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:11:04.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f3222d9d700 1 -- 172.21.15.125:0/3344813249 >> v1:172.21.15.125:6789/0 conn(0x7f3224070f50 legacy=0x7f322415a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:11:04.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f3222d9d700 1 -- 172.21.15.125:0/3344813249 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322415ef30 con 0x7f322406d090 2023-10-17T06:11:04.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f3222d9d700 1 --2- 172.21.15.125:0/3344813249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f322406d090 0x7f32240b2590 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f32240b2100 tx=0x7f3214009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bed549a04e5a0d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:11:04.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f3221d9b700 1 -- 172.21.15.125:0/3344813249 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3214011830 con 0x7f322406d090 2023-10-17T06:11:04.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f3221d9b700 1 -- 172.21.15.125:0/3344813249 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3214011990 con 0x7f322406d090 2023-10-17T06:11:04.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f3221d9b700 1 -- 172.21.15.125:0/3344813249 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3214011d20 con 0x7f322406d090 2023-10-17T06:11:04.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f32288de700 1 -- 172.21.15.125:0/3344813249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f322406d090 msgr2=0x7f32240b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:11:04.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f32288de700 1 --2- 172.21.15.125:0/3344813249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f322406d090 0x7f32240b2590 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f32240b2100 tx=0x7f3214009b30 comp rx=0 tx=0).stop 2023-10-17T06:11:04.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f32288de700 1 -- 172.21.15.125:0/3344813249 shutdown_connections 2023-10-17T06:11:04.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f32288de700 1 --2- 172.21.15.125:0/3344813249 >> v2:172.21.15.184:3300/0 conn(0x7f322406d470 0x7f3224070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:11:04.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f32288de700 1 --2- 172.21.15.125:0/3344813249 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f322406d090 0x7f32240b2590 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:11:04.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f32288de700 1 -- 172.21.15.125:0/3344813249 >> 172.21.15.125:0/3344813249 conn(0x7f32240ce5c0 msgr2=0x7f32240ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:11:04.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f32288de700 1 -- 172.21.15.125:0/3344813249 shutdown_connections 2023-10-17T06:11:04.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.423+0000 7f32288de700 1 -- 172.21.15.125:0/3344813249 wait complete. 2023-10-17T06:11:04.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.427+0000 7f32288de700 1 Processor -- start 2023-10-17T06:11:04.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f32288de700 1 -- start start 2023-10-17T06:11:04.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f32288de700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f322406d090 0x7f322415c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:11:04.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f32288de700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f322406d470 0x7f322415bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:11:04.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f32288de700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3224070f50 0x7f32241efbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:11:04.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f32288de700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322415dc50 con 0x7f322406d470 2023-10-17T06:11:04.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f32288de700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322415cfd0 con 0x7f322406d090 2023-10-17T06:11:04.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f32288de700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322415d2b0 con 0x7f3224070f50 2023-10-17T06:11:04.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f322259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f322406d470 0x7f322415bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:11:04.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f322259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f322406d470 0x7f322415bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44780/0 (socket says 172.21.15.125:44780) 2023-10-17T06:11:04.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f322259c700 1 -- 172.21.15.125:0/2489425254 learned_addr learned my addr 172.21.15.125:0/2489425254 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:11:04.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f3222d9d700 1 --2- 172.21.15.125:0/2489425254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f322406d090 0x7f322415c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:11:04.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f322359e700 1 --2- 172.21.15.125:0/2489425254 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3224070f50 0x7f32241efbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:11:04.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f322259c700 1 -- 172.21.15.125:0/2489425254 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3224070f50 msgr2=0x7f32241efbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:11:04.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f322259c700 1 --2- 172.21.15.125:0/2489425254 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3224070f50 0x7f32241efbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:11:04.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f322259c700 1 -- 172.21.15.125:0/2489425254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f322406d090 msgr2=0x7f322415c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:11:04.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f322259c700 1 --2- 172.21.15.125:0/2489425254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f322406d090 0x7f322415c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:11:04.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f322259c700 1 -- 172.21.15.125:0/2489425254 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32140094b0 con 0x7f322406d470 2023-10-17T06:11:04.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f322259c700 1 --2- 172.21.15.125:0/2489425254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f322406d470 0x7f322415bcd0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f321800e9d0 tx=0x7f321800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:11:04.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f320b7fe700 1 -- 172.21.15.125:0/2489425254 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3218009720 con 0x7f322406d470 2023-10-17T06:11:04.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f320b7fe700 1 -- 172.21.15.125:0/2489425254 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321800c850 con 0x7f322406d470 2023-10-17T06:11:04.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f32288de700 1 -- 172.21.15.125:0/2489425254 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322415d590 con 0x7f322406d470 2023-10-17T06:11:04.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f320b7fe700 1 -- 172.21.15.125:0/2489425254 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321800cbc0 con 0x7f322406d470 2023-10-17T06:11:04.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.431+0000 7f32288de700 1 -- 172.21.15.125:0/2489425254 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32241f0100 con 0x7f322406d470 2023-10-17T06:11:04.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.435+0000 7f32288de700 1 -- 172.21.15.125:0/2489425254 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f322415dd90 con 0x7f322406d470 2023-10-17T06:11:04.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.435+0000 7f320b7fe700 1 -- 172.21.15.125:0/2489425254 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f321800cd20 con 0x7f322406d470 2023-10-17T06:11:04.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.439+0000 7f320b7fe700 1 --2- 172.21.15.125:0/2489425254 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f32100656f0 0x7f3210067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:11:04.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.439+0000 7f320b7fe700 1 -- 172.21.15.125:0/2489425254 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3218083080 con 0x7f322406d470 2023-10-17T06:11:04.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.439+0000 7f3222d9d700 1 --2- 172.21.15.125:0/2489425254 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f32100656f0 0x7f3210067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:11:04.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.439+0000 7f3222d9d700 1 --2- 172.21.15.125:0/2489425254 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f32100656f0 0x7f3210067bb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3214000c00 tx=0x7f3214008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:11:04.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.443+0000 7f320b7fe700 1 -- 172.21.15.125:0/2489425254 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f32180b3d40 con 0x7f322406d470 2023-10-17T06:11:04.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.667+0000 7f32288de700 1 -- 172.21.15.125:0/2489425254 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3224072e60 con 0x7f322406d470 2023-10-17T06:11:04.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.671+0000 7f320b7fe700 1 -- 172.21.15.125:0/2489425254 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4887 (secure 0 0 0) 0x7f322415dd90 con 0x7f322406d470 2023-10-17T06:11:04.674 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:11:04.674 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:08:51.328615+0000","modified":"2023-10-17T06:08:54.897934+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.125:6837/2351050168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2351050168},{"type":"v1","addr":"172.21.15.125:6837","nonce":2351050168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-17T06:11:04.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.671+0000 7f32288de700 1 -- 172.21.15.125:0/2489425254 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f32100656f0 msgr2=0x7f3210067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:11:04.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.671+0000 7f32288de700 1 --2- 172.21.15.125:0/2489425254 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f32100656f0 0x7f3210067bb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3214000c00 tx=0x7f3214008030 comp rx=0 tx=0).stop 2023-10-17T06:11:04.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.671+0000 7f32288de700 1 -- 172.21.15.125:0/2489425254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f322406d470 msgr2=0x7f322415bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:11:04.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.671+0000 7f32288de700 1 --2- 172.21.15.125:0/2489425254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f322406d470 0x7f322415bcd0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f321800e9d0 tx=0x7f321800ece0 comp rx=0 tx=0).stop 2023-10-17T06:11:04.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.671+0000 7f32288de700 1 -- 172.21.15.125:0/2489425254 shutdown_connections 2023-10-17T06:11:04.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.671+0000 7f32288de700 1 --2- 172.21.15.125:0/2489425254 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f32100656f0 0x7f3210067bb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:11:04.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.671+0000 7f32288de700 1 --2- 172.21.15.125:0/2489425254 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3224070f50 0x7f32241efbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:11:04.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.671+0000 7f32288de700 1 --2- 172.21.15.125:0/2489425254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f322406d470 0x7f322415bcd0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:11:04.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.671+0000 7f32288de700 1 --2- 172.21.15.125:0/2489425254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f322406d090 0x7f322415c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:11:04.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.671+0000 7f32288de700 1 -- 172.21.15.125:0/2489425254 >> 172.21.15.125:0/2489425254 conn(0x7f32240ce5c0 msgr2=0x7f32240b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:11:04.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.671+0000 7f32288de700 1 -- 172.21.15.125:0/2489425254 shutdown_connections 2023-10-17T06:11:04.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:11:04.671+0000 7f32288de700 1 -- 172.21.15.125:0/2489425254 wait complete. 2023-10-17T06:11:04.679 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 17 2023-10-17T06:11:32.046 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:11:32.054 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:12:02.125 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:12:02.133 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:12:32.206 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:12:32.215 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:12:34.702 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:12:34.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.881+0000 7f89811ba700 1 Processor -- start 2023-10-17T06:12:34.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.881+0000 7f89811ba700 1 -- start start 2023-10-17T06:12:34.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.885+0000 7f89811ba700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f897c154040 0x7f897c0cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:12:34.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.885+0000 7f89811ba700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f897c0cb8a0 0x7f897c06f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:12:34.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.885+0000 7f89811ba700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f897c15e130 con 0x7f897c06e8a0 2023-10-17T06:12:34.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.885+0000 7f89811ba700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f897c0cdfa0 con 0x7f897c154040 2023-10-17T06:12:34.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.885+0000 7f89811ba700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897c0ce1b0 con 0x7f897c0cb8a0 2023-10-17T06:12:34.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.885+0000 7f897259c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f897c06e8a0 0x7f897c0cb190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:60180/0 (socket says 172.21.15.125:60180) 2023-10-17T06:12:34.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.885+0000 7f897259c700 1 -- 172.21.15.125:0/4070376092 learned_addr learned my addr 172.21.15.125:0/4070376092 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:12:34.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.885+0000 7f897ad9d700 1 --2- 172.21.15.125:0/4070376092 >> v2:172.21.15.184:3300/0 conn(0x7f897c154040 0x7f897c0cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:12:34.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.885+0000 7f897b59e700 1 --2- 172.21.15.125:0/4070376092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f897c0cb8a0 0x7f897c06f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:12:34.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.885+0000 7f897ad9d700 1 -- 172.21.15.125:0/4070376092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f897c0cb8a0 msgr2=0x7f897c06f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:12:34.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.885+0000 7f897ad9d700 1 --2- 172.21.15.125:0/4070376092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f897c0cb8a0 0x7f897c06f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:34.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.885+0000 7f897a59c700 1 -- 172.21.15.125:0/4070376092 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068756898 0 0) 0x7f897c15e130 con 0x7f897c06e8a0 2023-10-17T06:12:34.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.885+0000 7f897ad9d700 1 -- 172.21.15.125:0/4070376092 >> v1:172.21.15.125:6789/0 conn(0x7f897c06e8a0 legacy=0x7f897c0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:12:34.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.885+0000 7f897ad9d700 1 -- 172.21.15.125:0/4070376092 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897c0ce490 con 0x7f897c154040 2023-10-17T06:12:34.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.889+0000 7f897ad9d700 1 --2- 172.21.15.125:0/4070376092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f897c154040 0x7f897c0cc680 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f896c009850 tx=0x7f896c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8615ac96d9973c15 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:12:34.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.889+0000 7f897a59c700 1 -- 172.21.15.125:0/4070376092 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c011830 con 0x7f897c154040 2023-10-17T06:12:34.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.889+0000 7f897a59c700 1 -- 172.21.15.125:0/4070376092 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896c011990 con 0x7f897c154040 2023-10-17T06:12:34.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.889+0000 7f897a59c700 1 -- 172.21.15.125:0/4070376092 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896c011d40 con 0x7f897c154040 2023-10-17T06:12:34.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.889+0000 7f89811ba700 1 -- 172.21.15.125:0/4070376092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f897c154040 msgr2=0x7f897c0cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:12:34.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.889+0000 7f89811ba700 1 --2- 172.21.15.125:0/4070376092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f897c154040 0x7f897c0cc680 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f896c009850 tx=0x7f896c009b60 comp rx=0 tx=0).stop 2023-10-17T06:12:34.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.889+0000 7f89811ba700 1 -- 172.21.15.125:0/4070376092 shutdown_connections 2023-10-17T06:12:34.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.889+0000 7f89811ba700 1 --2- 172.21.15.125:0/4070376092 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f897c0cb8a0 0x7f897c06f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:34.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.889+0000 7f89811ba700 1 --2- 172.21.15.125:0/4070376092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f897c154040 0x7f897c0cc680 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:34.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.889+0000 7f89811ba700 1 -- 172.21.15.125:0/4070376092 >> 172.21.15.125:0/4070376092 conn(0x7f897c06a340 msgr2=0x7f897c0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:12:34.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.889+0000 7f89811ba700 1 -- 172.21.15.125:0/4070376092 shutdown_connections 2023-10-17T06:12:34.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.889+0000 7f89811ba700 1 -- 172.21.15.125:0/4070376092 wait complete. 2023-10-17T06:12:34.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.893+0000 7f89811ba700 1 Processor -- start 2023-10-17T06:12:34.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.893+0000 7f89811ba700 1 -- start start 2023-10-17T06:12:34.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.893+0000 7f89811ba700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f897c06e8a0 0x7f897c157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:12:34.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.893+0000 7f89811ba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f897c0cb8a0 0x7f897c154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:12:34.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.893+0000 7f89811ba700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f897c154040 0x7f897c15e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:12:34.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.893+0000 7f89811ba700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c142a00 con 0x7f897c0cb8a0 2023-10-17T06:12:34.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.893+0000 7f89811ba700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897c1549a0 con 0x7f897c154040 2023-10-17T06:12:34.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.893+0000 7f89811ba700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897c154c40 con 0x7f897c06e8a0 2023-10-17T06:12:34.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.893+0000 7f897259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f897c0cb8a0 0x7f897c154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:12:34.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.893+0000 7f897ad9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f897c06e8a0 0x7f897c157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:12:34.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.893+0000 7f897259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f897c0cb8a0 0x7f897c154460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52614/0 (socket says 172.21.15.125:52614) 2023-10-17T06:12:34.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.897+0000 7f897259c700 1 -- 172.21.15.125:0/394716610 learned_addr learned my addr 172.21.15.125:0/394716610 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:12:34.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.897+0000 7f897b59e700 1 --2- 172.21.15.125:0/394716610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f897c154040 0x7f897c15e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:12:34.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.897+0000 7f897259c700 1 -- 172.21.15.125:0/394716610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f897c06e8a0 msgr2=0x7f897c157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:12:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.897+0000 7f897259c700 1 --2- 172.21.15.125:0/394716610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f897c06e8a0 0x7f897c157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.897+0000 7f897259c700 1 -- 172.21.15.125:0/394716610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f897c154040 msgr2=0x7f897c15e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:12:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.897+0000 7f897259c700 1 --2- 172.21.15.125:0/394716610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f897c154040 0x7f897c15e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.897+0000 7f897259c700 1 -- 172.21.15.125:0/394716610 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c0094b0 con 0x7f897c0cb8a0 2023-10-17T06:12:34.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.897+0000 7f897259c700 1 --2- 172.21.15.125:0/394716610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f897c0cb8a0 0x7f897c154460 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f896400c580 tx=0x7f896400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:12:34.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.897+0000 7f8973fff700 1 -- 172.21.15.125:0/394716610 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8964004ca0 con 0x7f897c0cb8a0 2023-10-17T06:12:34.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.897+0000 7f89811ba700 1 -- 172.21.15.125:0/394716610 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897c154f20 con 0x7f897c0cb8a0 2023-10-17T06:12:34.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.897+0000 7f8973fff700 1 -- 172.21.15.125:0/394716610 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8964004e20 con 0x7f897c0cb8a0 2023-10-17T06:12:34.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.897+0000 7f8973fff700 1 -- 172.21.15.125:0/394716610 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8964007310 con 0x7f897c0cb8a0 2023-10-17T06:12:34.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.897+0000 7f89811ba700 1 -- 172.21.15.125:0/394716610 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f897c1554e0 con 0x7f897c0cb8a0 2023-10-17T06:12:34.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.897+0000 7f89811ba700 1 -- 172.21.15.125:0/394716610 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f897c155a00 con 0x7f897c0cb8a0 2023-10-17T06:12:34.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.901+0000 7f8973fff700 1 -- 172.21.15.125:0/394716610 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8964007470 con 0x7f897c0cb8a0 2023-10-17T06:12:34.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.901+0000 7f8973fff700 1 --2- 172.21.15.125:0/394716610 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f89600656f0 0x7f8960067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:12:34.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.901+0000 7f8973fff700 1 -- 172.21.15.125:0/394716610 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f89640830d0 con 0x7f897c0cb8a0 2023-10-17T06:12:34.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.901+0000 7f897ad9d700 1 --2- 172.21.15.125:0/394716610 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f89600656f0 0x7f8960067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:12:34.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.901+0000 7f897ad9d700 1 --2- 172.21.15.125:0/394716610 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f89600656f0 0x7f8960067bb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f896c0090b0 tx=0x7f896c01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:12:34.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:34.905+0000 7f8973fff700 1 -- 172.21.15.125:0/394716610 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f8964050a00 con 0x7f897c0cb8a0 2023-10-17T06:12:35.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.133+0000 7f89811ba700 1 -- 172.21.15.125:0/394716610 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f897c155a00 con 0x7f897c0cb8a0 2023-10-17T06:12:35.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.133+0000 7f8973fff700 1 -- 172.21.15.125:0/394716610 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4887 (secure 0 0 0) 0x7f897c155a00 con 0x7f897c0cb8a0 2023-10-17T06:12:35.141 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:12:35.142 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:08:51.328615+0000","modified":"2023-10-17T06:08:54.897934+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.125:6837/2351050168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2351050168},{"type":"v1","addr":"172.21.15.125:6837","nonce":2351050168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-17T06:12:35.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.137+0000 7f89811ba700 1 -- 172.21.15.125:0/394716610 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f89600656f0 msgr2=0x7f8960067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:12:35.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.137+0000 7f89811ba700 1 --2- 172.21.15.125:0/394716610 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f89600656f0 0x7f8960067bb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f896c0090b0 tx=0x7f896c01c040 comp rx=0 tx=0).stop 2023-10-17T06:12:35.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.137+0000 7f89811ba700 1 -- 172.21.15.125:0/394716610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f897c0cb8a0 msgr2=0x7f897c154460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:12:35.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.137+0000 7f89811ba700 1 --2- 172.21.15.125:0/394716610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f897c0cb8a0 0x7f897c154460 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f896400c580 tx=0x7f896400c890 comp rx=0 tx=0).stop 2023-10-17T06:12:35.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.137+0000 7f89811ba700 1 -- 172.21.15.125:0/394716610 shutdown_connections 2023-10-17T06:12:35.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.137+0000 7f89811ba700 1 --2- 172.21.15.125:0/394716610 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f89600656f0 0x7f8960067bb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:35.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.137+0000 7f89811ba700 1 --2- 172.21.15.125:0/394716610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f897c154040 0x7f897c15e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:35.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.137+0000 7f89811ba700 1 --2- 172.21.15.125:0/394716610 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f897c0cb8a0 0x7f897c154460 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:35.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.137+0000 7f89811ba700 1 --2- 172.21.15.125:0/394716610 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f897c06e8a0 0x7f897c157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:35.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.137+0000 7f89811ba700 1 -- 172.21.15.125:0/394716610 >> 172.21.15.125:0/394716610 conn(0x7f897c06a340 msgr2=0x7f897c153270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:12:35.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.137+0000 7f89811ba700 1 -- 172.21.15.125:0/394716610 shutdown_connections 2023-10-17T06:12:35.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.137+0000 7f89811ba700 1 -- 172.21.15.125:0/394716610 wait complete. 2023-10-17T06:12:35.150 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 17 2023-10-17T06:12:35.169 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-10-17T06:12:35.354 INFO:teuthology.orchestra.run.smithi125.stdout:[{"id":5557,"entity":{"name":{"type":"client","num":5557},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":520252958}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":214.14721323099999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.60970753852454129,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5557 192.168.0.1:0/520252958","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi184","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}},{"id":5213,"entity":{"name":{"type":"client","num":5213},"addr":{"type":"any","addr":"172.21.15.125:0","nonce":3775054255}},"state":"stale","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":215.63518041,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.60762061865266348,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":25,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5213 172.21.15.125:0/3775054255","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi125","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-17T06:12:35.355 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi184", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 520252958, "type": "any" }, "name": { "num": 5557, "type": "client" } }, "id": 5557, "inst": "client.5557 192.168.0.1:0/520252958", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.6097075385245413 }, "state": "open", "uptime": 214.147213231 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "0", "hostname": "smithi125", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.125:0", "nonce": 3775054255, "type": "any" }, "name": { "num": 5213, "type": "client" } }, "id": 5213, "inst": "client.5213 172.21.15.125:0/3775054255", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 25, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.6076206186526635 }, "state": "stale", "uptime": 215.63518041 } ] 2023-10-17T06:12:35.356 DEBUG:teuthology.orchestra.run.smithi125:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-17T06:12:35.363 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:12:35.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.529+0000 7f45275ed700 1 Processor -- start 2023-10-17T06:12:35.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.529+0000 7f45275ed700 1 -- start start 2023-10-17T06:12:35.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f45275ed700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4520155420 0x7f45200cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:12:35.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f45275ed700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45200ce320 0x7f45200cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:12:35.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f45275ed700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45200cbc80 con 0x7f452015bf00 2023-10-17T06:12:35.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f45275ed700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4520155800 con 0x7f4520155420 2023-10-17T06:12:35.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f45275ed700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45200cb9a0 con 0x7f45200ce320 2023-10-17T06:12:35.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f4524b88700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f452015bf00 0x7f45200cdc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:60184/0 (socket says 172.21.15.125:60184) 2023-10-17T06:12:35.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f4524b88700 1 -- 172.21.15.125:0/2087334489 learned_addr learned my addr 172.21.15.125:0/2087334489 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:12:35.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f4525389700 1 --2- 172.21.15.125:0/2087334489 >> v2:172.21.15.125:3300/0 conn(0x7f4520155420 0x7f45200cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:12:35.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f4525b8a700 1 --2- 172.21.15.125:0/2087334489 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45200ce320 0x7f45200cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:12:35.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f4517fff700 1 -- 172.21.15.125:0/2087334489 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144006438 0 0) 0x7f45200cbc80 con 0x7f452015bf00 2023-10-17T06:12:35.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f4517fff700 1 -- 172.21.15.125:0/2087334489 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f450c0035d0 con 0x7f452015bf00 2023-10-17T06:12:35.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f4517fff700 1 -- 172.21.15.125:0/2087334489 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3010888206 0 0) 0x7f450c0035d0 con 0x7f452015bf00 2023-10-17T06:12:35.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f4525389700 1 -- 172.21.15.125:0/2087334489 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45200ce320 msgr2=0x7f45200cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:12:35.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f4525389700 1 --2- 172.21.15.125:0/2087334489 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45200ce320 0x7f45200cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:35.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f4525389700 1 -- 172.21.15.125:0/2087334489 >> v1:172.21.15.125:6789/0 conn(0x7f452015bf00 legacy=0x7f45200cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:12:35.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f4525389700 1 -- 172.21.15.125:0/2087334489 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452015b420 con 0x7f4520155420 2023-10-17T06:12:35.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f4525389700 1 --2- 172.21.15.125:0/2087334489 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4520155420 0x7f45200cb150 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f451c009850 tx=0x7f451c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a733484593fae8 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:12:35.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f4517fff700 1 -- 172.21.15.125:0/2087334489 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4510001670 con 0x7f4520155420 2023-10-17T06:12:35.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f4517fff700 1 -- 172.21.15.125:0/2087334489 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451c004030 con 0x7f4520155420 2023-10-17T06:12:35.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f4517fff700 1 -- 172.21.15.125:0/2087334489 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c0043e0 con 0x7f4520155420 2023-10-17T06:12:35.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f45275ed700 1 -- 172.21.15.125:0/2087334489 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4520155420 msgr2=0x7f45200cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:12:35.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f45275ed700 1 --2- 172.21.15.125:0/2087334489 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4520155420 0x7f45200cb150 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f451c009850 tx=0x7f451c009b60 comp rx=0 tx=0).stop 2023-10-17T06:12:35.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f45275ed700 1 -- 172.21.15.125:0/2087334489 shutdown_connections 2023-10-17T06:12:35.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f45275ed700 1 --2- 172.21.15.125:0/2087334489 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45200ce320 0x7f45200cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:35.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f45275ed700 1 --2- 172.21.15.125:0/2087334489 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4520155420 0x7f45200cb150 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:35.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f45275ed700 1 -- 172.21.15.125:0/2087334489 >> 172.21.15.125:0/2087334489 conn(0x7f452006a340 msgr2=0x7f45200b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:12:35.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f45275ed700 1 -- 172.21.15.125:0/2087334489 shutdown_connections 2023-10-17T06:12:35.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.533+0000 7f45275ed700 1 -- 172.21.15.125:0/2087334489 wait complete. 2023-10-17T06:12:35.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.537+0000 7f45275ed700 1 Processor -- start 2023-10-17T06:12:35.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.537+0000 7f45275ed700 1 -- start start 2023-10-17T06:12:35.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.537+0000 7f45275ed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45200ce320 0x7f4520141120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:12:35.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.537+0000 7f45275ed700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4520155420 0x7f45200cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:12:35.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.537+0000 7f45275ed700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f452015bf00 0x7f45200ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:12:35.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.537+0000 7f45275ed700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4520159490 con 0x7f45200ce320 2023-10-17T06:12:35.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.537+0000 7f45275ed700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4520156420 con 0x7f452015bf00 2023-10-17T06:12:35.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.537+0000 7f45275ed700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4520156700 con 0x7f4520155420 2023-10-17T06:12:35.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.541+0000 7f4525389700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45200ce320 0x7f4520141120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:12:35.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.541+0000 7f4525389700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45200ce320 0x7f4520141120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52626/0 (socket says 172.21.15.125:52626) 2023-10-17T06:12:35.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.541+0000 7f4525389700 1 -- 172.21.15.125:0/1718873379 learned_addr learned my addr 172.21.15.125:0/1718873379 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:12:35.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.541+0000 7f4524b88700 1 --2- 172.21.15.125:0/1718873379 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4520155420 0x7f45200cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:12:35.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.541+0000 7f4525b8a700 1 --2- 172.21.15.125:0/1718873379 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f452015bf00 0x7f45200ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:12:35.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.541+0000 7f4525389700 1 -- 172.21.15.125:0/1718873379 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4520155420 msgr2=0x7f45200cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:12:35.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.541+0000 7f4525389700 1 --2- 172.21.15.125:0/1718873379 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4520155420 0x7f45200cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:35.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.541+0000 7f4525389700 1 -- 172.21.15.125:0/1718873379 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f452015bf00 msgr2=0x7f45200ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:12:35.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.541+0000 7f4525389700 1 --2- 172.21.15.125:0/1718873379 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f452015bf00 0x7f45200ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:35.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.541+0000 7f4525389700 1 -- 172.21.15.125:0/1718873379 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c0094b0 con 0x7f45200ce320 2023-10-17T06:12:35.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.541+0000 7f4525389700 1 --2- 172.21.15.125:0/1718873379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45200ce320 0x7f4520141120 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f451c000c00 tx=0x7f451c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:12:35.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.541+0000 7f4515ffb700 1 -- 172.21.15.125:0/1718873379 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c003d10 con 0x7f45200ce320 2023-10-17T06:12:35.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.541+0000 7f4515ffb700 1 -- 172.21.15.125:0/1718873379 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451c01f070 con 0x7f45200ce320 2023-10-17T06:12:35.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.541+0000 7f4515ffb700 1 -- 172.21.15.125:0/1718873379 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c011870 con 0x7f45200ce320 2023-10-17T06:12:35.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.541+0000 7f45275ed700 1 -- 172.21.15.125:0/1718873379 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45201569e0 con 0x7f45200ce320 2023-10-17T06:12:35.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.541+0000 7f45275ed700 1 -- 172.21.15.125:0/1718873379 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4520141660 con 0x7f45200ce320 2023-10-17T06:12:35.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.545+0000 7f45275ed700 1 -- 172.21.15.125:0/1718873379 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4520072e60 con 0x7f45200ce320 2023-10-17T06:12:35.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.545+0000 7f4515ffb700 1 -- 172.21.15.125:0/1718873379 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f451c0119d0 con 0x7f45200ce320 2023-10-17T06:12:35.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.545+0000 7f4515ffb700 1 --2- 172.21.15.125:0/1718873379 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f45040656f0 0x7f4504067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:12:35.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.545+0000 7f4515ffb700 1 -- 172.21.15.125:0/1718873379 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f451c021070 con 0x7f45200ce320 2023-10-17T06:12:35.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.545+0000 7f4524b88700 1 --2- 172.21.15.125:0/1718873379 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f45040656f0 0x7f4504067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:12:35.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.549+0000 7f4524b88700 1 --2- 172.21.15.125:0/1718873379 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f45040656f0 0x7f4504067bb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4510001eb0 tx=0x7f4510001730 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:12:35.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.549+0000 7f4515ffb700 1 -- 172.21.15.125:0/1718873379 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f451c0520a0 con 0x7f45200ce320 2023-10-17T06:12:35.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.553+0000 7fc46c9db700 1 Processor -- start 2023-10-17T06:12:35.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.553+0000 7fc46c9db700 1 -- start start 2023-10-17T06:12:35.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.557+0000 7fc46c9db700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc4680c9b40 0x7fc4680adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:12:35.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.557+0000 7fc46c9db700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc4680ad760 0x7fc46815f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:12:35.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.557+0000 7fc46c9db700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc468070a30 con 0x7fc46815ab70 2023-10-17T06:12:35.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.557+0000 7fc46c9db700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc468070cd0 con 0x7fc4680c9b40 2023-10-17T06:12:35.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.557+0000 7fc46c9db700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc46815e850 con 0x7fc4680ad760 2023-10-17T06:12:35.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.557+0000 7fc46659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc4680c9b40 0x7fc4680adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:12:35.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.557+0000 7fc46659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc4680c9b40 0x7fc4680adcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52630/0 (socket says 172.21.15.125:52630) 2023-10-17T06:12:35.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.557+0000 7fc46659c700 1 -- 172.21.15.125:0/3651888010 learned_addr learned my addr 172.21.15.125:0/3651888010 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:12:35.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.557+0000 7fc46759e700 1 --2- 172.21.15.125:0/3651888010 >> v2:172.21.15.184:3300/0 conn(0x7fc4680ad760 0x7fc46815f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:12:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.557+0000 7fc46659c700 1 -- 172.21.15.125:0/3651888010 >> v2:172.21.15.184:3300/0 conn(0x7fc4680ad760 msgr2=0x7fc46815f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:12:35.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.557+0000 7fc46659c700 1 --2- 172.21.15.125:0/3651888010 >> v2:172.21.15.184:3300/0 conn(0x7fc4680ad760 0x7fc46815f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:35.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.557+0000 7fc46659c700 1 -- 172.21.15.125:0/3651888010 >> v1:172.21.15.184:6789/0 conn(0x7fc46815ab70 legacy=0x7fc4680c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:12:35.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.557+0000 7fc46659c700 1 -- 172.21.15.125:0/3651888010 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46815eb30 con 0x7fc4680c9b40 2023-10-17T06:12:35.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.557+0000 7fc46659c700 1 --2- 172.21.15.125:0/3651888010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4680c9b40 0x7fc4680adcb0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc46806ee40 tx=0x7fc45c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192da397a1e86d6b server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:12:35.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.557+0000 7fc465d9b700 1 -- 172.21.15.125:0/3651888010 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c011830 con 0x7fc4680c9b40 2023-10-17T06:12:35.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.557+0000 7fc465d9b700 1 -- 172.21.15.125:0/3651888010 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45c011990 con 0x7fc4680c9b40 2023-10-17T06:12:35.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.557+0000 7fc465d9b700 1 -- 172.21.15.125:0/3651888010 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c011d20 con 0x7fc4680c9b40 2023-10-17T06:12:35.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.557+0000 7fc46c9db700 1 -- 172.21.15.125:0/3651888010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4680c9b40 msgr2=0x7fc4680adcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:12:35.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.557+0000 7fc46c9db700 1 --2- 172.21.15.125:0/3651888010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4680c9b40 0x7fc4680adcb0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc46806ee40 tx=0x7fc45c009bf0 comp rx=0 tx=0).stop 2023-10-17T06:12:35.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.561+0000 7fc46c9db700 1 -- 172.21.15.125:0/3651888010 shutdown_connections 2023-10-17T06:12:35.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.561+0000 7fc46c9db700 1 --2- 172.21.15.125:0/3651888010 >> v2:172.21.15.184:3300/0 conn(0x7fc4680ad760 0x7fc46815f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:35.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.561+0000 7fc46c9db700 1 --2- 172.21.15.125:0/3651888010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4680c9b40 0x7fc4680adcb0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:35.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.561+0000 7fc46c9db700 1 -- 172.21.15.125:0/3651888010 >> 172.21.15.125:0/3651888010 conn(0x7fc4680b02a0 msgr2=0x7fc4680b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:12:35.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.561+0000 7fc46c9db700 1 -- 172.21.15.125:0/3651888010 shutdown_connections 2023-10-17T06:12:35.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.561+0000 7fc46c9db700 1 -- 172.21.15.125:0/3651888010 wait complete. 2023-10-17T06:12:35.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.561+0000 7fc46c9db700 1 Processor -- start 2023-10-17T06:12:35.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.561+0000 7fc46c9db700 1 -- start start 2023-10-17T06:12:35.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc46c9db700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4680ad760 0x7fc468155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:12:35.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc46c9db700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4680c9b40 0x7fc46815d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:12:35.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc46c9db700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc46815ab70 0x7fc4680af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:12:35.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc46c9db700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46815e100 con 0x7fc4680ad760 2023-10-17T06:12:35.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc46c9db700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4680c2fd0 con 0x7fc4680c9b40 2023-10-17T06:12:35.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc46c9db700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4680c32b0 con 0x7fc46815ab70 2023-10-17T06:12:35.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc466d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4680ad760 0x7fc468155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:12:35.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc466d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4680ad760 0x7fc468155870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52638/0 (socket says 172.21.15.125:52638) 2023-10-17T06:12:35.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc466d9d700 1 -- 172.21.15.125:0/3644179998 learned_addr learned my addr 172.21.15.125:0/3644179998 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:12:35.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc46759e700 1 --2- 172.21.15.125:0/3644179998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc46815ab70 0x7fc4680af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:12:35.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc46659c700 1 --2- 172.21.15.125:0/3644179998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4680c9b40 0x7fc46815d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:12:35.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc466d9d700 1 -- 172.21.15.125:0/3644179998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc46815ab70 msgr2=0x7fc4680af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:12:35.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc466d9d700 1 --2- 172.21.15.125:0/3644179998 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc46815ab70 0x7fc4680af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:35.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc466d9d700 1 -- 172.21.15.125:0/3644179998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4680c9b40 msgr2=0x7fc46815d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:12:35.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc466d9d700 1 --2- 172.21.15.125:0/3644179998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4680c9b40 0x7fc46815d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:35.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc466d9d700 1 -- 172.21.15.125:0/3644179998 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c009570 con 0x7fc4680ad760 2023-10-17T06:12:35.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc466d9d700 1 --2- 172.21.15.125:0/3644179998 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc4680ad760 0x7fc468155870 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc45800c500 tx=0x7fc45800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:12:35.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc44f7fe700 1 -- 172.21.15.125:0/3644179998 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4580052d0 con 0x7fc4680ad760 2023-10-17T06:12:35.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc44f7fe700 1 -- 172.21.15.125:0/3644179998 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc458005430 con 0x7fc4680ad760 2023-10-17T06:12:35.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc44f7fe700 1 -- 172.21.15.125:0/3644179998 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4580055a0 con 0x7fc4680ad760 2023-10-17T06:12:35.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc46c9db700 1 -- 172.21.15.125:0/3644179998 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4680c3590 con 0x7fc4680ad760 2023-10-17T06:12:35.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc46c9db700 1 -- 172.21.15.125:0/3644179998 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc468155fc0 con 0x7fc4680ad760 2023-10-17T06:12:35.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.565+0000 7fc46c9db700 1 -- 172.21.15.125:0/3644179998 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fc468156150 con 0x7fc4680ad760 2023-10-17T06:12:35.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.569+0000 7fc44f7fe700 1 -- 172.21.15.125:0/3644179998 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc4580038e0 con 0x7fc4680ad760 2023-10-17T06:12:35.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.569+0000 7fc44f7fe700 1 --2- 172.21.15.125:0/3644179998 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc4540656f0 0x7fc454067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:12:35.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.569+0000 7fc44f7fe700 1 -- 172.21.15.125:0/3644179998 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fc458082c00 con 0x7fc4680ad760 2023-10-17T06:12:35.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.573+0000 7fc46659c700 1 --2- 172.21.15.125:0/3644179998 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc4540656f0 0x7fc454067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:12:35.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.573+0000 7fc44f7fe700 1 -- 172.21.15.125:0/3644179998 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+447 (secure 0 0 0) 0x7fc458083270 con 0x7fc4680ad760 2023-10-17T06:12:35.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.573+0000 7fc46c9db700 1 -- 172.21.15.125:0/3644179998 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fc468072e60 con 0x7fc4680ad760 2023-10-17T06:12:35.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.573+0000 7fc46659c700 1 --2- 172.21.15.125:0/3644179998 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc4540656f0 0x7fc454067bb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc45c000c00 tx=0x7fc45c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:12:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.797+0000 7f45275ed700 1 -- 172.21.15.125:0/1718873379 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45200cd2e0 con 0x7f45200ce320 2023-10-17T06:12:35.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.797+0000 7f4515ffb700 1 -- 172.21.15.125:0/1718873379 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4887 (secure 0 0 0) 0x7f451c0556c0 con 0x7f45200ce320 2023-10-17T06:12:35.805 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:12:35.805 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:08:51.328615+0000","modified":"2023-10-17T06:08:54.897934+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.125:6837/2351050168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2351050168},{"type":"v1","addr":"172.21.15.125:6837","nonce":2351050168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-17T06:12:35.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.801+0000 7f45275ed700 1 -- 172.21.15.125:0/1718873379 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f45040656f0 msgr2=0x7f4504067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:12:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.801+0000 7f45275ed700 1 --2- 172.21.15.125:0/1718873379 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f45040656f0 0x7f4504067bb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4510001eb0 tx=0x7f4510001730 comp rx=0 tx=0).stop 2023-10-17T06:12:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.801+0000 7f45275ed700 1 -- 172.21.15.125:0/1718873379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45200ce320 msgr2=0x7f4520141120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:12:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.801+0000 7f45275ed700 1 --2- 172.21.15.125:0/1718873379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45200ce320 0x7f4520141120 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f451c000c00 tx=0x7f451c004770 comp rx=0 tx=0).stop 2023-10-17T06:12:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.801+0000 7f45275ed700 1 -- 172.21.15.125:0/1718873379 shutdown_connections 2023-10-17T06:12:35.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.801+0000 7f45275ed700 1 --2- 172.21.15.125:0/1718873379 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f45040656f0 0x7f4504067bb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.801+0000 7f45275ed700 1 --2- 172.21.15.125:0/1718873379 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f452015bf00 0x7f45200ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.801+0000 7f45275ed700 1 --2- 172.21.15.125:0/1718873379 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4520155420 0x7f45200cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.801+0000 7f45275ed700 1 --2- 172.21.15.125:0/1718873379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f45200ce320 0x7f4520141120 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:12:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.801+0000 7f45275ed700 1 -- 172.21.15.125:0/1718873379 >> 172.21.15.125:0/1718873379 conn(0x7f452006a340 msgr2=0x7f452015cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:12:35.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.801+0000 7f45275ed700 1 -- 172.21.15.125:0/1718873379 shutdown_connections 2023-10-17T06:12:35.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:12:35.801+0000 7f45275ed700 1 -- 172.21.15.125:0/1718873379 wait complete. 2023-10-17T06:12:35.812 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 17 2023-10-17T06:12:35.832 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-10-17T06:12:36.013 INFO:teuthology.orchestra.run.smithi125.stdout:[{"id":5557,"entity":{"name":{"type":"client","num":5557},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":520252958}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":214.803198423,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.60878413669688292,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5557 192.168.0.1:0/520252958","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi184","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}},{"id":5213,"entity":{"name":{"type":"client","num":5213},"addr":{"type":"any","addr":"172.21.15.125:0","nonce":3775054255}},"state":"stale","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":216.29116560200001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.60670037746433148,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":25,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5213 172.21.15.125:0/3775054255","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi125","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-17T06:12:36.013 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi184", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 520252958, "type": "any" }, "name": { "num": 5557, "type": "client" } }, "id": 5557, "inst": "client.5557 192.168.0.1:0/520252958", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.6087841366968829 }, "state": "open", "uptime": 214.803198423 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "0", "hostname": "smithi125", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.125:0", "nonce": 3775054255, "type": "any" }, "name": { "num": 5213, "type": "client" } }, "id": 5213, "inst": "client.5213 172.21.15.125:0/3775054255", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 25, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.6067003774643315 }, "state": "stale", "uptime": 216.291165602 } ] 2023-10-17T06:12:36.115 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-17T06:13:02.295 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:13:02.303 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:13:32.378 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:13:32.386 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:13:36.143 ERROR:tasks.ceph_test_case:Log output: 2023-10-17T06:13:36.144 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: '1 client(s) laggy due to laggy OSDs', retrying 2023-10-17T06:13:41.146 DEBUG:teuthology.orchestra.run.smithi125:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-17T06:13:41.155 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:13:41.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.319+0000 7f6f12cdf700 1 Processor -- start 2023-10-17T06:13:41.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.319+0000 7f6f12cdf700 1 -- start start 2023-10-17T06:13:41.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.319+0000 7f6f12cdf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6f0c164a20 0x7f6f0c0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:13:41.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.319+0000 7f6f12cdf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0c0ca4c0 con 0x7f6f0c0b3d40 2023-10-17T06:13:41.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.319+0000 7f6f12cdf700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0c0ca7a0 con 0x7f6f0c06ce20 2023-10-17T06:13:41.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.319+0000 7f6f12cdf700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f0c06e2d0 con 0x7f6f0c164a20 2023-10-17T06:13:41.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.319+0000 7f6f11cdd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6f0c0b3d40 0x7f6f0c0c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:54672/0 (socket says 172.21.15.125:54672) 2023-10-17T06:13:41.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.319+0000 7f6f11cdd700 1 -- 172.21.15.125:0/4229326450 learned_addr learned my addr 172.21.15.125:0/4229326450 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:13:41.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.319+0000 7f6f114dc700 1 --2- 172.21.15.125:0/4229326450 >> v2:172.21.15.125:3300/0 conn(0x7f6f0c164a20 0x7f6f0c0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:13:41.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.319+0000 7f6f10cdb700 1 -- 172.21.15.125:0/4229326450 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012379637 0 0) 0x7f6f0c0ca4c0 con 0x7f6f0c0b3d40 2023-10-17T06:13:41.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.319+0000 7f6f10cdb700 1 -- 172.21.15.125:0/4229326450 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ef80035d0 con 0x7f6f0c0b3d40 2023-10-17T06:13:41.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.319+0000 7f6f114dc700 1 -- 172.21.15.125:0/4229326450 >> v1:172.21.15.184:6789/0 conn(0x7f6f0c06ce20 legacy=0x7f6f0c06f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:13:41.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.319+0000 7f6f114dc700 1 -- 172.21.15.125:0/4229326450 >> v1:172.21.15.125:6789/0 conn(0x7f6f0c0b3d40 legacy=0x7f6f0c0c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:13:41.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.319+0000 7f6f114dc700 1 -- 172.21.15.125:0/4229326450 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c0caa80 con 0x7f6f0c164a20 2023-10-17T06:13:41.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.323+0000 7f6f114dc700 1 --2- 172.21.15.125:0/4229326450 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f0c164a20 0x7f6f0c0cc190 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6efc009850 tx=0x7f6efc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee24e5dbb862919 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:13:41.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.323+0000 7f6f10cdb700 1 -- 172.21.15.125:0/4229326450 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc011830 con 0x7f6f0c164a20 2023-10-17T06:13:41.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.323+0000 7f6f10cdb700 1 -- 172.21.15.125:0/4229326450 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6efc011990 con 0x7f6f0c164a20 2023-10-17T06:13:41.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.323+0000 7f6f10cdb700 1 -- 172.21.15.125:0/4229326450 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc011d40 con 0x7f6f0c164a20 2023-10-17T06:13:41.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.323+0000 7f6f12cdf700 1 -- 172.21.15.125:0/4229326450 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f0c164a20 msgr2=0x7f6f0c0cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:13:41.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.323+0000 7f6f12cdf700 1 --2- 172.21.15.125:0/4229326450 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f0c164a20 0x7f6f0c0cc190 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6efc009850 tx=0x7f6efc009b60 comp rx=0 tx=0).stop 2023-10-17T06:13:41.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.323+0000 7f6f12cdf700 1 -- 172.21.15.125:0/4229326450 shutdown_connections 2023-10-17T06:13:41.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.323+0000 7f6f12cdf700 1 --2- 172.21.15.125:0/4229326450 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f0c164a20 0x7f6f0c0cc190 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:13:41.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.323+0000 7f6f12cdf700 1 -- 172.21.15.125:0/4229326450 >> 172.21.15.125:0/4229326450 conn(0x7f6f0c0ce5c0 msgr2=0x7f6f0c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:13:41.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.323+0000 7f6f12cdf700 1 -- 172.21.15.125:0/4229326450 shutdown_connections 2023-10-17T06:13:41.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.323+0000 7f6f12cdf700 1 -- 172.21.15.125:0/4229326450 wait complete. 2023-10-17T06:13:41.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f12cdf700 1 Processor -- start 2023-10-17T06:13:41.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f12cdf700 1 -- start start 2023-10-17T06:13:41.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f12cdf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f0c06ce20 0x7f6f0c161a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:13:41.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f12cdf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f0c0b3d40 0x7f6f0c153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:13:41.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f12cdf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f0c164a20 0x7f6f0c1589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:13:41.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f12cdf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c1641d0 con 0x7f6f0c06ce20 2023-10-17T06:13:41.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f12cdf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c163620 con 0x7f6f0c0b3d40 2023-10-17T06:13:41.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f12cdf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0c154d40 con 0x7f6f0c164a20 2023-10-17T06:13:41.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f11cdd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f0c06ce20 0x7f6f0c161a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:13:41.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f11cdd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f0c06ce20 0x7f6f0c161a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40902/0 (socket says 172.21.15.125:40902) 2023-10-17T06:13:41.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f11cdd700 1 -- 172.21.15.125:0/1046919737 learned_addr learned my addr 172.21.15.125:0/1046919737 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:13:41.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f124de700 1 --2- 172.21.15.125:0/1046919737 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f0c164a20 0x7f6f0c1589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:13:41.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f114dc700 1 --2- 172.21.15.125:0/1046919737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f0c0b3d40 0x7f6f0c153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:13:41.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f11cdd700 1 -- 172.21.15.125:0/1046919737 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f0c164a20 msgr2=0x7f6f0c1589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:13:41.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f11cdd700 1 --2- 172.21.15.125:0/1046919737 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f0c164a20 0x7f6f0c1589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:13:41.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f11cdd700 1 -- 172.21.15.125:0/1046919737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f0c0b3d40 msgr2=0x7f6f0c153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:13:41.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f11cdd700 1 --2- 172.21.15.125:0/1046919737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f0c0b3d40 0x7f6f0c153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:13:41.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f11cdd700 1 -- 172.21.15.125:0/1046919737 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6efc0094b0 con 0x7f6f0c06ce20 2023-10-17T06:13:41.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f124de700 1 --2- 172.21.15.125:0/1046919737 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f0c164a20 0x7f6f0c1589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:13:41.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f114dc700 1 --2- 172.21.15.125:0/1046919737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f0c0b3d40 0x7f6f0c153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:13:41.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f11cdd700 1 --2- 172.21.15.125:0/1046919737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f0c06ce20 0x7f6f0c161a30 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800c730 tx=0x7f6f0800caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:13:41.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f027fc700 1 -- 172.21.15.125:0/1046919737 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f08005d90 con 0x7f6f0c06ce20 2023-10-17T06:13:41.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f027fc700 1 -- 172.21.15.125:0/1046919737 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f080070d0 con 0x7f6f0c06ce20 2023-10-17T06:13:41.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f12cdf700 1 -- 172.21.15.125:0/1046919737 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f0c163830 con 0x7f6f0c06ce20 2023-10-17T06:13:41.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f027fc700 1 -- 172.21.15.125:0/1046919737 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f08007460 con 0x7f6f0c06ce20 2023-10-17T06:13:41.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.327+0000 7f6f12cdf700 1 -- 172.21.15.125:0/1046919737 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f0c163df0 con 0x7f6f0c06ce20 2023-10-17T06:13:41.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.331+0000 7f6f12cdf700 1 -- 172.21.15.125:0/1046919737 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f0c163f80 con 0x7f6f0c06ce20 2023-10-17T06:13:41.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.331+0000 7f6f027fc700 1 -- 172.21.15.125:0/1046919737 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6f080075c0 con 0x7f6f0c06ce20 2023-10-17T06:13:41.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.331+0000 7f6f027fc700 1 --2- 172.21.15.125:0/1046919737 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6ef00656f0 0x7f6ef0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:13:41.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.331+0000 7f6f027fc700 1 -- 172.21.15.125:0/1046919737 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f6f08082690 con 0x7f6f0c06ce20 2023-10-17T06:13:41.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.331+0000 7f6f114dc700 1 --2- 172.21.15.125:0/1046919737 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6ef00656f0 0x7f6ef0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:13:41.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.335+0000 7f6f114dc700 1 --2- 172.21.15.125:0/1046919737 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6ef00656f0 0x7f6ef0067bb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c1fa2a0 tx=0x7f6efc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:13:41.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.339+0000 7f6f027fc700 1 -- 172.21.15.125:0/1046919737 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f6f0804fea0 con 0x7f6f0c06ce20 2023-10-17T06:13:41.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.347+0000 7ff1c92df700 1 Processor -- start 2023-10-17T06:13:41.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.347+0000 7ff1c92df700 1 -- start start 2023-10-17T06:13:41.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c92df700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff1c41574c0 0x7ff1c40ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:13:41.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c92df700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1c40ca920 0x7ff1c4069d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:13:41.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c92df700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff1c40cb330 0x7ff1c406a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:13:41.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c92df700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c415acd0 con 0x7ff1c41574c0 2023-10-17T06:13:41.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c92df700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c40c9620 con 0x7ff1c40cb330 2023-10-17T06:13:41.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c92df700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c40c9900 con 0x7ff1c40ca920 2023-10-17T06:13:41.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff1c41574c0 0x7ff1c40ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:13:41.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c27fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1c40ca920 0x7ff1c4069d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:13:41.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c27fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1c40ca920 0x7ff1c4069d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:60630/0 (socket says 172.21.15.125:60630) 2023-10-17T06:13:41.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c27fc700 1 -- 172.21.15.125:0/2929475459 learned_addr learned my addr 172.21.15.125:0/2929475459 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:13:41.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c37fe700 1 --2- 172.21.15.125:0/2929475459 >> v2:172.21.15.184:3300/0 conn(0x7ff1c40cb330 0x7ff1c406a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:13:41.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c27fc700 1 -- 172.21.15.125:0/2929475459 >> v2:172.21.15.184:3300/0 conn(0x7ff1c40cb330 msgr2=0x7ff1c406a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:13:41.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c27fc700 1 --2- 172.21.15.125:0/2929475459 >> v2:172.21.15.184:3300/0 conn(0x7ff1c40cb330 0x7ff1c406a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:13:41.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c27fc700 1 -- 172.21.15.125:0/2929475459 >> v2:172.21.15.125:3300/0 conn(0x7ff1c41574c0 msgr2=0x7ff1c40ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:13:41.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c27fc700 1 --2- 172.21.15.125:0/2929475459 >> v2:172.21.15.125:3300/0 conn(0x7ff1c41574c0 0x7ff1c40ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:13:41.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c27fc700 1 -- 172.21.15.125:0/2929475459 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c40c9be0 con 0x7ff1c40ca920 2023-10-17T06:13:41.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c2ffd700 1 --2- 172.21.15.125:0/2929475459 >> v2:172.21.15.125:3300/0 conn(0x7ff1c41574c0 0x7ff1c40ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:13:41.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c27fc700 1 --2- 172.21.15.125:0/2929475459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1c40ca920 0x7ff1c4069d10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4061490 tx=0x7ff1b8009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bf89c180dbf2e58 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:13:41.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c1ffb700 1 -- 172.21.15.125:0/2929475459 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8011830 con 0x7ff1c40ca920 2023-10-17T06:13:41.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c1ffb700 1 -- 172.21.15.125:0/2929475459 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b8011990 con 0x7ff1c40ca920 2023-10-17T06:13:41.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.351+0000 7ff1c1ffb700 1 -- 172.21.15.125:0/2929475459 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8011d20 con 0x7ff1c40ca920 2023-10-17T06:13:41.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.355+0000 7ff1c92df700 1 -- 172.21.15.125:0/2929475459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1c40ca920 msgr2=0x7ff1c4069d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:13:41.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.355+0000 7ff1c92df700 1 --2- 172.21.15.125:0/2929475459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1c40ca920 0x7ff1c4069d10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4061490 tx=0x7ff1b8009bf0 comp rx=0 tx=0).stop 2023-10-17T06:13:41.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.355+0000 7ff1c92df700 1 -- 172.21.15.125:0/2929475459 shutdown_connections 2023-10-17T06:13:41.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.355+0000 7ff1c92df700 1 --2- 172.21.15.125:0/2929475459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1c40ca920 0x7ff1c4069d10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:13:41.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.355+0000 7ff1c92df700 1 --2- 172.21.15.125:0/2929475459 >> v2:172.21.15.184:3300/0 conn(0x7ff1c40cb330 0x7ff1c406a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:13:41.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.355+0000 7ff1c92df700 1 --2- 172.21.15.125:0/2929475459 >> v2:172.21.15.125:3300/0 conn(0x7ff1c41574c0 0x7ff1c40ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:13:41.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.355+0000 7ff1c92df700 1 -- 172.21.15.125:0/2929475459 >> 172.21.15.125:0/2929475459 conn(0x7ff1c40cba50 msgr2=0x7ff1c40cbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:13:41.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.355+0000 7ff1c92df700 1 -- 172.21.15.125:0/2929475459 shutdown_connections 2023-10-17T06:13:41.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.355+0000 7ff1c92df700 1 -- 172.21.15.125:0/2929475459 wait complete. 2023-10-17T06:13:41.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.359+0000 7ff1c92df700 1 Processor -- start 2023-10-17T06:13:41.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.359+0000 7ff1c92df700 1 -- start start 2023-10-17T06:13:41.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.359+0000 7ff1c92df700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1c40cb330 0x7ff1c4145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:13:41.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.359+0000 7ff1c92df700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1c41574c0 0x7ff1c4144b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:13:41.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.359+0000 7ff1c92df700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1c4146960 0x7ff1c406d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:13:41.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.359+0000 7ff1c92df700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c41537e0 con 0x7ff1c4146960 2023-10-17T06:13:41.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.359+0000 7ff1c92df700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c4146710 con 0x7ff1c41574c0 2023-10-17T06:13:41.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.359+0000 7ff1c92df700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c4145b00 con 0x7ff1c40cb330 2023-10-17T06:13:41.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.359+0000 7ff1c37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1c4146960 0x7ff1c406d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:13:41.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.359+0000 7ff1c37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1c4146960 0x7ff1c406d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40920/0 (socket says 172.21.15.125:40920) 2023-10-17T06:13:41.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.359+0000 7ff1c37fe700 1 -- 172.21.15.125:0/3181847796 learned_addr learned my addr 172.21.15.125:0/3181847796 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:13:41.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.359+0000 7ff1c2ffd700 1 --2- 172.21.15.125:0/3181847796 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1c40cb330 0x7ff1c4145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:13:41.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.359+0000 7ff1c27fc700 1 --2- 172.21.15.125:0/3181847796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1c41574c0 0x7ff1c4144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:13:41.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.359+0000 7ff1c37fe700 1 -- 172.21.15.125:0/3181847796 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1c40cb330 msgr2=0x7ff1c4145400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:13:41.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.359+0000 7ff1c37fe700 1 --2- 172.21.15.125:0/3181847796 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1c40cb330 0x7ff1c4145400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:13:41.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.359+0000 7ff1c37fe700 1 -- 172.21.15.125:0/3181847796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1c41574c0 msgr2=0x7ff1c4144b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:13:41.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.359+0000 7ff1c37fe700 1 --2- 172.21.15.125:0/3181847796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1c41574c0 0x7ff1c4144b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:13:41.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.359+0000 7ff1c37fe700 1 -- 172.21.15.125:0/3181847796 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b40094b0 con 0x7ff1c4146960 2023-10-17T06:13:41.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.359+0000 7ff1c27fc700 1 --2- 172.21.15.125:0/3181847796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1c41574c0 0x7ff1c4144b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:13:41.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.359+0000 7ff1c2ffd700 1 --2- 172.21.15.125:0/3181847796 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff1c40cb330 0x7ff1c4145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:13:41.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.363+0000 7ff1c37fe700 1 --2- 172.21.15.125:0/3181847796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1c4146960 0x7ff1c406d6f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00eed0 tx=0x7ff1bc009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:13:41.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.363+0000 7ff1ab7fe700 1 -- 172.21.15.125:0/3181847796 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc010040 con 0x7ff1c4146960 2023-10-17T06:13:41.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.363+0000 7ff1c92df700 1 -- 172.21.15.125:0/3181847796 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b8009570 con 0x7ff1c4146960 2023-10-17T06:13:41.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.363+0000 7ff1ab7fe700 1 -- 172.21.15.125:0/3181847796 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1bc00baf0 con 0x7ff1c4146960 2023-10-17T06:13:41.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.363+0000 7ff1ab7fe700 1 -- 172.21.15.125:0/3181847796 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc009b20 con 0x7ff1c4146960 2023-10-17T06:13:41.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.363+0000 7ff1c92df700 1 -- 172.21.15.125:0/3181847796 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c41460c0 con 0x7ff1c4146960 2023-10-17T06:13:41.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.363+0000 7ff1c92df700 1 -- 172.21.15.125:0/3181847796 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7ff1c4060fc0 con 0x7ff1c4146960 2023-10-17T06:13:41.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.367+0000 7ff1ab7fe700 1 -- 172.21.15.125:0/3181847796 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff1bc01d400 con 0x7ff1c4146960 2023-10-17T06:13:41.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.367+0000 7ff1ab7fe700 1 --2- 172.21.15.125:0/3181847796 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff1b00656f0 0x7ff1b0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:13:41.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.367+0000 7ff1ab7fe700 1 -- 172.21.15.125:0/3181847796 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6440+0+0 (secure 0 0 0) 0x7ff1bc0837d0 con 0x7ff1c4146960 2023-10-17T06:13:41.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.367+0000 7ff1ab7fe700 1 -- 172.21.15.125:0/3181847796 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+446 (secure 0 0 0) 0x7ff1bc08a070 con 0x7ff1c4146960 2023-10-17T06:13:41.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.367+0000 7ff1c2ffd700 1 --2- 172.21.15.125:0/3181847796 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff1b00656f0 0x7ff1b0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:13:41.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.367+0000 7ff1c92df700 1 -- 172.21.15.125:0/3181847796 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7ff1c41586e0 con 0x7ff1c4146960 2023-10-17T06:13:41.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.367+0000 7ff1c2ffd700 1 --2- 172.21.15.125:0/3181847796 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff1b00656f0 0x7ff1b0067bb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009dd0 tx=0x7ff1b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:13:41.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.543+0000 7f6f12cdf700 1 -- 172.21.15.125:0/1046919737 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f0c072e60 con 0x7f6f0c06ce20 2023-10-17T06:13:41.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.547+0000 7f6f027fc700 1 -- 172.21.15.125:0/1046919737 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4887 (secure 0 0 0) 0x7f6f080534c0 con 0x7f6f0c06ce20 2023-10-17T06:13:41.551 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:13:41.551 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:08:51.328615+0000","modified":"2023-10-17T06:08:54.897934+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.125:6837/2351050168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2351050168},{"type":"v1","addr":"172.21.15.125:6837","nonce":2351050168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-17T06:13:41.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.551+0000 7f6f12cdf700 1 -- 172.21.15.125:0/1046919737 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6ef00656f0 msgr2=0x7f6ef0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:13:41.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.551+0000 7f6f12cdf700 1 --2- 172.21.15.125:0/1046919737 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6ef00656f0 0x7f6ef0067bb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c1fa2a0 tx=0x7f6efc008030 comp rx=0 tx=0).stop 2023-10-17T06:13:41.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.551+0000 7f6f12cdf700 1 -- 172.21.15.125:0/1046919737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f0c06ce20 msgr2=0x7f6f0c161a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:13:41.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.551+0000 7f6f12cdf700 1 --2- 172.21.15.125:0/1046919737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f0c06ce20 0x7f6f0c161a30 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800c730 tx=0x7f6f0800caf0 comp rx=0 tx=0).stop 2023-10-17T06:13:41.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.551+0000 7f6f12cdf700 1 -- 172.21.15.125:0/1046919737 shutdown_connections 2023-10-17T06:13:41.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.551+0000 7f6f12cdf700 1 --2- 172.21.15.125:0/1046919737 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6ef00656f0 0x7f6ef0067bb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:13:41.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.551+0000 7f6f12cdf700 1 --2- 172.21.15.125:0/1046919737 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f0c164a20 0x7f6f0c1589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:13:41.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.551+0000 7f6f12cdf700 1 --2- 172.21.15.125:0/1046919737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f0c0b3d40 0x7f6f0c153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:13:41.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.551+0000 7f6f12cdf700 1 --2- 172.21.15.125:0/1046919737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f0c06ce20 0x7f6f0c161a30 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:13:41.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.551+0000 7f6f12cdf700 1 -- 172.21.15.125:0/1046919737 >> 172.21.15.125:0/1046919737 conn(0x7f6f0c0ce5c0 msgr2=0x7f6f0c070860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:13:41.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.551+0000 7f6f12cdf700 1 -- 172.21.15.125:0/1046919737 shutdown_connections 2023-10-17T06:13:41.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:13:41.551+0000 7f6f12cdf700 1 -- 172.21.15.125:0/1046919737 wait complete. 2023-10-17T06:13:41.560 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 17 2023-10-17T06:13:41.577 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-10-17T06:13:41.758 INFO:teuthology.orchestra.run.smithi125.stdout:[{"id":5557,"entity":{"name":{"type":"client","num":5557},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":520252958}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":280.55371108700001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.5229823981512105,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5557 192.168.0.1:0/520252958","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi184","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}},{"id":5213,"entity":{"name":{"type":"client","num":5213},"addr":{"type":"any","addr":"172.21.15.125:0","nonce":3775054255}},"state":"stale","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":282.04167826600002,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.52119232292598772,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":25,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5213 172.21.15.125:0/3775054255","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi125","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-17T06:13:41.759 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi184", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 520252958, "type": "any" }, "name": { "num": 5557, "type": "client" } }, "id": 5557, "inst": "client.5557 192.168.0.1:0/520252958", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.5229823981512105 }, "state": "open", "uptime": 280.553711087 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "0", "hostname": "smithi125", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.125:0", "nonce": 3775054255, "type": "any" }, "name": { "num": 5213, "type": "client" } }, "id": 5213, "inst": "client.5213 172.21.15.125:0/3775054255", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 25, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.5211923229259877 }, "state": "stale", "uptime": 282.041678266 } ] 2023-10-17T06:13:41.861 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-17T06:14:02.463 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:14:02.471 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:14:32.542 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:14:32.550 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:14:41.889 ERROR:tasks.ceph_test_case:Log output: 2023-10-17T06:14:41.889 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: '1 client(s) laggy due to laggy OSDs', retrying 2023-10-17T06:14:46.891 DEBUG:teuthology.orchestra.run.smithi125:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-17T06:14:46.898 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:14:47.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.062+0000 7f7c70f0c700 1 Processor -- start 2023-10-17T06:14:47.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.062+0000 7f7c70f0c700 1 -- start start 2023-10-17T06:14:47.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.062+0000 7f7c70f0c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7c6c0d30e0 0x7f7c6c0d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:14:47.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.062+0000 7f7c70f0c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c6c0b1df0 0x7f7c6c070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:14:47.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.062+0000 7f7c70f0c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6c15d060 con 0x7f7c6c15cc80 2023-10-17T06:14:47.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.062+0000 7f7c70f0c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6c06d830 con 0x7f7c6c0d30e0 2023-10-17T06:14:47.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.062+0000 7f7c70f0c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c06dd60 con 0x7f7c6c0b1df0 2023-10-17T06:14:47.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.062+0000 7f7c63fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7c6c0d30e0 0x7f7c6c0d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:14:47.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.062+0000 7f7c63fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7c6c0d30e0 0x7f7c6c0d13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58780/0 (socket says 172.21.15.125:58780) 2023-10-17T06:14:47.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.062+0000 7f7c63fff700 1 -- 172.21.15.125:0/2467279905 learned_addr learned my addr 172.21.15.125:0/2467279905 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:14:47.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.066+0000 7f7c6bfff700 1 --2- 172.21.15.125:0/2467279905 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c6c0b1df0 0x7f7c6c070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:14:47.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.066+0000 7f7c63fff700 1 -- 172.21.15.125:0/2467279905 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c6c0b1df0 msgr2=0x7f7c6c070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:14:47.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.066+0000 7f7c63fff700 1 --2- 172.21.15.125:0/2467279905 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c6c0b1df0 0x7f7c6c070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:14:47.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.066+0000 7f7c63fff700 1 -- 172.21.15.125:0/2467279905 >> v1:172.21.15.184:6789/0 conn(0x7f7c6c15cc80 legacy=0x7f7c6c0d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:14:47.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.066+0000 7f7c63fff700 1 -- 172.21.15.125:0/2467279905 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c06da80 con 0x7f7c6c0d30e0 2023-10-17T06:14:47.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.066+0000 7f7c6bfff700 1 --2- 172.21.15.125:0/2467279905 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c6c0b1df0 0x7f7c6c070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:14:47.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.066+0000 7f7c63fff700 1 --2- 172.21.15.125:0/2467279905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6c0d30e0 0x7f7c6c0d13c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009910 tx=0x7f7c54009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1bdee12f1bcfbf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:14:47.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.066+0000 7f7c6affd700 1 -- 172.21.15.125:0/2467279905 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5400ba60 con 0x7f7c6c0d30e0 2023-10-17T06:14:47.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.066+0000 7f7c6affd700 1 -- 172.21.15.125:0/2467279905 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5400bbc0 con 0x7f7c6c0d30e0 2023-10-17T06:14:47.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.066+0000 7f7c6affd700 1 -- 172.21.15.125:0/2467279905 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54009e60 con 0x7f7c6c0d30e0 2023-10-17T06:14:47.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.066+0000 7f7c70f0c700 1 -- 172.21.15.125:0/2467279905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6c0d30e0 msgr2=0x7f7c6c0d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:14:47.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.066+0000 7f7c70f0c700 1 --2- 172.21.15.125:0/2467279905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6c0d30e0 0x7f7c6c0d13c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009910 tx=0x7f7c54009c20 comp rx=0 tx=0).stop 2023-10-17T06:14:47.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.066+0000 7f7c70f0c700 1 -- 172.21.15.125:0/2467279905 shutdown_connections 2023-10-17T06:14:47.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.066+0000 7f7c70f0c700 1 --2- 172.21.15.125:0/2467279905 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c6c0b1df0 0x7f7c6c070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:14:47.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.066+0000 7f7c70f0c700 1 --2- 172.21.15.125:0/2467279905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6c0d30e0 0x7f7c6c0d13c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:14:47.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.066+0000 7f7c70f0c700 1 -- 172.21.15.125:0/2467279905 >> 172.21.15.125:0/2467279905 conn(0x7f7c6c0cf530 msgr2=0x7f7c6c0cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:14:47.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.066+0000 7f7c70f0c700 1 -- 172.21.15.125:0/2467279905 shutdown_connections 2023-10-17T06:14:47.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.066+0000 7f7c70f0c700 1 -- 172.21.15.125:0/2467279905 wait complete. 2023-10-17T06:14:47.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.070+0000 7f7c70f0c700 1 Processor -- start 2023-10-17T06:14:47.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.070+0000 7f7c70f0c700 1 -- start start 2023-10-17T06:14:47.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.070+0000 7f7c70f0c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c6c0b1df0 0x7f7c6c14c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:14:47.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.070+0000 7f7c70f0c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6c0d30e0 0x7f7c6c0b7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:14:47.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.070+0000 7f7c70f0c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c6c15cc80 0x7f7c6c15e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:14:47.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.070+0000 7f7c70f0c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c15d290 con 0x7f7c6c0d30e0 2023-10-17T06:14:47.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.070+0000 7f7c70f0c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c15d570 con 0x7f7c6c15cc80 2023-10-17T06:14:47.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.070+0000 7f7c70f0c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c15d850 con 0x7f7c6c0b1df0 2023-10-17T06:14:47.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.070+0000 7f7c63fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6c0d30e0 0x7f7c6c0b7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:14:47.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.070+0000 7f7c63fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6c0d30e0 0x7f7c6c0b7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58786/0 (socket says 172.21.15.125:58786) 2023-10-17T06:14:47.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.070+0000 7f7c63fff700 1 -- 172.21.15.125:0/1108536368 learned_addr learned my addr 172.21.15.125:0/1108536368 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:14:47.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.070+0000 7f7c6b7fe700 1 --2- 172.21.15.125:0/1108536368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c6c0b1df0 0x7f7c6c14c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:14:47.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.070+0000 7f7c6bfff700 1 --2- 172.21.15.125:0/1108536368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c6c15cc80 0x7f7c6c15e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:14:47.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.074+0000 7f7c63fff700 1 -- 172.21.15.125:0/1108536368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c6c0b1df0 msgr2=0x7f7c6c14c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:14:47.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.074+0000 7f7c63fff700 1 --2- 172.21.15.125:0/1108536368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c6c0b1df0 0x7f7c6c14c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:14:47.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.074+0000 7f7c63fff700 1 -- 172.21.15.125:0/1108536368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c6c15cc80 msgr2=0x7f7c6c15e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:14:47.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.074+0000 7f7c63fff700 1 --2- 172.21.15.125:0/1108536368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c6c15cc80 0x7f7c6c15e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:14:47.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.074+0000 7f7c63fff700 1 -- 172.21.15.125:0/1108536368 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c54009570 con 0x7f7c6c0d30e0 2023-10-17T06:14:47.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.074+0000 7f7c63fff700 1 --2- 172.21.15.125:0/1108536368 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6c0d30e0 0x7f7c6c0b7fd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c071440 tx=0x7f7c54004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:14:47.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.074+0000 7f7c68ff9700 1 -- 172.21.15.125:0/1108536368 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54004590 con 0x7f7c6c0d30e0 2023-10-17T06:14:47.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.074+0000 7f7c68ff9700 1 -- 172.21.15.125:0/1108536368 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5401f070 con 0x7f7c6c0d30e0 2023-10-17T06:14:47.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.074+0000 7f7c70f0c700 1 -- 172.21.15.125:0/1108536368 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6c15db30 con 0x7f7c6c0d30e0 2023-10-17T06:14:47.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.074+0000 7f7c68ff9700 1 -- 172.21.15.125:0/1108536368 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54003900 con 0x7f7c6c0d30e0 2023-10-17T06:14:47.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.074+0000 7f7c70f0c700 1 -- 172.21.15.125:0/1108536368 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6c0b8510 con 0x7f7c6c0d30e0 2023-10-17T06:14:47.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.074+0000 7f7c70f0c700 1 -- 172.21.15.125:0/1108536368 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6c072e60 con 0x7f7c6c0d30e0 2023-10-17T06:14:47.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.078+0000 7f7c68ff9700 1 -- 172.21.15.125:0/1108536368 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7c54003a60 con 0x7f7c6c0d30e0 2023-10-17T06:14:47.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.078+0000 7f7c68ff9700 1 --2- 172.21.15.125:0/1108536368 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7c4c0656f0 0x7f7c4c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:14:47.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.078+0000 7f7c68ff9700 1 -- 172.21.15.125:0/1108536368 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f7c54021070 con 0x7f7c6c0d30e0 2023-10-17T06:14:47.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.078+0000 7f7c6b7fe700 1 --2- 172.21.15.125:0/1108536368 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7c4c0656f0 0x7f7c4c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:14:47.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.082+0000 7f7c6b7fe700 1 --2- 172.21.15.125:0/1108536368 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7c4c0656f0 0x7f7c4c067bb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c000fb0 tx=0x7f7c5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:14:47.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.086+0000 7f7c68ff9700 1 -- 172.21.15.125:0/1108536368 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f7c54052110 con 0x7f7c6c0d30e0 2023-10-17T06:14:47.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.086+0000 7f635b59e700 1 Processor -- start 2023-10-17T06:14:47.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.086+0000 7f635b59e700 1 -- start start 2023-10-17T06:14:47.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.090+0000 7f635b59e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f635c0b1f70 0x7f635c1609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:14:47.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.090+0000 7f635b59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f635c0b2350 0x7f635c15d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:14:47.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.090+0000 7f635b59e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f635c15d7b0 con 0x7f635c0b6670 2023-10-17T06:14:47.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.090+0000 7f635b59e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f635c06f680 con 0x7f635c0b1f70 2023-10-17T06:14:47.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.090+0000 7f635b59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f635c161940 con 0x7f635c0b2350 2023-10-17T06:14:47.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.090+0000 7f635ad9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f635c0b6670 0x7f635c06dd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:45648/0 (socket says 172.21.15.125:45648) 2023-10-17T06:14:47.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.090+0000 7f635ad9d700 1 -- 172.21.15.125:0/1200492227 learned_addr learned my addr 172.21.15.125:0/1200492227 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:14:47.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.090+0000 7f635a59c700 1 --2- 172.21.15.125:0/1200492227 >> v2:172.21.15.125:3300/0 conn(0x7f635c0b1f70 0x7f635c1609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:14:47.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.090+0000 7f6359d9b700 1 --2- 172.21.15.125:0/1200492227 >> v2:172.21.15.184:3300/0 conn(0x7f635c0b2350 0x7f635c15d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:14:47.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.090+0000 7f635959a700 1 -- 172.21.15.125:0/1200492227 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690502955 0 0) 0x7f635c15d7b0 con 0x7f635c0b6670 2023-10-17T06:14:47.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.090+0000 7f635959a700 1 -- 172.21.15.125:0/1200492227 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63440035d0 con 0x7f635c0b6670 2023-10-17T06:14:47.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.090+0000 7f635a59c700 1 -- 172.21.15.125:0/1200492227 >> v2:172.21.15.184:3300/0 conn(0x7f635c0b2350 msgr2=0x7f635c15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:14:47.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.090+0000 7f635a59c700 1 --2- 172.21.15.125:0/1200492227 >> v2:172.21.15.184:3300/0 conn(0x7f635c0b2350 0x7f635c15d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:14:47.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.090+0000 7f635959a700 1 -- 172.21.15.125:0/1200492227 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3752151412 0 0) 0x7f63440035d0 con 0x7f635c0b6670 2023-10-17T06:14:47.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.090+0000 7f635a59c700 1 -- 172.21.15.125:0/1200492227 >> v1:172.21.15.125:6789/0 conn(0x7f635c0b6670 legacy=0x7f635c06dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:14:47.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.090+0000 7f635a59c700 1 -- 172.21.15.125:0/1200492227 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635c0b5d10 con 0x7f635c0b1f70 2023-10-17T06:14:47.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.090+0000 7f635a59c700 1 --2- 172.21.15.125:0/1200492227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f635c0b1f70 0x7f635c1609a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f635c0b80d0 tx=0x7f634c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8066885196d207 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:14:47.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.094+0000 7f635959a700 1 -- 172.21.15.125:0/1200492227 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6354001a40 con 0x7f635c0b1f70 2023-10-17T06:14:47.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.094+0000 7f635959a700 1 -- 172.21.15.125:0/1200492227 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634c004030 con 0x7f635c0b1f70 2023-10-17T06:14:47.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.094+0000 7f635959a700 1 -- 172.21.15.125:0/1200492227 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634c0043c0 con 0x7f635c0b1f70 2023-10-17T06:14:47.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.094+0000 7f635b59e700 1 -- 172.21.15.125:0/1200492227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f635c0b1f70 msgr2=0x7f635c1609a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:14:47.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.094+0000 7f635b59e700 1 --2- 172.21.15.125:0/1200492227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f635c0b1f70 0x7f635c1609a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f635c0b80d0 tx=0x7f634c009b30 comp rx=0 tx=0).stop 2023-10-17T06:14:47.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.094+0000 7f635b59e700 1 -- 172.21.15.125:0/1200492227 shutdown_connections 2023-10-17T06:14:47.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.094+0000 7f635b59e700 1 --2- 172.21.15.125:0/1200492227 >> v2:172.21.15.184:3300/0 conn(0x7f635c0b2350 0x7f635c15d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:14:47.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.094+0000 7f635b59e700 1 --2- 172.21.15.125:0/1200492227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f635c0b1f70 0x7f635c1609a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:14:47.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.094+0000 7f635b59e700 1 -- 172.21.15.125:0/1200492227 >> 172.21.15.125:0/1200492227 conn(0x7f635c06a500 msgr2=0x7f635c0b47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:14:47.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.094+0000 7f635b59e700 1 -- 172.21.15.125:0/1200492227 shutdown_connections 2023-10-17T06:14:47.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.094+0000 7f635b59e700 1 -- 172.21.15.125:0/1200492227 wait complete. 2023-10-17T06:14:47.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.098+0000 7f635b59e700 1 Processor -- start 2023-10-17T06:14:47.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.098+0000 7f635b59e700 1 -- start start 2023-10-17T06:14:47.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.098+0000 7f635b59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f635c0b1f70 0x7f635c0d1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:14:47.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.098+0000 7f635b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f635c0b2350 0x7f635c15fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:14:47.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.098+0000 7f635b59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f635c0b6670 0x7f635c146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:14:47.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.098+0000 7f635b59e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635c155e00 con 0x7f635c0b2350 2023-10-17T06:14:47.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.098+0000 7f635b59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635c156290 con 0x7f635c0b6670 2023-10-17T06:14:47.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.098+0000 7f635b59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635c1551f0 con 0x7f635c0b1f70 2023-10-17T06:14:47.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.098+0000 7f6359d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f635c0b2350 0x7f635c15fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:14:47.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.098+0000 7f6359d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f635c0b2350 0x7f635c15fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:58804/0 (socket says 172.21.15.125:58804) 2023-10-17T06:14:47.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.098+0000 7f6359d9b700 1 -- 172.21.15.125:0/2117204926 learned_addr learned my addr 172.21.15.125:0/2117204926 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:14:47.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.098+0000 7f635a59c700 1 --2- 172.21.15.125:0/2117204926 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f635c0b1f70 0x7f635c0d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:14:47.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.098+0000 7f635ad9d700 1 --2- 172.21.15.125:0/2117204926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f635c0b6670 0x7f635c146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:14:47.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.098+0000 7f6359d9b700 1 -- 172.21.15.125:0/2117204926 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f635c0b1f70 msgr2=0x7f635c0d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:14:47.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.098+0000 7f6359d9b700 1 --2- 172.21.15.125:0/2117204926 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f635c0b1f70 0x7f635c0d1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:14:47.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.098+0000 7f6359d9b700 1 -- 172.21.15.125:0/2117204926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f635c0b6670 msgr2=0x7f635c146220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:14:47.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.098+0000 7f6359d9b700 1 --2- 172.21.15.125:0/2117204926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f635c0b6670 0x7f635c146220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:14:47.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.098+0000 7f6359d9b700 1 -- 172.21.15.125:0/2117204926 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c0094b0 con 0x7f635c0b2350 2023-10-17T06:14:47.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.102+0000 7f6359d9b700 1 --2- 172.21.15.125:0/2117204926 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f635c0b2350 0x7f635c15fd50 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f635000e9d0 tx=0x7f635000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:14:47.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.102+0000 7f634affd700 1 -- 172.21.15.125:0/2117204926 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6350009720 con 0x7f635c0b2350 2023-10-17T06:14:47.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.102+0000 7f634affd700 1 -- 172.21.15.125:0/2117204926 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635000c850 con 0x7f635c0b2350 2023-10-17T06:14:47.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.102+0000 7f635b59e700 1 -- 172.21.15.125:0/2117204926 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f635c1554d0 con 0x7f635c0b2350 2023-10-17T06:14:47.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.102+0000 7f634affd700 1 -- 172.21.15.125:0/2117204926 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635000cbc0 con 0x7f635c0b2350 2023-10-17T06:14:47.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.102+0000 7f635b59e700 1 -- 172.21.15.125:0/2117204926 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f635c155a90 con 0x7f635c0b2350 2023-10-17T06:14:47.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.102+0000 7f635b59e700 1 -- 172.21.15.125:0/2117204926 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f635c155fb0 con 0x7f635c0b2350 2023-10-17T06:14:47.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.106+0000 7f634affd700 1 -- 172.21.15.125:0/2117204926 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f635000cd20 con 0x7f635c0b2350 2023-10-17T06:14:47.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.106+0000 7f634affd700 1 --2- 172.21.15.125:0/2117204926 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f633c0656f0 0x7f633c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:14:47.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.106+0000 7f634affd700 1 -- 172.21.15.125:0/2117204926 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f6350083270 con 0x7f635c0b2350 2023-10-17T06:14:47.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.106+0000 7f635a59c700 1 --2- 172.21.15.125:0/2117204926 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f633c0656f0 0x7f633c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:14:47.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.106+0000 7f634affd700 1 -- 172.21.15.125:0/2117204926 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+446 (secure 0 0 0) 0x7f6350083600 con 0x7f635c0b2350 2023-10-17T06:14:47.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.106+0000 7f635b59e700 1 -- 172.21.15.125:0/2117204926 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f635c155f70 con 0x7f635c0b2350 2023-10-17T06:14:47.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.106+0000 7f635a59c700 1 --2- 172.21.15.125:0/2117204926 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f633c0656f0 0x7f633c067bb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f634c0090b0 tx=0x7f634c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:14:47.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.318+0000 7f7c70f0c700 1 -- 172.21.15.125:0/1108536368 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c6c0b8bb0 con 0x7f7c6c0d30e0 2023-10-17T06:14:47.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.318+0000 7f7c68ff9700 1 -- 172.21.15.125:0/1108536368 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4887 (secure 0 0 0) 0x7f7c54055730 con 0x7f7c6c0d30e0 2023-10-17T06:14:47.324 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:14:47.324 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:08:51.328615+0000","modified":"2023-10-17T06:08:54.897934+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.125:6837/2351050168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2351050168},{"type":"v1","addr":"172.21.15.125:6837","nonce":2351050168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-17T06:14:47.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.322+0000 7f7c70f0c700 1 -- 172.21.15.125:0/1108536368 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7c4c0656f0 msgr2=0x7f7c4c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:14:47.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.322+0000 7f7c70f0c700 1 --2- 172.21.15.125:0/1108536368 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7c4c0656f0 0x7f7c4c067bb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c000fb0 tx=0x7f7c5c009040 comp rx=0 tx=0).stop 2023-10-17T06:14:47.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.322+0000 7f7c70f0c700 1 -- 172.21.15.125:0/1108536368 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6c0d30e0 msgr2=0x7f7c6c0b7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:14:47.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.322+0000 7f7c70f0c700 1 --2- 172.21.15.125:0/1108536368 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6c0d30e0 0x7f7c6c0b7fd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c071440 tx=0x7f7c54004770 comp rx=0 tx=0).stop 2023-10-17T06:14:47.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.322+0000 7f7c70f0c700 1 -- 172.21.15.125:0/1108536368 shutdown_connections 2023-10-17T06:14:47.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.322+0000 7f7c70f0c700 1 --2- 172.21.15.125:0/1108536368 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7c4c0656f0 0x7f7c4c067bb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:14:47.328 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.322+0000 7f7c70f0c700 1 --2- 172.21.15.125:0/1108536368 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c6c15cc80 0x7f7c6c15e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:14:47.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.322+0000 7f7c70f0c700 1 --2- 172.21.15.125:0/1108536368 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c6c0d30e0 0x7f7c6c0b7fd0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:14:47.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.322+0000 7f7c70f0c700 1 --2- 172.21.15.125:0/1108536368 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7c6c0b1df0 0x7f7c6c14c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:14:47.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.322+0000 7f7c70f0c700 1 -- 172.21.15.125:0/1108536368 >> 172.21.15.125:0/1108536368 conn(0x7f7c6c0cf530 msgr2=0x7f7c6c1574d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:14:47.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.322+0000 7f7c70f0c700 1 -- 172.21.15.125:0/1108536368 shutdown_connections 2023-10-17T06:14:47.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:14:47.322+0000 7f7c70f0c700 1 -- 172.21.15.125:0/1108536368 wait complete. 2023-10-17T06:14:47.330 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 17 2023-10-17T06:14:47.349 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-10-17T06:14:47.537 INFO:teuthology.orchestra.run.smithi125.stdout:[{"id":5557,"entity":{"name":{"type":"client","num":5557},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":520252958}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":346.32829272100003,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.44924853076856192,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5557 192.168.0.1:0/520252958","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi184","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}},{"id":5213,"entity":{"name":{"type":"client","num":5213},"addr":{"type":"any","addr":"172.21.15.125:0","nonce":3775054255}},"state":"stale","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":347.81625989999998,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.44771083338574474,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":25,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5213 172.21.15.125:0/3775054255","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi125","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-17T06:14:47.538 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi184", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 520252958, "type": "any" }, "name": { "num": 5557, "type": "client" } }, "id": 5557, "inst": "client.5557 192.168.0.1:0/520252958", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.4492485307685619 }, "state": "open", "uptime": 346.328292721 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "0", "hostname": "smithi125", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.125:0", "nonce": 3775054255, "type": "any" }, "name": { "num": 5213, "type": "client" } }, "id": 5213, "inst": "client.5213 172.21.15.125:0/3775054255", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 25, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.44771083338574474 }, "state": "stale", "uptime": 347.8162599 } ] 2023-10-17T06:14:47.639 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-17T06:15:02.665 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:15:02.673 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:15:32.762 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:15:32.773 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:15:47.660 ERROR:tasks.ceph_test_case:Log output: 2023-10-17T06:15:47.661 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: '1 client(s) laggy due to laggy OSDs', retrying 2023-10-17T06:15:52.663 DEBUG:teuthology.orchestra.run.smithi125:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-17T06:15:52.672 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:15:52.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.837+0000 7f14448fc700 1 Processor -- start 2023-10-17T06:15:52.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.837+0000 7f14448fc700 1 -- start start 2023-10-17T06:15:52.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.837+0000 7f14448fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1440154040 0x7f14400cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:52.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.837+0000 7f14448fc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f14400cb8a0 0x7f144006f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:52.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.837+0000 7f14448fc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f144015e130 con 0x7f144006e8a0 2023-10-17T06:15:52.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.837+0000 7f14448fc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14400cdfa0 con 0x7f1440154040 2023-10-17T06:15:52.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.837+0000 7f14448fc700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14400ce1b0 con 0x7f14400cb8a0 2023-10-17T06:15:52.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.837+0000 7f143e59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1440154040 0x7f14400cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:52.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.837+0000 7f143e59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1440154040 0x7f14400cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36998/0 (socket says 172.21.15.125:36998) 2023-10-17T06:15:52.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.837+0000 7f143e59c700 1 -- 172.21.15.125:0/2975977281 learned_addr learned my addr 172.21.15.125:0/2975977281 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:15:52.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.841+0000 7f143e59c700 1 -- 172.21.15.125:0/2975977281 >> v2:172.21.15.184:3300/0 conn(0x7f14400cb8a0 msgr2=0x7f144006f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:15:52.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.841+0000 7f143e59c700 1 --2- 172.21.15.125:0/2975977281 >> v2:172.21.15.184:3300/0 conn(0x7f14400cb8a0 0x7f144006f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:52.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.841+0000 7f143e59c700 1 -- 172.21.15.125:0/2975977281 >> v1:172.21.15.184:6789/0 conn(0x7f144006e8a0 legacy=0x7f14400cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:15:52.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.841+0000 7f143e59c700 1 -- 172.21.15.125:0/2975977281 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14400ce490 con 0x7f1440154040 2023-10-17T06:15:52.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.841+0000 7f143e59c700 1 --2- 172.21.15.125:0/2975977281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1440154040 0x7f14400cc680 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1440157990 tx=0x7f1430009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf54a698bfbb96bd server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:15:52.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.841+0000 7f143dd9b700 1 -- 172.21.15.125:0/2975977281 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430004230 con 0x7f1440154040 2023-10-17T06:15:52.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.841+0000 7f143dd9b700 1 -- 172.21.15.125:0/2975977281 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1430004390 con 0x7f1440154040 2023-10-17T06:15:52.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.841+0000 7f143dd9b700 1 -- 172.21.15.125:0/2975977281 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14300036c0 con 0x7f1440154040 2023-10-17T06:15:52.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.841+0000 7f14448fc700 1 -- 172.21.15.125:0/2975977281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1440154040 msgr2=0x7f14400cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:52.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.841+0000 7f14448fc700 1 --2- 172.21.15.125:0/2975977281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1440154040 0x7f14400cc680 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1440157990 tx=0x7f1430009bf0 comp rx=0 tx=0).stop 2023-10-17T06:15:52.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.841+0000 7f14448fc700 1 -- 172.21.15.125:0/2975977281 shutdown_connections 2023-10-17T06:15:52.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.841+0000 7f14448fc700 1 --2- 172.21.15.125:0/2975977281 >> v2:172.21.15.184:3300/0 conn(0x7f14400cb8a0 0x7f144006f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:52.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.841+0000 7f14448fc700 1 --2- 172.21.15.125:0/2975977281 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1440154040 0x7f14400cc680 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:52.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.841+0000 7f14448fc700 1 -- 172.21.15.125:0/2975977281 >> 172.21.15.125:0/2975977281 conn(0x7f144006a340 msgr2=0x7f14400b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:15:52.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.841+0000 7f14448fc700 1 -- 172.21.15.125:0/2975977281 shutdown_connections 2023-10-17T06:15:52.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.841+0000 7f14448fc700 1 -- 172.21.15.125:0/2975977281 wait complete. 2023-10-17T06:15:52.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.845+0000 7f14448fc700 1 Processor -- start 2023-10-17T06:15:52.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.845+0000 7f14448fc700 1 -- start start 2023-10-17T06:15:52.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.845+0000 7f14448fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f144006e8a0 0x7f1440141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:52.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.845+0000 7f14448fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14400cb8a0 0x7f1440154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:52.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.845+0000 7f14448fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1440154040 0x7f1440151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:52.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.845+0000 7f14448fc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1440154dd0 con 0x7f14400cb8a0 2023-10-17T06:15:52.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.845+0000 7f14448fc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14401550b0 con 0x7f1440154040 2023-10-17T06:15:52.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.845+0000 7f14448fc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1440155390 con 0x7f144006e8a0 2023-10-17T06:15:52.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.849+0000 7f1435d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14400cb8a0 0x7f1440154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:52.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.849+0000 7f1435d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14400cb8a0 0x7f1440154460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37002/0 (socket says 172.21.15.125:37002) 2023-10-17T06:15:52.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.849+0000 7f1435d9b700 1 -- 172.21.15.125:0/1453050626 learned_addr learned my addr 172.21.15.125:0/1453050626 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:15:52.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.849+0000 7f143e59c700 1 --2- 172.21.15.125:0/1453050626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f144006e8a0 0x7f1440141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:52.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.849+0000 7f143ed9d700 1 --2- 172.21.15.125:0/1453050626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1440154040 0x7f1440151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:52.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.849+0000 7f1435d9b700 1 -- 172.21.15.125:0/1453050626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f144006e8a0 msgr2=0x7f1440141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:52.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.849+0000 7f1435d9b700 1 --2- 172.21.15.125:0/1453050626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f144006e8a0 0x7f1440141360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:52.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.849+0000 7f1435d9b700 1 -- 172.21.15.125:0/1453050626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1440154040 msgr2=0x7f1440151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:52.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.849+0000 7f1435d9b700 1 --2- 172.21.15.125:0/1453050626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1440154040 0x7f1440151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:52.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.849+0000 7f1435d9b700 1 -- 172.21.15.125:0/1453050626 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1430009570 con 0x7f14400cb8a0 2023-10-17T06:15:52.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.849+0000 7f143ed9d700 1 --2- 172.21.15.125:0/1453050626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1440154040 0x7f1440151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:15:52.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.849+0000 7f1435d9b700 1 --2- 172.21.15.125:0/1453050626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14400cb8a0 0x7f1440154460 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f142800c4d0 tx=0x7f142800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:15:52.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.849+0000 7f14377fe700 1 -- 172.21.15.125:0/1453050626 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14280054e0 con 0x7f14400cb8a0 2023-10-17T06:15:52.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.849+0000 7f14377fe700 1 -- 172.21.15.125:0/1453050626 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14280036a0 con 0x7f14400cb8a0 2023-10-17T06:15:52.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.849+0000 7f14377fe700 1 -- 172.21.15.125:0/1453050626 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1428003a50 con 0x7f14400cb8a0 2023-10-17T06:15:52.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.849+0000 7f14448fc700 1 -- 172.21.15.125:0/1453050626 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1440155670 con 0x7f14400cb8a0 2023-10-17T06:15:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.849+0000 7f14448fc700 1 -- 172.21.15.125:0/1453050626 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14401549a0 con 0x7f14400cb8a0 2023-10-17T06:15:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.849+0000 7f14448fc700 1 -- 172.21.15.125:0/1453050626 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1440155b90 con 0x7f14400cb8a0 2023-10-17T06:15:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.853+0000 7f14377fe700 1 -- 172.21.15.125:0/1453050626 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1428003bb0 con 0x7f14400cb8a0 2023-10-17T06:15:52.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.853+0000 7f14377fe700 1 --2- 172.21.15.125:0/1453050626 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f14200656f0 0x7f1420067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:52.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.857+0000 7f14377fe700 1 -- 172.21.15.125:0/1453050626 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f1428081fe0 con 0x7f14400cb8a0 2023-10-17T06:15:52.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.857+0000 7f143e59c700 1 --2- 172.21.15.125:0/1453050626 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f14200656f0 0x7f1420067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:52.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.857+0000 7f143e59c700 1 --2- 172.21.15.125:0/1453050626 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f14200656f0 0x7f1420067bb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1440157990 tx=0x7f1430008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:15:52.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.861+0000 7f14377fe700 1 -- 172.21.15.125:0/1453050626 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f1440155b90 con 0x7f14400cb8a0 2023-10-17T06:15:52.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.869+0000 7fafeeb77700 1 Processor -- start 2023-10-17T06:15:52.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.869+0000 7fafeeb77700 1 -- start start 2023-10-17T06:15:52.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.873+0000 7fafeeb77700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fafe80adc90 0x7fafe80cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:52.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.873+0000 7fafeeb77700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafe80719e0 0x7fafe80c9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:52.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.873+0000 7fafeeb77700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe80ae070 con 0x7fafe80c1990 2023-10-17T06:15:52.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.873+0000 7fafeeb77700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe8161850 con 0x7fafe80adc90 2023-10-17T06:15:52.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.873+0000 7fafeeb77700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80cac90 con 0x7fafe80719e0 2023-10-17T06:15:52.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.873+0000 7fafee376700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafe80719e0 0x7fafe80c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:52.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.873+0000 7fafedb75700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fafe80adc90 0x7fafe80cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:52.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.873+0000 7fafed374700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fafe80c1990 0x7fafe80712d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:35794/0 (socket says 172.21.15.125:35794) 2023-10-17T06:15:52.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.873+0000 7fafed374700 1 -- 172.21.15.125:0/3893919980 learned_addr learned my addr 172.21.15.125:0/3893919980 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:15:52.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.873+0000 7fafedb75700 1 -- 172.21.15.125:0/3893919980 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafe80719e0 msgr2=0x7fafe80c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:15:52.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.873+0000 7fafedb75700 1 --2- 172.21.15.125:0/3893919980 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafe80719e0 0x7fafe80c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:52.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.873+0000 7fafedb75700 1 -- 172.21.15.125:0/3893919980 >> v1:172.21.15.184:6789/0 conn(0x7fafe80c1990 legacy=0x7fafe80712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.873+0000 7fafedb75700 1 -- 172.21.15.125:0/3893919980 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe806d920 con 0x7fafe80adc90 2023-10-17T06:15:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.873+0000 7fafee376700 1 --2- 172.21.15.125:0/3893919980 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafe80719e0 0x7fafe80c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:15:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.873+0000 7fafedb75700 1 --2- 172.21.15.125:0/3893919980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafe80adc90 0x7fafe80cc380 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fafe806db10 tx=0x7fafe4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1954875313aef2a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:15:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.873+0000 7fafecb73700 1 -- 172.21.15.125:0/3893919980 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe4004020 con 0x7fafe80adc90 2023-10-17T06:15:52.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.873+0000 7fafecb73700 1 -- 172.21.15.125:0/3893919980 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe4004180 con 0x7fafe80adc90 2023-10-17T06:15:52.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.873+0000 7fafecb73700 1 -- 172.21.15.125:0/3893919980 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe4004530 con 0x7fafe80adc90 2023-10-17T06:15:52.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.877+0000 7fafeeb77700 1 -- 172.21.15.125:0/3893919980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafe80adc90 msgr2=0x7fafe80cc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:52.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.877+0000 7fafeeb77700 1 --2- 172.21.15.125:0/3893919980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafe80adc90 0x7fafe80cc380 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fafe806db10 tx=0x7fafe4009b30 comp rx=0 tx=0).stop 2023-10-17T06:15:52.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.877+0000 7fafeeb77700 1 -- 172.21.15.125:0/3893919980 shutdown_connections 2023-10-17T06:15:52.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.877+0000 7fafeeb77700 1 --2- 172.21.15.125:0/3893919980 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafe80719e0 0x7fafe80c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:52.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.877+0000 7fafeeb77700 1 --2- 172.21.15.125:0/3893919980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafe80adc90 0x7fafe80cc380 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:52.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.877+0000 7fafeeb77700 1 -- 172.21.15.125:0/3893919980 >> 172.21.15.125:0/3893919980 conn(0x7fafe80b02a0 msgr2=0x7fafe80b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:15:52.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.877+0000 7fafeeb77700 1 -- 172.21.15.125:0/3893919980 shutdown_connections 2023-10-17T06:15:52.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.877+0000 7fafeeb77700 1 -- 172.21.15.125:0/3893919980 wait complete. 2023-10-17T06:15:52.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.877+0000 7fafeeb77700 1 Processor -- start 2023-10-17T06:15:52.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.877+0000 7fafeeb77700 1 -- start start 2023-10-17T06:15:52.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafeeb77700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafe80719e0 0x7fafe8163f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:52.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafeeb77700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafe80adc90 0x7fafe80b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:52.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafeeb77700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafe80c1990 0x7fafe81f6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:52.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafeeb77700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe81644a0 con 0x7fafe80c1990 2023-10-17T06:15:52.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafeeb77700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe81f7410 con 0x7fafe80719e0 2023-10-17T06:15:52.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafeeb77700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe81f76f0 con 0x7fafe80adc90 2023-10-17T06:15:52.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafee376700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafe80c1990 0x7fafe81f6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:52.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafee376700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafe80c1990 0x7fafe81f6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:37012/0 (socket says 172.21.15.125:37012) 2023-10-17T06:15:52.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafee376700 1 -- 172.21.15.125:0/3866200897 learned_addr learned my addr 172.21.15.125:0/3866200897 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:15:52.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafedb75700 1 --2- 172.21.15.125:0/3866200897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafe80719e0 0x7fafe8163f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:52.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafed374700 1 --2- 172.21.15.125:0/3866200897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafe80adc90 0x7fafe80b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:52.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafee376700 1 -- 172.21.15.125:0/3866200897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafe80adc90 msgr2=0x7fafe80b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:52.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafee376700 1 --2- 172.21.15.125:0/3866200897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fafe80adc90 0x7fafe80b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:52.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafee376700 1 -- 172.21.15.125:0/3866200897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafe80719e0 msgr2=0x7fafe8163f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:52.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafee376700 1 --2- 172.21.15.125:0/3866200897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafe80719e0 0x7fafe8163f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:52.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafee376700 1 -- 172.21.15.125:0/3866200897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe0009a70 con 0x7fafe80c1990 2023-10-17T06:15:52.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafee376700 1 --2- 172.21.15.125:0/3866200897 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafe80c1990 0x7fafe81f6a20 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fafe000ef90 tx=0x7fafe000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:15:52.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafde7fc700 1 -- 172.21.15.125:0/3866200897 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe000cd40 con 0x7fafe80c1990 2023-10-17T06:15:52.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafde7fc700 1 -- 172.21.15.125:0/3866200897 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe000f040 con 0x7fafe80c1990 2023-10-17T06:15:52.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafeeb77700 1 -- 172.21.15.125:0/3866200897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe40094b0 con 0x7fafe80c1990 2023-10-17T06:15:52.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafde7fc700 1 -- 172.21.15.125:0/3866200897 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe00146c0 con 0x7fafe80c1990 2023-10-17T06:15:52.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafeeb77700 1 -- 172.21.15.125:0/3866200897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe80b24a0 con 0x7fafe80c1990 2023-10-17T06:15:52.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.881+0000 7fafeeb77700 1 -- 172.21.15.125:0/3866200897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fafe8072e60 con 0x7fafe80c1990 2023-10-17T06:15:52.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.885+0000 7fafde7fc700 1 -- 172.21.15.125:0/3866200897 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fafe0014820 con 0x7fafe80c1990 2023-10-17T06:15:52.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.885+0000 7fafde7fc700 1 --2- 172.21.15.125:0/3866200897 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fafcc0656f0 0x7fafcc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:52.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.885+0000 7fafde7fc700 1 -- 172.21.15.125:0/3866200897 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fafe0083b90 con 0x7fafe80c1990 2023-10-17T06:15:52.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.885+0000 7fafedb75700 1 --2- 172.21.15.125:0/3866200897 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fafcc0656f0 0x7fafcc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:52.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.885+0000 7fafde7fc700 1 -- 172.21.15.125:0/3866200897 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+446 (secure 0 0 0) 0x7fafe0088220 con 0x7fafe80c1990 2023-10-17T06:15:52.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.889+0000 7fafeeb77700 1 -- 172.21.15.125:0/3866200897 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fafe80b4730 con 0x7fafe80c1990 2023-10-17T06:15:52.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.889+0000 7fafedb75700 1 --2- 172.21.15.125:0/3866200897 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fafcc0656f0 0x7fafcc067bb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fafe4000c00 tx=0x7fafe4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:15:52.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:52.941+0000 7fafde7fc700 1 -- 172.21.15.125:0/3866200897 <== mon.0 v2:172.21.15.125:3300/0 7 ==== log(1 entries from seq 534 at 2023-10-17T06:15:52.890823+0000) v1 ==== 246+0+0 (secure 0 0 0) 0x7fafe0055780 con 0x7fafe80c1990 2023-10-17T06:15:52.950 INFO:teuthology.orchestra.run.smithi125.stdout: cluster: 2023-10-17T06:15:52.950 INFO:teuthology.orchestra.run.smithi125.stdout: id: c779df02-0ec4-47de-a0f3-2371e60a2dde 2023-10-17T06:15:52.950 INFO:teuthology.orchestra.run.smithi125.stdout: health: HEALTH_OK 2023-10-17T06:15:52.950 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:15:52.951 INFO:teuthology.orchestra.run.smithi125.stdout: services: 2023-10-17T06:15:52.951 INFO:teuthology.orchestra.run.smithi125.stdout: mon: 3 daemons, quorum a,b,c (age 9m) 2023-10-17T06:15:52.951 INFO:teuthology.orchestra.run.smithi125.stdout: mgr: y(active, since 9m), standbys: x 2023-10-17T06:15:52.951 INFO:teuthology.orchestra.run.smithi125.stdout: mds: 1/1 daemons up, 3 standby 2023-10-17T06:15:52.951 INFO:teuthology.orchestra.run.smithi125.stdout: osd: 8 osds: 8 up (since 4m), 8 in (since 9m) 2023-10-17T06:15:52.951 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:15:52.952 INFO:teuthology.orchestra.run.smithi125.stdout: data: 2023-10-17T06:15:52.952 INFO:teuthology.orchestra.run.smithi125.stdout: volumes: 1/1 healthy 2023-10-17T06:15:52.952 INFO:teuthology.orchestra.run.smithi125.stdout: pools: 4 pools, 105 pgs 2023-10-17T06:15:52.952 INFO:teuthology.orchestra.run.smithi125.stdout: objects: 24 objects, 580 KiB 2023-10-17T06:15:52.952 INFO:teuthology.orchestra.run.smithi125.stdout: usage: 217 MiB used, 720 GiB / 720 GiB avail 2023-10-17T06:15:52.952 INFO:teuthology.orchestra.run.smithi125.stdout: pgs: 105 active+clean 2023-10-17T06:15:52.953 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:15:52.953 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:15:52.953 INFO:teuthology.orchestra.run.smithi125.stdout:2023-10-17T06:15:52.890823+0000 mon.a [WRN] Health check failed: 1 client(s) laggy due to laggy OSDs (MDS_CLIENTS_LAGGY) 2023-10-17T06:15:53.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.117+0000 7f14448fc700 1 -- 172.21.15.125:0/1453050626 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1440155b90 con 0x7f14400cb8a0 2023-10-17T06:15:53.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.117+0000 7f14377fe700 1 -- 172.21.15.125:0/1453050626 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4889 (secure 0 0 0) 0x7f1440155b90 con 0x7f14400cb8a0 2023-10-17T06:15:53.124 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:15:53.125 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:08:51.328615+0000","modified":"2023-10-17T06:15:52.890737+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":109,"addr":"172.21.15.125:6837/2351050168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2351050168},{"type":"v1","addr":"172.21.15.125:6837","nonce":2351050168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-17T06:15:53.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.121+0000 7f14448fc700 1 -- 172.21.15.125:0/1453050626 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f14200656f0 msgr2=0x7f1420067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:53.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.121+0000 7f14448fc700 1 --2- 172.21.15.125:0/1453050626 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f14200656f0 0x7f1420067bb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1440157990 tx=0x7f1430008030 comp rx=0 tx=0).stop 2023-10-17T06:15:53.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.121+0000 7f14448fc700 1 -- 172.21.15.125:0/1453050626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14400cb8a0 msgr2=0x7f1440154460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:53.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.121+0000 7f14448fc700 1 --2- 172.21.15.125:0/1453050626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14400cb8a0 0x7f1440154460 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f142800c4d0 tx=0x7f142800c7e0 comp rx=0 tx=0).stop 2023-10-17T06:15:53.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.121+0000 7f14448fc700 1 -- 172.21.15.125:0/1453050626 shutdown_connections 2023-10-17T06:15:53.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.121+0000 7f14448fc700 1 --2- 172.21.15.125:0/1453050626 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f14200656f0 0x7f1420067bb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:53.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.121+0000 7f14448fc700 1 --2- 172.21.15.125:0/1453050626 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1440154040 0x7f1440151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:53.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.121+0000 7f14448fc700 1 --2- 172.21.15.125:0/1453050626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f14400cb8a0 0x7f1440154460 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:53.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.121+0000 7f14448fc700 1 --2- 172.21.15.125:0/1453050626 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f144006e8a0 0x7f1440141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:53.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.121+0000 7f14448fc700 1 -- 172.21.15.125:0/1453050626 >> 172.21.15.125:0/1453050626 conn(0x7f144006a340 msgr2=0x7f14400afb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:15:53.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.121+0000 7f14448fc700 1 -- 172.21.15.125:0/1453050626 shutdown_connections 2023-10-17T06:15:53.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.121+0000 7f14448fc700 1 -- 172.21.15.125:0/1453050626 wait complete. 2023-10-17T06:15:53.130 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 18 2023-10-17T06:15:53.148 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-10-17T06:15:53.334 INFO:teuthology.orchestra.run.smithi125.stdout:[{"id":5557,"entity":{"name":{"type":"client","num":5557},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":520252958}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":412.127110405,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.38588859174229728,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5557 192.168.0.1:0/520252958","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi184","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}},{"id":5213,"entity":{"name":{"type":"client","num":5213},"addr":{"type":"any","addr":"172.21.15.125:0","nonce":3775054255}},"state":"stale","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":413.61507758400001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.38456776410026572,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":25,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5213 172.21.15.125:0/3775054255","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi125","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-17T06:15:53.335 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi184", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 520252958, "type": "any" }, "name": { "num": 5557, "type": "client" } }, "id": 5557, "inst": "client.5557 192.168.0.1:0/520252958", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.3858885917422973 }, "state": "open", "uptime": 412.127110405 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "0", "hostname": "smithi125", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.125:0", "nonce": 3775054255, "type": "any" }, "name": { "num": 5213, "type": "client" } }, "id": 5213, "inst": "client.5213 172.21.15.125:0/3775054255", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 25, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.3845677641002657 }, "state": "stale", "uptime": 413.615077584 } ] 2023-10-17T06:15:53.437 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mon mon_osd_laggy_weight 2023-10-17T06:15:53.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.613+0000 7f79155b1700 1 Processor -- start 2023-10-17T06:15:53.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.613+0000 7f79155b1700 1 -- start start 2023-10-17T06:15:53.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.613+0000 7f79155b1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f79100d2e00 0x7f79100b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:53.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.613+0000 7f79155b1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f79100b5ae0 0x7f791006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:53.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.613+0000 7f79155b1700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791015d0d0 con 0x7f7910160710 2023-10-17T06:15:53.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.613+0000 7f79155b1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f791015df90 con 0x7f79100b5ae0 2023-10-17T06:15:53.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.613+0000 7f79155b1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f791006f0f0 con 0x7f79100d2e00 2023-10-17T06:15:53.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.613+0000 7f790f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f79100b5ae0 0x7f791006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:53.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.613+0000 7f790f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f79100b5ae0 0x7f791006db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40136/0 (socket says 172.21.15.125:40136) 2023-10-17T06:15:53.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.613+0000 7f790f7fe700 1 -- 172.21.15.125:0/1752779665 learned_addr learned my addr 172.21.15.125:0/1752779665 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:15:53.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.613+0000 7f790effd700 1 --2- 172.21.15.125:0/1752779665 >> v2:172.21.15.184:3300/0 conn(0x7f79100d2e00 0x7f79100b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:53.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.613+0000 7f790f7fe700 1 -- 172.21.15.125:0/1752779665 >> v2:172.21.15.184:3300/0 conn(0x7f79100d2e00 msgr2=0x7f79100b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:15:53.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.613+0000 7f790f7fe700 1 --2- 172.21.15.125:0/1752779665 >> v2:172.21.15.184:3300/0 conn(0x7f79100d2e00 0x7f79100b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:53.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.617+0000 7f790f7fe700 1 -- 172.21.15.125:0/1752779665 >> v1:172.21.15.184:6789/0 conn(0x7f7910160710 legacy=0x7f79100d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:53.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.617+0000 7f790f7fe700 1 -- 172.21.15.125:0/1752779665 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791015d310 con 0x7f79100b5ae0 2023-10-17T06:15:53.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.617+0000 7f790f7fe700 1 --2- 172.21.15.125:0/1752779665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79100b5ae0 0x7f791006db60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7910070660 tx=0x7f790800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7d841276e010e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:15:53.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.617+0000 7f790dffb700 1 -- 172.21.15.125:0/1752779665 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790800e070 con 0x7f79100b5ae0 2023-10-17T06:15:53.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.617+0000 7f790dffb700 1 -- 172.21.15.125:0/1752779665 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790800b9c0 con 0x7f79100b5ae0 2023-10-17T06:15:53.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.617+0000 7f790dffb700 1 -- 172.21.15.125:0/1752779665 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790800bd70 con 0x7f79100b5ae0 2023-10-17T06:15:53.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.617+0000 7f79155b1700 1 -- 172.21.15.125:0/1752779665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79100b5ae0 msgr2=0x7f791006db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:53.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.617+0000 7f79155b1700 1 --2- 172.21.15.125:0/1752779665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79100b5ae0 0x7f791006db60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7910070660 tx=0x7f790800b330 comp rx=0 tx=0).stop 2023-10-17T06:15:53.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.617+0000 7f79155b1700 1 -- 172.21.15.125:0/1752779665 shutdown_connections 2023-10-17T06:15:53.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.617+0000 7f79155b1700 1 --2- 172.21.15.125:0/1752779665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79100b5ae0 0x7f791006db60 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:53.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.617+0000 7f79155b1700 1 --2- 172.21.15.125:0/1752779665 >> v2:172.21.15.184:3300/0 conn(0x7f79100d2e00 0x7f79100b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:53.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.617+0000 7f79155b1700 1 -- 172.21.15.125:0/1752779665 >> 172.21.15.125:0/1752779665 conn(0x7f7910069f20 msgr2=0x7f791006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:15:53.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.617+0000 7f79155b1700 1 -- 172.21.15.125:0/1752779665 shutdown_connections 2023-10-17T06:15:53.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.617+0000 7f79155b1700 1 -- 172.21.15.125:0/1752779665 wait complete. 2023-10-17T06:15:53.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.621+0000 7f79155b1700 1 Processor -- start 2023-10-17T06:15:53.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.621+0000 7f79155b1700 1 -- start start 2023-10-17T06:15:53.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.621+0000 7f79155b1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79100b5ae0 0x7f7910146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:53.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.621+0000 7f79155b1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79100d2e00 0x7f791015b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:53.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.621+0000 7f79155b1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7910160710 0x7f791015b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:53.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.621+0000 7f79155b1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7910154460 con 0x7f79100d2e00 2023-10-17T06:15:53.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.621+0000 7f79155b1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7910158f80 con 0x7f7910160710 2023-10-17T06:15:53.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.621+0000 7f79155b1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7910146960 con 0x7f79100b5ae0 2023-10-17T06:15:53.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.625+0000 7f790e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79100d2e00 0x7f791015b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:53.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.625+0000 7f790e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79100d2e00 0x7f791015b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40144/0 (socket says 172.21.15.125:40144) 2023-10-17T06:15:53.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.625+0000 7f790e7fc700 1 -- 172.21.15.125:0/4194409632 learned_addr learned my addr 172.21.15.125:0/4194409632 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:15:53.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.625+0000 7f790f7fe700 1 --2- 172.21.15.125:0/4194409632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7910160710 0x7f791015b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:53.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.625+0000 7f790effd700 1 --2- 172.21.15.125:0/4194409632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79100b5ae0 0x7f7910146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:53.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.625+0000 7f790e7fc700 1 -- 172.21.15.125:0/4194409632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79100b5ae0 msgr2=0x7f7910146420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:53.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.625+0000 7f790e7fc700 1 --2- 172.21.15.125:0/4194409632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79100b5ae0 0x7f7910146420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:53.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.625+0000 7f790e7fc700 1 -- 172.21.15.125:0/4194409632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7910160710 msgr2=0x7f791015b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:53.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.625+0000 7f790e7fc700 1 --2- 172.21.15.125:0/4194409632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7910160710 0x7f791015b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:53.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.625+0000 7f790e7fc700 1 -- 172.21.15.125:0/4194409632 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7908009b30 con 0x7f79100d2e00 2023-10-17T06:15:53.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.625+0000 7f790effd700 1 --2- 172.21.15.125:0/4194409632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79100b5ae0 0x7f7910146420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:15:53.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.625+0000 7f790e7fc700 1 --2- 172.21.15.125:0/4194409632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79100d2e00 0x7f791015b3d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f78f800c500 tx=0x7f78f800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:15:53.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.625+0000 7f79077fe700 1 -- 172.21.15.125:0/4194409632 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f80052d0 con 0x7f79100d2e00 2023-10-17T06:15:53.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.625+0000 7f79077fe700 1 -- 172.21.15.125:0/4194409632 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f8005430 con 0x7f79100d2e00 2023-10-17T06:15:53.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.625+0000 7f79077fe700 1 -- 172.21.15.125:0/4194409632 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f80055a0 con 0x7f79100d2e00 2023-10-17T06:15:53.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.625+0000 7f79155b1700 1 -- 172.21.15.125:0/4194409632 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7910153bc0 con 0x7f79100d2e00 2023-10-17T06:15:53.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.625+0000 7f79155b1700 1 -- 172.21.15.125:0/4194409632 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7910154180 con 0x7f79100d2e00 2023-10-17T06:15:53.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.625+0000 7f79155b1700 1 -- 172.21.15.125:0/4194409632 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f791004e910 con 0x7f79100d2e00 2023-10-17T06:15:53.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.629+0000 7f79077fe700 1 -- 172.21.15.125:0/4194409632 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f78f80038c0 con 0x7f79100d2e00 2023-10-17T06:15:53.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.629+0000 7f79077fe700 1 --2- 172.21.15.125:0/4194409632 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f78f00656f0 0x7f78f0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:53.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.629+0000 7f79077fe700 1 -- 172.21.15.125:0/4194409632 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f78f8082250 con 0x7f79100d2e00 2023-10-17T06:15:53.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.629+0000 7f790effd700 1 --2- 172.21.15.125:0/4194409632 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f78f00656f0 0x7f78f0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:53.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.633+0000 7f790effd700 1 --2- 172.21.15.125:0/4194409632 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f78f00656f0 0x7f78f0067bb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7900007a70 tx=0x7f7900008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:15:53.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.637+0000 7f79077fe700 1 -- 172.21.15.125:0/4194409632 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f78f804faf0 con 0x7f79100d2e00 2023-10-17T06:15:53.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.929+0000 7f79155b1700 1 -- 172.21.15.125:0/4194409632 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "config get", "who": "mon", "key": "mon_osd_laggy_weight"} v 0) v1 -- 0x7f791015d0d0 con 0x7f79100d2e00 2023-10-17T06:15:53.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.933+0000 7f79077fe700 1 -- 172.21.15.125:0/4194409632 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mon", "key": "mon_osd_laggy_weight"}]=0 v11) v1 ==== 103+0+9 (secure 0 0 0) 0x7f791015d0d0 con 0x7f79100d2e00 2023-10-17T06:15:53.939 INFO:teuthology.orchestra.run.smithi125.stdout:0.300000 2023-10-17T06:15:53.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.933+0000 7f79155b1700 1 -- 172.21.15.125:0/4194409632 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f78f00656f0 msgr2=0x7f78f0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:53.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.933+0000 7f79155b1700 1 --2- 172.21.15.125:0/4194409632 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f78f00656f0 0x7f78f0067bb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7900007a70 tx=0x7f7900008040 comp rx=0 tx=0).stop 2023-10-17T06:15:53.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.933+0000 7f79155b1700 1 -- 172.21.15.125:0/4194409632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79100d2e00 msgr2=0x7f791015b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:53.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.933+0000 7f79155b1700 1 --2- 172.21.15.125:0/4194409632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79100d2e00 0x7f791015b3d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f78f800c500 tx=0x7f78f800c810 comp rx=0 tx=0).stop 2023-10-17T06:15:53.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.933+0000 7f79155b1700 1 -- 172.21.15.125:0/4194409632 shutdown_connections 2023-10-17T06:15:53.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.933+0000 7f79155b1700 1 --2- 172.21.15.125:0/4194409632 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f78f00656f0 0x7f78f0067bb0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:53.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.933+0000 7f79155b1700 1 --2- 172.21.15.125:0/4194409632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7910160710 0x7f791015b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:53.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.933+0000 7f79155b1700 1 --2- 172.21.15.125:0/4194409632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79100d2e00 0x7f791015b3d0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:53.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.933+0000 7f79155b1700 1 --2- 172.21.15.125:0/4194409632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f79100b5ae0 0x7f7910146420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:53.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.933+0000 7f79155b1700 1 -- 172.21.15.125:0/4194409632 >> 172.21.15.125:0/4194409632 conn(0x7f7910069f20 msgr2=0x7f79100b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:15:53.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.937+0000 7f79155b1700 1 -- 172.21.15.125:0/4194409632 shutdown_connections 2023-10-17T06:15:53.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:53.937+0000 7f79155b1700 1 -- 172.21.15.125:0/4194409632 wait complete. 2023-10-17T06:15:53.964 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_osd_laggy_weight 1 2023-10-17T06:15:54.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.129+0000 7f88c1341700 1 Processor -- start 2023-10-17T06:15:54.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.133+0000 7f88c1341700 1 -- start start 2023-10-17T06:15:54.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.133+0000 7f88c1341700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f88bc159750 0x7f88bc070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:54.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.133+0000 7f88c1341700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88bc0ce040 0x7f88bc06cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:54.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.133+0000 7f88c1341700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88bc0b14f0 con 0x7f88bc070aa0 2023-10-17T06:15:54.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.133+0000 7f88c1341700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88bc0c9aa0 con 0x7f88bc159750 2023-10-17T06:15:54.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.133+0000 7f88c1341700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc070f30 con 0x7f88bc0ce040 2023-10-17T06:15:54.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88baffd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f88bc159750 0x7f88bc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:54.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88ba7fc700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f88bc070aa0 0x7f88bc0cd930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:33852/0 (socket says 172.21.15.125:33852) 2023-10-17T06:15:54.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88ba7fc700 1 -- 172.21.15.125:0/3695359727 learned_addr learned my addr 172.21.15.125:0/3695359727 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:15:54.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88bb7fe700 1 --2- 172.21.15.125:0/3695359727 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88bc0ce040 0x7f88bc06cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:54.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88b9ffb700 1 -- 172.21.15.125:0/3695359727 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584923523 0 0) 0x7f88bc0b14f0 con 0x7f88bc070aa0 2023-10-17T06:15:54.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88b9ffb700 1 -- 172.21.15.125:0/3695359727 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88a40035d0 con 0x7f88bc070aa0 2023-10-17T06:15:54.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88baffd700 1 -- 172.21.15.125:0/3695359727 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88bc0ce040 msgr2=0x7f88bc06cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:15:54.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88baffd700 1 --2- 172.21.15.125:0/3695359727 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88bc0ce040 0x7f88bc06cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:54.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88baffd700 1 -- 172.21.15.125:0/3695359727 >> v1:172.21.15.184:6789/0 conn(0x7f88bc070aa0 legacy=0x7f88bc0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:54.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88baffd700 1 -- 172.21.15.125:0/3695359727 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88bc15d590 con 0x7f88bc159750 2023-10-17T06:15:54.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88bb7fe700 1 --2- 172.21.15.125:0/3695359727 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88bc0ce040 0x7f88bc06cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:15:54.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88baffd700 1 --2- 172.21.15.125:0/3695359727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88bc159750 0x7f88bc070560 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f88ac009850 tx=0x7f88ac009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39ab8593722da server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:15:54.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88b9ffb700 1 -- 172.21.15.125:0/3695359727 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac011830 con 0x7f88bc159750 2023-10-17T06:15:54.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88b9ffb700 1 -- 172.21.15.125:0/3695359727 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac011990 con 0x7f88bc159750 2023-10-17T06:15:54.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88b9ffb700 1 -- 172.21.15.125:0/3695359727 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac011d40 con 0x7f88bc159750 2023-10-17T06:15:54.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88c1341700 1 -- 172.21.15.125:0/3695359727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88bc159750 msgr2=0x7f88bc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:54.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88c1341700 1 --2- 172.21.15.125:0/3695359727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88bc159750 0x7f88bc070560 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f88ac009850 tx=0x7f88ac009b60 comp rx=0 tx=0).stop 2023-10-17T06:15:54.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88c1341700 1 -- 172.21.15.125:0/3695359727 shutdown_connections 2023-10-17T06:15:54.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88c1341700 1 --2- 172.21.15.125:0/3695359727 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88bc0ce040 0x7f88bc06cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:54.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88c1341700 1 --2- 172.21.15.125:0/3695359727 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88bc159750 0x7f88bc070560 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:54.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88c1341700 1 -- 172.21.15.125:0/3695359727 >> 172.21.15.125:0/3695359727 conn(0x7f88bc0ce5c0 msgr2=0x7f88bc0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:15:54.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88c1341700 1 -- 172.21.15.125:0/3695359727 shutdown_connections 2023-10-17T06:15:54.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.137+0000 7f88c1341700 1 -- 172.21.15.125:0/3695359727 wait complete. 2023-10-17T06:15:54.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.141+0000 7f88c1341700 1 Processor -- start 2023-10-17T06:15:54.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.141+0000 7f88c1341700 1 -- start start 2023-10-17T06:15:54.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.141+0000 7f88c1341700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88bc070aa0 0x7f88bc14d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:54.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.141+0000 7f88c1341700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88bc0ce040 0x7f88bc0c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:54.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.141+0000 7f88c1341700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88bc159750 0x7f88bc0c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:54.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.141+0000 7f88c1341700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc0b1360 con 0x7f88bc159750 2023-10-17T06:15:54.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.141+0000 7f88c1341700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc0b1640 con 0x7f88bc070aa0 2023-10-17T06:15:54.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.141+0000 7f88c1341700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc0b1920 con 0x7f88bc0ce040 2023-10-17T06:15:54.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.141+0000 7f88bb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88bc159750 0x7f88bc0c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:54.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.141+0000 7f88ba7fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88bc0ce040 0x7f88bc0c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:54.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.141+0000 7f88bb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88bc159750 0x7f88bc0c7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40160/0 (socket says 172.21.15.125:40160) 2023-10-17T06:15:54.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.141+0000 7f88bb7fe700 1 -- 172.21.15.125:0/3463360903 learned_addr learned my addr 172.21.15.125:0/3463360903 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:15:54.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.141+0000 7f88baffd700 1 --2- 172.21.15.125:0/3463360903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88bc070aa0 0x7f88bc14d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:54.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.145+0000 7f88bb7fe700 1 -- 172.21.15.125:0/3463360903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88bc0ce040 msgr2=0x7f88bc0c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:54.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.145+0000 7f88bb7fe700 1 --2- 172.21.15.125:0/3463360903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88bc0ce040 0x7f88bc0c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:54.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.145+0000 7f88bb7fe700 1 -- 172.21.15.125:0/3463360903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88bc070aa0 msgr2=0x7f88bc14d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:54.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.145+0000 7f88bb7fe700 1 --2- 172.21.15.125:0/3463360903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88bc070aa0 0x7f88bc14d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:54.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.145+0000 7f88bb7fe700 1 -- 172.21.15.125:0/3463360903 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b4009a70 con 0x7f88bc159750 2023-10-17T06:15:54.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.145+0000 7f88bb7fe700 1 --2- 172.21.15.125:0/3463360903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88bc159750 0x7f88bc0c7960 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f88b400efc0 tx=0x7f88b400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:15:54.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.145+0000 7f88a37fe700 1 -- 172.21.15.125:0/3463360903 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b400ca90 con 0x7f88bc159750 2023-10-17T06:15:54.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.145+0000 7f88a37fe700 1 -- 172.21.15.125:0/3463360903 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b400f040 con 0x7f88bc159750 2023-10-17T06:15:54.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.145+0000 7f88c1341700 1 -- 172.21.15.125:0/3463360903 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ac0094b0 con 0x7f88bc159750 2023-10-17T06:15:54.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.145+0000 7f88a37fe700 1 -- 172.21.15.125:0/3463360903 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b400ce10 con 0x7f88bc159750 2023-10-17T06:15:54.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.145+0000 7f88c1341700 1 -- 172.21.15.125:0/3463360903 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88bc06fc20 con 0x7f88bc159750 2023-10-17T06:15:54.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.145+0000 7f88c1341700 1 -- 172.21.15.125:0/3463360903 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88bc0b1e40 con 0x7f88bc159750 2023-10-17T06:15:54.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.149+0000 7f88a37fe700 1 -- 172.21.15.125:0/3463360903 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f88b4014480 con 0x7f88bc159750 2023-10-17T06:15:54.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.149+0000 7f88a37fe700 1 --2- 172.21.15.125:0/3463360903 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f88a80656f0 0x7f88a8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:15:54.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.149+0000 7f88a37fe700 1 -- 172.21.15.125:0/3463360903 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f88b4083530 con 0x7f88bc159750 2023-10-17T06:15:54.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.149+0000 7f88baffd700 1 --2- 172.21.15.125:0/3463360903 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f88a80656f0 0x7f88a8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:15:54.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.149+0000 7f88baffd700 1 --2- 172.21.15.125:0/3463360903 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f88a80656f0 0x7f88a8067bb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0090b0 tx=0x7f88ac01c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:15:54.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.157+0000 7f88a37fe700 1 -- 172.21.15.125:0/3463360903 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f88bc0b1e40 con 0x7f88bc159750 2023-10-17T06:15:54.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.333+0000 7f88c1341700 1 -- 172.21.15.125:0/3463360903 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command([{prefix=config set, name=mon_osd_laggy_weight}] v 0) v1 -- 0x7f88bc0b1e40 con 0x7f88bc159750 2023-10-17T06:15:54.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.345+0000 7f88a37fe700 1 -- 172.21.15.125:0/3463360903 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_osd_laggy_weight}]=0 v12)=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7f88bc0b1e40 con 0x7f88bc159750 2023-10-17T06:15:54.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.349+0000 7f88c1341700 1 -- 172.21.15.125:0/3463360903 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f88a80656f0 msgr2=0x7f88a8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:54.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.349+0000 7f88c1341700 1 --2- 172.21.15.125:0/3463360903 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f88a80656f0 0x7f88a8067bb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0090b0 tx=0x7f88ac01c040 comp rx=0 tx=0).stop 2023-10-17T06:15:54.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.349+0000 7f88c1341700 1 -- 172.21.15.125:0/3463360903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88bc159750 msgr2=0x7f88bc0c7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:15:54.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.349+0000 7f88c1341700 1 --2- 172.21.15.125:0/3463360903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88bc159750 0x7f88bc0c7960 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f88b400efc0 tx=0x7f88b400c3a0 comp rx=0 tx=0).stop 2023-10-17T06:15:54.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.349+0000 7f88c1341700 1 -- 172.21.15.125:0/3463360903 shutdown_connections 2023-10-17T06:15:54.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.349+0000 7f88c1341700 1 --2- 172.21.15.125:0/3463360903 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f88a80656f0 0x7f88a8067bb0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:54.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.349+0000 7f88c1341700 1 --2- 172.21.15.125:0/3463360903 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f88bc159750 0x7f88bc0c7960 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:54.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.349+0000 7f88c1341700 1 --2- 172.21.15.125:0/3463360903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88bc0ce040 0x7f88bc0c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:54.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.349+0000 7f88c1341700 1 --2- 172.21.15.125:0/3463360903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88bc070aa0 0x7f88bc14d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:15:54.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.349+0000 7f88c1341700 1 -- 172.21.15.125:0/3463360903 >> 172.21.15.125:0/3463360903 conn(0x7f88bc0ce5c0 msgr2=0x7f88bc06ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:15:54.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.349+0000 7f88c1341700 1 -- 172.21.15.125:0/3463360903 shutdown_connections 2023-10-17T06:15:54.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:15:54.349+0000 7f88c1341700 1 -- 172.21.15.125:0/3463360903 wait complete. 2023-10-17T06:15:54.377 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-17T06:15:54.378 INFO:tasks.ceph.osd.3:Stopping old one... 2023-10-17T06:15:54.378 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-17T06:15:54.379 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:15:54.479 INFO:tasks.ceph.osd.3:Stopped 2023-10-17T06:15:54.480 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-17T06:15:54.484 INFO:tasks.ceph.osd.3:Started 2023-10-17T06:15:54.485 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-10-17T06:15:54.661 INFO:teuthology.orchestra.run.smithi125.stderr:no valid command found; 10 closest matches: 2023-10-17T06:15:54.662 INFO:teuthology.orchestra.run.smithi125.stderr:0 2023-10-17T06:15:54.662 INFO:teuthology.orchestra.run.smithi125.stderr:1 2023-10-17T06:15:54.662 INFO:teuthology.orchestra.run.smithi125.stderr:2 2023-10-17T06:15:54.662 INFO:teuthology.orchestra.run.smithi125.stderr:abort 2023-10-17T06:15:54.663 INFO:teuthology.orchestra.run.smithi125.stderr:assert 2023-10-17T06:15:54.663 INFO:teuthology.orchestra.run.smithi125.stderr:config diff 2023-10-17T06:15:54.663 INFO:teuthology.orchestra.run.smithi125.stderr:config diff get 2023-10-17T06:15:54.663 INFO:teuthology.orchestra.run.smithi125.stderr:config get 2023-10-17T06:15:54.663 INFO:teuthology.orchestra.run.smithi125.stderr:config help [] 2023-10-17T06:15:54.664 INFO:teuthology.orchestra.run.smithi125.stderr:config set ... 2023-10-17T06:15:54.664 INFO:teuthology.orchestra.run.smithi125.stderr:admin_socket: invalid command 2023-10-17T06:15:54.667 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-10-17T06:15:54.668 INFO:tasks.cephfs.filesystem.ceph_manager:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2023-10-17T06:15:55.181 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-10-17T06:15:55.173+0000 7fbe8ecac700 -1 Falling back to public interface 2023-10-17T06:15:55.788 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-17T06:15:59.496 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-10-17T06:15:59.488+0000 7fbe8ecac700 -1 osd.3 50 log_to_monitors true 2023-10-17T06:15:59.669 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-10-17T06:15:59.840 INFO:teuthology.orchestra.run.smithi125.stderr:no valid command found; 10 closest matches: 2023-10-17T06:15:59.840 INFO:teuthology.orchestra.run.smithi125.stderr:0 2023-10-17T06:15:59.840 INFO:teuthology.orchestra.run.smithi125.stderr:1 2023-10-17T06:15:59.841 INFO:teuthology.orchestra.run.smithi125.stderr:2 2023-10-17T06:15:59.841 INFO:teuthology.orchestra.run.smithi125.stderr:abort 2023-10-17T06:15:59.841 INFO:teuthology.orchestra.run.smithi125.stderr:assert 2023-10-17T06:15:59.841 INFO:teuthology.orchestra.run.smithi125.stderr:bluefs debug_inject_read_zeros 2023-10-17T06:15:59.841 INFO:teuthology.orchestra.run.smithi125.stderr:bluefs files list 2023-10-17T06:15:59.842 INFO:teuthology.orchestra.run.smithi125.stderr:bluefs stats 2023-10-17T06:15:59.842 INFO:teuthology.orchestra.run.smithi125.stderr:bluestore allocator dump block 2023-10-17T06:15:59.842 INFO:teuthology.orchestra.run.smithi125.stderr:bluestore allocator fragmentation block 2023-10-17T06:15:59.842 INFO:teuthology.orchestra.run.smithi125.stderr:admin_socket: invalid command 2023-10-17T06:15:59.847 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-10-17T06:15:59.847 INFO:tasks.cephfs.filesystem.ceph_manager:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2023-10-17T06:16:00.407 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-10-17T06:16:00.400+0000 7fbe823f0700 -1 osd.3 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-17T06:16:02.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-10-17T06:16:02.851 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:16:02.858 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:16:04.849 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-10-17T06:16:05.025 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-17T06:16:05.026 INFO:teuthology.orchestra.run.smithi125.stdout: "ops": [], 2023-10-17T06:16:05.026 INFO:teuthology.orchestra.run.smithi125.stdout: "num_ops": 0 2023-10-17T06:16:05.026 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-17T06:16:05.042 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_osd_laggy_weight 0.300000 2023-10-17T06:16:05.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.208+0000 7f109530c700 1 Processor -- start 2023-10-17T06:16:05.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.208+0000 7f109530c700 1 -- start start 2023-10-17T06:16:05.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.208+0000 7f109530c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f109006d470 0x7f1090070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:16:05.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.208+0000 7f109530c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1090070f50 0x7f109015a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:16:05.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.208+0000 7f109530c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109015e990 con 0x7f109006d090 2023-10-17T06:16:05.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.208+0000 7f109530c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109015f4f0 con 0x7f109006d470 2023-10-17T06:16:05.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.208+0000 7f109530c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10900b2ca0 con 0x7f1090070f50 2023-10-17T06:16:05.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.208+0000 7f10877fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f109006d470 0x7f1090070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:16:05.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.208+0000 7f108ffff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f109006d090 0x7f10900b2590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:35012/0 (socket says 172.21.15.125:35012) 2023-10-17T06:16:05.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.208+0000 7f108ffff700 1 -- 172.21.15.125:0/1785036583 learned_addr learned my addr 172.21.15.125:0/1785036583 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:16:05.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.208+0000 7f10877fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f109006d470 0x7f1090070a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50212/0 (socket says 172.21.15.125:50212) 2023-10-17T06:16:05.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.208+0000 7f1094b0b700 1 --2- 172.21.15.125:0/1785036583 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1090070f50 0x7f109015a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:16:05.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.212+0000 7f108f7fe700 1 -- 172.21.15.125:0/1785036583 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734779839 0 0) 0x7f109015e990 con 0x7f109006d090 2023-10-17T06:16:05.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.212+0000 7f108f7fe700 1 -- 172.21.15.125:0/1785036583 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f107c0035d0 con 0x7f109006d090 2023-10-17T06:16:05.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.212+0000 7f10877fe700 1 -- 172.21.15.125:0/1785036583 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1090070f50 msgr2=0x7f109015a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:16:05.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.212+0000 7f10877fe700 1 --2- 172.21.15.125:0/1785036583 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1090070f50 0x7f109015a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.212+0000 7f10877fe700 1 -- 172.21.15.125:0/1785036583 >> v1:172.21.15.184:6789/0 conn(0x7f109006d090 legacy=0x7f10900b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:16:05.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.212+0000 7f10877fe700 1 -- 172.21.15.125:0/1785036583 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109015ec50 con 0x7f109006d470 2023-10-17T06:16:05.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.212+0000 7f10877fe700 1 --2- 172.21.15.125:0/1785036583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f109006d470 0x7f1090070a10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1078009850 tx=0x7f1078009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ddc7ff23737dcf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:16:05.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.212+0000 7f108f7fe700 1 -- 172.21.15.125:0/1785036583 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1078011830 con 0x7f109006d470 2023-10-17T06:16:05.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.212+0000 7f108f7fe700 1 -- 172.21.15.125:0/1785036583 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1078011990 con 0x7f109006d470 2023-10-17T06:16:05.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.212+0000 7f108f7fe700 1 -- 172.21.15.125:0/1785036583 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1078011d40 con 0x7f109006d470 2023-10-17T06:16:05.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.212+0000 7f109530c700 1 -- 172.21.15.125:0/1785036583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f109006d470 msgr2=0x7f1090070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:16:05.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.212+0000 7f109530c700 1 --2- 172.21.15.125:0/1785036583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f109006d470 0x7f1090070a10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1078009850 tx=0x7f1078009b60 comp rx=0 tx=0).stop 2023-10-17T06:16:05.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.212+0000 7f109530c700 1 -- 172.21.15.125:0/1785036583 shutdown_connections 2023-10-17T06:16:05.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.212+0000 7f109530c700 1 --2- 172.21.15.125:0/1785036583 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1090070f50 0x7f109015a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.212+0000 7f109530c700 1 --2- 172.21.15.125:0/1785036583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f109006d470 0x7f1090070a10 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.212+0000 7f109530c700 1 -- 172.21.15.125:0/1785036583 >> 172.21.15.125:0/1785036583 conn(0x7f10900ce5c0 msgr2=0x7f10900ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:16:05.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.212+0000 7f109530c700 1 -- 172.21.15.125:0/1785036583 shutdown_connections 2023-10-17T06:16:05.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.212+0000 7f109530c700 1 -- 172.21.15.125:0/1785036583 wait complete. 2023-10-17T06:16:05.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f109530c700 1 Processor -- start 2023-10-17T06:16:05.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f109530c700 1 -- start start 2023-10-17T06:16:05.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f109530c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f109006d090 0x7f10900cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:16:05.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f109530c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f109006d470 0x7f10900b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:16:05.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f109530c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1090070f50 0x7f10900b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:16:05.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f109530c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109015bf30 con 0x7f109006d090 2023-10-17T06:16:05.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f109530c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109015b360 con 0x7f1090070f50 2023-10-17T06:16:05.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f109530c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109015b600 con 0x7f109006d470 2023-10-17T06:16:05.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f108ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f109006d090 0x7f10900cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:16:05.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f108ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f109006d090 0x7f10900cca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50214/0 (socket says 172.21.15.125:50214) 2023-10-17T06:16:05.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f108ffff700 1 -- 172.21.15.125:0/345358773 learned_addr learned my addr 172.21.15.125:0/345358773 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:16:05.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f1094b0b700 1 --2- 172.21.15.125:0/345358773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1090070f50 0x7f10900b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:16:05.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f10877fe700 1 --2- 172.21.15.125:0/345358773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f109006d470 0x7f10900b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:16:05.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f108ffff700 1 -- 172.21.15.125:0/345358773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f109006d470 msgr2=0x7f10900b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:16:05.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f108ffff700 1 --2- 172.21.15.125:0/345358773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f109006d470 0x7f10900b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f108ffff700 1 -- 172.21.15.125:0/345358773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1090070f50 msgr2=0x7f10900b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:16:05.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f108ffff700 1 --2- 172.21.15.125:0/345358773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1090070f50 0x7f10900b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f108ffff700 1 -- 172.21.15.125:0/345358773 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10780094b0 con 0x7f109006d090 2023-10-17T06:16:05.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f1094b0b700 1 --2- 172.21.15.125:0/345358773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1090070f50 0x7f10900b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:16:05.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f10877fe700 1 --2- 172.21.15.125:0/345358773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f109006d470 0x7f10900b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:16:05.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.216+0000 7f108ffff700 1 --2- 172.21.15.125:0/345358773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f109006d090 0x7f10900cca40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f108000c700 tx=0x7f108000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:16:05.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.220+0000 7f108d7fa700 1 -- 172.21.15.125:0/345358773 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080005d90 con 0x7f109006d090 2023-10-17T06:16:05.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.220+0000 7f108d7fa700 1 -- 172.21.15.125:0/345358773 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10800070d0 con 0x7f109006d090 2023-10-17T06:16:05.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.220+0000 7f109530c700 1 -- 172.21.15.125:0/345358773 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109015b8e0 con 0x7f109006d090 2023-10-17T06:16:05.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.220+0000 7f108d7fa700 1 -- 172.21.15.125:0/345358773 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080007480 con 0x7f109006d090 2023-10-17T06:16:05.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.220+0000 7f109530c700 1 -- 172.21.15.125:0/345358773 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10900c4650 con 0x7f109006d090 2023-10-17T06:16:05.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.220+0000 7f109530c700 1 -- 172.21.15.125:0/345358773 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109004e910 con 0x7f109006d090 2023-10-17T06:16:05.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.220+0000 7f108d7fa700 1 -- 172.21.15.125:0/345358773 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f10800075e0 con 0x7f109006d090 2023-10-17T06:16:05.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.224+0000 7f108d7fa700 1 --2- 172.21.15.125:0/345358773 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1070065720 0x7f1070067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:16:05.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.224+0000 7f108d7fa700 1 -- 172.21.15.125:0/345358773 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f1080082620 con 0x7f109006d090 2023-10-17T06:16:05.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.224+0000 7f10877fe700 1 --2- 172.21.15.125:0/345358773 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1070065720 0x7f1070067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:16:05.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.224+0000 7f10877fe700 1 --2- 172.21.15.125:0/345358773 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1070065720 0x7f1070067be0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f10780090b0 tx=0x7f1078008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:16:05.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.232+0000 7f108d7fa700 1 -- 172.21.15.125:0/345358773 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f108004fea0 con 0x7f109006d090 2023-10-17T06:16:05.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.468+0000 7f109530c700 1 -- 172.21.15.125:0/345358773 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command([{prefix=config set, name=mon_osd_laggy_weight}] v 0) v1 -- 0x7f109015efc0 con 0x7f109006d090 2023-10-17T06:16:05.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.480+0000 7f108d7fa700 1 -- 172.21.15.125:0/345358773 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_osd_laggy_weight}]=0 v13)=0 v13) v1 ==== 125+0+0 (secure 0 0 0) 0x7f10800534c0 con 0x7f109006d090 2023-10-17T06:16:05.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.484+0000 7f109530c700 1 -- 172.21.15.125:0/345358773 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1070065720 msgr2=0x7f1070067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:16:05.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.484+0000 7f109530c700 1 --2- 172.21.15.125:0/345358773 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1070065720 0x7f1070067be0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f10780090b0 tx=0x7f1078008030 comp rx=0 tx=0).stop 2023-10-17T06:16:05.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.484+0000 7f109530c700 1 -- 172.21.15.125:0/345358773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f109006d090 msgr2=0x7f10900cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:16:05.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.484+0000 7f109530c700 1 --2- 172.21.15.125:0/345358773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f109006d090 0x7f10900cca40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f108000c700 tx=0x7f108000cac0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.484+0000 7f109530c700 1 -- 172.21.15.125:0/345358773 shutdown_connections 2023-10-17T06:16:05.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.484+0000 7f109530c700 1 --2- 172.21.15.125:0/345358773 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1070065720 0x7f1070067be0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.484+0000 7f109530c700 1 --2- 172.21.15.125:0/345358773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1090070f50 0x7f10900b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.484+0000 7f109530c700 1 --2- 172.21.15.125:0/345358773 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f109006d470 0x7f10900b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.484+0000 7f109530c700 1 --2- 172.21.15.125:0/345358773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f109006d090 0x7f10900cca40 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.484+0000 7f109530c700 1 -- 172.21.15.125:0/345358773 >> 172.21.15.125:0/345358773 conn(0x7f10900ce5c0 msgr2=0x7f10900b2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:16:05.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.484+0000 7f109530c700 1 -- 172.21.15.125:0/345358773 shutdown_connections 2023-10-17T06:16:05.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.484+0000 7f109530c700 1 -- 172.21.15.125:0/345358773 wait complete. 2023-10-17T06:16:05.515 DEBUG:teuthology.orchestra.run.smithi125:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-17T06:16:05.520 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:16:05.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.676+0000 7f42e0f84700 1 Processor -- start 2023-10-17T06:16:05.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.676+0000 7f42e0f84700 1 -- start start 2023-10-17T06:16:05.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42e0f84700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42dc159750 0x7f42dc070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:16:05.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42e0f84700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42dc070aa0 0x7f42dc0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:16:05.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42e0f84700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42dc070f00 con 0x7f42dc0cde70 2023-10-17T06:16:05.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42e0f84700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42dc0c9aa0 con 0x7f42dc070aa0 2023-10-17T06:16:05.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42e0f84700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc0b14f0 con 0x7f42dc159750 2023-10-17T06:16:05.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42d3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42dc070aa0 0x7f42dc0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:16:05.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42d3fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42dc070aa0 0x7f42dc0cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50224/0 (socket says 172.21.15.125:50224) 2023-10-17T06:16:05.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42d3fff700 1 -- 172.21.15.125:0/3463013187 learned_addr learned my addr 172.21.15.125:0/3463013187 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:16:05.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42db7fe700 1 --2- 172.21.15.125:0/3463013187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42dc159750 0x7f42dc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:16:05.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42d3fff700 1 -- 172.21.15.125:0/3463013187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42dc159750 msgr2=0x7f42dc070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:16:05.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42d3fff700 1 --2- 172.21.15.125:0/3463013187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42dc159750 0x7f42dc070560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42d3fff700 1 -- 172.21.15.125:0/3463013187 >> v1:172.21.15.184:6789/0 conn(0x7f42dc0cde70 legacy=0x7f42dc0cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:16:05.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42d3fff700 1 -- 172.21.15.125:0/3463013187 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42dc15d590 con 0x7f42dc070aa0 2023-10-17T06:16:05.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42d3fff700 1 --2- 172.21.15.125:0/3463013187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42dc070aa0 0x7f42dc0cd930 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f42c4009910 tx=0x7f42c4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da861afeca97bb5a server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:16:05.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42daffd700 1 -- 172.21.15.125:0/3463013187 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4004230 con 0x7f42dc070aa0 2023-10-17T06:16:05.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42daffd700 1 -- 172.21.15.125:0/3463013187 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c4004390 con 0x7f42dc070aa0 2023-10-17T06:16:05.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42daffd700 1 -- 172.21.15.125:0/3463013187 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4009e60 con 0x7f42dc070aa0 2023-10-17T06:16:05.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42e0f84700 1 -- 172.21.15.125:0/3463013187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42dc070aa0 msgr2=0x7f42dc0cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:16:05.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42e0f84700 1 --2- 172.21.15.125:0/3463013187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42dc070aa0 0x7f42dc0cd930 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f42c4009910 tx=0x7f42c4009c20 comp rx=0 tx=0).stop 2023-10-17T06:16:05.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42e0f84700 1 -- 172.21.15.125:0/3463013187 shutdown_connections 2023-10-17T06:16:05.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42e0f84700 1 --2- 172.21.15.125:0/3463013187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42dc070aa0 0x7f42dc0cd930 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42e0f84700 1 --2- 172.21.15.125:0/3463013187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42dc159750 0x7f42dc070560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42e0f84700 1 -- 172.21.15.125:0/3463013187 >> 172.21.15.125:0/3463013187 conn(0x7f42dc0ce5c0 msgr2=0x7f42dc0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:16:05.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42e0f84700 1 -- 172.21.15.125:0/3463013187 shutdown_connections 2023-10-17T06:16:05.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.680+0000 7f42e0f84700 1 -- 172.21.15.125:0/3463013187 wait complete. 2023-10-17T06:16:05.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.684+0000 7f42e0f84700 1 Processor -- start 2023-10-17T06:16:05.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.684+0000 7f42e0f84700 1 -- start start 2023-10-17T06:16:05.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.684+0000 7f42e0f84700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42dc070aa0 0x7f42dc1587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:16:05.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.684+0000 7f42e0f84700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42dc0cde70 0x7f42dc155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:16:05.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42e0f84700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42dc159750 0x7f42dc155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:16:05.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42e0f84700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc158fb0 con 0x7f42dc070aa0 2023-10-17T06:16:05.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42e0f84700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc1f23d0 con 0x7f42dc159750 2023-10-17T06:16:05.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42e0f84700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42dc158ce0 con 0x7f42dc0cde70 2023-10-17T06:16:05.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42db7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42dc070aa0 0x7f42dc1587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:16:05.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42db7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42dc070aa0 0x7f42dc1587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50228/0 (socket says 172.21.15.125:50228) 2023-10-17T06:16:05.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42db7fe700 1 -- 172.21.15.125:0/4045733085 learned_addr learned my addr 172.21.15.125:0/4045733085 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:16:05.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42d3fff700 1 --2- 172.21.15.125:0/4045733085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42dc0cde70 0x7f42dc155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:16:05.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42dbfff700 1 --2- 172.21.15.125:0/4045733085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42dc159750 0x7f42dc155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:16:05.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42db7fe700 1 -- 172.21.15.125:0/4045733085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42dc0cde70 msgr2=0x7f42dc155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:16:05.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42db7fe700 1 --2- 172.21.15.125:0/4045733085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42dc0cde70 0x7f42dc155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42db7fe700 1 -- 172.21.15.125:0/4045733085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42dc159750 msgr2=0x7f42dc155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:16:05.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42db7fe700 1 --2- 172.21.15.125:0/4045733085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42dc159750 0x7f42dc155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42db7fe700 1 -- 172.21.15.125:0/4045733085 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c4009570 con 0x7f42dc070aa0 2023-10-17T06:16:05.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42d3fff700 1 --2- 172.21.15.125:0/4045733085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42dc0cde70 0x7f42dc155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:16:05.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42db7fe700 1 --2- 172.21.15.125:0/4045733085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42dc070aa0 0x7f42dc1587a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00d800 tx=0x7f42cc00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:16:05.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42d8ff9700 1 -- 172.21.15.125:0/4045733085 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0125f0 con 0x7f42dc070aa0 2023-10-17T06:16:05.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42d8ff9700 1 -- 172.21.15.125:0/4045733085 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc012750 con 0x7f42dc070aa0 2023-10-17T06:16:05.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42d8ff9700 1 -- 172.21.15.125:0/4045733085 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc012ac0 con 0x7f42dc070aa0 2023-10-17T06:16:05.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42e0f84700 1 -- 172.21.15.125:0/4045733085 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42dc1528c0 con 0x7f42dc070aa0 2023-10-17T06:16:05.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42e0f84700 1 -- 172.21.15.125:0/4045733085 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42dc152e80 con 0x7f42dc070aa0 2023-10-17T06:16:05.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.688+0000 7f42e0f84700 1 -- 172.21.15.125:0/4045733085 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42dc072e60 con 0x7f42dc070aa0 2023-10-17T06:16:05.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.692+0000 7f42d8ff9700 1 -- 172.21.15.125:0/4045733085 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f42cc012c20 con 0x7f42dc070aa0 2023-10-17T06:16:05.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.692+0000 7f42d8ff9700 1 --2- 172.21.15.125:0/4045733085 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f42bc0656f0 0x7f42bc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:16:05.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.692+0000 7f42d8ff9700 1 -- 172.21.15.125:0/4045733085 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f42cc0833a0 con 0x7f42dc070aa0 2023-10-17T06:16:05.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.692+0000 7f42d3fff700 1 --2- 172.21.15.125:0/4045733085 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f42bc0656f0 0x7f42bc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:16:05.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.692+0000 7f42d3fff700 1 --2- 172.21.15.125:0/4045733085 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f42bc0656f0 0x7f42bc067bb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f42c4009910 tx=0x7f42c4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:16:05.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.696+0000 7fd685edd700 1 Processor -- start 2023-10-17T06:16:05.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.696+0000 7fd685edd700 1 -- start start 2023-10-17T06:16:05.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.696+0000 7f42d8ff9700 1 -- 172.21.15.125:0/4045733085 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f42cc054730 con 0x7f42dc070aa0 2023-10-17T06:16:05.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.700+0000 7fd685edd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd680159a40 0x7fd6800cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:16:05.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.700+0000 7fd685edd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd6800ad750 0x7fd6800cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:16:05.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.700+0000 7fd685edd700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6800cadf0 con 0x7fd680159e20 2023-10-17T06:16:05.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.700+0000 7fd685edd700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6800adcc0 con 0x7fd6800ad750 2023-10-17T06:16:05.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.700+0000 7fd685edd700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6800ca220 con 0x7fd680159a40 2023-10-17T06:16:05.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.700+0000 7fd67ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd6800ad750 0x7fd6800cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:16:05.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.700+0000 7fd67ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd6800ad750 0x7fd6800cdfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50234/0 (socket says 172.21.15.125:50234) 2023-10-17T06:16:05.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.700+0000 7fd67ffff700 1 -- 172.21.15.125:0/3903606780 learned_addr learned my addr 172.21.15.125:0/3903606780 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:16:05.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.700+0000 7fd684edb700 1 --2- 172.21.15.125:0/3903606780 >> v2:172.21.15.184:3300/0 conn(0x7fd680159a40 0x7fd6800cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:16:05.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.700+0000 7fd67ffff700 1 -- 172.21.15.125:0/3903606780 >> v2:172.21.15.184:3300/0 conn(0x7fd680159a40 msgr2=0x7fd6800cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:16:05.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.700+0000 7fd67ffff700 1 --2- 172.21.15.125:0/3903606780 >> v2:172.21.15.184:3300/0 conn(0x7fd680159a40 0x7fd6800cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.700+0000 7fd67ffff700 1 -- 172.21.15.125:0/3903606780 >> v1:172.21.15.125:6789/0 conn(0x7fd680159e20 legacy=0x7fd6800b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:16:05.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.700+0000 7fd67ffff700 1 -- 172.21.15.125:0/3903606780 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6800ca4c0 con 0x7fd6800ad750 2023-10-17T06:16:05.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.700+0000 7fd67ffff700 1 --2- 172.21.15.125:0/3903606780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6800ad750 0x7fd6800cdfa0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd68006cbc0 tx=0x7fd66c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d855ad1261a488 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:16:05.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.700+0000 7fd67f7fe700 1 -- 172.21.15.125:0/3903606780 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c00b8a0 con 0x7fd6800ad750 2023-10-17T06:16:05.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.700+0000 7fd67f7fe700 1 -- 172.21.15.125:0/3903606780 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66c00ba00 con 0x7fd6800ad750 2023-10-17T06:16:05.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.700+0000 7fd67f7fe700 1 -- 172.21.15.125:0/3903606780 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c00bd90 con 0x7fd6800ad750 2023-10-17T06:16:05.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.704+0000 7fd685edd700 1 -- 172.21.15.125:0/3903606780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6800ad750 msgr2=0x7fd6800cdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:16:05.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.704+0000 7fd685edd700 1 --2- 172.21.15.125:0/3903606780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6800ad750 0x7fd6800cdfa0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd68006cbc0 tx=0x7fd66c009bf0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.704+0000 7fd685edd700 1 -- 172.21.15.125:0/3903606780 shutdown_connections 2023-10-17T06:16:05.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.704+0000 7fd685edd700 1 --2- 172.21.15.125:0/3903606780 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6800ad750 0x7fd6800cdfa0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.704+0000 7fd685edd700 1 --2- 172.21.15.125:0/3903606780 >> v2:172.21.15.184:3300/0 conn(0x7fd680159a40 0x7fd6800cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.704+0000 7fd685edd700 1 -- 172.21.15.125:0/3903606780 >> 172.21.15.125:0/3903606780 conn(0x7fd6800b02a0 msgr2=0x7fd6800b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:16:05.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.704+0000 7fd685edd700 1 -- 172.21.15.125:0/3903606780 shutdown_connections 2023-10-17T06:16:05.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.704+0000 7fd685edd700 1 -- 172.21.15.125:0/3903606780 wait complete. 2023-10-17T06:16:05.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.704+0000 7fd685edd700 1 Processor -- start 2023-10-17T06:16:05.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.704+0000 7fd685edd700 1 -- start start 2023-10-17T06:16:05.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.704+0000 7fd685edd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6800ad750 0x7fd6800c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:16:05.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.704+0000 7fd685edd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd680159a40 0x7fd6800c2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:16:05.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.704+0000 7fd685edd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd680159e20 0x7fd6801f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:16:05.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.704+0000 7fd685edd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800c7b10 con 0x7fd680159e20 2023-10-17T06:16:05.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.704+0000 7fd685edd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800c6f00 con 0x7fd680159a40 2023-10-17T06:16:05.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.704+0000 7fd685edd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800c71e0 con 0x7fd6800ad750 2023-10-17T06:16:05.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.704+0000 7fd6856dc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd680159e20 0x7fd6801f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:16:05.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.708+0000 7fd6856dc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd680159e20 0x7fd6801f3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50244/0 (socket says 172.21.15.125:50244) 2023-10-17T06:16:05.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.708+0000 7fd6856dc700 1 -- 172.21.15.125:0/3130602144 learned_addr learned my addr 172.21.15.125:0/3130602144 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:16:05.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.708+0000 7fd684edb700 1 --2- 172.21.15.125:0/3130602144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6800ad750 0x7fd6800c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:16:05.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.708+0000 7fd67ffff700 1 --2- 172.21.15.125:0/3130602144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd680159a40 0x7fd6800c2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:16:05.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.708+0000 7fd6856dc700 1 -- 172.21.15.125:0/3130602144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6800ad750 msgr2=0x7fd6800c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:16:05.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.708+0000 7fd6856dc700 1 --2- 172.21.15.125:0/3130602144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6800ad750 0x7fd6800c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.708+0000 7fd6856dc700 1 -- 172.21.15.125:0/3130602144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd680159a40 msgr2=0x7fd6800c2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:16:05.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.708+0000 7fd6856dc700 1 --2- 172.21.15.125:0/3130602144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd680159a40 0x7fd6800c2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.708+0000 7fd6856dc700 1 -- 172.21.15.125:0/3130602144 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c009570 con 0x7fd680159e20 2023-10-17T06:16:05.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.708+0000 7fd67ffff700 1 --2- 172.21.15.125:0/3130602144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd680159a40 0x7fd6800c2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:16:05.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.708+0000 7fd684edb700 1 --2- 172.21.15.125:0/3130602144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd6800ad750 0x7fd6800c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:16:05.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.708+0000 7fd6856dc700 1 --2- 172.21.15.125:0/3130602144 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd680159e20 0x7fd6801f3e20 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd67800cb50 tx=0x7fd67800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:16:05.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.708+0000 7fd67d7fa700 1 -- 172.21.15.125:0/3130602144 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678003c20 con 0x7fd680159e20 2023-10-17T06:16:05.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.708+0000 7fd67d7fa700 1 -- 172.21.15.125:0/3130602144 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678003d80 con 0x7fd680159e20 2023-10-17T06:16:05.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.708+0000 7fd685edd700 1 -- 172.21.15.125:0/3130602144 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6800c74c0 con 0x7fd680159e20 2023-10-17T06:16:05.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.708+0000 7fd67d7fa700 1 -- 172.21.15.125:0/3130602144 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67800ab70 con 0x7fd680159e20 2023-10-17T06:16:05.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.708+0000 7fd685edd700 1 -- 172.21.15.125:0/3130602144 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6800c2a90 con 0x7fd680159e20 2023-10-17T06:16:05.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.708+0000 7fd685edd700 1 -- 172.21.15.125:0/3130602144 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fd6800c2c80 con 0x7fd680159e20 2023-10-17T06:16:05.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.712+0000 7fd67d7fa700 1 -- 172.21.15.125:0/3130602144 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd67800acd0 con 0x7fd680159e20 2023-10-17T06:16:05.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.712+0000 7fd67d7fa700 1 --2- 172.21.15.125:0/3130602144 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd6640656f0 0x7fd664067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:16:05.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.712+0000 7fd67d7fa700 1 -- 172.21.15.125:0/3130602144 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fd678083090 con 0x7fd680159e20 2023-10-17T06:16:05.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.712+0000 7fd67d7fa700 1 -- 172.21.15.125:0/3130602144 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+710 (secure 0 0 0) 0x7fd67808a070 con 0x7fd680159e20 2023-10-17T06:16:05.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.712+0000 7fd684edb700 1 --2- 172.21.15.125:0/3130602144 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd6640656f0 0x7fd664067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:16:05.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.712+0000 7fd685edd700 1 -- 172.21.15.125:0/3130602144 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fd680072e60 con 0x7fd680159e20 2023-10-17T06:16:05.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.712+0000 7fd684edb700 1 --2- 172.21.15.125:0/3130602144 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd6640656f0 0x7fd664067bb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd674009a10 tx=0x7fd674008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:16:05.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.932+0000 7f42e0f84700 1 -- 172.21.15.125:0/4045733085 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42dc070070 con 0x7f42dc070aa0 2023-10-17T06:16:05.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.936+0000 7f42d8ff9700 1 -- 172.21.15.125:0/4045733085 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4889 (secure 0 0 0) 0x7f42cc012ed0 con 0x7f42dc070aa0 2023-10-17T06:16:05.944 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:16:05.944 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:08:51.328615+0000","modified":"2023-10-17T06:16:00.378712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":111,"addr":"172.21.15.125:6837/2351050168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2351050168},{"type":"v1","addr":"172.21.15.125:6837","nonce":2351050168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-17T06:16:05.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.936+0000 7f42e0f84700 1 -- 172.21.15.125:0/4045733085 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f42bc0656f0 msgr2=0x7f42bc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:16:05.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.936+0000 7f42e0f84700 1 --2- 172.21.15.125:0/4045733085 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f42bc0656f0 0x7f42bc067bb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f42c4009910 tx=0x7f42c4008030 comp rx=0 tx=0).stop 2023-10-17T06:16:05.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.936+0000 7f42e0f84700 1 -- 172.21.15.125:0/4045733085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42dc070aa0 msgr2=0x7f42dc1587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:16:05.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.936+0000 7f42e0f84700 1 --2- 172.21.15.125:0/4045733085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42dc070aa0 0x7f42dc1587a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00d800 tx=0x7f42cc00dbc0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.940+0000 7f42e0f84700 1 -- 172.21.15.125:0/4045733085 shutdown_connections 2023-10-17T06:16:05.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.940+0000 7f42e0f84700 1 --2- 172.21.15.125:0/4045733085 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f42bc0656f0 0x7f42bc067bb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.940+0000 7f42e0f84700 1 --2- 172.21.15.125:0/4045733085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f42dc159750 0x7f42dc155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.940+0000 7f42e0f84700 1 --2- 172.21.15.125:0/4045733085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f42dc0cde70 0x7f42dc155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.940+0000 7f42e0f84700 1 --2- 172.21.15.125:0/4045733085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42dc070aa0 0x7f42dc1587a0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:16:05.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.940+0000 7f42e0f84700 1 -- 172.21.15.125:0/4045733085 >> 172.21.15.125:0/4045733085 conn(0x7f42dc0ce5c0 msgr2=0x7f42dc0cc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:16:05.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.940+0000 7f42e0f84700 1 -- 172.21.15.125:0/4045733085 shutdown_connections 2023-10-17T06:16:05.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:05.940+0000 7f42e0f84700 1 -- 172.21.15.125:0/4045733085 wait complete. 2023-10-17T06:16:05.950 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 19 2023-10-17T06:16:05.970 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-10-17T06:16:06.154 INFO:teuthology.orchestra.run.smithi125.stdout:[{"id":5557,"entity":{"name":{"type":"client","num":5557},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":520252958}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":424.94287194899999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.37462967652404217,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5557 192.168.0.1:0/520252958","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi184","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-17T06:16:06.155 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi184", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 520252958, "type": "any" }, "name": { "num": 5557, "type": "client" } }, "id": 5557, "inst": "client.5557 192.168.0.1:0/520252958", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.37462967652404217 }, "state": "open", "uptime": 424.942871949 } ] 2023-10-17T06:16:06.256 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-17T06:16:06.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:06.492+0000 7fd67d7fa700 1 -- 172.21.15.125:0/3130602144 <== mon.0 v2:172.21.15.125:3300/0 7 ==== log(1 entries from seq 598 at 2023-10-17T06:16:05.486508+0000) v1 ==== 232+0+0 (secure 0 0 0) 0x7fd678054c70 con 0x7fd680159e20 2023-10-17T06:16:07.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:16:07.496+0000 7fd67d7fa700 1 -- 172.21.15.125:0/3130602144 <== mon.0 v2:172.21.15.125:3300/0 8 ==== log(2 entries from seq 601 at 2023-10-17T06:16:06.479735+0000) v1 ==== 438+0+0 (secure 0 0 0) 0x7fd6780583a0 con 0x7fd680159e20 2023-10-17T06:16:07.503 INFO:teuthology.orchestra.run.smithi125.stdout: cluster: 2023-10-17T06:16:07.504 INFO:teuthology.orchestra.run.smithi125.stdout: id: c779df02-0ec4-47de-a0f3-2371e60a2dde 2023-10-17T06:16:07.504 INFO:teuthology.orchestra.run.smithi125.stdout: health: HEALTH_WARN 2023-10-17T06:16:07.504 INFO:teuthology.orchestra.run.smithi125.stdout: Degraded data redundancy: 7/48 objects degraded (14.583%), 5 pgs degraded 2023-10-17T06:16:07.504 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:16:07.505 INFO:teuthology.orchestra.run.smithi125.stdout: services: 2023-10-17T06:16:07.505 INFO:teuthology.orchestra.run.smithi125.stdout: mon: 3 daemons, quorum a,b,c (age 9m) 2023-10-17T06:16:07.505 INFO:teuthology.orchestra.run.smithi125.stdout: mgr: y(active, since 9m), standbys: x 2023-10-17T06:16:07.505 INFO:teuthology.orchestra.run.smithi125.stdout: mds: 1/1 daemons up, 3 standby 2023-10-17T06:16:07.505 INFO:teuthology.orchestra.run.smithi125.stdout: osd: 8 osds: 8 up (since 4s), 8 in (since 9m) 2023-10-17T06:16:07.506 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:16:07.506 INFO:teuthology.orchestra.run.smithi125.stdout: data: 2023-10-17T06:16:07.506 INFO:teuthology.orchestra.run.smithi125.stdout: volumes: 1/1 healthy 2023-10-17T06:16:07.506 INFO:teuthology.orchestra.run.smithi125.stdout: pools: 4 pools, 105 pgs 2023-10-17T06:16:07.507 INFO:teuthology.orchestra.run.smithi125.stdout: objects: 24 objects, 580 KiB 2023-10-17T06:16:07.507 INFO:teuthology.orchestra.run.smithi125.stdout: usage: 218 MiB used, 720 GiB / 720 GiB avail 2023-10-17T06:16:07.507 INFO:teuthology.orchestra.run.smithi125.stdout: pgs: 7/48 objects degraded (14.583%) 2023-10-17T06:16:07.507 INFO:teuthology.orchestra.run.smithi125.stdout: 84 active+clean 2023-10-17T06:16:07.507 INFO:teuthology.orchestra.run.smithi125.stdout: 16 active+undersized 2023-10-17T06:16:07.508 INFO:teuthology.orchestra.run.smithi125.stdout: 5 active+undersized+degraded 2023-10-17T06:16:07.508 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:16:07.508 INFO:teuthology.orchestra.run.smithi125.stdout: io: 2023-10-17T06:16:07.508 INFO:teuthology.orchestra.run.smithi125.stdout: client: 341 B/s wr, 0 op/s rd, 0 op/s wr 2023-10-17T06:16:07.508 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:16:07.509 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:16:07.509 INFO:teuthology.orchestra.run.smithi125.stdout:2023-10-17T06:16:06.479735+0000 mon.a [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/48 objects degraded (14.583%), 5 pgs degraded) 2023-10-17T06:16:07.509 INFO:teuthology.orchestra.run.smithi125.stdout:2023-10-17T06:16:06.479801+0000 mon.a [INF] Cluster is now healthy 2023-10-17T06:16:32.967 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:16:32.975 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:17:03.053 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:17:03.060 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:17:06.284 ERROR:tasks.ceph_test_case:Log output: cluster: id: c779df02-0ec4-47de-a0f3-2371e60a2dde health: HEALTH_WARN Degraded data redundancy: 7/48 objects degraded (14.583%), 5 pgs degraded services: mon: 3 daemons, quorum a,b,c (age 9m) mgr: y(active, since 9m), standbys: x mds: 1/1 daemons up, 3 standby osd: 8 osds: 8 up (since 4s), 8 in (since 9m) data: volumes: 1/1 healthy pools: 4 pools, 105 pgs objects: 24 objects, 580 KiB usage: 218 MiB used, 720 GiB / 720 GiB avail pgs: 7/48 objects degraded (14.583%) 84 active+clean 16 active+undersized 5 active+undersized+degraded io: client: 341 B/s wr, 0 op/s rd, 0 op/s wr 2023-10-17T06:16:06.479735+0000 mon.a [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/48 objects degraded (14.583%), 5 pgs degraded) 2023-10-17T06:16:06.479801+0000 mon.a [INF] Cluster is now healthy 2023-10-17T06:17:06.284 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-17T06:17:11.286 DEBUG:teuthology.orchestra.run.smithi125:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-17T06:17:11.294 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:17:11.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.471+0000 7fb178156700 1 Processor -- start 2023-10-17T06:17:11.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.471+0000 7fb178156700 1 -- start start 2023-10-17T06:17:11.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.471+0000 7fb178156700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb170154040 0x7fb1700cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:17:11.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.471+0000 7fb178156700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17015e130 con 0x7fb17006e8a0 2023-10-17T06:17:11.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.471+0000 7fb178156700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1700ce1b0 con 0x7fb1700cb8a0 2023-10-17T06:17:11.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.471+0000 7fb178156700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700cdfa0 con 0x7fb170154040 2023-10-17T06:17:11.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.471+0000 7fb1756f1700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb17006e8a0 0x7fb1700cb190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43192/0 (socket says 172.21.15.125:43192) 2023-10-17T06:17:11.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.471+0000 7fb1756f1700 1 -- 172.21.15.125:0/3768035978 learned_addr learned my addr 172.21.15.125:0/3768035978 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:17:11.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.471+0000 7fb175ef2700 1 --2- 172.21.15.125:0/3768035978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb170154040 0x7fb1700cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:17:11.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.471+0000 7fb174ef0700 1 -- 172.21.15.125:0/3768035978 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871092872 0 0) 0x7fb17015e130 con 0x7fb17006e8a0 2023-10-17T06:17:11.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.471+0000 7fb174ef0700 1 -- 172.21.15.125:0/3768035978 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb15c0035d0 con 0x7fb17006e8a0 2023-10-17T06:17:11.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.475+0000 7fb174ef0700 1 -- 172.21.15.125:0/3768035978 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273254999 0 0) 0x7fb1700ce1b0 con 0x7fb1700cb8a0 2023-10-17T06:17:11.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.475+0000 7fb174ef0700 1 -- 172.21.15.125:0/3768035978 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb17015e130 con 0x7fb1700cb8a0 2023-10-17T06:17:11.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.475+0000 7fb174ef0700 1 -- 172.21.15.125:0/3768035978 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 626179033 0 0) 0x7fb15c0035d0 con 0x7fb17006e8a0 2023-10-17T06:17:11.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.475+0000 7fb175ef2700 1 -- 172.21.15.125:0/3768035978 >> v1:172.21.15.184:6789/0 conn(0x7fb1700cb8a0 legacy=0x7fb17006f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:17:11.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.475+0000 7fb175ef2700 1 -- 172.21.15.125:0/3768035978 >> v1:172.21.15.125:6789/0 conn(0x7fb17006e8a0 legacy=0x7fb1700cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:17:11.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.475+0000 7fb175ef2700 1 -- 172.21.15.125:0/3768035978 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1700ce490 con 0x7fb170154040 2023-10-17T06:17:11.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.475+0000 7fb175ef2700 1 --2- 172.21.15.125:0/3768035978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb170154040 0x7fb1700cc680 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb16c009880 tx=0x7fb16c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd0b78e184302b61 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:17:11.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.475+0000 7fb174ef0700 1 -- 172.21.15.125:0/3768035978 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160001670 con 0x7fb170154040 2023-10-17T06:17:11.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.475+0000 7fb174ef0700 1 -- 172.21.15.125:0/3768035978 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16c004030 con 0x7fb170154040 2023-10-17T06:17:11.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.475+0000 7fb174ef0700 1 -- 172.21.15.125:0/3768035978 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c0043a0 con 0x7fb170154040 2023-10-17T06:17:11.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.475+0000 7fb178156700 1 -- 172.21.15.125:0/3768035978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb170154040 msgr2=0x7fb1700cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:17:11.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.475+0000 7fb178156700 1 --2- 172.21.15.125:0/3768035978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb170154040 0x7fb1700cc680 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb16c009880 tx=0x7fb16c009b90 comp rx=0 tx=0).stop 2023-10-17T06:17:11.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.475+0000 7fb178156700 1 -- 172.21.15.125:0/3768035978 shutdown_connections 2023-10-17T06:17:11.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.475+0000 7fb178156700 1 --2- 172.21.15.125:0/3768035978 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb170154040 0x7fb1700cc680 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:17:11.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.475+0000 7fb178156700 1 -- 172.21.15.125:0/3768035978 >> 172.21.15.125:0/3768035978 conn(0x7fb17006a340 msgr2=0x7fb1700b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:17:11.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.475+0000 7fb178156700 1 -- 172.21.15.125:0/3768035978 shutdown_connections 2023-10-17T06:17:11.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.475+0000 7fb178156700 1 -- 172.21.15.125:0/3768035978 wait complete. 2023-10-17T06:17:11.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.479+0000 7fb178156700 1 Processor -- start 2023-10-17T06:17:11.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.479+0000 7fb178156700 1 -- start start 2023-10-17T06:17:11.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.479+0000 7fb178156700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb17006e8a0 0x7fb1700b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:17:11.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb178156700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1700cb8a0 0x7fb1701555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:17:11.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb178156700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb170154040 0x7fb17015e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:17:11.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb178156700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1701560e0 con 0x7fb1700cb8a0 2023-10-17T06:17:11.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb178156700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb170155e00 con 0x7fb17006e8a0 2023-10-17T06:17:11.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb178156700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1700b15d0 con 0x7fb170154040 2023-10-17T06:17:11.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb1756f1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1700cb8a0 0x7fb1701555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:17:11.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb1756f1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1700cb8a0 0x7fb1701555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52098/0 (socket says 172.21.15.125:52098) 2023-10-17T06:17:11.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb1756f1700 1 -- 172.21.15.125:0/3480410918 learned_addr learned my addr 172.21.15.125:0/3480410918 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:17:11.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb175ef2700 1 --2- 172.21.15.125:0/3480410918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb17006e8a0 0x7fb1700b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:17:11.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb1766f3700 1 --2- 172.21.15.125:0/3480410918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb170154040 0x7fb17015e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:17:11.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb1756f1700 1 -- 172.21.15.125:0/3480410918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb170154040 msgr2=0x7fb17015e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:17:11.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb1756f1700 1 --2- 172.21.15.125:0/3480410918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb170154040 0x7fb17015e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:17:11.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb1756f1700 1 -- 172.21.15.125:0/3480410918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb17006e8a0 msgr2=0x7fb1700b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:17:11.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb1756f1700 1 --2- 172.21.15.125:0/3480410918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb17006e8a0 0x7fb1700b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:17:11.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb1756f1700 1 -- 172.21.15.125:0/3480410918 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16c0094b0 con 0x7fb1700cb8a0 2023-10-17T06:17:11.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb1756f1700 1 --2- 172.21.15.125:0/3480410918 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1700cb8a0 0x7fb1701555d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb1600011e0 tx=0x7fb16000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:17:11.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb1667fc700 1 -- 172.21.15.125:0/3480410918 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160004ca0 con 0x7fb1700cb8a0 2023-10-17T06:17:11.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb1667fc700 1 -- 172.21.15.125:0/3480410918 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb160004e00 con 0x7fb1700cb8a0 2023-10-17T06:17:11.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb1667fc700 1 -- 172.21.15.125:0/3480410918 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb160007310 con 0x7fb1700cb8a0 2023-10-17T06:17:11.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb178156700 1 -- 172.21.15.125:0/3480410918 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1700b18b0 con 0x7fb1700cb8a0 2023-10-17T06:17:11.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb178156700 1 -- 172.21.15.125:0/3480410918 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb170155b10 con 0x7fb1700cb8a0 2023-10-17T06:17:11.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.483+0000 7fb178156700 1 -- 172.21.15.125:0/3480410918 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1700b1dd0 con 0x7fb1700cb8a0 2023-10-17T06:17:11.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.487+0000 7fb1667fc700 1 -- 172.21.15.125:0/3480410918 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb160007470 con 0x7fb1700cb8a0 2023-10-17T06:17:11.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.487+0000 7fb1667fc700 1 --2- 172.21.15.125:0/3480410918 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb1540656f0 0x7fb154067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:17:11.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.487+0000 7fb1667fc700 1 -- 172.21.15.125:0/3480410918 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fb160082d10 con 0x7fb1700cb8a0 2023-10-17T06:17:11.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.487+0000 7fb175ef2700 1 --2- 172.21.15.125:0/3480410918 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb1540656f0 0x7fb154067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:17:11.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.491+0000 7fb175ef2700 1 --2- 172.21.15.125:0/3480410918 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb1540656f0 0x7fb154067bb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0097d0 tx=0x7fb16c010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:17:11.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.495+0000 7fb1667fc700 1 -- 172.21.15.125:0/3480410918 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fb1700b1dd0 con 0x7fb1700cb8a0 2023-10-17T06:17:11.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.495+0000 7f6a5cbfc700 1 Processor -- start 2023-10-17T06:17:11.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.495+0000 7f6a5cbfc700 1 -- start start 2023-10-17T06:17:11.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.495+0000 7f6a5cbfc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6a580ce7b0 0x7f6a580b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:17:11.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.495+0000 7f6a5cbfc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6a580b2920 0x7f6a5806a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:17:11.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.495+0000 7f6a5cbfc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a5806a260 con 0x7f6a5815cd90 2023-10-17T06:17:11.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.495+0000 7f6a5cbfc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5806fb60 con 0x7f6a580ce7b0 2023-10-17T06:17:11.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.495+0000 7f6a5cbfc700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a580b2d90 con 0x7f6a580b2920 2023-10-17T06:17:11.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.495+0000 7f6a56ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6a580ce7b0 0x7f6a580b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:17:11.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.495+0000 7f6a577fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6a5815cd90 0x7f6a5806f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43194/0 (socket says 172.21.15.125:43194) 2023-10-17T06:17:11.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.495+0000 7f6a56ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6a580ce7b0 0x7f6a580b23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52104/0 (socket says 172.21.15.125:52104) 2023-10-17T06:17:11.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.495+0000 7f6a577fe700 1 -- 172.21.15.125:0/3888474284 learned_addr learned my addr 172.21.15.125:0/3888474284 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:17:11.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.495+0000 7f6a57fff700 1 --2- 172.21.15.125:0/3888474284 >> v2:172.21.15.184:3300/0 conn(0x7f6a580b2920 0x7f6a5806a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:17:11.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.495+0000 7f6a56ffd700 1 -- 172.21.15.125:0/3888474284 >> v2:172.21.15.184:3300/0 conn(0x7f6a580b2920 msgr2=0x7f6a5806a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:17:11.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.495+0000 7f6a56ffd700 1 --2- 172.21.15.125:0/3888474284 >> v2:172.21.15.184:3300/0 conn(0x7f6a580b2920 0x7f6a5806a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:17:11.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.495+0000 7f6a56ffd700 1 -- 172.21.15.125:0/3888474284 >> v1:172.21.15.125:6789/0 conn(0x7f6a5815cd90 legacy=0x7f6a5806f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:17:11.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.495+0000 7f6a56ffd700 1 -- 172.21.15.125:0/3888474284 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5806fd50 con 0x7f6a580ce7b0 2023-10-17T06:17:11.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.499+0000 7f6a56ffd700 1 --2- 172.21.15.125:0/3888474284 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a580ce7b0 0x7f6a580b23e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6a5806ef10 tx=0x7f6a4c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183a4ffc57c9aefe server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:17:11.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.499+0000 7f6a567fc700 1 -- 172.21.15.125:0/3888474284 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c011830 con 0x7f6a580ce7b0 2023-10-17T06:17:11.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.499+0000 7f6a567fc700 1 -- 172.21.15.125:0/3888474284 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c011990 con 0x7f6a580ce7b0 2023-10-17T06:17:11.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.499+0000 7f6a567fc700 1 -- 172.21.15.125:0/3888474284 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c011d20 con 0x7f6a580ce7b0 2023-10-17T06:17:11.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.499+0000 7f6a5cbfc700 1 -- 172.21.15.125:0/3888474284 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a580ce7b0 msgr2=0x7f6a580b23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:17:11.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.499+0000 7f6a5cbfc700 1 --2- 172.21.15.125:0/3888474284 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a580ce7b0 0x7f6a580b23e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6a5806ef10 tx=0x7f6a4c009b60 comp rx=0 tx=0).stop 2023-10-17T06:17:11.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.499+0000 7f6a5cbfc700 1 -- 172.21.15.125:0/3888474284 shutdown_connections 2023-10-17T06:17:11.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.499+0000 7f6a5cbfc700 1 --2- 172.21.15.125:0/3888474284 >> v2:172.21.15.184:3300/0 conn(0x7f6a580b2920 0x7f6a5806a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:17:11.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.499+0000 7f6a5cbfc700 1 --2- 172.21.15.125:0/3888474284 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a580ce7b0 0x7f6a580b23e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:17:11.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.499+0000 7f6a5cbfc700 1 -- 172.21.15.125:0/3888474284 >> 172.21.15.125:0/3888474284 conn(0x7f6a5806cad0 msgr2=0x7f6a580cd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:17:11.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.499+0000 7f6a5cbfc700 1 -- 172.21.15.125:0/3888474284 shutdown_connections 2023-10-17T06:17:11.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.499+0000 7f6a5cbfc700 1 -- 172.21.15.125:0/3888474284 wait complete. 2023-10-17T06:17:11.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a5cbfc700 1 Processor -- start 2023-10-17T06:17:11.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a5cbfc700 1 -- start start 2023-10-17T06:17:11.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a5cbfc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a580b2920 0x7f6a5815ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:17:11.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a5cbfc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a580ce7b0 0x7f6a580b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:17:11.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a5cbfc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a5815cd90 0x7f6a580b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:17:11.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a5cbfc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580c8e70 con 0x7f6a580b2920 2023-10-17T06:17:11.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a5cbfc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a581f5a30 con 0x7f6a5815cd90 2023-10-17T06:17:11.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a5cbfc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a581f5c40 con 0x7f6a580ce7b0 2023-10-17T06:17:11.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a577fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a580b2920 0x7f6a5815ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:17:11.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a577fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a580b2920 0x7f6a5815ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52108/0 (socket says 172.21.15.125:52108) 2023-10-17T06:17:11.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a577fe700 1 -- 172.21.15.125:0/1878707396 learned_addr learned my addr 172.21.15.125:0/1878707396 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:17:11.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a56ffd700 1 --2- 172.21.15.125:0/1878707396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a580ce7b0 0x7f6a580b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:17:11.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a57fff700 1 --2- 172.21.15.125:0/1878707396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a5815cd90 0x7f6a580b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:17:11.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a577fe700 1 -- 172.21.15.125:0/1878707396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a580ce7b0 msgr2=0x7f6a580b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:17:11.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a577fe700 1 --2- 172.21.15.125:0/1878707396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a580ce7b0 0x7f6a580b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:17:11.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a577fe700 1 -- 172.21.15.125:0/1878707396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a5815cd90 msgr2=0x7f6a580b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:17:11.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a577fe700 1 --2- 172.21.15.125:0/1878707396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a5815cd90 0x7f6a580b1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:17:11.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a577fe700 1 -- 172.21.15.125:0/1878707396 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c0094b0 con 0x7f6a580b2920 2023-10-17T06:17:11.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a56ffd700 1 --2- 172.21.15.125:0/1878707396 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a580ce7b0 0x7f6a580b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:17:11.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a57fff700 1 --2- 172.21.15.125:0/1878707396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a5815cd90 0x7f6a580b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:17:11.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a577fe700 1 --2- 172.21.15.125:0/1878707396 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6a580b2920 0x7f6a5815ae10 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800c700 tx=0x7f6a4800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:17:11.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.503+0000 7f6a3ffff700 1 -- 172.21.15.125:0/1878707396 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48005d90 con 0x7f6a580b2920 2023-10-17T06:17:11.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.507+0000 7f6a3ffff700 1 -- 172.21.15.125:0/1878707396 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a480070d0 con 0x7f6a580b2920 2023-10-17T06:17:11.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.507+0000 7f6a5cbfc700 1 -- 172.21.15.125:0/1878707396 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a581f5f20 con 0x7f6a580b2920 2023-10-17T06:17:11.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.507+0000 7f6a3ffff700 1 -- 172.21.15.125:0/1878707396 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48007440 con 0x7f6a580b2920 2023-10-17T06:17:11.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.507+0000 7f6a5cbfc700 1 -- 172.21.15.125:0/1878707396 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a581f64e0 con 0x7f6a580b2920 2023-10-17T06:17:11.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.507+0000 7f6a5cbfc700 1 -- 172.21.15.125:0/1878707396 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f6a58072e60 con 0x7f6a580b2920 2023-10-17T06:17:11.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.507+0000 7f6a3ffff700 1 -- 172.21.15.125:0/1878707396 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6a480075a0 con 0x7f6a580b2920 2023-10-17T06:17:11.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.511+0000 7f6a3ffff700 1 --2- 172.21.15.125:0/1878707396 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6a440656f0 0x7f6a44067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:17:11.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.511+0000 7f6a3ffff700 1 -- 172.21.15.125:0/1878707396 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f6a48082450 con 0x7f6a580b2920 2023-10-17T06:17:11.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.511+0000 7f6a56ffd700 1 --2- 172.21.15.125:0/1878707396 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6a440656f0 0x7f6a44067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:17:11.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.511+0000 7f6a3ffff700 1 -- 172.21.15.125:0/1878707396 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+450 (secure 0 0 0) 0x7f6a48089070 con 0x7f6a580b2920 2023-10-17T06:17:11.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.511+0000 7f6a5cbfc700 1 -- 172.21.15.125:0/1878707396 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f6a580b68e0 con 0x7f6a580b2920 2023-10-17T06:17:11.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.511+0000 7f6a56ffd700 1 --2- 172.21.15.125:0/1878707396 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6a440656f0 0x7f6a44067bb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6a5806ef10 tx=0x7f6a4c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:17:11.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.719+0000 7fb178156700 1 -- 172.21.15.125:0/3480410918 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1700b1dd0 con 0x7fb1700cb8a0 2023-10-17T06:17:11.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.719+0000 7fb1667fc700 1 -- 172.21.15.125:0/3480410918 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4889 (secure 0 0 0) 0x7fb1700b1dd0 con 0x7fb1700cb8a0 2023-10-17T06:17:11.726 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:17:11.727 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:08:51.328615+0000","modified":"2023-10-17T06:16:00.378712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":111,"addr":"172.21.15.125:6837/2351050168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2351050168},{"type":"v1","addr":"172.21.15.125:6837","nonce":2351050168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-17T06:17:11.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.723+0000 7fb178156700 1 -- 172.21.15.125:0/3480410918 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb1540656f0 msgr2=0x7fb154067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:17:11.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.723+0000 7fb178156700 1 --2- 172.21.15.125:0/3480410918 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb1540656f0 0x7fb154067bb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0097d0 tx=0x7fb16c010000 comp rx=0 tx=0).stop 2023-10-17T06:17:11.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.723+0000 7fb178156700 1 -- 172.21.15.125:0/3480410918 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1700cb8a0 msgr2=0x7fb1701555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:17:11.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.723+0000 7fb178156700 1 --2- 172.21.15.125:0/3480410918 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1700cb8a0 0x7fb1701555d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb1600011e0 tx=0x7fb16000ca30 comp rx=0 tx=0).stop 2023-10-17T06:17:11.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.723+0000 7fb178156700 1 -- 172.21.15.125:0/3480410918 shutdown_connections 2023-10-17T06:17:11.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.723+0000 7fb178156700 1 --2- 172.21.15.125:0/3480410918 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb1540656f0 0x7fb154067bb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:17:11.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.723+0000 7fb178156700 1 --2- 172.21.15.125:0/3480410918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb170154040 0x7fb17015e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:17:11.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.723+0000 7fb178156700 1 --2- 172.21.15.125:0/3480410918 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1700cb8a0 0x7fb1701555d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:17:11.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.723+0000 7fb178156700 1 --2- 172.21.15.125:0/3480410918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb17006e8a0 0x7fb1700b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:17:11.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.723+0000 7fb178156700 1 -- 172.21.15.125:0/3480410918 >> 172.21.15.125:0/3480410918 conn(0x7fb17006a340 msgr2=0x7fb1700adf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:17:11.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.723+0000 7fb178156700 1 -- 172.21.15.125:0/3480410918 shutdown_connections 2023-10-17T06:17:11.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:17:11.723+0000 7fb178156700 1 -- 172.21.15.125:0/3480410918 wait complete. 2023-10-17T06:17:11.732 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 19 2023-10-17T06:17:11.752 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-10-17T06:17:11.942 INFO:teuthology.orchestra.run.smithi125.stdout:[{"id":5557,"entity":{"name":{"type":"client","num":5557},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":520252958}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":490.733730202,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.32179955415681455,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5557 192.168.0.1:0/520252958","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi184","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-17T06:17:11.943 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi184", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 520252958, "type": "any" }, "name": { "num": 5557, "type": "client" } }, "id": 5557, "inst": "client.5557 192.168.0.1:0/520252958", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.32179955415681455 }, "state": "open", "uptime": 490.733730202 } ] 2023-10-17T06:17:12.045 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-17T06:17:33.217 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:17:33.225 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:18:03.313 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:18:03.322 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:18:12.072 ERROR:tasks.ceph_test_case:Log output: 2023-10-17T06:18:12.073 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-17T06:18:17.073 DEBUG:teuthology.orchestra.run.smithi125:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-17T06:18:17.081 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:18:17.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.246+0000 7f2eb3034700 1 Processor -- start 2023-10-17T06:18:17.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.246+0000 7f2eb3034700 1 -- start start 2023-10-17T06:18:17.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.250+0000 7f2eb3034700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2eac15cf20 0x7f2eac0b1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:18:17.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.250+0000 7f2eb3034700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2eac0c9f90 0x7f2eac0b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:18:17.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.250+0000 7f2eb3034700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eac0cb890 con 0x7f2eac15cb40 2023-10-17T06:18:17.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.250+0000 7f2eb3034700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eac071f30 con 0x7f2eac0c9f90 2023-10-17T06:18:17.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.250+0000 7f2eb3034700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eac0ca7f0 con 0x7f2eac15cf20 2023-10-17T06:18:17.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.250+0000 7f2eb15d1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2eac0c9f90 0x7f2eac0b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:18:17.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.250+0000 7f2eb15d1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2eac0c9f90 0x7f2eac0b1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49550/0 (socket says 172.21.15.125:49550) 2023-10-17T06:18:17.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.250+0000 7f2eb15d1700 1 -- 172.21.15.125:0/2486826725 learned_addr learned my addr 172.21.15.125:0/2486826725 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:18:17.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.250+0000 7f2eabfff700 1 --2- 172.21.15.125:0/2486826725 >> v2:172.21.15.184:3300/0 conn(0x7f2eac15cf20 0x7f2eac0b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:18:17.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.250+0000 7f2eb15d1700 1 -- 172.21.15.125:0/2486826725 >> v2:172.21.15.184:3300/0 conn(0x7f2eac15cf20 msgr2=0x7f2eac0b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:18:17.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.250+0000 7f2eb15d1700 1 --2- 172.21.15.125:0/2486826725 >> v2:172.21.15.184:3300/0 conn(0x7f2eac15cf20 0x7f2eac0b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:18:17.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.250+0000 7f2eb15d1700 1 -- 172.21.15.125:0/2486826725 >> v1:172.21.15.184:6789/0 conn(0x7f2eac15cb40 legacy=0x7f2eac071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:18:17.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.250+0000 7f2eb15d1700 1 -- 172.21.15.125:0/2486826725 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac0caad0 con 0x7f2eac0c9f90 2023-10-17T06:18:17.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.250+0000 7f2eb15d1700 1 --2- 172.21.15.125:0/2486826725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2eac0c9f90 0x7f2eac0b1850 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2eac06fc40 tx=0x7f2ea400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8d13247b970c44 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:18:17.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.250+0000 7f2eab7fe700 1 -- 172.21.15.125:0/2486826725 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea400e070 con 0x7f2eac0c9f90 2023-10-17T06:18:17.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.250+0000 7f2eab7fe700 1 -- 172.21.15.125:0/2486826725 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea400b910 con 0x7f2eac0c9f90 2023-10-17T06:18:17.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.250+0000 7f2eab7fe700 1 -- 172.21.15.125:0/2486826725 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea400bcc0 con 0x7f2eac0c9f90 2023-10-17T06:18:17.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.254+0000 7f2eb3034700 1 -- 172.21.15.125:0/2486826725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2eac0c9f90 msgr2=0x7f2eac0b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:18:17.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.254+0000 7f2eb3034700 1 --2- 172.21.15.125:0/2486826725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2eac0c9f90 0x7f2eac0b1850 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2eac06fc40 tx=0x7f2ea400b330 comp rx=0 tx=0).stop 2023-10-17T06:18:17.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.254+0000 7f2eb3034700 1 -- 172.21.15.125:0/2486826725 shutdown_connections 2023-10-17T06:18:17.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.254+0000 7f2eb3034700 1 --2- 172.21.15.125:0/2486826725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2eac0c9f90 0x7f2eac0b1850 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:18:17.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.254+0000 7f2eb3034700 1 --2- 172.21.15.125:0/2486826725 >> v2:172.21.15.184:3300/0 conn(0x7f2eac15cf20 0x7f2eac0b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:18:17.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.254+0000 7f2eb3034700 1 -- 172.21.15.125:0/2486826725 >> 172.21.15.125:0/2486826725 conn(0x7f2eac0cc310 msgr2=0x7f2eac0cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:18:17.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.254+0000 7f2eb3034700 1 -- 172.21.15.125:0/2486826725 shutdown_connections 2023-10-17T06:18:17.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.254+0000 7f2eb3034700 1 -- 172.21.15.125:0/2486826725 wait complete. 2023-10-17T06:18:17.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.254+0000 7f2eb3034700 1 Processor -- start 2023-10-17T06:18:17.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.254+0000 7f2eb3034700 1 -- start start 2023-10-17T06:18:17.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2eb3034700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eac0c9f90 0x7f2eac0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:18:17.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2eb3034700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eac15cb40 0x7f2eac15ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:18:17.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2eb3034700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2eac0b1230 0x7f2eac0b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:18:17.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2eb3034700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0b1c00 con 0x7f2eac0b1230 2023-10-17T06:18:17.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2eb3034700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac14c7d0 con 0x7f2eac0c9f90 2023-10-17T06:18:17.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2eb3034700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0c8570 con 0x7f2eac15cb40 2023-10-17T06:18:17.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2eb15d1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2eac0b1230 0x7f2eac0b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:18:17.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2eb15d1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2eac0b1230 0x7f2eac0b16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49556/0 (socket says 172.21.15.125:49556) 2023-10-17T06:18:17.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2eb15d1700 1 -- 172.21.15.125:0/2594954359 learned_addr learned my addr 172.21.15.125:0/2594954359 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:18:17.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2eabfff700 1 --2- 172.21.15.125:0/2594954359 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eac15cb40 0x7f2eac15ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:18:17.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2eb0dd0700 1 --2- 172.21.15.125:0/2594954359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eac0c9f90 0x7f2eac0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:18:17.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2eb15d1700 1 -- 172.21.15.125:0/2594954359 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eac15cb40 msgr2=0x7f2eac15ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:18:17.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2eb15d1700 1 --2- 172.21.15.125:0/2594954359 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eac15cb40 0x7f2eac15ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:18:17.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2eb15d1700 1 -- 172.21.15.125:0/2594954359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eac0c9f90 msgr2=0x7f2eac0b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:18:17.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2eb15d1700 1 --2- 172.21.15.125:0/2594954359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eac0c9f90 0x7f2eac0b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:18:17.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2eb15d1700 1 -- 172.21.15.125:0/2594954359 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea4009b30 con 0x7f2eac0b1230 2023-10-17T06:18:17.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2eb15d1700 1 --2- 172.21.15.125:0/2594954359 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2eac0b1230 0x7f2eac0b16c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4012000 tx=0x7f2ea4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:18:17.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2ea97fa700 1 -- 172.21.15.125:0/2594954359 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40099b0 con 0x7f2eac0b1230 2023-10-17T06:18:17.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2ea97fa700 1 -- 172.21.15.125:0/2594954359 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea40092e0 con 0x7f2eac0b1230 2023-10-17T06:18:17.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2eb3034700 1 -- 172.21.15.125:0/2594954359 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eac15f2b0 con 0x7f2eac0b1230 2023-10-17T06:18:17.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2ea97fa700 1 -- 172.21.15.125:0/2594954359 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea401c640 con 0x7f2eac0b1230 2023-10-17T06:18:17.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.258+0000 7f2eb3034700 1 -- 172.21.15.125:0/2594954359 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eac0c8aa0 con 0x7f2eac0b1230 2023-10-17T06:18:17.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.262+0000 7f2eb3034700 1 -- 172.21.15.125:0/2594954359 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eac072e60 con 0x7f2eac0b1230 2023-10-17T06:18:17.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.262+0000 7f2ea97fa700 1 -- 172.21.15.125:0/2594954359 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2ea401c7a0 con 0x7f2eac0b1230 2023-10-17T06:18:17.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.262+0000 7f2ea97fa700 1 --2- 172.21.15.125:0/2594954359 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2e90065720 0x7f2e90067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:18:17.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.262+0000 7f2ea97fa700 1 -- 172.21.15.125:0/2594954359 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f2ea4084880 con 0x7f2eac0b1230 2023-10-17T06:18:17.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.262+0000 7f2eb0dd0700 1 --2- 172.21.15.125:0/2594954359 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2e90065720 0x7f2e90067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:18:17.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.266+0000 7f2eb0dd0700 1 --2- 172.21.15.125:0/2594954359 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2e90065720 0x7f2e90067be0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0000f60 tx=0x7f2ea0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:18:17.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.266+0000 7f2ea97fa700 1 -- 172.21.15.125:0/2594954359 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2ea4052100 con 0x7f2eac0b1230 2023-10-17T06:18:17.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.274+0000 7f8fdd1d9700 1 Processor -- start 2023-10-17T06:18:17.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.274+0000 7f8fdd1d9700 1 -- start start 2023-10-17T06:18:17.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.278+0000 7f8fdd1d9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8fd81572f0 0x7f8fd8160830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:18:17.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.278+0000 7f8fdd1d9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fd80cf320 0x7f8fd80b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:18:17.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.278+0000 7f8fdd1d9700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd81576d0 con 0x7f8fd80d2f60 2023-10-17T06:18:17.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.278+0000 7f8fdd1d9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd806dd60 con 0x7f8fd81572f0 2023-10-17T06:18:17.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.278+0000 7f8fdd1d9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd806e040 con 0x7f8fd80cf320 2023-10-17T06:18:17.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.278+0000 7f8fd7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8fd81572f0 0x7f8fd8160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:18:17.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.278+0000 7f8fd77fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fd80cf320 0x7f8fd80b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:18:17.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.278+0000 7f8fdc9d8700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f8fd80d2f60 0x7f8fd815d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:45494/0 (socket says 172.21.15.125:45494) 2023-10-17T06:18:17.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.278+0000 7f8fd7fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8fd81572f0 0x7f8fd8160830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49558/0 (socket says 172.21.15.125:49558) 2023-10-17T06:18:17.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.278+0000 7f8fdc9d8700 1 -- 172.21.15.125:0/2570446012 learned_addr learned my addr 172.21.15.125:0/2570446012 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:18:17.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.278+0000 7f8fd7fff700 1 -- 172.21.15.125:0/2570446012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fd80cf320 msgr2=0x7f8fd80b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:18:17.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.278+0000 7f8fd7fff700 1 --2- 172.21.15.125:0/2570446012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fd80cf320 0x7f8fd80b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:18:17.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.278+0000 7f8fd7fff700 1 -- 172.21.15.125:0/2570446012 >> v1:172.21.15.184:6789/0 conn(0x7f8fd80d2f60 legacy=0x7f8fd815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:18:17.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.278+0000 7f8fd7fff700 1 -- 172.21.15.125:0/2570446012 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd806e320 con 0x7f8fd81572f0 2023-10-17T06:18:17.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.278+0000 7f8fd77fe700 1 --2- 172.21.15.125:0/2570446012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fd80cf320 0x7f8fd80b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:18:17.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.282+0000 7f8fd7fff700 1 --2- 172.21.15.125:0/2570446012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fd81572f0 0x7f8fd8160830 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009850 tx=0x7f8fc8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80d0ed0a25ea985 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:18:17.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.282+0000 7f8fd6ffd700 1 -- 172.21.15.125:0/2570446012 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8011830 con 0x7f8fd81572f0 2023-10-17T06:18:17.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.282+0000 7f8fd6ffd700 1 -- 172.21.15.125:0/2570446012 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc8011990 con 0x7f8fd81572f0 2023-10-17T06:18:17.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.282+0000 7f8fd6ffd700 1 -- 172.21.15.125:0/2570446012 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8011d40 con 0x7f8fd81572f0 2023-10-17T06:18:17.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.282+0000 7f8fdd1d9700 1 -- 172.21.15.125:0/2570446012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fd81572f0 msgr2=0x7f8fd8160830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:18:17.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.282+0000 7f8fdd1d9700 1 --2- 172.21.15.125:0/2570446012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fd81572f0 0x7f8fd8160830 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009850 tx=0x7f8fc8009b60 comp rx=0 tx=0).stop 2023-10-17T06:18:17.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.282+0000 7f8fdd1d9700 1 -- 172.21.15.125:0/2570446012 shutdown_connections 2023-10-17T06:18:17.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.282+0000 7f8fdd1d9700 1 --2- 172.21.15.125:0/2570446012 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fd80cf320 0x7f8fd80b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:18:17.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.282+0000 7f8fdd1d9700 1 --2- 172.21.15.125:0/2570446012 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fd81572f0 0x7f8fd8160830 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:18:17.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.282+0000 7f8fdd1d9700 1 -- 172.21.15.125:0/2570446012 >> 172.21.15.125:0/2570446012 conn(0x7f8fd8069ef0 msgr2=0x7f8fd806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:18:17.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.282+0000 7f8fdd1d9700 1 -- 172.21.15.125:0/2570446012 shutdown_connections 2023-10-17T06:18:17.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.282+0000 7f8fdd1d9700 1 -- 172.21.15.125:0/2570446012 wait complete. 2023-10-17T06:18:17.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.286+0000 7f8fdd1d9700 1 Processor -- start 2023-10-17T06:18:17.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.286+0000 7f8fdd1d9700 1 -- start start 2023-10-17T06:18:17.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.286+0000 7f8fdd1d9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fd80cf320 0x7f8fd81547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:18:17.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.286+0000 7f8fdd1d9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fd80d2f60 0x7f8fd815e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:18:17.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.286+0000 7f8fdd1d9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fd81572f0 0x7f8fd8158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:18:17.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.286+0000 7f8fdd1d9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd8158800 con 0x7f8fd80cf320 2023-10-17T06:18:17.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.286+0000 7f8fdd1d9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd815ccf0 con 0x7f8fd81572f0 2023-10-17T06:18:17.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.286+0000 7f8fdd1d9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd8157e60 con 0x7f8fd80d2f60 2023-10-17T06:18:17.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.290+0000 7f8fd7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fd80cf320 0x7f8fd81547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:18:17.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.290+0000 7f8fd7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fd80cf320 0x7f8fd81547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49560/0 (socket says 172.21.15.125:49560) 2023-10-17T06:18:17.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.290+0000 7f8fd7fff700 1 -- 172.21.15.125:0/1129887846 learned_addr learned my addr 172.21.15.125:0/1129887846 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:18:17.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.290+0000 7f8fd77fe700 1 --2- 172.21.15.125:0/1129887846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fd80d2f60 0x7f8fd815e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:18:17.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.290+0000 7f8fdc9d8700 1 --2- 172.21.15.125:0/1129887846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fd81572f0 0x7f8fd8158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:18:17.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.290+0000 7f8fd7fff700 1 -- 172.21.15.125:0/1129887846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fd80d2f60 msgr2=0x7f8fd815e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:18:17.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.290+0000 7f8fd7fff700 1 --2- 172.21.15.125:0/1129887846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fd80d2f60 0x7f8fd815e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:18:17.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.290+0000 7f8fd7fff700 1 -- 172.21.15.125:0/1129887846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fd81572f0 msgr2=0x7f8fd8158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:18:17.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.290+0000 7f8fd7fff700 1 --2- 172.21.15.125:0/1129887846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fd81572f0 0x7f8fd8158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:18:17.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.290+0000 7f8fd7fff700 1 -- 172.21.15.125:0/1129887846 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc0094b0 con 0x7f8fd80cf320 2023-10-17T06:18:17.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.290+0000 7f8fd7fff700 1 --2- 172.21.15.125:0/1129887846 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fd80cf320 0x7f8fd81547b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8014040 tx=0x7f8fc8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:18:17.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.290+0000 7f8fd4ff9700 1 -- 172.21.15.125:0/1129887846 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc80036c0 con 0x7f8fd80cf320 2023-10-17T06:18:17.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.290+0000 7f8fd4ff9700 1 -- 172.21.15.125:0/1129887846 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc801e070 con 0x7f8fd80cf320 2023-10-17T06:18:17.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.290+0000 7f8fdd1d9700 1 -- 172.21.15.125:0/1129887846 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc80094b0 con 0x7f8fd80cf320 2023-10-17T06:18:17.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.290+0000 7f8fd4ff9700 1 -- 172.21.15.125:0/1129887846 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8003a80 con 0x7f8fd80cf320 2023-10-17T06:18:17.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.290+0000 7f8fdd1d9700 1 -- 172.21.15.125:0/1129887846 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd8158420 con 0x7f8fd80cf320 2023-10-17T06:18:17.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.290+0000 7f8fdd1d9700 1 -- 172.21.15.125:0/1129887846 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f8fd806e8c0 con 0x7f8fd80cf320 2023-10-17T06:18:17.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.294+0000 7f8fd4ff9700 1 -- 172.21.15.125:0/1129887846 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8fc8003be0 con 0x7f8fd80cf320 2023-10-17T06:18:17.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.294+0000 7f8fd4ff9700 1 --2- 172.21.15.125:0/1129887846 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8fc4065720 0x7f8fc4067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:18:17.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.294+0000 7f8fd4ff9700 1 -- 172.21.15.125:0/1129887846 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f8fc8020070 con 0x7f8fd80cf320 2023-10-17T06:18:17.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.294+0000 7f8fd77fe700 1 --2- 172.21.15.125:0/1129887846 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8fc4065720 0x7f8fc4067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:18:17.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.294+0000 7f8fd4ff9700 1 -- 172.21.15.125:0/1129887846 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+449 (secure 0 0 0) 0x7f8fd806e8c0 con 0x7f8fd80cf320 2023-10-17T06:18:17.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.298+0000 7f8fdd1d9700 1 -- 172.21.15.125:0/1129887846 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f8fd806e8c0 con 0x7f8fd80cf320 2023-10-17T06:18:17.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.298+0000 7f8fd77fe700 1 --2- 172.21.15.125:0/1129887846 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8fc4065720 0x7f8fc4067be0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8fd8160ac0 tx=0x7f8fcc009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:18:17.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.498+0000 7f2eb3034700 1 -- 172.21.15.125:0/2594954359 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2eac0b5810 con 0x7f2eac0b1230 2023-10-17T06:18:17.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.502+0000 7f2ea97fa700 1 -- 172.21.15.125:0/2594954359 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4889 (secure 0 0 0) 0x7f2ea4055720 con 0x7f2eac0b1230 2023-10-17T06:18:17.507 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:18:17.507 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:08:51.328615+0000","modified":"2023-10-17T06:16:00.378712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":111,"addr":"172.21.15.125:6837/2351050168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2351050168},{"type":"v1","addr":"172.21.15.125:6837","nonce":2351050168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-17T06:18:17.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.502+0000 7f2eb3034700 1 -- 172.21.15.125:0/2594954359 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2e90065720 msgr2=0x7f2e90067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:18:17.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.502+0000 7f2eb3034700 1 --2- 172.21.15.125:0/2594954359 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2e90065720 0x7f2e90067be0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0000f60 tx=0x7f2ea0009040 comp rx=0 tx=0).stop 2023-10-17T06:18:17.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.502+0000 7f2eb3034700 1 -- 172.21.15.125:0/2594954359 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2eac0b1230 msgr2=0x7f2eac0b16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:18:17.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.502+0000 7f2eb3034700 1 --2- 172.21.15.125:0/2594954359 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2eac0b1230 0x7f2eac0b16c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4012000 tx=0x7f2ea4004af0 comp rx=0 tx=0).stop 2023-10-17T06:18:17.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.502+0000 7f2eb3034700 1 -- 172.21.15.125:0/2594954359 shutdown_connections 2023-10-17T06:18:17.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.502+0000 7f2eb3034700 1 --2- 172.21.15.125:0/2594954359 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2e90065720 0x7f2e90067be0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:18:17.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.502+0000 7f2eb3034700 1 --2- 172.21.15.125:0/2594954359 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2eac0b1230 0x7f2eac0b16c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:18:17.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.502+0000 7f2eb3034700 1 --2- 172.21.15.125:0/2594954359 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2eac15cb40 0x7f2eac15ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:18:17.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.502+0000 7f2eb3034700 1 --2- 172.21.15.125:0/2594954359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2eac0c9f90 0x7f2eac0b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:18:17.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.502+0000 7f2eb3034700 1 -- 172.21.15.125:0/2594954359 >> 172.21.15.125:0/2594954359 conn(0x7f2eac0cc310 msgr2=0x7f2eac0af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:18:17.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.502+0000 7f2eb3034700 1 -- 172.21.15.125:0/2594954359 shutdown_connections 2023-10-17T06:18:17.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:18:17.502+0000 7f2eb3034700 1 -- 172.21.15.125:0/2594954359 wait complete. 2023-10-17T06:18:17.513 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 19 2023-10-17T06:18:17.531 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-10-17T06:18:17.716 INFO:teuthology.orchestra.run.smithi125.stdout:[{"id":5557,"entity":{"name":{"type":"client","num":5557},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":520252958}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":556.50866468599997,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.27642968397796341,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5557 192.168.0.1:0/520252958","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi184","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-17T06:18:17.716 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi184", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 520252958, "type": "any" }, "name": { "num": 5557, "type": "client" } }, "id": 5557, "inst": "client.5557 192.168.0.1:0/520252958", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.2764296839779634 }, "state": "open", "uptime": 556.508664686 } ] 2023-10-17T06:18:17.818 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-17T06:18:33.407 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:18:33.415 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:19:03.504 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:19:03.512 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:19:17.844 ERROR:tasks.ceph_test_case:Log output: 2023-10-17T06:19:17.845 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-17T06:19:22.846 DEBUG:teuthology.orchestra.run.smithi125:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-17T06:19:22.855 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:19:23.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.021+0000 7f7a3d34c700 1 Processor -- start 2023-10-17T06:19:23.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.021+0000 7f7a3d34c700 1 -- start start 2023-10-17T06:19:23.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.021+0000 7f7a3d34c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7a380d2e00 0x7f7a380b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:19:23.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.021+0000 7f7a3d34c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a38160710 0x7f7a380d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:19:23.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.021+0000 7f7a3d34c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a3815d0d0 con 0x7f7a380b5ae0 2023-10-17T06:19:23.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.021+0000 7f7a3d34c700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3815df90 con 0x7f7a380d2e00 2023-10-17T06:19:23.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.021+0000 7f7a3d34c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3806f0f0 con 0x7f7a38160710 2023-10-17T06:19:23.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.025+0000 7f7a3cb4b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7a380b5ae0 0x7f7a3806db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:37544/0 (socket says 172.21.15.125:37544) 2023-10-17T06:19:23.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.025+0000 7f7a3cb4b700 1 -- 172.21.15.125:0/1272198525 learned_addr learned my addr 172.21.15.125:0/1272198525 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:19:23.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.025+0000 7f7a37fff700 1 --2- 172.21.15.125:0/1272198525 >> v2:172.21.15.184:3300/0 conn(0x7f7a380d2e00 0x7f7a380b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:19:23.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.025+0000 7f7a377fe700 1 --2- 172.21.15.125:0/1272198525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a38160710 0x7f7a380d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:19:23.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.025+0000 7f7a37fff700 1 -- 172.21.15.125:0/1272198525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a38160710 msgr2=0x7f7a380d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:19:23.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.025+0000 7f7a37fff700 1 --2- 172.21.15.125:0/1272198525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a38160710 0x7f7a380d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:19:23.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.025+0000 7f7a37fff700 1 -- 172.21.15.125:0/1272198525 >> v1:172.21.15.125:6789/0 conn(0x7f7a380b5ae0 legacy=0x7f7a3806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:19:23.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.025+0000 7f7a37fff700 1 -- 172.21.15.125:0/1272198525 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a380d3720 con 0x7f7a380d2e00 2023-10-17T06:19:23.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.025+0000 7f7a37fff700 1 --2- 172.21.15.125:0/1272198525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a380d2e00 0x7f7a380b6e00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7a28009dc0 tx=0x7f7a2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a47bd948ec08981 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:19:23.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.025+0000 7f7a36ffd700 1 -- 172.21.15.125:0/1272198525 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2800e070 con 0x7f7a380d2e00 2023-10-17T06:19:23.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.025+0000 7f7a36ffd700 1 -- 172.21.15.125:0/1272198525 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2800bae0 con 0x7f7a380d2e00 2023-10-17T06:19:23.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.025+0000 7f7a36ffd700 1 -- 172.21.15.125:0/1272198525 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2800be90 con 0x7f7a380d2e00 2023-10-17T06:19:23.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.025+0000 7f7a3d34c700 1 -- 172.21.15.125:0/1272198525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a380d2e00 msgr2=0x7f7a380b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:19:23.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.025+0000 7f7a3d34c700 1 --2- 172.21.15.125:0/1272198525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a380d2e00 0x7f7a380b6e00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7a28009dc0 tx=0x7f7a2800b330 comp rx=0 tx=0).stop 2023-10-17T06:19:23.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.025+0000 7f7a3d34c700 1 -- 172.21.15.125:0/1272198525 shutdown_connections 2023-10-17T06:19:23.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.025+0000 7f7a3d34c700 1 --2- 172.21.15.125:0/1272198525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a38160710 0x7f7a380d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:19:23.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.025+0000 7f7a3d34c700 1 --2- 172.21.15.125:0/1272198525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a380d2e00 0x7f7a380b6e00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:19:23.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.025+0000 7f7a3d34c700 1 -- 172.21.15.125:0/1272198525 >> 172.21.15.125:0/1272198525 conn(0x7f7a38069f20 msgr2=0x7f7a3806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:19:23.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.025+0000 7f7a3d34c700 1 -- 172.21.15.125:0/1272198525 shutdown_connections 2023-10-17T06:19:23.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.025+0000 7f7a3d34c700 1 -- 172.21.15.125:0/1272198525 wait complete. 2023-10-17T06:19:23.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.029+0000 7f7a3d34c700 1 Processor -- start 2023-10-17T06:19:23.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.029+0000 7f7a3d34c700 1 -- start start 2023-10-17T06:19:23.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.029+0000 7f7a3d34c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a380b5ae0 0x7f7a381f53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:19:23.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.029+0000 7f7a3d34c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a380d2e00 0x7f7a3815f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:19:23.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.029+0000 7f7a3d34c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a38160710 0x7f7a3815fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:19:23.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.029+0000 7f7a3d34c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a381f4f40 con 0x7f7a38160710 2023-10-17T06:19:23.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.029+0000 7f7a3d34c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a381f4330 con 0x7f7a380b5ae0 2023-10-17T06:19:23.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.029+0000 7f7a3d34c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a381f4610 con 0x7f7a380d2e00 2023-10-17T06:19:23.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.029+0000 7f7a3cb4b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a38160710 0x7f7a3815fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:19:23.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.029+0000 7f7a3cb4b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a38160710 0x7f7a3815fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53832/0 (socket says 172.21.15.125:53832) 2023-10-17T06:19:23.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.029+0000 7f7a3cb4b700 1 -- 172.21.15.125:0/3437357726 learned_addr learned my addr 172.21.15.125:0/3437357726 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:19:23.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.029+0000 7f7a37fff700 1 --2- 172.21.15.125:0/3437357726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a380b5ae0 0x7f7a381f53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:19:23.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.029+0000 7f7a377fe700 1 --2- 172.21.15.125:0/3437357726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a380d2e00 0x7f7a3815f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:19:23.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.029+0000 7f7a37fff700 1 -- 172.21.15.125:0/3437357726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a380d2e00 msgr2=0x7f7a3815f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:19:23.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.029+0000 7f7a37fff700 1 --2- 172.21.15.125:0/3437357726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a380d2e00 0x7f7a3815f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:19:23.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.029+0000 7f7a37fff700 1 -- 172.21.15.125:0/3437357726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a38160710 msgr2=0x7f7a3815fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:19:23.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.029+0000 7f7a37fff700 1 --2- 172.21.15.125:0/3437357726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a38160710 0x7f7a3815fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:19:23.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.029+0000 7f7a37fff700 1 -- 172.21.15.125:0/3437357726 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a28009a70 con 0x7f7a380b5ae0 2023-10-17T06:19:23.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.029+0000 7f7a3cb4b700 1 --2- 172.21.15.125:0/3437357726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a38160710 0x7f7a3815fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:19:23.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.033+0000 7f7a37fff700 1 --2- 172.21.15.125:0/3437357726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a380b5ae0 0x7f7a381f53d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7a28016000 tx=0x7f7a28004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:19:23.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.033+0000 7f7a34ff9700 1 -- 172.21.15.125:0/3437357726 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a28004880 con 0x7f7a380b5ae0 2023-10-17T06:19:23.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.033+0000 7f7a34ff9700 1 -- 172.21.15.125:0/3437357726 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a28020070 con 0x7f7a380b5ae0 2023-10-17T06:19:23.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.033+0000 7f7a3d34c700 1 -- 172.21.15.125:0/3437357726 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a381f48f0 con 0x7f7a380b5ae0 2023-10-17T06:19:23.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.033+0000 7f7a34ff9700 1 -- 172.21.15.125:0/3437357726 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a280276c0 con 0x7f7a380b5ae0 2023-10-17T06:19:23.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.033+0000 7f7a3d34c700 1 -- 172.21.15.125:0/3437357726 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a3814c7c0 con 0x7f7a380b5ae0 2023-10-17T06:19:23.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.033+0000 7f7a3d34c700 1 -- 172.21.15.125:0/3437357726 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a38072e60 con 0x7f7a380b5ae0 2023-10-17T06:19:23.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.033+0000 7f7a34ff9700 1 -- 172.21.15.125:0/3437357726 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7a28012430 con 0x7f7a380b5ae0 2023-10-17T06:19:23.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.037+0000 7f7a34ff9700 1 --2- 172.21.15.125:0/3437357726 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7a240656f0 0x7f7a24067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:19:23.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.037+0000 7f7a34ff9700 1 -- 172.21.15.125:0/3437357726 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f7a28022070 con 0x7f7a380b5ae0 2023-10-17T06:19:23.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.037+0000 7f7a377fe700 1 --2- 172.21.15.125:0/3437357726 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7a240656f0 0x7f7a24067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:19:23.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.037+0000 7f7a377fe700 1 --2- 172.21.15.125:0/3437357726 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7a240656f0 0x7f7a24067bb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7a380aef00 tx=0x7f7a2c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:19:23.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.045+0000 7f7a34ff9700 1 -- 172.21.15.125:0/3437357726 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f7a28052850 con 0x7f7a380b5ae0 2023-10-17T06:19:23.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.053+0000 7f48954cd700 1 Processor -- start 2023-10-17T06:19:23.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.053+0000 7f48954cd700 1 -- start start 2023-10-17T06:19:23.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.053+0000 7f48954cd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f489015ce60 0x7f489006f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:19:23.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.053+0000 7f48954cd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489006f990 0x7f48900ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:19:23.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f48954cd700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489006de30 con 0x7f48900ce660 2023-10-17T06:19:23.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f48954cd700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48900cd640 con 0x7f489015ce60 2023-10-17T06:19:23.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f48954cd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48900cd920 con 0x7f489006f990 2023-10-17T06:19:23.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f488effd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f489015ce60 0x7f489006f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:19:23.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f488effd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f489015ce60 0x7f489006f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:44506/0 (socket says 172.21.15.125:44506) 2023-10-17T06:19:23.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f4887fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489006f990 0x7f48900ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:19:23.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f488effd700 1 -- 172.21.15.125:0/1326207909 learned_addr learned my addr 172.21.15.125:0/1326207909 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:19:23.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f488effd700 1 -- 172.21.15.125:0/1326207909 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489006f990 msgr2=0x7f48900ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:19:23.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f488effd700 1 --2- 172.21.15.125:0/1326207909 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489006f990 0x7f48900ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:19:23.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f488effd700 1 -- 172.21.15.125:0/1326207909 >> v1:172.21.15.184:6789/0 conn(0x7f48900ce660 legacy=0x7f48900cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:19:23.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f488effd700 1 -- 172.21.15.125:0/1326207909 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48900cdc00 con 0x7f489015ce60 2023-10-17T06:19:23.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f488effd700 1 --2- 172.21.15.125:0/1326207909 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f489015ce60 0x7f489006f450 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4880009910 tx=0x7f4880009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ed019abe54ad0fa server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:19:23.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f488e7fc700 1 -- 172.21.15.125:0/1326207909 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880011830 con 0x7f489015ce60 2023-10-17T06:19:23.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f488e7fc700 1 -- 172.21.15.125:0/1326207909 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4880011990 con 0x7f489015ce60 2023-10-17T06:19:23.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f488e7fc700 1 -- 172.21.15.125:0/1326207909 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880011d40 con 0x7f489015ce60 2023-10-17T06:19:23.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f48954cd700 1 -- 172.21.15.125:0/1326207909 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f489015ce60 msgr2=0x7f489006f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:19:23.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f48954cd700 1 --2- 172.21.15.125:0/1326207909 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f489015ce60 0x7f489006f450 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4880009910 tx=0x7f4880009c20 comp rx=0 tx=0).stop 2023-10-17T06:19:23.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f48954cd700 1 -- 172.21.15.125:0/1326207909 shutdown_connections 2023-10-17T06:19:23.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f48954cd700 1 --2- 172.21.15.125:0/1326207909 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f489006f990 0x7f48900ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:19:23.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f48954cd700 1 --2- 172.21.15.125:0/1326207909 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f489015ce60 0x7f489006f450 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:19:23.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f48954cd700 1 -- 172.21.15.125:0/1326207909 >> 172.21.15.125:0/1326207909 conn(0x7f48900b48f0 msgr2=0x7f48900b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:19:23.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f48954cd700 1 -- 172.21.15.125:0/1326207909 shutdown_connections 2023-10-17T06:19:23.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.057+0000 7f48954cd700 1 -- 172.21.15.125:0/1326207909 wait complete. 2023-10-17T06:19:23.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.061+0000 7f48954cd700 1 Processor -- start 2023-10-17T06:19:23.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.061+0000 7f48954cd700 1 -- start start 2023-10-17T06:19:23.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.061+0000 7f48954cd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f489006f990 0x7f489015dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:19:23.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.061+0000 7f48954cd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48900ce660 0x7f48900ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:19:23.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.061+0000 7f48954cd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f489015ce60 0x7f489006cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:19:23.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.061+0000 7f48954cd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489015fc10 con 0x7f489006f990 2023-10-17T06:19:23.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.061+0000 7f48954cd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489015f000 con 0x7f489015ce60 2023-10-17T06:19:23.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.061+0000 7f48954cd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489015f2e0 con 0x7f48900ce660 2023-10-17T06:19:23.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.065+0000 7f488effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f489006f990 0x7f489015dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:19:23.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.065+0000 7f488effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f489006f990 0x7f489015dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53838/0 (socket says 172.21.15.125:53838) 2023-10-17T06:19:23.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.065+0000 7f488effd700 1 -- 172.21.15.125:0/2337125902 learned_addr learned my addr 172.21.15.125:0/2337125902 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:19:23.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.065+0000 7f488ffff700 1 --2- 172.21.15.125:0/2337125902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f489015ce60 0x7f489006cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:19:23.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.065+0000 7f4887fff700 1 --2- 172.21.15.125:0/2337125902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48900ce660 0x7f48900ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:19:23.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.065+0000 7f488effd700 1 -- 172.21.15.125:0/2337125902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48900ce660 msgr2=0x7f48900ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:19:23.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.065+0000 7f488effd700 1 --2- 172.21.15.125:0/2337125902 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48900ce660 0x7f48900ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:19:23.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.065+0000 7f488effd700 1 -- 172.21.15.125:0/2337125902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f489015ce60 msgr2=0x7f489006cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:19:23.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.065+0000 7f488effd700 1 --2- 172.21.15.125:0/2337125902 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f489015ce60 0x7f489006cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:19:23.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.065+0000 7f488effd700 1 -- 172.21.15.125:0/2337125902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4880009570 con 0x7f489006f990 2023-10-17T06:19:23.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.065+0000 7f488effd700 1 --2- 172.21.15.125:0/2337125902 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f489006f990 0x7f489015dc50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4880000c00 tx=0x7f4880004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:19:23.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.065+0000 7f48877fe700 1 -- 172.21.15.125:0/2337125902 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880004510 con 0x7f489006f990 2023-10-17T06:19:23.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.065+0000 7f48877fe700 1 -- 172.21.15.125:0/2337125902 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48800036c0 con 0x7f489006f990 2023-10-17T06:19:23.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.065+0000 7f48877fe700 1 -- 172.21.15.125:0/2337125902 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880003a70 con 0x7f489006f990 2023-10-17T06:19:23.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.065+0000 7f48954cd700 1 -- 172.21.15.125:0/2337125902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489015f5c0 con 0x7f489006f990 2023-10-17T06:19:23.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.065+0000 7f48954cd700 1 -- 172.21.15.125:0/2337125902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48900cd000 con 0x7f489006f990 2023-10-17T06:19:23.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.065+0000 7f48954cd700 1 -- 172.21.15.125:0/2337125902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f4890073f00 con 0x7f489006f990 2023-10-17T06:19:23.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.069+0000 7f48877fe700 1 -- 172.21.15.125:0/2337125902 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4880003bd0 con 0x7f489006f990 2023-10-17T06:19:23.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.069+0000 7f48877fe700 1 --2- 172.21.15.125:0/2337125902 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f48700656f0 0x7f4870067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:19:23.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.069+0000 7f48877fe700 1 -- 172.21.15.125:0/2337125902 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f4880021030 con 0x7f489006f990 2023-10-17T06:19:23.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.069+0000 7f4887fff700 1 --2- 172.21.15.125:0/2337125902 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f48700656f0 0x7f4870067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:19:23.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.069+0000 7f48877fe700 1 -- 172.21.15.125:0/2337125902 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+449 (secure 0 0 0) 0x7f4880085280 con 0x7f489006f990 2023-10-17T06:19:23.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.073+0000 7f48954cd700 1 -- 172.21.15.125:0/2337125902 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f48900caa50 con 0x7f489006f990 2023-10-17T06:19:23.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.073+0000 7f4887fff700 1 --2- 172.21.15.125:0/2337125902 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f48700656f0 0x7f4870067bb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f48900b7db0 tx=0x7f4878009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:19:23.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.277+0000 7f7a3d34c700 1 -- 172.21.15.125:0/3437357726 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a3814ca10 con 0x7f7a380b5ae0 2023-10-17T06:19:23.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.277+0000 7f7a34ff9700 1 -- 172.21.15.125:0/3437357726 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4889 (secure 0 0 0) 0x7f7a28055e70 con 0x7f7a380b5ae0 2023-10-17T06:19:23.286 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:19:23.287 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:08:51.328615+0000","modified":"2023-10-17T06:16:00.378712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":111,"addr":"172.21.15.125:6837/2351050168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2351050168},{"type":"v1","addr":"172.21.15.125:6837","nonce":2351050168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-17T06:19:23.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.281+0000 7f7a3d34c700 1 -- 172.21.15.125:0/3437357726 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7a240656f0 msgr2=0x7f7a24067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:19:23.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.281+0000 7f7a3d34c700 1 --2- 172.21.15.125:0/3437357726 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7a240656f0 0x7f7a24067bb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7a380aef00 tx=0x7f7a2c009240 comp rx=0 tx=0).stop 2023-10-17T06:19:23.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.281+0000 7f7a3d34c700 1 -- 172.21.15.125:0/3437357726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a380b5ae0 msgr2=0x7f7a381f53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:19:23.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.281+0000 7f7a3d34c700 1 --2- 172.21.15.125:0/3437357726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a380b5ae0 0x7f7a381f53d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7a28016000 tx=0x7f7a28004af0 comp rx=0 tx=0).stop 2023-10-17T06:19:23.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.281+0000 7f7a3d34c700 1 -- 172.21.15.125:0/3437357726 shutdown_connections 2023-10-17T06:19:23.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.281+0000 7f7a3d34c700 1 --2- 172.21.15.125:0/3437357726 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7a240656f0 0x7f7a24067bb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:19:23.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.281+0000 7f7a3d34c700 1 --2- 172.21.15.125:0/3437357726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a38160710 0x7f7a3815fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:19:23.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.281+0000 7f7a3d34c700 1 --2- 172.21.15.125:0/3437357726 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7a380d2e00 0x7f7a3815f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:19:23.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.281+0000 7f7a3d34c700 1 --2- 172.21.15.125:0/3437357726 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a380b5ae0 0x7f7a381f53d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:19:23.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.281+0000 7f7a3d34c700 1 -- 172.21.15.125:0/3437357726 >> 172.21.15.125:0/3437357726 conn(0x7f7a38069f20 msgr2=0x7f7a3806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:19:23.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.281+0000 7f7a3d34c700 1 -- 172.21.15.125:0/3437357726 shutdown_connections 2023-10-17T06:19:23.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:19:23.281+0000 7f7a3d34c700 1 -- 172.21.15.125:0/3437357726 wait complete. 2023-10-17T06:19:23.291 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 19 2023-10-17T06:19:23.315 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-10-17T06:19:23.499 INFO:teuthology.orchestra.run.smithi125.stdout:[{"id":5557,"entity":{"name":{"type":"client","num":5557},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":520252958}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":622.29151050600001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.23745207985756508,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5557 192.168.0.1:0/520252958","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi184","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-17T06:19:23.500 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi184", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 520252958, "type": "any" }, "name": { "num": 5557, "type": "client" } }, "id": 5557, "inst": "client.5557 192.168.0.1:0/520252958", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.23745207985756508 }, "state": "open", "uptime": 622.291510506 } ] 2023-10-17T06:19:23.601 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-17T06:19:33.725 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:19:33.733 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:20:00.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:00.912+0000 7f48877fe700 1 -- 172.21.15.125:0/2337125902 <== mon.0 v2:172.21.15.125:3300/0 7 ==== log(1 entries from seq 608 at 2023-10-17T06:20:00.000182+0000) v1 ==== 187+0+0 (secure 0 0 0) 0x7f4880006d80 con 0x7f489006f990 2023-10-17T06:20:00.920 INFO:teuthology.orchestra.run.smithi125.stdout: cluster: 2023-10-17T06:20:00.920 INFO:teuthology.orchestra.run.smithi125.stdout: id: c779df02-0ec4-47de-a0f3-2371e60a2dde 2023-10-17T06:20:00.920 INFO:teuthology.orchestra.run.smithi125.stdout: health: HEALTH_OK 2023-10-17T06:20:00.920 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:20:00.921 INFO:teuthology.orchestra.run.smithi125.stdout: services: 2023-10-17T06:20:00.921 INFO:teuthology.orchestra.run.smithi125.stdout: mon: 3 daemons, quorum a,b,c (age 12m) 2023-10-17T06:20:00.921 INFO:teuthology.orchestra.run.smithi125.stdout: mgr: y(active, since 12m), standbys: x 2023-10-17T06:20:00.921 INFO:teuthology.orchestra.run.smithi125.stdout: mds: 1/1 daemons up, 3 standby 2023-10-17T06:20:00.921 INFO:teuthology.orchestra.run.smithi125.stdout: osd: 8 osds: 8 up (since 3m), 8 in (since 12m) 2023-10-17T06:20:00.922 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:20:00.922 INFO:teuthology.orchestra.run.smithi125.stdout: data: 2023-10-17T06:20:00.922 INFO:teuthology.orchestra.run.smithi125.stdout: volumes: 1/1 healthy 2023-10-17T06:20:00.922 INFO:teuthology.orchestra.run.smithi125.stdout: pools: 4 pools, 105 pgs 2023-10-17T06:20:00.922 INFO:teuthology.orchestra.run.smithi125.stdout: objects: 24 objects, 580 KiB 2023-10-17T06:20:00.923 INFO:teuthology.orchestra.run.smithi125.stdout: usage: 218 MiB used, 720 GiB / 720 GiB avail 2023-10-17T06:20:00.923 INFO:teuthology.orchestra.run.smithi125.stdout: pgs: 105 active+clean 2023-10-17T06:20:00.923 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:20:00.923 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:20:00.923 INFO:teuthology.orchestra.run.smithi125.stdout:2023-10-17T06:20:00.000182+0000 mon.a [INF] overall HEALTH_OK 2023-10-17T06:20:03.824 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:20:03.832 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:20:23.629 ERROR:tasks.ceph_test_case:Log output: cluster: id: c779df02-0ec4-47de-a0f3-2371e60a2dde health: HEALTH_OK services: mon: 3 daemons, quorum a,b,c (age 12m) mgr: y(active, since 12m), standbys: x mds: 1/1 daemons up, 3 standby osd: 8 osds: 8 up (since 3m), 8 in (since 12m) data: volumes: 1/1 healthy pools: 4 pools, 105 pgs objects: 24 objects, 580 KiB usage: 218 MiB used, 720 GiB / 720 GiB avail pgs: 105 active+clean 2023-10-17T06:20:00.000182+0000 mon.a [INF] overall HEALTH_OK 2023-10-17T06:20:23.629 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-17T06:20:28.631 DEBUG:teuthology.orchestra.run.smithi125:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-17T06:20:28.638 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:20:28.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.808+0000 7f22d1bf6700 1 Processor -- start 2023-10-17T06:20:28.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.808+0000 7f22d1bf6700 1 -- start start 2023-10-17T06:20:28.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.808+0000 7f22d1bf6700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f22cc15a870 0x7f22cc06fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:20:28.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.808+0000 7f22d1bf6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f22cc15b6d0 0x7f22cc15bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:20:28.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.808+0000 7f22d1bf6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc0ca3c0 con 0x7f22cc15ac50 2023-10-17T06:20:28.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.808+0000 7f22d1bf6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc0703a0 con 0x7f22cc15b6d0 2023-10-17T06:20:28.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.808+0000 7f22d1bf6700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc0c9b20 con 0x7f22cc15a870 2023-10-17T06:20:28.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.808+0000 7f22cbfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f22cc15ac50 0x7f22cc15e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52374/0 (socket says 172.21.15.125:52374) 2023-10-17T06:20:28.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.808+0000 7f22cbfff700 1 -- 172.21.15.125:0/1526036344 learned_addr learned my addr 172.21.15.125:0/1526036344 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:20:28.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.808+0000 7f22d13f5700 1 --2- 172.21.15.125:0/1526036344 >> v2:172.21.15.125:3300/0 conn(0x7f22cc15b6d0 0x7f22cc15bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:20:28.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.808+0000 7f22d0bf4700 1 --2- 172.21.15.125:0/1526036344 >> v2:172.21.15.184:3300/0 conn(0x7f22cc15a870 0x7f22cc06fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:20:28.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.808+0000 7f22cb7fe700 1 -- 172.21.15.125:0/1526036344 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702429144 0 0) 0x7f22cc0ca3c0 con 0x7f22cc15ac50 2023-10-17T06:20:28.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.808+0000 7f22cb7fe700 1 -- 172.21.15.125:0/1526036344 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22b40035d0 con 0x7f22cc15ac50 2023-10-17T06:20:28.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.812+0000 7f22d13f5700 1 -- 172.21.15.125:0/1526036344 >> v2:172.21.15.184:3300/0 conn(0x7f22cc15a870 msgr2=0x7f22cc06fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:20:28.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.812+0000 7f22d13f5700 1 --2- 172.21.15.125:0/1526036344 >> v2:172.21.15.184:3300/0 conn(0x7f22cc15a870 0x7f22cc06fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:20:28.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.812+0000 7f22cb7fe700 1 -- 172.21.15.125:0/1526036344 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1545924639 0 0) 0x7f22b40035d0 con 0x7f22cc15ac50 2023-10-17T06:20:28.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.812+0000 7f22d13f5700 1 -- 172.21.15.125:0/1526036344 >> v1:172.21.15.125:6789/0 conn(0x7f22cc15ac50 legacy=0x7f22cc15e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:20:28.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.812+0000 7f22d13f5700 1 -- 172.21.15.125:0/1526036344 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc0c9e00 con 0x7f22cc15b6d0 2023-10-17T06:20:28.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.812+0000 7f22d13f5700 1 --2- 172.21.15.125:0/1526036344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22cc15b6d0 0x7f22cc15bb40 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f22cc0cfe30 tx=0x7f22c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f017f9ddadf093 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:20:28.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.812+0000 7f22cb7fe700 1 -- 172.21.15.125:0/1526036344 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c400e070 con 0x7f22cc15b6d0 2023-10-17T06:20:28.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.812+0000 7f22cb7fe700 1 -- 172.21.15.125:0/1526036344 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c4003a40 con 0x7f22cc15b6d0 2023-10-17T06:20:28.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.812+0000 7f22cb7fe700 1 -- 172.21.15.125:0/1526036344 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc001670 con 0x7f22cc15b6d0 2023-10-17T06:20:28.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.812+0000 7f22d1bf6700 1 -- 172.21.15.125:0/1526036344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22cc15b6d0 msgr2=0x7f22cc15bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:20:28.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.812+0000 7f22d1bf6700 1 --2- 172.21.15.125:0/1526036344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22cc15b6d0 0x7f22cc15bb40 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f22cc0cfe30 tx=0x7f22c400b330 comp rx=0 tx=0).stop 2023-10-17T06:20:28.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.812+0000 7f22d1bf6700 1 -- 172.21.15.125:0/1526036344 shutdown_connections 2023-10-17T06:20:28.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.812+0000 7f22d1bf6700 1 --2- 172.21.15.125:0/1526036344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22cc15b6d0 0x7f22cc15bb40 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:20:28.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.812+0000 7f22d1bf6700 1 --2- 172.21.15.125:0/1526036344 >> v2:172.21.15.184:3300/0 conn(0x7f22cc15a870 0x7f22cc06fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:20:28.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.812+0000 7f22d1bf6700 1 -- 172.21.15.125:0/1526036344 >> 172.21.15.125:0/1526036344 conn(0x7f22cc0cef70 msgr2=0x7f22cc0cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:20:28.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.812+0000 7f22d1bf6700 1 -- 172.21.15.125:0/1526036344 shutdown_connections 2023-10-17T06:20:28.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.812+0000 7f22d1bf6700 1 -- 172.21.15.125:0/1526036344 wait complete. 2023-10-17T06:20:28.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.812+0000 7f22d1bf6700 1 Processor -- start 2023-10-17T06:20:28.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.812+0000 7f22d1bf6700 1 -- start start 2023-10-17T06:20:28.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22d1bf6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22cc15a870 0x7f22cc0c3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:20:28.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22d1bf6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22cc15ac50 0x7f22cc1545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:20:28.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22d1bf6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22cc15b6d0 0x7f22cc0c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:20:28.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22d1bf6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0c3710 con 0x7f22cc15ac50 2023-10-17T06:20:28.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22d1bf6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0c39f0 con 0x7f22cc15a870 2023-10-17T06:20:28.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22d1bf6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0c3cd0 con 0x7f22cc15b6d0 2023-10-17T06:20:28.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22cbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22cc15ac50 0x7f22cc1545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:20:28.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22cbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22cc15ac50 0x7f22cc1545f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42064/0 (socket says 172.21.15.125:42064) 2023-10-17T06:20:28.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22cbfff700 1 -- 172.21.15.125:0/1837856523 learned_addr learned my addr 172.21.15.125:0/1837856523 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:20:28.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22d0bf4700 1 --2- 172.21.15.125:0/1837856523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22cc15a870 0x7f22cc0c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:20:28.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22d13f5700 1 --2- 172.21.15.125:0/1837856523 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22cc15b6d0 0x7f22cc0c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:20:28.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22cbfff700 1 -- 172.21.15.125:0/1837856523 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22cc15b6d0 msgr2=0x7f22cc0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:20:28.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22cbfff700 1 --2- 172.21.15.125:0/1837856523 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22cc15b6d0 0x7f22cc0c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:20:28.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22cbfff700 1 -- 172.21.15.125:0/1837856523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22cc15a870 msgr2=0x7f22cc0c3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:20:28.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22cbfff700 1 --2- 172.21.15.125:0/1837856523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22cc15a870 0x7f22cc0c3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:20:28.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22cbfff700 1 -- 172.21.15.125:0/1837856523 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c4009a70 con 0x7f22cc15ac50 2023-10-17T06:20:28.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22cbfff700 1 --2- 172.21.15.125:0/1837856523 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22cc15ac50 0x7f22cc1545f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f22bc00c530 tx=0x7f22bc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:20:28.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22c97fa700 1 -- 172.21.15.125:0/1837856523 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc004d60 con 0x7f22cc15ac50 2023-10-17T06:20:28.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22c97fa700 1 -- 172.21.15.125:0/1837856523 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22bc0070d0 con 0x7f22cc15ac50 2023-10-17T06:20:28.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22c97fa700 1 -- 172.21.15.125:0/1837856523 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc007460 con 0x7f22cc15ac50 2023-10-17T06:20:28.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22d1bf6700 1 -- 172.21.15.125:0/1837856523 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22cc0c3fb0 con 0x7f22cc15ac50 2023-10-17T06:20:28.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.816+0000 7f22d1bf6700 1 -- 172.21.15.125:0/1837856523 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc0c87d0 con 0x7f22cc15ac50 2023-10-17T06:20:28.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.820+0000 7f22d1bf6700 1 -- 172.21.15.125:0/1837856523 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc0c44d0 con 0x7f22cc15ac50 2023-10-17T06:20:28.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.820+0000 7f22c97fa700 1 -- 172.21.15.125:0/1837856523 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f22bc0075c0 con 0x7f22cc15ac50 2023-10-17T06:20:28.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.820+0000 7f22c97fa700 1 --2- 172.21.15.125:0/1837856523 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f22b80656f0 0x7f22b8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:20:28.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.820+0000 7f22c97fa700 1 -- 172.21.15.125:0/1837856523 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f22bc082d10 con 0x7f22cc15ac50 2023-10-17T06:20:28.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.820+0000 7f22d0bf4700 1 --2- 172.21.15.125:0/1837856523 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f22b80656f0 0x7f22b8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:20:28.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.824+0000 7f22d0bf4700 1 --2- 172.21.15.125:0/1837856523 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f22b80656f0 0x7f22b8067bb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f22c0009b50 tx=0x7f22c0009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:20:28.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.828+0000 7f22c97fa700 1 -- 172.21.15.125:0/1837856523 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f22cc0c44d0 con 0x7f22cc15ac50 2023-10-17T06:20:28.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.836+0000 7f906841d700 1 Processor -- start 2023-10-17T06:20:28.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.836+0000 7f906841d700 1 -- start start 2023-10-17T06:20:28.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.836+0000 7f906841d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9060160620 0x7f90600cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:20:28.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f906841d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906006bd70 con 0x7f9060070a80 2023-10-17T06:20:28.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f906841d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906006f5f0 con 0x7f90600cbb20 2023-10-17T06:20:28.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f906841d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906006f890 con 0x7f9060160620 2023-10-17T06:20:28.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f90661b9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9060160620 0x7f90600cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:20:28.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f90659b8700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f90600cbb20 0x7f9060070370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:50770/0 (socket says 172.21.15.125:50770) 2023-10-17T06:20:28.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f90659b8700 1 -- 172.21.15.125:0/2933738674 learned_addr learned my addr 172.21.15.125:0/2933738674 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:20:28.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f90669ba700 1 --1- 172.21.15.125:0/2933738674 >> v1:172.21.15.125:6789/0 conn(0x7f9060070a80 0x7f906006a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52380/0 (socket says 172.21.15.125:52380) 2023-10-17T06:20:28.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f90661b9700 1 -- 172.21.15.125:0/2933738674 >> v1:172.21.15.184:6789/0 conn(0x7f90600cbb20 legacy=0x7f9060070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:20:28.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f90661b9700 1 -- 172.21.15.125:0/2933738674 >> v1:172.21.15.125:6789/0 conn(0x7f9060070a80 legacy=0x7f906006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:20:28.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f90651b7700 1 -- 172.21.15.125:0/2933738674 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707908219 0 0) 0x7f906006f5f0 con 0x7f90600cbb20 2023-10-17T06:20:28.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f90661b9700 1 -- 172.21.15.125:0/2933738674 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906006fb70 con 0x7f9060160620 2023-10-17T06:20:28.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f90661b9700 1 --2- 172.21.15.125:0/2933738674 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9060160620 0x7f90600cb5e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f905c009880 tx=0x7f905c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd3cff0e6a29fb96 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:20:28.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f90651b7700 1 -- 172.21.15.125:0/2933738674 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c004230 con 0x7f9060160620 2023-10-17T06:20:28.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f90651b7700 1 -- 172.21.15.125:0/2933738674 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905c004390 con 0x7f9060160620 2023-10-17T06:20:28.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f90651b7700 1 -- 172.21.15.125:0/2933738674 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c0036c0 con 0x7f9060160620 2023-10-17T06:20:28.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f906841d700 1 -- 172.21.15.125:0/2933738674 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9060160620 msgr2=0x7f90600cb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:20:28.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f906841d700 1 --2- 172.21.15.125:0/2933738674 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9060160620 0x7f90600cb5e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f905c009880 tx=0x7f905c009b90 comp rx=0 tx=0).stop 2023-10-17T06:20:28.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f906841d700 1 -- 172.21.15.125:0/2933738674 shutdown_connections 2023-10-17T06:20:28.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f906841d700 1 --2- 172.21.15.125:0/2933738674 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9060160620 0x7f90600cb5e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:20:28.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f906841d700 1 -- 172.21.15.125:0/2933738674 >> 172.21.15.125:0/2933738674 conn(0x7f90600d0bb0 msgr2=0x7f90600d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:20:28.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f906841d700 1 -- 172.21.15.125:0/2933738674 shutdown_connections 2023-10-17T06:20:28.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.840+0000 7f906841d700 1 -- 172.21.15.125:0/2933738674 wait complete. 2023-10-17T06:20:28.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.844+0000 7f906841d700 1 Processor -- start 2023-10-17T06:20:28.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.844+0000 7f906841d700 1 -- start start 2023-10-17T06:20:28.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.844+0000 7f906841d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9060070a80 0x7f90600c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:20:28.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.844+0000 7f906841d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90600cbb20 0x7f9060158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:20:28.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.844+0000 7f906841d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9060160620 0x7f90601539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:20:28.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.844+0000 7f906841d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90600cb050 con 0x7f9060160620 2023-10-17T06:20:28.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.844+0000 7f906841d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90600c7250 con 0x7f9060070a80 2023-10-17T06:20:28.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.844+0000 7f906841d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90600c5220 con 0x7f90600cbb20 2023-10-17T06:20:28.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.844+0000 7f90669ba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9060160620 0x7f90601539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:20:28.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.844+0000 7f90669ba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9060160620 0x7f90601539c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42076/0 (socket says 172.21.15.125:42076) 2023-10-17T06:20:28.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.844+0000 7f90669ba700 1 -- 172.21.15.125:0/1438212153 learned_addr learned my addr 172.21.15.125:0/1438212153 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:20:28.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.844+0000 7f90661b9700 1 --2- 172.21.15.125:0/1438212153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9060070a80 0x7f90600c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:20:28.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.844+0000 7f90659b8700 1 --2- 172.21.15.125:0/1438212153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90600cbb20 0x7f9060158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:20:28.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.844+0000 7f90669ba700 1 -- 172.21.15.125:0/1438212153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90600cbb20 msgr2=0x7f9060158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:20:28.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.844+0000 7f90669ba700 1 --2- 172.21.15.125:0/1438212153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90600cbb20 0x7f9060158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:20:28.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.844+0000 7f90669ba700 1 -- 172.21.15.125:0/1438212153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9060070a80 msgr2=0x7f90600c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:20:28.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.844+0000 7f90669ba700 1 --2- 172.21.15.125:0/1438212153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9060070a80 0x7f90600c6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:20:28.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.844+0000 7f90669ba700 1 -- 172.21.15.125:0/1438212153 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905c0094b0 con 0x7f9060160620 2023-10-17T06:20:28.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.844+0000 7f90659b8700 1 --2- 172.21.15.125:0/1438212153 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90600cbb20 0x7f9060158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:20:28.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.848+0000 7f90669ba700 1 --2- 172.21.15.125:0/1438212153 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9060160620 0x7f90601539c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9058001f80 tx=0x7f905800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:20:28.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.848+0000 7f9056ffd700 1 -- 172.21.15.125:0/1438212153 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905800ad80 con 0x7f9060160620 2023-10-17T06:20:28.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.848+0000 7f906841d700 1 -- 172.21.15.125:0/1438212153 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90600c5500 con 0x7f9060160620 2023-10-17T06:20:28.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.848+0000 7f906841d700 1 -- 172.21.15.125:0/1438212153 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90600c5890 con 0x7f9060160620 2023-10-17T06:20:28.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.848+0000 7f9056ffd700 1 -- 172.21.15.125:0/1438212153 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90580020d0 con 0x7f9060160620 2023-10-17T06:20:28.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.848+0000 7f9056ffd700 1 -- 172.21.15.125:0/1438212153 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90580072d0 con 0x7f9060160620 2023-10-17T06:20:28.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.848+0000 7f906841d700 1 -- 172.21.15.125:0/1438212153 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f9060073f00 con 0x7f9060160620 2023-10-17T06:20:28.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.848+0000 7f9056ffd700 1 -- 172.21.15.125:0/1438212153 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9058007430 con 0x7f9060160620 2023-10-17T06:20:28.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.852+0000 7f9056ffd700 1 --2- 172.21.15.125:0/1438212153 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f90440656f0 0x7f9044067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:20:28.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.852+0000 7f9056ffd700 1 -- 172.21.15.125:0/1438212153 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f9058082bb0 con 0x7f9060160620 2023-10-17T06:20:28.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.852+0000 7f9056ffd700 1 -- 172.21.15.125:0/1438212153 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+449 (secure 0 0 0) 0x7f9058087220 con 0x7f9060160620 2023-10-17T06:20:28.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.852+0000 7f90661b9700 1 --2- 172.21.15.125:0/1438212153 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f90440656f0 0x7f9044067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:20:28.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.852+0000 7f906841d700 1 -- 172.21.15.125:0/1438212153 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f90600c5690 con 0x7f9060160620 2023-10-17T06:20:28.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:28.852+0000 7f90661b9700 1 --2- 172.21.15.125:0/1438212153 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f90440656f0 0x7f9044067bb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f905c009880 tx=0x7f905c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:20:29.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:29.064+0000 7f22d1bf6700 1 -- 172.21.15.125:0/1837856523 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22cc0c44d0 con 0x7f22cc15ac50 2023-10-17T06:20:29.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:29.064+0000 7f22c97fa700 1 -- 172.21.15.125:0/1837856523 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4889 (secure 0 0 0) 0x7f22cc0c44d0 con 0x7f22cc15ac50 2023-10-17T06:20:29.069 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:20:29.069 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:08:51.328615+0000","modified":"2023-10-17T06:16:00.378712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":111,"addr":"172.21.15.125:6837/2351050168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2351050168},{"type":"v1","addr":"172.21.15.125:6837","nonce":2351050168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-17T06:20:29.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:29.068+0000 7f22d1bf6700 1 -- 172.21.15.125:0/1837856523 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f22b80656f0 msgr2=0x7f22b8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:20:29.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:29.068+0000 7f22d1bf6700 1 --2- 172.21.15.125:0/1837856523 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f22b80656f0 0x7f22b8067bb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f22c0009b50 tx=0x7f22c0009240 comp rx=0 tx=0).stop 2023-10-17T06:20:29.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:29.068+0000 7f22d1bf6700 1 -- 172.21.15.125:0/1837856523 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22cc15ac50 msgr2=0x7f22cc1545f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:20:29.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:29.068+0000 7f22d1bf6700 1 --2- 172.21.15.125:0/1837856523 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22cc15ac50 0x7f22cc1545f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f22bc00c530 tx=0x7f22bc00c840 comp rx=0 tx=0).stop 2023-10-17T06:20:29.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:29.068+0000 7f22d1bf6700 1 -- 172.21.15.125:0/1837856523 shutdown_connections 2023-10-17T06:20:29.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:29.068+0000 7f22d1bf6700 1 --2- 172.21.15.125:0/1837856523 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f22b80656f0 0x7f22b8067bb0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:20:29.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:29.068+0000 7f22d1bf6700 1 --2- 172.21.15.125:0/1837856523 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22cc15b6d0 0x7f22cc0c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:20:29.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:29.068+0000 7f22d1bf6700 1 --2- 172.21.15.125:0/1837856523 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22cc15ac50 0x7f22cc1545f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:20:29.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:29.068+0000 7f22d1bf6700 1 --2- 172.21.15.125:0/1837856523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22cc15a870 0x7f22cc0c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:20:29.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:29.068+0000 7f22d1bf6700 1 -- 172.21.15.125:0/1837856523 >> 172.21.15.125:0/1837856523 conn(0x7f22cc0cef70 msgr2=0x7f22cc0af0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:20:29.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:29.068+0000 7f22d1bf6700 1 -- 172.21.15.125:0/1837856523 shutdown_connections 2023-10-17T06:20:29.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:20:29.068+0000 7f22d1bf6700 1 -- 172.21.15.125:0/1837856523 wait complete. 2023-10-17T06:20:29.075 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 19 2023-10-17T06:20:29.095 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-10-17T06:20:29.286 INFO:teuthology.orchestra.run.smithi125.stdout:[{"id":5557,"entity":{"name":{"type":"client","num":5557},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":520252958}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":688.07828781299997,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.20396860876503162,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5557 192.168.0.1:0/520252958","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi184","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-17T06:20:29.287 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi184", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 520252958, "type": "any" }, "name": { "num": 5557, "type": "client" } }, "id": 5557, "inst": "client.5557 192.168.0.1:0/520252958", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.20396860876503162 }, "state": "open", "uptime": 688.078287813 } ] 2023-10-17T06:20:29.388 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-17T06:20:33.913 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:20:33.922 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:21:03.992 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:21:03.999 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:21:29.416 ERROR:tasks.ceph_test_case:Log output: 2023-10-17T06:21:29.417 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-17T06:21:34.072 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:21:34.081 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:21:34.418 DEBUG:teuthology.orchestra.run.smithi125:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-17T06:21:34.426 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:21:34.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.603+0000 7facd35d2700 1 Processor -- start 2023-10-17T06:21:34.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.607+0000 7facd35d2700 1 -- start start 2023-10-17T06:21:34.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.607+0000 7facd35d2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faccc0b1e60 0x7faccc070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:21:34.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.607+0000 7facd35d2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faccc0d0460 con 0x7faccc15cc10 2023-10-17T06:21:34.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.607+0000 7facd35d2700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faccc06d220 con 0x7faccc0d2f20 2023-10-17T06:21:34.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.607+0000 7facd35d2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faccc06eef0 con 0x7faccc0b1e60 2023-10-17T06:21:34.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.607+0000 7facd136e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7faccc15cc10 0x7faccc0cfd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:48838/0 (socket says 172.21.15.125:48838) 2023-10-17T06:21:34.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.607+0000 7facd136e700 1 -- 172.21.15.125:0/1557138704 learned_addr learned my addr 172.21.15.125:0/1557138704 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:21:34.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.607+0000 7facd0b6d700 1 --2- 172.21.15.125:0/1557138704 >> v2:172.21.15.125:3300/0 conn(0x7faccc0b1e60 0x7faccc070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:21:34.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.607+0000 7facc3fff700 1 -- 172.21.15.125:0/1557138704 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236870726 0 0) 0x7faccc0d0460 con 0x7faccc15cc10 2023-10-17T06:21:34.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.607+0000 7facc3fff700 1 -- 172.21.15.125:0/1557138704 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facb80035d0 con 0x7faccc15cc10 2023-10-17T06:21:34.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.607+0000 7facc3fff700 1 -- 172.21.15.125:0/1557138704 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484102131 0 0) 0x7faccc06d220 con 0x7faccc0d2f20 2023-10-17T06:21:34.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.607+0000 7facc3fff700 1 -- 172.21.15.125:0/1557138704 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faccc0d0460 con 0x7faccc0d2f20 2023-10-17T06:21:34.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.611+0000 7facd0b6d700 1 -- 172.21.15.125:0/1557138704 >> v1:172.21.15.184:6789/0 conn(0x7faccc0d2f20 legacy=0x7faccc0d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:21:34.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.611+0000 7facd0b6d700 1 -- 172.21.15.125:0/1557138704 >> v1:172.21.15.125:6789/0 conn(0x7faccc15cc10 legacy=0x7faccc0cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:21:34.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.611+0000 7facd0b6d700 1 -- 172.21.15.125:0/1557138704 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc06ec10 con 0x7faccc0b1e60 2023-10-17T06:21:34.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.611+0000 7facd0b6d700 1 --2- 172.21.15.125:0/1557138704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faccc0b1e60 0x7faccc070a00 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7facbc009850 tx=0x7facbc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a2c61002693082 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:21:34.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.611+0000 7facc3fff700 1 -- 172.21.15.125:0/1557138704 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc011830 con 0x7faccc0b1e60 2023-10-17T06:21:34.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.611+0000 7facc3fff700 1 -- 172.21.15.125:0/1557138704 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc011990 con 0x7faccc0b1e60 2023-10-17T06:21:34.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.611+0000 7facc3fff700 1 -- 172.21.15.125:0/1557138704 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc011d40 con 0x7faccc0b1e60 2023-10-17T06:21:34.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.611+0000 7facd35d2700 1 -- 172.21.15.125:0/1557138704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faccc0b1e60 msgr2=0x7faccc070a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:21:34.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.611+0000 7facd35d2700 1 --2- 172.21.15.125:0/1557138704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faccc0b1e60 0x7faccc070a00 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7facbc009850 tx=0x7facbc009b60 comp rx=0 tx=0).stop 2023-10-17T06:21:34.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.611+0000 7facd35d2700 1 -- 172.21.15.125:0/1557138704 shutdown_connections 2023-10-17T06:21:34.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.611+0000 7facd35d2700 1 --2- 172.21.15.125:0/1557138704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faccc0b1e60 0x7faccc070a00 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:21:34.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.611+0000 7facd35d2700 1 -- 172.21.15.125:0/1557138704 >> 172.21.15.125:0/1557138704 conn(0x7faccc069ef0 msgr2=0x7faccc06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:21:34.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.611+0000 7facd35d2700 1 -- 172.21.15.125:0/1557138704 shutdown_connections 2023-10-17T06:21:34.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.611+0000 7facd35d2700 1 -- 172.21.15.125:0/1557138704 wait complete. 2023-10-17T06:21:34.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.615+0000 7facd35d2700 1 Processor -- start 2023-10-17T06:21:34.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.615+0000 7facd35d2700 1 -- start start 2023-10-17T06:21:34.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facd35d2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faccc0b1e60 0x7faccc145770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:21:34.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facd35d2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faccc0d2f20 0x7faccc160c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:21:34.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facd35d2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faccc15cc10 0x7faccc0b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:21:34.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facd35d2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0b4db0 con 0x7faccc15cc10 2023-10-17T06:21:34.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facd35d2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0b3d10 con 0x7faccc0d2f20 2023-10-17T06:21:34.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facd35d2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0b3ff0 con 0x7faccc0b1e60 2023-10-17T06:21:34.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facd1b6f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faccc15cc10 0x7faccc0b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:21:34.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facd1b6f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faccc15cc10 0x7faccc0b5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42798/0 (socket says 172.21.15.125:42798) 2023-10-17T06:21:34.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facd1b6f700 1 -- 172.21.15.125:0/3449152808 learned_addr learned my addr 172.21.15.125:0/3449152808 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:21:34.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facd0b6d700 1 --2- 172.21.15.125:0/3449152808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faccc0d2f20 0x7faccc160c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:21:34.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facd136e700 1 --2- 172.21.15.125:0/3449152808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faccc0b1e60 0x7faccc145770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:21:34.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facd1b6f700 1 -- 172.21.15.125:0/3449152808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faccc0b1e60 msgr2=0x7faccc145770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:21:34.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facd1b6f700 1 --2- 172.21.15.125:0/3449152808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faccc0b1e60 0x7faccc145770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:21:34.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facd1b6f700 1 -- 172.21.15.125:0/3449152808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faccc0d2f20 msgr2=0x7faccc160c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:21:34.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facd1b6f700 1 --2- 172.21.15.125:0/3449152808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faccc0d2f20 0x7faccc160c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:21:34.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facd1b6f700 1 -- 172.21.15.125:0/3449152808 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc0094b0 con 0x7faccc15cc10 2023-10-17T06:21:34.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facd1b6f700 1 --2- 172.21.15.125:0/3449152808 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faccc15cc10 0x7faccc0b5df0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7facc400cc20 tx=0x7facc400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:21:34.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facc1ffb700 1 -- 172.21.15.125:0/3449152808 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc4003c20 con 0x7faccc15cc10 2023-10-17T06:21:34.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facc1ffb700 1 -- 172.21.15.125:0/3449152808 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc4003d80 con 0x7faccc15cc10 2023-10-17T06:21:34.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facc1ffb700 1 -- 172.21.15.125:0/3449152808 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc400aae0 con 0x7faccc15cc10 2023-10-17T06:21:34.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.619+0000 7facd35d2700 1 -- 172.21.15.125:0/3449152808 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faccc0b42d0 con 0x7faccc15cc10 2023-10-17T06:21:34.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.623+0000 7facd35d2700 1 -- 172.21.15.125:0/3449152808 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faccc0b4890 con 0x7faccc15cc10 2023-10-17T06:21:34.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.623+0000 7facd35d2700 1 -- 172.21.15.125:0/3449152808 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faccc0b4ab0 con 0x7faccc15cc10 2023-10-17T06:21:34.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.623+0000 7facc1ffb700 1 -- 172.21.15.125:0/3449152808 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7facc400ac40 con 0x7faccc15cc10 2023-10-17T06:21:34.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.627+0000 7fa24b440700 1 Processor -- start 2023-10-17T06:21:34.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.627+0000 7facc1ffb700 1 --2- 172.21.15.125:0/3449152808 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7facb00656f0 0x7facb0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:21:34.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.627+0000 7fa24b440700 1 -- start start 2023-10-17T06:21:34.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.627+0000 7facc1ffb700 1 -- 172.21.15.125:0/3449152808 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7facc4082fd0 con 0x7faccc15cc10 2023-10-17T06:21:34.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.627+0000 7facd136e700 1 --2- 172.21.15.125:0/3449152808 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7facb00656f0 0x7facb0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:21:34.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.627+0000 7facd136e700 1 --2- 172.21.15.125:0/3449152808 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7facb00656f0 0x7facb0067bb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7facc8007fd0 tx=0x7facc8007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:21:34.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.627+0000 7fa24b440700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2441572f0 0x7fa244160830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:21:34.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.627+0000 7fa24b440700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa2440d2f60 0x7fa2440d33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:21:34.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.627+0000 7fa24b440700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2440b61f0 con 0x7fa2440cf320 2023-10-17T06:21:34.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.627+0000 7fa24b440700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2440d3930 con 0x7fa2440d2f60 2023-10-17T06:21:34.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.627+0000 7fa24b440700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2441576d0 con 0x7fa2441572f0 2023-10-17T06:21:34.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.627+0000 7fa24ac3f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa2440d2f60 0x7fa2440d33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:21:34.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.627+0000 7fa24ac3f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa2440d2f60 0x7fa2440d33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42812/0 (socket says 172.21.15.125:42812) 2023-10-17T06:21:34.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.627+0000 7fa24ac3f700 1 -- 172.21.15.125:0/3605524736 learned_addr learned my addr 172.21.15.125:0/3605524736 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:21:34.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.631+0000 7fa24a43e700 1 --2- 172.21.15.125:0/3605524736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2441572f0 0x7fa244160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:21:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.631+0000 7fa24ac3f700 1 -- 172.21.15.125:0/3605524736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2441572f0 msgr2=0x7fa244160830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:21:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.631+0000 7fa24ac3f700 1 --2- 172.21.15.125:0/3605524736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2441572f0 0x7fa244160830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:21:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.631+0000 7fa24ac3f700 1 -- 172.21.15.125:0/3605524736 >> v1:172.21.15.125:6789/0 conn(0x7fa2440cf320 legacy=0x7fa2440b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:21:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.631+0000 7fa24ac3f700 1 -- 172.21.15.125:0/3605524736 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24406dd60 con 0x7fa2440d2f60 2023-10-17T06:21:34.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.631+0000 7fa24ac3f700 1 --2- 172.21.15.125:0/3605524736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2440d2f60 0x7fa2440d33f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009e50 tx=0x7fa23c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd1c0bce043d26a server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:21:34.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.631+0000 7fa24943c700 1 -- 172.21.15.125:0/3605524736 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c00e070 con 0x7fa2440d2f60 2023-10-17T06:21:34.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.635+0000 7fa24943c700 1 -- 172.21.15.125:0/3605524736 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c003a40 con 0x7fa2440d2f60 2023-10-17T06:21:34.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.635+0000 7fa24943c700 1 -- 172.21.15.125:0/3605524736 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c003df0 con 0x7fa2440d2f60 2023-10-17T06:21:34.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.635+0000 7facc1ffb700 1 -- 172.21.15.125:0/3449152808 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7facc40508d0 con 0x7faccc15cc10 2023-10-17T06:21:34.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.635+0000 7fa24b440700 1 -- 172.21.15.125:0/3605524736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2440d2f60 msgr2=0x7fa2440d33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:21:34.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.635+0000 7fa24b440700 1 --2- 172.21.15.125:0/3605524736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2440d2f60 0x7fa2440d33f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009e50 tx=0x7fa23c00b330 comp rx=0 tx=0).stop 2023-10-17T06:21:34.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.635+0000 7fa24b440700 1 -- 172.21.15.125:0/3605524736 shutdown_connections 2023-10-17T06:21:34.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.635+0000 7fa24b440700 1 --2- 172.21.15.125:0/3605524736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2440d2f60 0x7fa2440d33f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:21:34.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.635+0000 7fa24b440700 1 --2- 172.21.15.125:0/3605524736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2441572f0 0x7fa244160830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:21:34.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.635+0000 7fa24b440700 1 -- 172.21.15.125:0/3605524736 >> 172.21.15.125:0/3605524736 conn(0x7fa244069ef0 msgr2=0x7fa24406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:21:34.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.635+0000 7fa24b440700 1 -- 172.21.15.125:0/3605524736 shutdown_connections 2023-10-17T06:21:34.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.635+0000 7fa24b440700 1 -- 172.21.15.125:0/3605524736 wait complete. 2023-10-17T06:21:34.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.635+0000 7fa24b440700 1 Processor -- start 2023-10-17T06:21:34.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.635+0000 7fa24b440700 1 -- start start 2023-10-17T06:21:34.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa24b440700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2440cf320 0x7fa244153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:21:34.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa24b440700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2440d2f60 0x7fa24406f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:21:34.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa24b440700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2441572f0 0x7fa24406f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:21:34.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa24b440700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24415c3a0 con 0x7fa2441572f0 2023-10-17T06:21:34.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa24b440700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24415ba00 con 0x7fa2440d2f60 2023-10-17T06:21:34.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa24b440700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24415bce0 con 0x7fa2440cf320 2023-10-17T06:21:34.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa24ac3f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2441572f0 0x7fa24406f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:21:34.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa24ac3f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2441572f0 0x7fa24406f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:42820/0 (socket says 172.21.15.125:42820) 2023-10-17T06:21:34.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa24ac3f700 1 -- 172.21.15.125:0/3634161621 learned_addr learned my addr 172.21.15.125:0/3634161621 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:21:34.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa24a43e700 1 --2- 172.21.15.125:0/3634161621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2440cf320 0x7fa244153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:21:34.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa249c3d700 1 --2- 172.21.15.125:0/3634161621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2440d2f60 0x7fa24406f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:21:34.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa24ac3f700 1 -- 172.21.15.125:0/3634161621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2440cf320 msgr2=0x7fa244153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:21:34.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa24ac3f700 1 --2- 172.21.15.125:0/3634161621 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa2440cf320 0x7fa244153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:21:34.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa24ac3f700 1 -- 172.21.15.125:0/3634161621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2440d2f60 msgr2=0x7fa24406f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:21:34.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa24ac3f700 1 --2- 172.21.15.125:0/3634161621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2440d2f60 0x7fa24406f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:21:34.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa24ac3f700 1 -- 172.21.15.125:0/3634161621 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c009b30 con 0x7fa2441572f0 2023-10-17T06:21:34.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa24ac3f700 1 --2- 172.21.15.125:0/3634161621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa2441572f0 0x7fa24406f990 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa244070640 tx=0x7fa23c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:21:34.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa23affd700 1 -- 172.21.15.125:0/3634161621 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c004440 con 0x7fa2441572f0 2023-10-17T06:21:34.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa23affd700 1 -- 172.21.15.125:0/3634161621 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c0045c0 con 0x7fa2441572f0 2023-10-17T06:21:34.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa24b440700 1 -- 172.21.15.125:0/3634161621 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24415bfc0 con 0x7fa2441572f0 2023-10-17T06:21:34.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa23affd700 1 -- 172.21.15.125:0/3634161621 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c004970 con 0x7fa2441572f0 2023-10-17T06:21:34.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.639+0000 7fa24b440700 1 -- 172.21.15.125:0/3634161621 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24415c7c0 con 0x7fa2441572f0 2023-10-17T06:21:34.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.643+0000 7fa24b440700 1 -- 172.21.15.125:0/3634161621 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fa24415c4e0 con 0x7fa2441572f0 2023-10-17T06:21:34.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.643+0000 7fa23affd700 1 -- 172.21.15.125:0/3634161621 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa23c012430 con 0x7fa2441572f0 2023-10-17T06:21:34.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.643+0000 7fa23affd700 1 --2- 172.21.15.125:0/3634161621 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fa2280656f0 0x7fa228067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:21:34.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.643+0000 7fa23affd700 1 -- 172.21.15.125:0/3634161621 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fa23c084390 con 0x7fa2441572f0 2023-10-17T06:21:34.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.643+0000 7fa24a43e700 1 --2- 172.21.15.125:0/3634161621 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fa2280656f0 0x7fa228067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:21:34.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.643+0000 7fa23affd700 1 -- 172.21.15.125:0/3634161621 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+449 (secure 0 0 0) 0x7fa24415c4e0 con 0x7fa2441572f0 2023-10-17T06:21:34.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.647+0000 7fa24b440700 1 -- 172.21.15.125:0/3634161621 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fa24415c4e0 con 0x7fa2441572f0 2023-10-17T06:21:34.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.647+0000 7fa24a43e700 1 --2- 172.21.15.125:0/3634161621 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fa2280656f0 0x7fa228067bb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa240006b40 tx=0x7fa240008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:21:34.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.859+0000 7facd35d2700 1 -- 172.21.15.125:0/3449152808 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faccc06ced0 con 0x7faccc15cc10 2023-10-17T06:21:34.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.863+0000 7facc1ffb700 1 -- 172.21.15.125:0/3449152808 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4889 (secure 0 0 0) 0x7facc4053ef0 con 0x7faccc15cc10 2023-10-17T06:21:34.868 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:21:34.868 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:08:51.328615+0000","modified":"2023-10-17T06:16:00.378712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":111,"addr":"172.21.15.125:6837/2351050168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2351050168},{"type":"v1","addr":"172.21.15.125:6837","nonce":2351050168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-17T06:21:34.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.863+0000 7facd35d2700 1 -- 172.21.15.125:0/3449152808 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7facb00656f0 msgr2=0x7facb0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:21:34.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.863+0000 7facd35d2700 1 --2- 172.21.15.125:0/3449152808 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7facb00656f0 0x7facb0067bb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7facc8007fd0 tx=0x7facc8007de0 comp rx=0 tx=0).stop 2023-10-17T06:21:34.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.863+0000 7facd35d2700 1 -- 172.21.15.125:0/3449152808 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faccc15cc10 msgr2=0x7faccc0b5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:21:34.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.863+0000 7facd35d2700 1 --2- 172.21.15.125:0/3449152808 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faccc15cc10 0x7faccc0b5df0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7facc400cc20 tx=0x7facc400cf30 comp rx=0 tx=0).stop 2023-10-17T06:21:34.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.867+0000 7facd35d2700 1 -- 172.21.15.125:0/3449152808 shutdown_connections 2023-10-17T06:21:34.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.867+0000 7facd35d2700 1 --2- 172.21.15.125:0/3449152808 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7facb00656f0 0x7facb0067bb0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:21:34.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.867+0000 7facd35d2700 1 --2- 172.21.15.125:0/3449152808 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faccc15cc10 0x7faccc0b5df0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:21:34.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.867+0000 7facd35d2700 1 --2- 172.21.15.125:0/3449152808 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faccc0d2f20 0x7faccc160c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:21:34.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.867+0000 7facd35d2700 1 --2- 172.21.15.125:0/3449152808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faccc0b1e60 0x7faccc145770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:21:34.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.867+0000 7facd35d2700 1 -- 172.21.15.125:0/3449152808 >> 172.21.15.125:0/3449152808 conn(0x7faccc069ef0 msgr2=0x7faccc158620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:21:34.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.867+0000 7facd35d2700 1 -- 172.21.15.125:0/3449152808 shutdown_connections 2023-10-17T06:21:34.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:21:34.867+0000 7facd35d2700 1 -- 172.21.15.125:0/3449152808 wait complete. 2023-10-17T06:21:34.873 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 19 2023-10-17T06:21:34.890 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2023-10-17T06:21:35.066 INFO:teuthology.orchestra.run.smithi125.stdout:[{"id":5557,"entity":{"name":{"type":"client","num":5557},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":520252958}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":753.86123808299999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.17520824099504684,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5557 192.168.0.1:0/520252958","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi184","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-17T06:21:35.067 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi184", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 520252958, "type": "any" }, "name": { "num": 5557, "type": "client" } }, "id": 5557, "inst": "client.5557 192.168.0.1:0/520252958", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.17520824099504684 }, "state": "open", "uptime": 753.861238083 } ] 2023-10-17T06:21:35.168 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-17T06:22:04.153 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:22:04.161 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:22:34.242 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:22:34.250 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:22:35.195 ERROR:tasks.ceph_test_case:Log output: 2023-10-17T06:22:35.195 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-17T06:22:35.196 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi125.front.sepia.ceph.com 2023-10-17T06:22:35.196 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:22:35.197 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:22:35.257 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:22:35.258 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:22:35.320 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:22:35.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.538+0000 7f2165e07700 1 Processor -- start 2023-10-17T06:22:35.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.542+0000 7f2165e07700 1 -- start start 2023-10-17T06:22:35.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.542+0000 7f2165e07700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216006a6c0 0x7f21600cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:35.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.542+0000 7f2165e07700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21600ce6c0 con 0x7f216015cdb0 2023-10-17T06:22:35.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.542+0000 7f2165e07700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216006fe60 con 0x7f216006f450 2023-10-17T06:22:35.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.542+0000 7f2165e07700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2160070140 con 0x7f216006a6c0 2023-10-17T06:22:35.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.542+0000 7f2164e05700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f216015cdb0 0x7f21600caf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:60230/0 (socket says 172.21.15.125:60230) 2023-10-17T06:22:35.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.542+0000 7f2164e05700 1 -- 172.21.15.125:0/4124332880 learned_addr learned my addr 172.21.15.125:0/4124332880 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:22:35.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.542+0000 7f2165606700 1 --2- 172.21.15.125:0/4124332880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216006a6c0 0x7f21600cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:35.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.542+0000 7f215f7fe700 1 -- 172.21.15.125:0/4124332880 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408011214 0 0) 0x7f21600ce6c0 con 0x7f216015cdb0 2023-10-17T06:22:35.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.546+0000 7f215f7fe700 1 -- 172.21.15.125:0/4124332880 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21500035d0 con 0x7f216015cdb0 2023-10-17T06:22:35.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.546+0000 7f215f7fe700 1 -- 172.21.15.125:0/4124332880 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006261407 0 0) 0x7f216006fe60 con 0x7f216006f450 2023-10-17T06:22:35.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.546+0000 7f215f7fe700 1 -- 172.21.15.125:0/4124332880 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21600ce6c0 con 0x7f216006f450 2023-10-17T06:22:35.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.546+0000 7f2165606700 1 -- 172.21.15.125:0/4124332880 >> v1:172.21.15.184:6789/0 conn(0x7f216006f450 legacy=0x7f2160069fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:35.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.546+0000 7f2165606700 1 -- 172.21.15.125:0/4124332880 >> v1:172.21.15.125:6789/0 conn(0x7f216015cdb0 legacy=0x7f21600caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:35.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.546+0000 7f2165606700 1 -- 172.21.15.125:0/4124332880 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2160070420 con 0x7f216006a6c0 2023-10-17T06:22:35.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.546+0000 7f2165606700 1 --2- 172.21.15.125:0/4124332880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216006a6c0 0x7f21600cee30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2158009dc0 tx=0x7f215800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbba5aa9a047077d server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:35.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.546+0000 7f215f7fe700 1 -- 172.21.15.125:0/4124332880 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215800e070 con 0x7f216006a6c0 2023-10-17T06:22:35.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.546+0000 7f215f7fe700 1 -- 172.21.15.125:0/4124332880 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215800bb20 con 0x7f216006a6c0 2023-10-17T06:22:35.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.546+0000 7f215f7fe700 1 -- 172.21.15.125:0/4124332880 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158012430 con 0x7f216006a6c0 2023-10-17T06:22:35.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.546+0000 7f2165e07700 1 -- 172.21.15.125:0/4124332880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216006a6c0 msgr2=0x7f21600cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:35.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.546+0000 7f2165e07700 1 --2- 172.21.15.125:0/4124332880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216006a6c0 0x7f21600cee30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2158009dc0 tx=0x7f215800b330 comp rx=0 tx=0).stop 2023-10-17T06:22:35.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.546+0000 7f2165e07700 1 -- 172.21.15.125:0/4124332880 shutdown_connections 2023-10-17T06:22:35.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.546+0000 7f2165e07700 1 --2- 172.21.15.125:0/4124332880 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216006a6c0 0x7f21600cee30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:35.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.546+0000 7f2165e07700 1 -- 172.21.15.125:0/4124332880 >> 172.21.15.125:0/4124332880 conn(0x7f21600cd240 msgr2=0x7f21600cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:35.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.546+0000 7f2165e07700 1 -- 172.21.15.125:0/4124332880 shutdown_connections 2023-10-17T06:22:35.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.546+0000 7f2165e07700 1 -- 172.21.15.125:0/4124332880 wait complete. 2023-10-17T06:22:35.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.550+0000 7f2165e07700 1 Processor -- start 2023-10-17T06:22:35.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.550+0000 7f2165e07700 1 -- start start 2023-10-17T06:22:35.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.550+0000 7f2165e07700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f216006a6c0 0x7f21601f1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:35.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.550+0000 7f2165e07700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216006f450 0x7f21600c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:35.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.550+0000 7f2165e07700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f216015cdb0 0x7f21600c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:35.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.550+0000 7f2165e07700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21600b1ef0 con 0x7f216006a6c0 2023-10-17T06:22:35.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.550+0000 7f2165e07700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21600c6f50 con 0x7f216015cdb0 2023-10-17T06:22:35.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.550+0000 7f2165e07700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21600b1370 con 0x7f216006f450 2023-10-17T06:22:35.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.550+0000 7f2164e05700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f216006a6c0 0x7f21601f1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:35.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.550+0000 7f2164e05700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f216006a6c0 0x7f21601f1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50164/0 (socket says 172.21.15.125:50164) 2023-10-17T06:22:35.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.550+0000 7f2164e05700 1 -- 172.21.15.125:0/3456478069 learned_addr learned my addr 172.21.15.125:0/3456478069 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:35.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.550+0000 7f215ffff700 1 --2- 172.21.15.125:0/3456478069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216006f450 0x7f21600c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:35.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.550+0000 7f2165606700 1 --2- 172.21.15.125:0/3456478069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f216015cdb0 0x7f21600c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:35.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.550+0000 7f2164e05700 1 -- 172.21.15.125:0/3456478069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216006f450 msgr2=0x7f21600c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:35.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.550+0000 7f2164e05700 1 --2- 172.21.15.125:0/3456478069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216006f450 0x7f21600c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:35.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.550+0000 7f2164e05700 1 -- 172.21.15.125:0/3456478069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f216015cdb0 msgr2=0x7f21600c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:35.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.550+0000 7f2164e05700 1 --2- 172.21.15.125:0/3456478069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f216015cdb0 0x7f21600c6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:35.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.550+0000 7f2164e05700 1 -- 172.21.15.125:0/3456478069 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2158009a70 con 0x7f216006a6c0 2023-10-17T06:22:35.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.550+0000 7f2165606700 1 --2- 172.21.15.125:0/3456478069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f216015cdb0 0x7f21600c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:22:35.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.550+0000 7f2164e05700 1 --2- 172.21.15.125:0/3456478069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f216006a6c0 0x7f21601f1c60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f215400c5b0 tx=0x7f215400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:35.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.554+0000 7f215d7fa700 1 -- 172.21.15.125:0/3456478069 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2154005d90 con 0x7f216006a6c0 2023-10-17T06:22:35.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.554+0000 7f215d7fa700 1 -- 172.21.15.125:0/3456478069 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21540070d0 con 0x7f216006a6c0 2023-10-17T06:22:35.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.554+0000 7f2165e07700 1 -- 172.21.15.125:0/3456478069 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21600b1650 con 0x7f216006a6c0 2023-10-17T06:22:35.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.554+0000 7f215d7fa700 1 -- 172.21.15.125:0/3456478069 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2154007460 con 0x7f216006a6c0 2023-10-17T06:22:35.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.554+0000 7f2165e07700 1 -- 172.21.15.125:0/3456478069 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21600b1c10 con 0x7f216006a6c0 2023-10-17T06:22:35.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.554+0000 7f2165e07700 1 -- 172.21.15.125:0/3456478069 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21600cac60 con 0x7f216006a6c0 2023-10-17T06:22:35.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.554+0000 7f215d7fa700 1 -- 172.21.15.125:0/3456478069 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f21540075c0 con 0x7f216006a6c0 2023-10-17T06:22:35.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.558+0000 7f215d7fa700 1 --2- 172.21.15.125:0/3456478069 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f21440656f0 0x7f2144067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:35.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.558+0000 7f215d7fa700 1 -- 172.21.15.125:0/3456478069 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f2154082460 con 0x7f216006a6c0 2023-10-17T06:22:35.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.558+0000 7f215ffff700 1 --2- 172.21.15.125:0/3456478069 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f21440656f0 0x7f2144067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:35.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.558+0000 7f215ffff700 1 --2- 172.21.15.125:0/3456478069 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f21440656f0 0x7f2144067bb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f214c001710 tx=0x7f214c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:35.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.562+0000 7f215d7fa700 1 -- 172.21.15.125:0/3456478069 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f215404fe00 con 0x7f216006a6c0 2023-10-17T06:22:35.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.754+0000 7f2165e07700 1 -- 172.21.15.125:0/3456478069 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2160072e60 con 0x7f216006a6c0 2023-10-17T06:22:35.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.754+0000 7f215d7fa700 1 -- 172.21.15.125:0/3456478069 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+18788 (secure 0 0 0) 0x7f2154053420 con 0x7f216006a6c0 2023-10-17T06:22:35.762 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:22:35.762 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":55,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:16:02.394779+0000","last_up_change":"2023-10-17T06:16:01.390745+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:08:48.973490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-17T06:08:50.385778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":50,"up_from":54,"up_thru":54,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6801","nonce":1353754211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6803","nonce":1353754211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6807","nonce":1353754211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6805","nonce":1353754211}]},"public_addr":"172.21.15.125:6801/1353754211","cluster_addr":"172.21.15.125:6803/1353754211","heartbeat_back_addr":"172.21.15.125:6807/1353754211","heartbeat_front_addr":"172.21.15.125:6805/1353754211","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"2023-10-17T06:09:26.602656+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":51},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.12","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:0/3775054255":"2023-10-17T07:15:56.011706+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:22:35.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.758+0000 7f2165e07700 1 -- 172.21.15.125:0/3456478069 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f21440656f0 msgr2=0x7f2144067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:35.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.758+0000 7f2165e07700 1 --2- 172.21.15.125:0/3456478069 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f21440656f0 0x7f2144067bb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f214c001710 tx=0x7f214c009040 comp rx=0 tx=0).stop 2023-10-17T06:22:35.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.758+0000 7f2165e07700 1 -- 172.21.15.125:0/3456478069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f216006a6c0 msgr2=0x7f21601f1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:35.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.758+0000 7f2165e07700 1 --2- 172.21.15.125:0/3456478069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f216006a6c0 0x7f21601f1c60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f215400c5b0 tx=0x7f215400c970 comp rx=0 tx=0).stop 2023-10-17T06:22:35.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.758+0000 7f2165e07700 1 -- 172.21.15.125:0/3456478069 shutdown_connections 2023-10-17T06:22:35.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.758+0000 7f2165e07700 1 --2- 172.21.15.125:0/3456478069 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f21440656f0 0x7f2144067bb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:35.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.758+0000 7f2165e07700 1 --2- 172.21.15.125:0/3456478069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f216015cdb0 0x7f21600c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:35.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.758+0000 7f2165e07700 1 --2- 172.21.15.125:0/3456478069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f216006f450 0x7f21600c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:35.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.758+0000 7f2165e07700 1 --2- 172.21.15.125:0/3456478069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f216006a6c0 0x7f21601f1c60 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:35.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.758+0000 7f2165e07700 1 -- 172.21.15.125:0/3456478069 >> 172.21.15.125:0/3456478069 conn(0x7f21600cd240 msgr2=0x7f216015a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:35.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.758+0000 7f2165e07700 1 -- 172.21.15.125:0/3456478069 shutdown_connections 2023-10-17T06:22:35.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.758+0000 7f2165e07700 1 -- 172.21.15.125:0/3456478069 wait complete. 2023-10-17T06:22:35.785 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-17T06:08:48.973490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-17T06:08:50.385778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-17T06:22:35.786 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:22:35.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.974+0000 7f53df2d6700 1 Processor -- start 2023-10-17T06:22:35.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.974+0000 7f53df2d6700 1 -- start start 2023-10-17T06:22:35.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.974+0000 7f53df2d6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f53d8159310 0x7f53d80cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:35.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.974+0000 7f53df2d6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53d80ce360 0x7f53d806f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:35.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.978+0000 7f53df2d6700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d80cb250 con 0x7f53d806fd90 2023-10-17T06:22:35.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.978+0000 7f53df2d6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d81596f0 con 0x7f53d8159310 2023-10-17T06:22:35.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.978+0000 7f53df2d6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80cb530 con 0x7f53d80ce360 2023-10-17T06:22:35.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.978+0000 7f53dd072700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f53d8159310 0x7f53d80cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:35.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.978+0000 7f53dd072700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f53d8159310 0x7f53d80cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50170/0 (socket says 172.21.15.125:50170) 2023-10-17T06:22:35.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.978+0000 7f53dd072700 1 -- 172.21.15.125:0/884838808 learned_addr learned my addr 172.21.15.125:0/884838808 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:35.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.978+0000 7f53dc871700 1 --2- 172.21.15.125:0/884838808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53d80ce360 0x7f53d806f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:35.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.978+0000 7f53dd072700 1 -- 172.21.15.125:0/884838808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53d80ce360 msgr2=0x7f53d806f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:35.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.978+0000 7f53dd072700 1 --2- 172.21.15.125:0/884838808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53d80ce360 0x7f53d806f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:35.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.978+0000 7f53dd072700 1 -- 172.21.15.125:0/884838808 >> v1:172.21.15.184:6789/0 conn(0x7f53d806fd90 legacy=0x7f53d8069d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:35.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.978+0000 7f53dd072700 1 -- 172.21.15.125:0/884838808 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d80cd340 con 0x7f53d8159310 2023-10-17T06:22:35.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.978+0000 7f53dd072700 1 --2- 172.21.15.125:0/884838808 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53d8159310 0x7f53d80cde20 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f53d4006fd0 tx=0x7f53d400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b6595e0273523b server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:35.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.982+0000 7f53cffff700 1 -- 172.21.15.125:0/884838808 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d400dc20 con 0x7f53d8159310 2023-10-17T06:22:35.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.982+0000 7f53cffff700 1 -- 172.21.15.125:0/884838808 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d400dd80 con 0x7f53d8159310 2023-10-17T06:22:35.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.982+0000 7f53cffff700 1 -- 172.21.15.125:0/884838808 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4004250 con 0x7f53d8159310 2023-10-17T06:22:35.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.982+0000 7f53df2d6700 1 -- 172.21.15.125:0/884838808 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53d8159310 msgr2=0x7f53d80cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:35.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.982+0000 7f53df2d6700 1 --2- 172.21.15.125:0/884838808 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53d8159310 0x7f53d80cde20 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f53d4006fd0 tx=0x7f53d400bea0 comp rx=0 tx=0).stop 2023-10-17T06:22:35.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.982+0000 7f53df2d6700 1 -- 172.21.15.125:0/884838808 shutdown_connections 2023-10-17T06:22:35.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.982+0000 7f53df2d6700 1 --2- 172.21.15.125:0/884838808 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53d80ce360 0x7f53d806f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:35.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.982+0000 7f53df2d6700 1 --2- 172.21.15.125:0/884838808 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53d8159310 0x7f53d80cde20 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:35.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.982+0000 7f53df2d6700 1 -- 172.21.15.125:0/884838808 >> 172.21.15.125:0/884838808 conn(0x7f53d80cbb10 msgr2=0x7f53d80cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:35.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.982+0000 7f53df2d6700 1 -- 172.21.15.125:0/884838808 shutdown_connections 2023-10-17T06:22:35.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.982+0000 7f53df2d6700 1 -- 172.21.15.125:0/884838808 wait complete. 2023-10-17T06:22:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.986+0000 7f53df2d6700 1 Processor -- start 2023-10-17T06:22:35.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.986+0000 7f53df2d6700 1 -- start start 2023-10-17T06:22:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53df2d6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53d806fd90 0x7f53d80b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53df2d6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53d80ce360 0x7f53d80b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:35.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53df2d6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53d8159310 0x7f53d814efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:35.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53df2d6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80afc20 con 0x7f53d806fd90 2023-10-17T06:22:35.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53df2d6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80af2a0 con 0x7f53d8159310 2023-10-17T06:22:35.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53df2d6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80c54c0 con 0x7f53d80ce360 2023-10-17T06:22:35.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53dd072700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53d806fd90 0x7f53d80b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:35.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53dd072700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53d806fd90 0x7f53d80b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50176/0 (socket says 172.21.15.125:50176) 2023-10-17T06:22:35.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53dd072700 1 -- 172.21.15.125:0/3499111211 learned_addr learned my addr 172.21.15.125:0/3499111211 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:35.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53dc871700 1 --2- 172.21.15.125:0/3499111211 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53d80ce360 0x7f53d80b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:35.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53dd873700 1 --2- 172.21.15.125:0/3499111211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53d8159310 0x7f53d814efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:35.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53dd072700 1 -- 172.21.15.125:0/3499111211 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53d80ce360 msgr2=0x7f53d80b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:35.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53dd072700 1 --2- 172.21.15.125:0/3499111211 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53d80ce360 0x7f53d80b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:35.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53dd072700 1 -- 172.21.15.125:0/3499111211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53d8159310 msgr2=0x7f53d814efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:35.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53dd072700 1 --2- 172.21.15.125:0/3499111211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53d8159310 0x7f53d814efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:35.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53dd072700 1 -- 172.21.15.125:0/3499111211 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d400b820 con 0x7f53d806fd90 2023-10-17T06:22:36.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53dd072700 1 --2- 172.21.15.125:0/3499111211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53d806fd90 0x7f53d80b4980 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f53d4019040 tx=0x7f53d4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:36.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53cdffb700 1 -- 172.21.15.125:0/3499111211 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4004610 con 0x7f53d806fd90 2023-10-17T06:22:36.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53cdffb700 1 -- 172.21.15.125:0/3499111211 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d4003e40 con 0x7f53d806fd90 2023-10-17T06:22:36.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53df2d6700 1 -- 172.21.15.125:0/3499111211 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d80af560 con 0x7f53d806fd90 2023-10-17T06:22:36.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53cdffb700 1 -- 172.21.15.125:0/3499111211 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4021450 con 0x7f53d806fd90 2023-10-17T06:22:36.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.990+0000 7f53df2d6700 1 -- 172.21.15.125:0/3499111211 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d80b2460 con 0x7f53d806fd90 2023-10-17T06:22:36.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.994+0000 7f53df2d6700 1 -- 172.21.15.125:0/3499111211 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d80cd8e0 con 0x7f53d806fd90 2023-10-17T06:22:36.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.994+0000 7f53cdffb700 1 -- 172.21.15.125:0/3499111211 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f53d4015070 con 0x7f53d806fd90 2023-10-17T06:22:36.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.998+0000 7f53cdffb700 1 --2- 172.21.15.125:0/3499111211 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f53bc0656f0 0x7f53bc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:36.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.998+0000 7f53cdffb700 1 -- 172.21.15.125:0/3499111211 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f53d4086dc0 con 0x7f53d806fd90 2023-10-17T06:22:36.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.998+0000 7f53dc871700 1 --2- 172.21.15.125:0/3499111211 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f53bc0656f0 0x7f53bc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:36.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:35.998+0000 7f53dc871700 1 --2- 172.21.15.125:0/3499111211 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f53bc0656f0 0x7f53bc067bb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f53d80b1ad0 tx=0x7f53c8009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:36.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.002+0000 7f53cdffb700 1 -- 172.21.15.125:0/3499111211 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f53d80cd8e0 con 0x7f53d806fd90 2023-10-17T06:22:36.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.178+0000 7f53df2d6700 1 -- 172.21.15.125:0/3499111211 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53d80cd8e0 con 0x7f53d806fd90 2023-10-17T06:22:36.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.178+0000 7f53cdffb700 1 -- 172.21.15.125:0/3499111211 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53d80cd8e0 con 0x7f53d806fd90 2023-10-17T06:22:36.185 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:22:36.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.182+0000 7f53df2d6700 1 -- 172.21.15.125:0/3499111211 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f53bc0656f0 msgr2=0x7f53bc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:36.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.182+0000 7f53df2d6700 1 --2- 172.21.15.125:0/3499111211 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f53bc0656f0 0x7f53bc067bb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f53d80b1ad0 tx=0x7f53c8009240 comp rx=0 tx=0).stop 2023-10-17T06:22:36.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.182+0000 7f53df2d6700 1 -- 172.21.15.125:0/3499111211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53d806fd90 msgr2=0x7f53d80b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:36.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.182+0000 7f53df2d6700 1 --2- 172.21.15.125:0/3499111211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53d806fd90 0x7f53d80b4980 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f53d4019040 tx=0x7f53d4004770 comp rx=0 tx=0).stop 2023-10-17T06:22:36.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.182+0000 7f53df2d6700 1 -- 172.21.15.125:0/3499111211 shutdown_connections 2023-10-17T06:22:36.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.182+0000 7f53df2d6700 1 --2- 172.21.15.125:0/3499111211 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f53bc0656f0 0x7f53bc067bb0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:36.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.182+0000 7f53df2d6700 1 --2- 172.21.15.125:0/3499111211 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53d8159310 0x7f53d814efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:36.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.182+0000 7f53df2d6700 1 --2- 172.21.15.125:0/3499111211 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f53d80ce360 0x7f53d80b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:36.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.182+0000 7f53df2d6700 1 --2- 172.21.15.125:0/3499111211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f53d806fd90 0x7f53d80b4980 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:36.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.182+0000 7f53df2d6700 1 -- 172.21.15.125:0/3499111211 >> 172.21.15.125:0/3499111211 conn(0x7f53d80cbb10 msgr2=0x7f53d80c80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:36.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.182+0000 7f53df2d6700 1 -- 172.21.15.125:0/3499111211 shutdown_connections 2023-10-17T06:22:36.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.182+0000 7f53df2d6700 1 -- 172.21.15.125:0/3499111211 wait complete. 2023-10-17T06:22:36.209 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:22:36.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.390+0000 7f83792b5700 1 Processor -- start 2023-10-17T06:22:36.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.390+0000 7f83792b5700 1 -- start start 2023-10-17T06:22:36.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.390+0000 7f83792b5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83740b5b80 0x7f837415d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:36.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.390+0000 7f83792b5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8374146ba0 con 0x7f837406f9a0 2023-10-17T06:22:36.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.390+0000 7f83792b5700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83740d0920 con 0x7f83741467c0 2023-10-17T06:22:36.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.390+0000 7f83792b5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83740b6160 con 0x7f83740b5b80 2023-10-17T06:22:36.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.394+0000 7f83727fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83740b5b80 0x7f837415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:36.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.394+0000 7f83727fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83740b5b80 0x7f837415d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50186/0 (socket says 172.21.15.125:50186) 2023-10-17T06:22:36.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.394+0000 7f83727fc700 1 -- 172.21.15.125:0/2945585224 learned_addr learned my addr 172.21.15.125:0/2945585224 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:36.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.394+0000 7f83727fc700 1 -- 172.21.15.125:0/2945585224 >> v1:172.21.15.184:6789/0 conn(0x7f83741467c0 legacy=0x7f83741612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:36.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.394+0000 7f83727fc700 1 -- 172.21.15.125:0/2945585224 >> v1:172.21.15.125:6789/0 conn(0x7f837406f9a0 legacy=0x7f83740d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:36.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.394+0000 7f83727fc700 1 -- 172.21.15.125:0/2945585224 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83740b6440 con 0x7f83740b5b80 2023-10-17T06:22:36.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.394+0000 7f83727fc700 1 --2- 172.21.15.125:0/2945585224 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83740b5b80 0x7f837415d310 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8368009910 tx=0x7f8368009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fdf411ad4f2516 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:36.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.394+0000 7f8371ffb700 1 -- 172.21.15.125:0/2945585224 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836800ba60 con 0x7f83740b5b80 2023-10-17T06:22:36.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.394+0000 7f8371ffb700 1 -- 172.21.15.125:0/2945585224 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836800bbc0 con 0x7f83740b5b80 2023-10-17T06:22:36.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.394+0000 7f8371ffb700 1 -- 172.21.15.125:0/2945585224 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368009e60 con 0x7f83740b5b80 2023-10-17T06:22:36.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.394+0000 7f83792b5700 1 -- 172.21.15.125:0/2945585224 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83740b5b80 msgr2=0x7f837415d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:36.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.394+0000 7f83792b5700 1 --2- 172.21.15.125:0/2945585224 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83740b5b80 0x7f837415d310 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8368009910 tx=0x7f8368009c20 comp rx=0 tx=0).stop 2023-10-17T06:22:36.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.394+0000 7f83792b5700 1 -- 172.21.15.125:0/2945585224 shutdown_connections 2023-10-17T06:22:36.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.394+0000 7f83792b5700 1 --2- 172.21.15.125:0/2945585224 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83740b5b80 0x7f837415d310 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:36.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.394+0000 7f83792b5700 1 -- 172.21.15.125:0/2945585224 >> 172.21.15.125:0/2945585224 conn(0x7f837406a130 msgr2=0x7f837406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:36.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.394+0000 7f83792b5700 1 -- 172.21.15.125:0/2945585224 shutdown_connections 2023-10-17T06:22:36.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.394+0000 7f83792b5700 1 -- 172.21.15.125:0/2945585224 wait complete. 2023-10-17T06:22:36.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.398+0000 7f83792b5700 1 Processor -- start 2023-10-17T06:22:36.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.398+0000 7f83792b5700 1 -- start start 2023-10-17T06:22:36.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.398+0000 7f83792b5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f837406f9a0 0x7f837414fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:36.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.398+0000 7f83792b5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f83740b5b80 0x7f837413fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:36.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.398+0000 7f83792b5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83741467c0 0x7f837413d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:36.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.398+0000 7f83792b5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83741403c0 con 0x7f837406f9a0 2023-10-17T06:22:36.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.398+0000 7f83792b5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8374140620 con 0x7f83741467c0 2023-10-17T06:22:36.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.398+0000 7f83792b5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8374140900 con 0x7f83740b5b80 2023-10-17T06:22:36.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.398+0000 7f8372ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f837406f9a0 0x7f837414fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:36.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.398+0000 7f8372ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f837406f9a0 0x7f837414fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50198/0 (socket says 172.21.15.125:50198) 2023-10-17T06:22:36.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.398+0000 7f8372ffd700 1 -- 172.21.15.125:0/3718403415 learned_addr learned my addr 172.21.15.125:0/3718403415 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:36.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.398+0000 7f83737fe700 1 --2- 172.21.15.125:0/3718403415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83741467c0 0x7f837413d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:36.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.398+0000 7f83727fc700 1 --2- 172.21.15.125:0/3718403415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f83740b5b80 0x7f837413fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:36.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.402+0000 7f8372ffd700 1 -- 172.21.15.125:0/3718403415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f83740b5b80 msgr2=0x7f837413fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:36.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.402+0000 7f8372ffd700 1 --2- 172.21.15.125:0/3718403415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f83740b5b80 0x7f837413fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:36.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.402+0000 7f8372ffd700 1 -- 172.21.15.125:0/3718403415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83741467c0 msgr2=0x7f837413d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:36.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.402+0000 7f8372ffd700 1 --2- 172.21.15.125:0/3718403415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83741467c0 0x7f837413d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:36.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.402+0000 7f8372ffd700 1 -- 172.21.15.125:0/3718403415 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8368009570 con 0x7f837406f9a0 2023-10-17T06:22:36.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.402+0000 7f8372ffd700 1 --2- 172.21.15.125:0/3718403415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f837406f9a0 0x7f837414fcd0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f836400c500 tx=0x7f836400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:36.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.402+0000 7f835b7fe700 1 -- 172.21.15.125:0/3718403415 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83640052d0 con 0x7f837406f9a0 2023-10-17T06:22:36.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.402+0000 7f835b7fe700 1 -- 172.21.15.125:0/3718403415 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8364005430 con 0x7f837406f9a0 2023-10-17T06:22:36.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.402+0000 7f835b7fe700 1 -- 172.21.15.125:0/3718403415 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83640055a0 con 0x7f837406f9a0 2023-10-17T06:22:36.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.402+0000 7f83792b5700 1 -- 172.21.15.125:0/3718403415 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8374140be0 con 0x7f837406f9a0 2023-10-17T06:22:36.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.402+0000 7f83792b5700 1 -- 172.21.15.125:0/3718403415 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83741411a0 con 0x7f837406f9a0 2023-10-17T06:22:36.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.402+0000 7f83792b5700 1 -- 172.21.15.125:0/3718403415 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8374072e60 con 0x7f837406f9a0 2023-10-17T06:22:36.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.406+0000 7f835b7fe700 1 -- 172.21.15.125:0/3718403415 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f83640038e0 con 0x7f837406f9a0 2023-10-17T06:22:36.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.406+0000 7f835b7fe700 1 --2- 172.21.15.125:0/3718403415 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f83600656f0 0x7f8360067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:36.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.406+0000 7f835b7fe700 1 -- 172.21.15.125:0/3718403415 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f83640822e0 con 0x7f837406f9a0 2023-10-17T06:22:36.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.406+0000 7f83727fc700 1 --2- 172.21.15.125:0/3718403415 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f83600656f0 0x7f8360067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:36.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.406+0000 7f83727fc700 1 --2- 172.21.15.125:0/3718403415 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f83600656f0 0x7f8360067bb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8368006f80 tx=0x7f8368008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:36.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.410+0000 7f835b7fe700 1 -- 172.21.15.125:0/3718403415 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f836404fbe0 con 0x7f837406f9a0 2023-10-17T06:22:36.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.594+0000 7f83792b5700 1 -- 172.21.15.125:0/3718403415 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f837414d0e0 con 0x7f837406f9a0 2023-10-17T06:22:36.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.594+0000 7f835b7fe700 1 -- 172.21.15.125:0/3718403415 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v55) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8364053200 con 0x7f837406f9a0 2023-10-17T06:22:36.600 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:22:36.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.594+0000 7f83792b5700 1 -- 172.21.15.125:0/3718403415 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f83600656f0 msgr2=0x7f8360067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:36.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.594+0000 7f83792b5700 1 --2- 172.21.15.125:0/3718403415 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f83600656f0 0x7f8360067bb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8368006f80 tx=0x7f8368008030 comp rx=0 tx=0).stop 2023-10-17T06:22:36.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.594+0000 7f83792b5700 1 -- 172.21.15.125:0/3718403415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f837406f9a0 msgr2=0x7f837414fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:36.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.594+0000 7f83792b5700 1 --2- 172.21.15.125:0/3718403415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f837406f9a0 0x7f837414fcd0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f836400c500 tx=0x7f836400c810 comp rx=0 tx=0).stop 2023-10-17T06:22:36.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.598+0000 7f83792b5700 1 -- 172.21.15.125:0/3718403415 shutdown_connections 2023-10-17T06:22:36.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.598+0000 7f83792b5700 1 --2- 172.21.15.125:0/3718403415 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f83600656f0 0x7f8360067bb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:36.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.598+0000 7f83792b5700 1 --2- 172.21.15.125:0/3718403415 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83741467c0 0x7f837413d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:36.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.598+0000 7f83792b5700 1 --2- 172.21.15.125:0/3718403415 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f83740b5b80 0x7f837413fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:36.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.598+0000 7f83792b5700 1 --2- 172.21.15.125:0/3718403415 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f837406f9a0 0x7f837414fcd0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:36.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.598+0000 7f83792b5700 1 -- 172.21.15.125:0/3718403415 >> 172.21.15.125:0/3718403415 conn(0x7f837406a130 msgr2=0x7f837406e830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:36.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.598+0000 7f83792b5700 1 -- 172.21.15.125:0/3718403415 shutdown_connections 2023-10-17T06:22:36.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.598+0000 7f83792b5700 1 -- 172.21.15.125:0/3718403415 wait complete. 2023-10-17T06:22:36.624 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-17T06:22:36.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.794+0000 7f3929b70700 1 Processor -- start 2023-10-17T06:22:36.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.794+0000 7f3929b70700 1 -- start start 2023-10-17T06:22:36.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.794+0000 7f3929b70700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f39240d2e00 0x7f39240b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:36.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.794+0000 7f3929b70700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f39240b5ae0 0x7f392406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:36.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.794+0000 7f3929b70700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392415d0d0 con 0x7f3924160710 2023-10-17T06:22:36.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.794+0000 7f3929b70700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392415df90 con 0x7f39240d2e00 2023-10-17T06:22:36.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.794+0000 7f3929b70700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392406f0f0 con 0x7f39240b5ae0 2023-10-17T06:22:36.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.794+0000 7f3923fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3924160710 0x7f39240d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:60250/0 (socket says 172.21.15.125:60250) 2023-10-17T06:22:36.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.794+0000 7f3923fff700 1 -- 172.21.15.125:0/3578124328 learned_addr learned my addr 172.21.15.125:0/3578124328 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:22:36.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.794+0000 7f3928b6e700 1 --2- 172.21.15.125:0/3578124328 >> v2:172.21.15.125:3300/0 conn(0x7f39240d2e00 0x7f39240b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:36.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.794+0000 7f392936f700 1 --2- 172.21.15.125:0/3578124328 >> v2:172.21.15.184:3300/0 conn(0x7f39240b5ae0 0x7f392406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:36.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.798+0000 7f3928b6e700 1 -- 172.21.15.125:0/3578124328 >> v2:172.21.15.184:3300/0 conn(0x7f39240b5ae0 msgr2=0x7f392406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:36.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.798+0000 7f3928b6e700 1 --2- 172.21.15.125:0/3578124328 >> v2:172.21.15.184:3300/0 conn(0x7f39240b5ae0 0x7f392406db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:36.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.798+0000 7f3928b6e700 1 -- 172.21.15.125:0/3578124328 >> v1:172.21.15.125:6789/0 conn(0x7f3924160710 legacy=0x7f39240d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:36.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.798+0000 7f3928b6e700 1 -- 172.21.15.125:0/3578124328 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392415d310 con 0x7f39240d2e00 2023-10-17T06:22:36.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.798+0000 7f3928b6e700 1 --2- 172.21.15.125:0/3578124328 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39240d2e00 0x7f39240b6e00 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f392406d040 tx=0x7f3918009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5789cbfcd29e49 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:36.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.798+0000 7f39237fe700 1 -- 172.21.15.125:0/3578124328 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918011830 con 0x7f39240d2e00 2023-10-17T06:22:36.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.798+0000 7f39237fe700 1 -- 172.21.15.125:0/3578124328 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3918011990 con 0x7f39240d2e00 2023-10-17T06:22:36.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.798+0000 7f39237fe700 1 -- 172.21.15.125:0/3578124328 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918011d40 con 0x7f39240d2e00 2023-10-17T06:22:36.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.798+0000 7f3929b70700 1 -- 172.21.15.125:0/3578124328 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39240d2e00 msgr2=0x7f39240b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:36.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.798+0000 7f3929b70700 1 --2- 172.21.15.125:0/3578124328 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39240d2e00 0x7f39240b6e00 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f392406d040 tx=0x7f3918009b30 comp rx=0 tx=0).stop 2023-10-17T06:22:36.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.798+0000 7f3929b70700 1 -- 172.21.15.125:0/3578124328 shutdown_connections 2023-10-17T06:22:36.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.798+0000 7f3929b70700 1 --2- 172.21.15.125:0/3578124328 >> v2:172.21.15.184:3300/0 conn(0x7f39240b5ae0 0x7f392406db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:36.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.798+0000 7f3929b70700 1 --2- 172.21.15.125:0/3578124328 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39240d2e00 0x7f39240b6e00 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:36.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.798+0000 7f3929b70700 1 -- 172.21.15.125:0/3578124328 >> 172.21.15.125:0/3578124328 conn(0x7f3924069f20 msgr2=0x7f392406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:36.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.798+0000 7f3929b70700 1 -- 172.21.15.125:0/3578124328 shutdown_connections 2023-10-17T06:22:36.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.798+0000 7f3929b70700 1 -- 172.21.15.125:0/3578124328 wait complete. 2023-10-17T06:22:36.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.802+0000 7f3929b70700 1 Processor -- start 2023-10-17T06:22:36.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.802+0000 7f3929b70700 1 -- start start 2023-10-17T06:22:36.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.802+0000 7f3929b70700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39240b5ae0 0x7f3924151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:36.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.802+0000 7f3929b70700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39240d2e00 0x7f392415b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:36.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.802+0000 7f3929b70700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3924160710 0x7f392415bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:36.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.802+0000 7f3929b70700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39241548a0 con 0x7f3924160710 2023-10-17T06:22:36.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.802+0000 7f3929b70700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392415a0b0 con 0x7f39240d2e00 2023-10-17T06:22:36.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.802+0000 7f3929b70700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39241f3210 con 0x7f39240b5ae0 2023-10-17T06:22:36.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.802+0000 7f392936f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3924160710 0x7f392415bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:36.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.802+0000 7f392936f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3924160710 0x7f392415bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50206/0 (socket says 172.21.15.125:50206) 2023-10-17T06:22:36.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.802+0000 7f392936f700 1 -- 172.21.15.125:0/1433411348 learned_addr learned my addr 172.21.15.125:0/1433411348 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:36.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.802+0000 7f3928b6e700 1 --2- 172.21.15.125:0/1433411348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39240b5ae0 0x7f3924151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:36.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.802+0000 7f3923fff700 1 --2- 172.21.15.125:0/1433411348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39240d2e00 0x7f392415b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:36.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.802+0000 7f392936f700 1 -- 172.21.15.125:0/1433411348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39240b5ae0 msgr2=0x7f3924151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:36.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.802+0000 7f392936f700 1 --2- 172.21.15.125:0/1433411348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39240b5ae0 0x7f3924151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:36.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.802+0000 7f392936f700 1 -- 172.21.15.125:0/1433411348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39240d2e00 msgr2=0x7f392415b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:36.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.802+0000 7f392936f700 1 --2- 172.21.15.125:0/1433411348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39240d2e00 0x7f392415b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:36.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.802+0000 7f392936f700 1 -- 172.21.15.125:0/1433411348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39180094b0 con 0x7f3924160710 2023-10-17T06:22:36.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.802+0000 7f3928b6e700 1 --2- 172.21.15.125:0/1433411348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39240b5ae0 0x7f3924151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:22:36.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.802+0000 7f392936f700 1 --2- 172.21.15.125:0/1433411348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3924160710 0x7f392415bdb0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f391c007e60 tx=0x7f391c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:36.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.806+0000 7f39217fa700 1 -- 172.21.15.125:0/1433411348 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c00ede0 con 0x7f3924160710 2023-10-17T06:22:36.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.806+0000 7f39217fa700 1 -- 172.21.15.125:0/1433411348 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c014420 con 0x7f3924160710 2023-10-17T06:22:36.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.806+0000 7f3929b70700 1 -- 172.21.15.125:0/1433411348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392415a300 con 0x7f3924160710 2023-10-17T06:22:36.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.806+0000 7f39217fa700 1 -- 172.21.15.125:0/1433411348 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c0147d0 con 0x7f3924160710 2023-10-17T06:22:36.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.806+0000 7f3929b70700 1 -- 172.21.15.125:0/1433411348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392415a8c0 con 0x7f3924160710 2023-10-17T06:22:36.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.806+0000 7f3929b70700 1 -- 172.21.15.125:0/1433411348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392404e910 con 0x7f3924160710 2023-10-17T06:22:36.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.806+0000 7f39217fa700 1 -- 172.21.15.125:0/1433411348 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f391c014930 con 0x7f3924160710 2023-10-17T06:22:36.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.810+0000 7f39217fa700 1 --2- 172.21.15.125:0/1433411348 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f39080656f0 0x7f3908067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:36.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.810+0000 7f39217fa700 1 -- 172.21.15.125:0/1433411348 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f391c006e40 con 0x7f3924160710 2023-10-17T06:22:36.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.810+0000 7f3928b6e700 1 --2- 172.21.15.125:0/1433411348 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f39080656f0 0x7f3908067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:36.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.810+0000 7f3928b6e700 1 --2- 172.21.15.125:0/1433411348 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f39080656f0 0x7f3908067bb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f39180090b0 tx=0x7f3918008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:36.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:36.818+0000 7f39217fa700 1 -- 172.21.15.125:0/1433411348 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f391c051020 con 0x7f3924160710 2023-10-17T06:22:37.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.002+0000 7f3929b70700 1 -- 172.21.15.125:0/1433411348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f392406d3e0 con 0x7f3924160710 2023-10-17T06:22:37.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.002+0000 7f39217fa700 1 -- 172.21.15.125:0/1433411348 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f391c054640 con 0x7f3924160710 2023-10-17T06:22:37.008 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:22:37.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.006+0000 7f3929b70700 1 -- 172.21.15.125:0/1433411348 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f39080656f0 msgr2=0x7f3908067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:37.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.006+0000 7f3929b70700 1 --2- 172.21.15.125:0/1433411348 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f39080656f0 0x7f3908067bb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f39180090b0 tx=0x7f3918008030 comp rx=0 tx=0).stop 2023-10-17T06:22:37.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.006+0000 7f3929b70700 1 -- 172.21.15.125:0/1433411348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3924160710 msgr2=0x7f392415bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:37.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.006+0000 7f3929b70700 1 --2- 172.21.15.125:0/1433411348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3924160710 0x7f392415bdb0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f391c007e60 tx=0x7f391c00e3c0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.006+0000 7f3929b70700 1 -- 172.21.15.125:0/1433411348 shutdown_connections 2023-10-17T06:22:37.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.006+0000 7f3929b70700 1 --2- 172.21.15.125:0/1433411348 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f39080656f0 0x7f3908067bb0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.006+0000 7f3929b70700 1 --2- 172.21.15.125:0/1433411348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3924160710 0x7f392415bdb0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.006+0000 7f3929b70700 1 --2- 172.21.15.125:0/1433411348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f39240d2e00 0x7f392415b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.006+0000 7f3929b70700 1 --2- 172.21.15.125:0/1433411348 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f39240b5ae0 0x7f3924151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.006+0000 7f3929b70700 1 -- 172.21.15.125:0/1433411348 >> 172.21.15.125:0/1433411348 conn(0x7f3924069f20 msgr2=0x7f392406f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:37.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.006+0000 7f3929b70700 1 -- 172.21.15.125:0/1433411348 shutdown_connections 2023-10-17T06:22:37.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.006+0000 7f3929b70700 1 -- 172.21.15.125:0/1433411348 wait complete. 2023-10-17T06:22:37.032 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-17T06:22:37.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.214+0000 7f7aefa37700 1 Processor -- start 2023-10-17T06:22:37.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.214+0000 7f7aefa37700 1 -- start start 2023-10-17T06:22:37.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.218+0000 7f7aefa37700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ae80c1e30 0x7f7ae806f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:37.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.218+0000 7f7aefa37700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ae806ec20 0x7f7ae80c9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:37.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.218+0000 7f7aefa37700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae80cc3f0 con 0x7f7ae80cad50 2023-10-17T06:22:37.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.218+0000 7f7aefa37700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae80c2210 con 0x7f7ae80c1e30 2023-10-17T06:22:37.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.218+0000 7f7aefa37700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae806d820 con 0x7f7ae806ec20 2023-10-17T06:22:37.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.218+0000 7f7aed7d3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ae80c1e30 0x7f7ae806f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:37.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.218+0000 7f7aed7d3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7ae80c1e30 0x7f7ae806f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50222/0 (socket says 172.21.15.125:50222) 2023-10-17T06:22:37.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.218+0000 7f7aed7d3700 1 -- 172.21.15.125:0/3951213992 learned_addr learned my addr 172.21.15.125:0/3951213992 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:37.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.218+0000 7f7aedfd4700 1 --2- 172.21.15.125:0/3951213992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ae806ec20 0x7f7ae80c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:37.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.218+0000 7f7aed7d3700 1 -- 172.21.15.125:0/3951213992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ae806ec20 msgr2=0x7f7ae80c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:37.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.218+0000 7f7aed7d3700 1 --2- 172.21.15.125:0/3951213992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ae806ec20 0x7f7ae80c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.218+0000 7f7aed7d3700 1 -- 172.21.15.125:0/3951213992 >> v1:172.21.15.125:6789/0 conn(0x7f7ae80cad50 legacy=0x7f7ae806e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:37.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.218+0000 7f7aed7d3700 1 -- 172.21.15.125:0/3951213992 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae806e080 con 0x7f7ae80c1e30 2023-10-17T06:22:37.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.218+0000 7f7aed7d3700 1 --2- 172.21.15.125:0/3951213992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae80c1e30 0x7f7ae806f450 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009910 tx=0x7f7ae4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13000346ffae9caa server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:37.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.218+0000 7f7adffff700 1 -- 172.21.15.125:0/3951213992 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4011830 con 0x7f7ae80c1e30 2023-10-17T06:22:37.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.218+0000 7f7adffff700 1 -- 172.21.15.125:0/3951213992 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae4011990 con 0x7f7ae80c1e30 2023-10-17T06:22:37.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.218+0000 7f7adffff700 1 -- 172.21.15.125:0/3951213992 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4011d40 con 0x7f7ae80c1e30 2023-10-17T06:22:37.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.222+0000 7f7aefa37700 1 -- 172.21.15.125:0/3951213992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae80c1e30 msgr2=0x7f7ae806f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:37.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.222+0000 7f7aefa37700 1 --2- 172.21.15.125:0/3951213992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae80c1e30 0x7f7ae806f450 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009910 tx=0x7f7ae4009c20 comp rx=0 tx=0).stop 2023-10-17T06:22:37.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.222+0000 7f7aefa37700 1 -- 172.21.15.125:0/3951213992 shutdown_connections 2023-10-17T06:22:37.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.222+0000 7f7aefa37700 1 --2- 172.21.15.125:0/3951213992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ae806ec20 0x7f7ae80c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.222+0000 7f7aefa37700 1 --2- 172.21.15.125:0/3951213992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae80c1e30 0x7f7ae806f450 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.222+0000 7f7aefa37700 1 -- 172.21.15.125:0/3951213992 >> 172.21.15.125:0/3951213992 conn(0x7f7ae80ce820 msgr2=0x7f7ae80cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:37.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.222+0000 7f7aefa37700 1 -- 172.21.15.125:0/3951213992 shutdown_connections 2023-10-17T06:22:37.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.222+0000 7f7aefa37700 1 -- 172.21.15.125:0/3951213992 wait complete. 2023-10-17T06:22:37.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.222+0000 7f7aefa37700 1 Processor -- start 2023-10-17T06:22:37.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.222+0000 7f7aefa37700 1 -- start start 2023-10-17T06:22:37.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7aefa37700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ae806ec20 0x7f7ae8152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:37.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7aefa37700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ae80c1e30 0x7f7ae80af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:37.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7aefa37700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae80cad50 0x7f7ae80afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:37.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7aefa37700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae80bddf0 con 0x7f7ae80cad50 2023-10-17T06:22:37.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7aefa37700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae80be040 con 0x7f7ae80c1e30 2023-10-17T06:22:37.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7aefa37700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae80be320 con 0x7f7ae806ec20 2023-10-17T06:22:37.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7aedfd4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae80cad50 0x7f7ae80afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:37.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7aedfd4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae80cad50 0x7f7ae80afcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50230/0 (socket says 172.21.15.125:50230) 2023-10-17T06:22:37.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7aedfd4700 1 -- 172.21.15.125:0/424012454 learned_addr learned my addr 172.21.15.125:0/424012454 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:37.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7aecfd2700 1 --2- 172.21.15.125:0/424012454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ae80c1e30 0x7f7ae80af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:37.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7aed7d3700 1 --2- 172.21.15.125:0/424012454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ae806ec20 0x7f7ae8152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:37.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7aedfd4700 1 -- 172.21.15.125:0/424012454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ae806ec20 msgr2=0x7f7ae8152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:37.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7aedfd4700 1 --2- 172.21.15.125:0/424012454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ae806ec20 0x7f7ae8152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7aedfd4700 1 -- 172.21.15.125:0/424012454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ae80c1e30 msgr2=0x7f7ae80af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:37.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7aedfd4700 1 --2- 172.21.15.125:0/424012454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ae80c1e30 0x7f7ae80af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7aedfd4700 1 -- 172.21.15.125:0/424012454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae4009570 con 0x7f7ae80cad50 2023-10-17T06:22:37.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7aedfd4700 1 --2- 172.21.15.125:0/424012454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae80cad50 0x7f7ae80afcb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000efc0 tx=0x7f7ae000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:37.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7addffb700 1 -- 172.21.15.125:0/424012454 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0009ea0 con 0x7f7ae80cad50 2023-10-17T06:22:37.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7addffb700 1 -- 172.21.15.125:0/424012454 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae000f040 con 0x7f7ae80cad50 2023-10-17T06:22:37.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7aefa37700 1 -- 172.21.15.125:0/424012454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae80be600 con 0x7f7ae80cad50 2023-10-17T06:22:37.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.226+0000 7f7addffb700 1 -- 172.21.15.125:0/424012454 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae000ced0 con 0x7f7ae80cad50 2023-10-17T06:22:37.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.230+0000 7f7aefa37700 1 -- 172.21.15.125:0/424012454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae80bebc0 con 0x7f7ae80cad50 2023-10-17T06:22:37.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.230+0000 7f7aefa37700 1 -- 172.21.15.125:0/424012454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae80bede0 con 0x7f7ae80cad50 2023-10-17T06:22:37.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.230+0000 7f7addffb700 1 -- 172.21.15.125:0/424012454 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7ae0014480 con 0x7f7ae80cad50 2023-10-17T06:22:37.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.234+0000 7f7addffb700 1 --2- 172.21.15.125:0/424012454 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7acc0656f0 0x7f7acc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:37.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.234+0000 7f7addffb700 1 -- 172.21.15.125:0/424012454 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f7ae0083ab0 con 0x7f7ae80cad50 2023-10-17T06:22:37.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.234+0000 7f7aed7d3700 1 --2- 172.21.15.125:0/424012454 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7acc0656f0 0x7f7acc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:37.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.234+0000 7f7aed7d3700 1 --2- 172.21.15.125:0/424012454 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7acc0656f0 0x7f7acc067bb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4000c00 tx=0x7f7ae4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:37.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.238+0000 7f7addffb700 1 -- 172.21.15.125:0/424012454 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f7ae00513d0 con 0x7f7ae80cad50 2023-10-17T06:22:37.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.418+0000 7f7aefa37700 1 -- 172.21.15.125:0/424012454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7ae8072e60 con 0x7f7ae80cad50 2023-10-17T06:22:37.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.418+0000 7f7addffb700 1 -- 172.21.15.125:0/424012454 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7ae0018020 con 0x7f7ae80cad50 2023-10-17T06:22:37.426 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-17T06:22:37.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.422+0000 7f7aefa37700 1 -- 172.21.15.125:0/424012454 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7acc0656f0 msgr2=0x7f7acc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:37.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.422+0000 7f7aefa37700 1 --2- 172.21.15.125:0/424012454 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7acc0656f0 0x7f7acc067bb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4000c00 tx=0x7f7ae4008030 comp rx=0 tx=0).stop 2023-10-17T06:22:37.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.422+0000 7f7aefa37700 1 -- 172.21.15.125:0/424012454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae80cad50 msgr2=0x7f7ae80afcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:37.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.422+0000 7f7aefa37700 1 --2- 172.21.15.125:0/424012454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae80cad50 0x7f7ae80afcb0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000efc0 tx=0x7f7ae000c3a0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.422+0000 7f7aefa37700 1 -- 172.21.15.125:0/424012454 shutdown_connections 2023-10-17T06:22:37.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.422+0000 7f7aefa37700 1 --2- 172.21.15.125:0/424012454 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7acc0656f0 0x7f7acc067bb0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.422+0000 7f7aefa37700 1 --2- 172.21.15.125:0/424012454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae80cad50 0x7f7ae80afcb0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.422+0000 7f7aefa37700 1 --2- 172.21.15.125:0/424012454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7ae80c1e30 0x7f7ae80af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.422+0000 7f7aefa37700 1 --2- 172.21.15.125:0/424012454 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7ae806ec20 0x7f7ae8152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.422+0000 7f7aefa37700 1 -- 172.21.15.125:0/424012454 >> 172.21.15.125:0/424012454 conn(0x7f7ae80ce820 msgr2=0x7f7ae80cb860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:37.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.422+0000 7f7aefa37700 1 -- 172.21.15.125:0/424012454 shutdown_connections 2023-10-17T06:22:37.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.422+0000 7f7aefa37700 1 -- 172.21.15.125:0/424012454 wait complete. 2023-10-17T06:22:37.453 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-17T06:22:37.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.630+0000 7f3633964700 1 Processor -- start 2023-10-17T06:22:37.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.634+0000 7f3633964700 1 -- start start 2023-10-17T06:22:37.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.634+0000 7f3633964700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f362c0cdb60 0x7f362c0cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:37.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.634+0000 7f3633964700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f362c0cc7d0 0x7f362c0ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:37.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.634+0000 7f3633964700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362c144770 con 0x7f362c144390 2023-10-17T06:22:37.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.634+0000 7f3633964700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362c0ce530 con 0x7f362c0cdb60 2023-10-17T06:22:37.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.634+0000 7f3633964700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362c06fd40 con 0x7f362c0cc7d0 2023-10-17T06:22:37.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.634+0000 7f3631f01700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f362c0cc7d0 0x7f362c0ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:37.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.634+0000 7f3631f01700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f362c0cc7d0 0x7f362c0ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:36704/0 (socket says 172.21.15.125:36704) 2023-10-17T06:22:37.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.634+0000 7f3631f01700 1 -- 172.21.15.125:0/1653836912 learned_addr learned my addr 172.21.15.125:0/1653836912 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:37.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.634+0000 7f3630eff700 1 --2- 172.21.15.125:0/1653836912 >> v2:172.21.15.184:3300/0 conn(0x7f362c0cdb60 0x7f362c0cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:37.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.634+0000 7f3631f01700 1 -- 172.21.15.125:0/1653836912 >> v2:172.21.15.184:3300/0 conn(0x7f362c0cdb60 msgr2=0x7f362c0cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:37.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.634+0000 7f3631f01700 1 --2- 172.21.15.125:0/1653836912 >> v2:172.21.15.184:3300/0 conn(0x7f362c0cdb60 0x7f362c0cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.634+0000 7f3631f01700 1 -- 172.21.15.125:0/1653836912 >> v1:172.21.15.184:6789/0 conn(0x7f362c144390 legacy=0x7f362c0701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:37.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.634+0000 7f3631f01700 1 -- 172.21.15.125:0/1653836912 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c06f450 con 0x7f362c0cc7d0 2023-10-17T06:22:37.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.638+0000 7f3631f01700 1 --2- 172.21.15.125:0/1653836912 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f362c0cc7d0 0x7f362c0ccc60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3624009e50 tx=0x7f362400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49fb006953c52bd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:37.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.638+0000 7f3623fff700 1 -- 172.21.15.125:0/1653836912 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362400e070 con 0x7f362c0cc7d0 2023-10-17T06:22:37.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.638+0000 7f3623fff700 1 -- 172.21.15.125:0/1653836912 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362400b910 con 0x7f362c0cc7d0 2023-10-17T06:22:37.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.638+0000 7f3623fff700 1 -- 172.21.15.125:0/1653836912 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362400bcc0 con 0x7f362c0cc7d0 2023-10-17T06:22:37.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.638+0000 7f3633964700 1 -- 172.21.15.125:0/1653836912 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f362c0cc7d0 msgr2=0x7f362c0ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:37.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.638+0000 7f3633964700 1 --2- 172.21.15.125:0/1653836912 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f362c0cc7d0 0x7f362c0ccc60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3624009e50 tx=0x7f362400b330 comp rx=0 tx=0).stop 2023-10-17T06:22:37.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.638+0000 7f3633964700 1 -- 172.21.15.125:0/1653836912 shutdown_connections 2023-10-17T06:22:37.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.638+0000 7f3633964700 1 --2- 172.21.15.125:0/1653836912 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f362c0cc7d0 0x7f362c0ccc60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.638+0000 7f3633964700 1 --2- 172.21.15.125:0/1653836912 >> v2:172.21.15.184:3300/0 conn(0x7f362c0cdb60 0x7f362c0cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.638+0000 7f3633964700 1 -- 172.21.15.125:0/1653836912 >> 172.21.15.125:0/1653836912 conn(0x7f362c06a340 msgr2=0x7f362c0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:37.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.638+0000 7f3633964700 1 -- 172.21.15.125:0/1653836912 shutdown_connections 2023-10-17T06:22:37.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.638+0000 7f3633964700 1 -- 172.21.15.125:0/1653836912 wait complete. 2023-10-17T06:22:37.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.642+0000 7f3633964700 1 Processor -- start 2023-10-17T06:22:37.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.642+0000 7f3633964700 1 -- start start 2023-10-17T06:22:37.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.642+0000 7f3633964700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f362c0cc7d0 0x7f362c1f4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:37.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.642+0000 7f3633964700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f362c0cdb60 0x7f362c12db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:37.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.642+0000 7f3633964700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f362c144390 0x7f362c1ed810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:37.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.642+0000 7f3633964700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c1f4a80 con 0x7f362c144390 2023-10-17T06:22:37.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.642+0000 7f3633964700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c12fb80 con 0x7f362c0cc7d0 2023-10-17T06:22:37.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.642+0000 7f3633964700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362c12e0b0 con 0x7f362c0cdb60 2023-10-17T06:22:37.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.642+0000 7f3631f01700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f362c144390 0x7f362c1ed810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:37.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.646+0000 7f3631f01700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f362c144390 0x7f362c1ed810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50244/0 (socket says 172.21.15.125:50244) 2023-10-17T06:22:37.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.646+0000 7f3631f01700 1 -- 172.21.15.125:0/512364207 learned_addr learned my addr 172.21.15.125:0/512364207 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:37.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.646+0000 7f3631700700 1 --2- 172.21.15.125:0/512364207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f362c0cc7d0 0x7f362c1f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:37.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.646+0000 7f3630eff700 1 --2- 172.21.15.125:0/512364207 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f362c0cdb60 0x7f362c12db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:37.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.646+0000 7f3631f01700 1 -- 172.21.15.125:0/512364207 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f362c0cdb60 msgr2=0x7f362c12db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:37.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.646+0000 7f3631f01700 1 --2- 172.21.15.125:0/512364207 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f362c0cdb60 0x7f362c12db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.646+0000 7f3631f01700 1 -- 172.21.15.125:0/512364207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f362c0cc7d0 msgr2=0x7f362c1f4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:37.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.646+0000 7f3631f01700 1 --2- 172.21.15.125:0/512364207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f362c0cc7d0 0x7f362c1f4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.646+0000 7f3631f01700 1 -- 172.21.15.125:0/512364207 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3624009b30 con 0x7f362c144390 2023-10-17T06:22:37.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.646+0000 7f3631f01700 1 --2- 172.21.15.125:0/512364207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f362c144390 0x7f362c1ed810 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f362c06fe80 tx=0x7f3624004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:37.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.646+0000 7f3621ffb700 1 -- 172.21.15.125:0/512364207 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624004800 con 0x7f362c144390 2023-10-17T06:22:37.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.646+0000 7f3621ffb700 1 -- 172.21.15.125:0/512364207 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36240092e0 con 0x7f362c144390 2023-10-17T06:22:37.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.646+0000 7f3621ffb700 1 -- 172.21.15.125:0/512364207 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362401c660 con 0x7f362c144390 2023-10-17T06:22:37.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.646+0000 7f3633964700 1 -- 172.21.15.125:0/512364207 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f362c1f0990 con 0x7f362c144390 2023-10-17T06:22:37.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.646+0000 7f3633964700 1 -- 172.21.15.125:0/512364207 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362c1f0f50 con 0x7f362c144390 2023-10-17T06:22:37.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.650+0000 7f3633964700 1 -- 172.21.15.125:0/512364207 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362c12fcc0 con 0x7f362c144390 2023-10-17T06:22:37.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.650+0000 7f3621ffb700 1 -- 172.21.15.125:0/512364207 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f362401c7c0 con 0x7f362c144390 2023-10-17T06:22:37.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.650+0000 7f3621ffb700 1 --2- 172.21.15.125:0/512364207 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36100656f0 0x7f3610067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:37.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.650+0000 7f3621ffb700 1 -- 172.21.15.125:0/512364207 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f3624084bb0 con 0x7f362c144390 2023-10-17T06:22:37.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.650+0000 7f3631700700 1 --2- 172.21.15.125:0/512364207 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36100656f0 0x7f3610067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:37.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.654+0000 7f3631700700 1 --2- 172.21.15.125:0/512364207 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36100656f0 0x7f3610067bb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3628000f60 tx=0x7f3628009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:37.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.658+0000 7f3621ffb700 1 -- 172.21.15.125:0/512364207 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f36240524d0 con 0x7f362c144390 2023-10-17T06:22:37.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.862+0000 7f3633964700 1 -- 172.21.15.125:0/512364207 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f362c072e60 con 0x7f362c144390 2023-10-17T06:22:37.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.862+0000 7f3621ffb700 1 -- 172.21.15.125:0/512364207 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v55) v1 ==== 80+0+59 (secure 0 0 0) 0x7f3624055af0 con 0x7f362c144390 2023-10-17T06:22:37.868 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:0/3775054255 2023-10-17T07:15:56.011706+0000 2023-10-17T06:22:37.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.866+0000 7f3633964700 1 -- 172.21.15.125:0/512364207 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36100656f0 msgr2=0x7f3610067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:37.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.866+0000 7f3633964700 1 --2- 172.21.15.125:0/512364207 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36100656f0 0x7f3610067bb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3628000f60 tx=0x7f3628009040 comp rx=0 tx=0).stop 2023-10-17T06:22:37.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.866+0000 7f3633964700 1 -- 172.21.15.125:0/512364207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f362c144390 msgr2=0x7f362c1ed810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:37.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.866+0000 7f3633964700 1 --2- 172.21.15.125:0/512364207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f362c144390 0x7f362c1ed810 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f362c06fe80 tx=0x7f3624004af0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.866+0000 7f3633964700 1 -- 172.21.15.125:0/512364207 shutdown_connections 2023-10-17T06:22:37.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.866+0000 7f3633964700 1 --2- 172.21.15.125:0/512364207 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f36100656f0 0x7f3610067bb0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.866+0000 7f3633964700 1 --2- 172.21.15.125:0/512364207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f362c144390 0x7f362c1ed810 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.866+0000 7f3633964700 1 --2- 172.21.15.125:0/512364207 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f362c0cdb60 0x7f362c12db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.866+0000 7f3633964700 1 --2- 172.21.15.125:0/512364207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f362c0cc7d0 0x7f362c1f4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:37.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.866+0000 7f3633964700 1 -- 172.21.15.125:0/512364207 >> 172.21.15.125:0/512364207 conn(0x7f362c06a340 msgr2=0x7f362c0af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:37.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.866+0000 7f3633964700 1 -- 172.21.15.125:0/512364207 shutdown_connections 2023-10-17T06:22:37.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:37.866+0000 7f3633964700 1 -- 172.21.15.125:0/512364207 wait complete. 2023-10-17T06:22:37.874 INFO:teuthology.orchestra.run.smithi125.stderr:listed 1 entries 2023-10-17T06:22:37.891 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-17T06:22:37.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:37.892 DEBUG:teuthology.orchestra.run.smithi125:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-17T06:22:37.934 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-10-17T06:22:37.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:37.935 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-17T06:22:37.993 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-17T06:22:38.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.206+0000 7fceba216700 1 Processor -- start 2023-10-17T06:22:38.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.206+0000 7fceba216700 1 -- start start 2023-10-17T06:22:38.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.206+0000 7fceba216700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fceb4164a20 0x7fceb40cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:38.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.206+0000 7fceba216700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fceb406ce20 0x7fceb406d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:38.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.206+0000 7fceba216700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb406d7b0 con 0x7fceb40b3d40 2023-10-17T06:22:38.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.206+0000 7fceba216700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb406e2d0 con 0x7fceb4164a20 2023-10-17T06:22:38.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.206+0000 7fceba216700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb40ca4c0 con 0x7fceb406ce20 2023-10-17T06:22:38.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.206+0000 7fceb8a13700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fceb4164a20 0x7fceb40cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:38.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.206+0000 7fceb8a13700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fceb4164a20 0x7fceb40cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50258/0 (socket says 172.21.15.125:50258) 2023-10-17T06:22:38.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.206+0000 7fceb8a13700 1 -- 172.21.15.125:0/3528256283 learned_addr learned my addr 172.21.15.125:0/3528256283 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:38.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.210+0000 7fceb9a15700 1 --2- 172.21.15.125:0/3528256283 >> v2:172.21.15.184:3300/0 conn(0x7fceb406ce20 0x7fceb406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:38.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.210+0000 7fceb8a13700 1 -- 172.21.15.125:0/3528256283 >> v2:172.21.15.184:3300/0 conn(0x7fceb406ce20 msgr2=0x7fceb406d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:38.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.210+0000 7fceb8a13700 1 --2- 172.21.15.125:0/3528256283 >> v2:172.21.15.184:3300/0 conn(0x7fceb406ce20 0x7fceb406d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:38.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.210+0000 7fceb8a13700 1 -- 172.21.15.125:0/3528256283 >> v1:172.21.15.125:6789/0 conn(0x7fceb40b3d40 legacy=0x7fceb40c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:38.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.210+0000 7fceb8a13700 1 -- 172.21.15.125:0/3528256283 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb40ca7a0 con 0x7fceb4164a20 2023-10-17T06:22:38.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.210+0000 7fceb8a13700 1 --2- 172.21.15.125:0/3528256283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fceb4164a20 0x7fceb40cc190 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fceb40c9240 tx=0x7fcea4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb47eda47169b2f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:38.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.210+0000 7fceabfff700 1 -- 172.21.15.125:0/3528256283 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea400b8a0 con 0x7fceb4164a20 2023-10-17T06:22:38.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.210+0000 7fceabfff700 1 -- 172.21.15.125:0/3528256283 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea400ba00 con 0x7fceb4164a20 2023-10-17T06:22:38.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.210+0000 7fceabfff700 1 -- 172.21.15.125:0/3528256283 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea400bd90 con 0x7fceb4164a20 2023-10-17T06:22:38.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.210+0000 7fceba216700 1 -- 172.21.15.125:0/3528256283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fceb4164a20 msgr2=0x7fceb40cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:38.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.210+0000 7fceba216700 1 --2- 172.21.15.125:0/3528256283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fceb4164a20 0x7fceb40cc190 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fceb40c9240 tx=0x7fcea4009bf0 comp rx=0 tx=0).stop 2023-10-17T06:22:38.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.210+0000 7fceba216700 1 -- 172.21.15.125:0/3528256283 shutdown_connections 2023-10-17T06:22:38.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.210+0000 7fceba216700 1 --2- 172.21.15.125:0/3528256283 >> v2:172.21.15.184:3300/0 conn(0x7fceb406ce20 0x7fceb406d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:38.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.210+0000 7fceba216700 1 --2- 172.21.15.125:0/3528256283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fceb4164a20 0x7fceb40cc190 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:38.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.210+0000 7fceba216700 1 -- 172.21.15.125:0/3528256283 >> 172.21.15.125:0/3528256283 conn(0x7fceb40ce5c0 msgr2=0x7fceb40ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:38.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.210+0000 7fceba216700 1 -- 172.21.15.125:0/3528256283 shutdown_connections 2023-10-17T06:22:38.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.210+0000 7fceba216700 1 -- 172.21.15.125:0/3528256283 wait complete. 2023-10-17T06:22:38.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fceba216700 1 Processor -- start 2023-10-17T06:22:38.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fceba216700 1 -- start start 2023-10-17T06:22:38.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fceba216700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fceb406ce20 0x7fceb415f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:38.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fceba216700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fceb40b3d40 0x7fceb415dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:38.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fceba216700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fceb4164a20 0x7fceb41f3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:38.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fceba216700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb415e3f0 con 0x7fceb40b3d40 2023-10-17T06:22:38.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fceba216700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb415e6d0 con 0x7fceb4164a20 2023-10-17T06:22:38.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fceba216700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb415e9b0 con 0x7fceb406ce20 2023-10-17T06:22:38.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fceb8a13700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fceb40b3d40 0x7fceb415dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:38.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fceb8a13700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fceb40b3d40 0x7fceb415dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50272/0 (socket says 172.21.15.125:50272) 2023-10-17T06:22:38.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fceb8a13700 1 -- 172.21.15.125:0/3131080032 learned_addr learned my addr 172.21.15.125:0/3131080032 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:38.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fceb9214700 1 --2- 172.21.15.125:0/3131080032 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fceb406ce20 0x7fceb415f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:38.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fceb9a15700 1 --2- 172.21.15.125:0/3131080032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fceb4164a20 0x7fceb41f3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:38.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fceb8a13700 1 -- 172.21.15.125:0/3131080032 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fceb406ce20 msgr2=0x7fceb415f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:38.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fceb8a13700 1 --2- 172.21.15.125:0/3131080032 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fceb406ce20 0x7fceb415f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:38.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fceb8a13700 1 -- 172.21.15.125:0/3131080032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fceb4164a20 msgr2=0x7fceb41f3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:38.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fceb8a13700 1 --2- 172.21.15.125:0/3131080032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fceb4164a20 0x7fceb41f3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:38.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fceb8a13700 1 -- 172.21.15.125:0/3131080032 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea4009570 con 0x7fceb40b3d40 2023-10-17T06:22:38.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fceb8a13700 1 --2- 172.21.15.125:0/3131080032 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fceb40b3d40 0x7fceb415dba0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fcea4000c00 tx=0x7fcea4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:38.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fcea9ffb700 1 -- 172.21.15.125:0/3131080032 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea40038c0 con 0x7fceb40b3d40 2023-10-17T06:22:38.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.214+0000 7fcea9ffb700 1 -- 172.21.15.125:0/3131080032 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea401e070 con 0x7fceb40b3d40 2023-10-17T06:22:38.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.218+0000 7fceba216700 1 -- 172.21.15.125:0/3131080032 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb41f6ce0 con 0x7fceb40b3d40 2023-10-17T06:22:38.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.218+0000 7fcea9ffb700 1 -- 172.21.15.125:0/3131080032 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea4003c80 con 0x7fceb40b3d40 2023-10-17T06:22:38.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.218+0000 7fceba216700 1 -- 172.21.15.125:0/3131080032 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb41f6980 con 0x7fceb40b3d40 2023-10-17T06:22:38.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.218+0000 7fceba216700 1 -- 172.21.15.125:0/3131080032 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb4072e60 con 0x7fceb40b3d40 2023-10-17T06:22:38.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.218+0000 7fcea9ffb700 1 -- 172.21.15.125:0/3131080032 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fcea4011420 con 0x7fceb40b3d40 2023-10-17T06:22:38.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.222+0000 7fcea9ffb700 1 --2- 172.21.15.125:0/3131080032 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fce980656f0 0x7fce98067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:38.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.222+0000 7fcea9ffb700 1 -- 172.21.15.125:0/3131080032 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fcea4020070 con 0x7fceb40b3d40 2023-10-17T06:22:38.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.222+0000 7fceb9214700 1 --2- 172.21.15.125:0/3131080032 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fce980656f0 0x7fce98067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:38.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.222+0000 7fceb9214700 1 --2- 172.21.15.125:0/3131080032 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fce980656f0 0x7fce98067bb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fceb00018a0 tx=0x7fceb0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:38.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.226+0000 7fcea9ffb700 1 -- 172.21.15.125:0/3131080032 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fcea4051fd0 con 0x7fceb40b3d40 2023-10-17T06:22:38.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.538+0000 7fceba216700 1 -- 172.21.15.125:0/3131080032 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fceb41620d0 con 0x7fceb40b3d40 2023-10-17T06:22:38.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.538+0000 7fcea9ffb700 1 -- 172.21.15.125:0/3131080032 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcea40555f0 con 0x7fceb40b3d40 2023-10-17T06:22:38.546 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-17T06:22:38.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.542+0000 7fceba216700 1 -- 172.21.15.125:0/3131080032 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fce980656f0 msgr2=0x7fce98067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:38.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.542+0000 7fceba216700 1 --2- 172.21.15.125:0/3131080032 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fce980656f0 0x7fce98067bb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fceb00018a0 tx=0x7fceb0009040 comp rx=0 tx=0).stop 2023-10-17T06:22:38.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.542+0000 7fceba216700 1 -- 172.21.15.125:0/3131080032 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fceb40b3d40 msgr2=0x7fceb415dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:38.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.542+0000 7fceba216700 1 --2- 172.21.15.125:0/3131080032 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fceb40b3d40 0x7fceb415dba0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fcea4000c00 tx=0x7fcea4004770 comp rx=0 tx=0).stop 2023-10-17T06:22:38.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.542+0000 7fceba216700 1 -- 172.21.15.125:0/3131080032 shutdown_connections 2023-10-17T06:22:38.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.542+0000 7fceba216700 1 --2- 172.21.15.125:0/3131080032 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fce980656f0 0x7fce98067bb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:38.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.542+0000 7fceba216700 1 --2- 172.21.15.125:0/3131080032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fceb4164a20 0x7fceb41f3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:38.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.542+0000 7fceba216700 1 --2- 172.21.15.125:0/3131080032 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fceb40b3d40 0x7fceb415dba0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:38.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.542+0000 7fceba216700 1 --2- 172.21.15.125:0/3131080032 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fceb406ce20 0x7fceb415f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:38.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.542+0000 7fceba216700 1 -- 172.21.15.125:0/3131080032 >> 172.21.15.125:0/3131080032 conn(0x7fceb40ce5c0 msgr2=0x7fceb4161240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:38.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.542+0000 7fceba216700 1 -- 172.21.15.125:0/3131080032 shutdown_connections 2023-10-17T06:22:38.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:38.542+0000 7fceba216700 1 -- 172.21.15.125:0/3131080032 wait complete. 2023-10-17T06:22:38.571 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-17T06:22:38.572 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-17T06:22:38.572 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-10-17T06:22:38.572 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-17T06:22:38.573 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-17T06:22:38.573 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-17T06:22:38.574 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-17T06:22:38.574 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-17T06:22:38.574 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-17T06:22:38.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:38.575 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-10-17T06:22:38.592 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-17T06:22:38.592 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-17T06:22:38.592 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-10-17T06:22:38.593 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:22:38.593 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-10-17T06:22:38.593 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:22:38.593 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:22:38.593 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:22:38.594 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f0 2023-10-17T06:22:38.594 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:22:38.594 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:22:38.594 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f1 2023-10-17T06:22:38.594 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-17T06:22:38.595 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:22:38.595 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-17T06:22:38.595 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-10-17T06:22:38.595 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-17T06:22:38.595 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 41489sec preferred_lft 41489sec 2023-10-17T06:22:38.596 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::ec4:7aff:fe8f:d739/64 scope link 2023-10-17T06:22:38.596 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:22:38.596 INFO:teuthology.orchestra.run.smithi125.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-17T06:22:38.596 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 02:42:72:b2:4f:6c brd ff:ff:ff:ff:ff:ff 2023-10-17T06:22:38.597 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-17T06:22:38.597 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:22:38.597 INFO:teuthology.orchestra.run.smithi125.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-17T06:22:38.597 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 12:09:8b:4c:94:dd brd ff:ff:ff:ff:ff:ff 2023-10-17T06:22:38.597 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-17T06:22:38.597 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:22:38.598 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::5cb5:97ff:fe65:f7ee/64 scope link 2023-10-17T06:22:38.598 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:22:38.598 INFO:teuthology.orchestra.run.smithi125.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state DOWN group default qlen 1000 2023-10-17T06:22:38.598 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 86:a3:a0:1e:b3:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-17T06:22:38.599 INFO:teuthology.orchestra.run.smithi125.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-17T06:22:38.599 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 12:09:8b:4c:94:dd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-17T06:22:38.599 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::1009:8bff:fe4c:94dd/64 scope link 2023-10-17T06:22:38.599 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-17T06:22:38.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:38.601 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-17T06:22:38.683 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-10-17T06:22:38.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:38.687 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-10-17T06:22:38.753 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-10-17T06:22:38.753 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-17T06:22:38.753 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-17T06:22:38.753 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-17T06:22:38.754 INFO:teuthology.orchestra.run.smithi125.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-17T06:22:38.754 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-17T06:22:38.754 INFO:teuthology.orchestra.run.smithi125.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-17T06:22:38.754 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-17T06:22:38.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:38.756 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-17T06:22:38.756 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-17T06:22:38.757 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-17T06:22:38.757 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-17T06:22:38.758 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-17T06:22:38.758 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-17T06:22:38.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:38.896 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-10-17T06:22:38.913 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-17T06:22:38.913 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-17T06:22:38.914 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-17T06:22:38.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:38.915 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2023-10-17T06:22:38.998 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-17T06:22:38.999 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-17T06:22:39.061 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-17T06:22:39.061 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-17T06:22:39.062 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-17T06:22:39.120 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-17T06:22:39.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:39.120 DEBUG:teuthology.orchestra.run.smithi125:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:22:39.254 INFO:teuthology.orchestra.run.smithi125.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:22:39.254 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-17T06:22:39.857 INFO:teuthology.orchestra.run.smithi125.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-17T06:22:39.858 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-17T06:22:39.858 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: resolved to: "172.21.15.125:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-10-17T06:22:39.858 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: trying mount with new device syntax: 0@c779df02-0ec4-47de-a0f3-2371e60a2dde.cephfs=/ 2023-10-17T06:22:39.858 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.125:3300/172.21.15.184:3300/172.21.15.184:3301" will pass to kernel 2023-10-17T06:22:39.864 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-17T06:22:39.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:39.865 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-17T06:22:39.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:39.897 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-17T06:22:39.962 INFO:teuthology.orchestra.run.smithi125.stdout:client5788 2023-10-17T06:22:39.963 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:22:39.963 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:22:40.025 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:22:40.026 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:22:40.085 DEBUG:tasks.cephfs.mount:Creating test file 2023-10-17 06:22:40.085874 0 2023-10-17T06:22:40.086 DEBUG:teuthology.orchestra.run.smithi125:> touch '/home/ubuntu/cephtest/mnt.0/2023-10-17 06:22:40.085874 0' 2023-10-17T06:22:40.150 DEBUG:tasks.cephfs.mount:Deleting test file 2023-10-17 06:22:40.085874 0 2023-10-17T06:22:40.151 DEBUG:teuthology.orchestra.run.smithi125:> rm -f '/home/ubuntu/cephtest/mnt.0/2023-10-17 06:22:40.085874 0' 2023-10-17T06:22:40.221 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-17T06:22:40.221 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-17T06:22:40.307 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-17T06:22:40.348 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-17T06:22:40.348 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:22:40.349 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:22:40.369 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:22:40.369 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:22:40.431 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:22:40.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.642+0000 7f9955dd5700 1 Processor -- start 2023-10-17T06:22:40.651 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.646+0000 7f9955dd5700 1 -- start start 2023-10-17T06:22:40.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.646+0000 7f9955dd5700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f99500cc190 0x7f99500b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:40.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.646+0000 7f9955dd5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99500b4140 0x7f99500ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:40.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.646+0000 7f9955dd5700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995015e000 con 0x7f99500cdd90 2023-10-17T06:22:40.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.646+0000 7f9955dd5700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99500b45d0 con 0x7f99500cc190 2023-10-17T06:22:40.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.646+0000 7f9955dd5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99500ce170 con 0x7f99500b4140 2023-10-17T06:22:40.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.646+0000 7f994ffff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f99500cc190 0x7f99500b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:40.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.646+0000 7f99555d4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99500b4140 0x7f99500ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:40.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.646+0000 7f99555d4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99500b4140 0x7f99500ca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:36732/0 (socket says 172.21.15.125:36732) 2023-10-17T06:22:40.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.646+0000 7f9954dd3700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f99500cdd90 0x7f995006d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:35682/0 (socket says 172.21.15.125:35682) 2023-10-17T06:22:40.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.646+0000 7f99555d4700 1 -- 172.21.15.125:0/1440040483 learned_addr learned my addr 172.21.15.125:0/1440040483 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:40.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.646+0000 7f994ffff700 1 --2- 172.21.15.125:0/1440040483 >> v2:172.21.15.184:3300/0 conn(0x7f99500cc190 0x7f99500b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:52372/0 (socket says 172.21.15.125:52372) 2023-10-17T06:22:40.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.646+0000 7f99555d4700 1 -- 172.21.15.125:0/1440040483 >> v2:172.21.15.184:3300/0 conn(0x7f99500cc190 msgr2=0x7f99500b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:40.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.646+0000 7f99555d4700 1 --2- 172.21.15.125:0/1440040483 >> v2:172.21.15.184:3300/0 conn(0x7f99500cc190 0x7f99500b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:40.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.646+0000 7f99555d4700 1 -- 172.21.15.125:0/1440040483 >> v1:172.21.15.184:6789/0 conn(0x7f99500cdd90 legacy=0x7f995006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:40.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.646+0000 7f99555d4700 1 -- 172.21.15.125:0/1440040483 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995015d3f0 con 0x7f99500b4140 2023-10-17T06:22:40.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.646+0000 7f994ffff700 1 --2- 172.21.15.125:0/1440040483 >> v2:172.21.15.184:3300/0 conn(0x7f99500cc190 0x7f99500b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:22:40.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.650+0000 7f99555d4700 1 --2- 172.21.15.125:0/1440040483 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99500b4140 0x7f99500ca0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9948009e50 tx=0x7f994800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49d67be899691d0b server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:40.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.650+0000 7f994f7fe700 1 -- 172.21.15.125:0/1440040483 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994800e070 con 0x7f99500b4140 2023-10-17T06:22:40.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.650+0000 7f994f7fe700 1 -- 172.21.15.125:0/1440040483 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994800b910 con 0x7f99500b4140 2023-10-17T06:22:40.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.650+0000 7f994f7fe700 1 -- 172.21.15.125:0/1440040483 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994800bcc0 con 0x7f99500b4140 2023-10-17T06:22:40.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.650+0000 7f9955dd5700 1 -- 172.21.15.125:0/1440040483 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99500b4140 msgr2=0x7f99500ca0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:40.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.650+0000 7f9955dd5700 1 --2- 172.21.15.125:0/1440040483 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99500b4140 0x7f99500ca0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9948009e50 tx=0x7f994800b330 comp rx=0 tx=0).stop 2023-10-17T06:22:40.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.650+0000 7f9955dd5700 1 -- 172.21.15.125:0/1440040483 shutdown_connections 2023-10-17T06:22:40.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.650+0000 7f9955dd5700 1 --2- 172.21.15.125:0/1440040483 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99500b4140 0x7f99500ca0a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:40.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.650+0000 7f9955dd5700 1 --2- 172.21.15.125:0/1440040483 >> v2:172.21.15.184:3300/0 conn(0x7f99500cc190 0x7f99500b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:40.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.650+0000 7f9955dd5700 1 -- 172.21.15.125:0/1440040483 >> 172.21.15.125:0/1440040483 conn(0x7f99500ce5c0 msgr2=0x7f99500ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:40.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.650+0000 7f9955dd5700 1 -- 172.21.15.125:0/1440040483 shutdown_connections 2023-10-17T06:22:40.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.650+0000 7f9955dd5700 1 -- 172.21.15.125:0/1440040483 wait complete. 2023-10-17T06:22:40.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.654+0000 7f9955dd5700 1 Processor -- start 2023-10-17T06:22:40.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.654+0000 7f9955dd5700 1 -- start start 2023-10-17T06:22:40.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.654+0000 7f9955dd5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99500b4140 0x7f995015e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:40.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.654+0000 7f9955dd5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99500cc190 0x7f995014d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:40.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.654+0000 7f9955dd5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99500cdd90 0x7f99500c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:40.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.654+0000 7f9955dd5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99500b2730 con 0x7f99500cdd90 2023-10-17T06:22:40.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.654+0000 7f9955dd5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995014d5f0 con 0x7f99500cc190 2023-10-17T06:22:40.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.654+0000 7f9955dd5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99500b1d90 con 0x7f99500b4140 2023-10-17T06:22:40.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.658+0000 7f99555d4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99500cdd90 0x7f99500c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:40.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.658+0000 7f99555d4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99500cdd90 0x7f99500c5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50276/0 (socket says 172.21.15.125:50276) 2023-10-17T06:22:40.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.658+0000 7f99555d4700 1 -- 172.21.15.125:0/3955383589 learned_addr learned my addr 172.21.15.125:0/3955383589 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:40.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.658+0000 7f9954dd3700 1 --2- 172.21.15.125:0/3955383589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99500b4140 0x7f995015e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:40.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.658+0000 7f994ffff700 1 --2- 172.21.15.125:0/3955383589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99500cc190 0x7f995014d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:40.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.658+0000 7f99555d4700 1 -- 172.21.15.125:0/3955383589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99500b4140 msgr2=0x7f995015e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:40.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.658+0000 7f99555d4700 1 --2- 172.21.15.125:0/3955383589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99500b4140 0x7f995015e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:40.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.658+0000 7f99555d4700 1 -- 172.21.15.125:0/3955383589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99500cc190 msgr2=0x7f995014d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:40.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.658+0000 7f99555d4700 1 --2- 172.21.15.125:0/3955383589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99500cc190 0x7f995014d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:40.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.658+0000 7f99555d4700 1 -- 172.21.15.125:0/3955383589 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c0094b0 con 0x7f99500cdd90 2023-10-17T06:22:40.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.658+0000 7f99555d4700 1 --2- 172.21.15.125:0/3955383589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99500cdd90 0x7f99500c5e10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f99500ce2b0 tx=0x7f9948004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:40.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.658+0000 7f994d7fa700 1 -- 172.21.15.125:0/3955383589 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9948004800 con 0x7f99500cdd90 2023-10-17T06:22:40.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.658+0000 7f994d7fa700 1 -- 172.21.15.125:0/3955383589 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99480099b0 con 0x7f99500cdd90 2023-10-17T06:22:40.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.658+0000 7f9955dd5700 1 -- 172.21.15.125:0/3955383589 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9948009b30 con 0x7f99500cdd90 2023-10-17T06:22:40.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.658+0000 7f994d7fa700 1 -- 172.21.15.125:0/3955383589 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994801b670 con 0x7f99500cdd90 2023-10-17T06:22:40.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.658+0000 7f9955dd5700 1 -- 172.21.15.125:0/3955383589 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99500b2350 con 0x7f99500cdd90 2023-10-17T06:22:40.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.662+0000 7f9955dd5700 1 -- 172.21.15.125:0/3955383589 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99500b2870 con 0x7f99500cdd90 2023-10-17T06:22:40.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.662+0000 7f994d7fa700 1 -- 172.21.15.125:0/3955383589 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f994801b7d0 con 0x7f99500cdd90 2023-10-17T06:22:40.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.662+0000 7f994d7fa700 1 --2- 172.21.15.125:0/3955383589 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f99340656f0 0x7f9934067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:40.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.662+0000 7f994d7fa700 1 -- 172.21.15.125:0/3955383589 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f9948084820 con 0x7f99500cdd90 2023-10-17T06:22:40.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.662+0000 7f9954dd3700 1 --2- 172.21.15.125:0/3955383589 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f99340656f0 0x7f9934067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:40.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.666+0000 7f9954dd3700 1 --2- 172.21.15.125:0/3955383589 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f99340656f0 0x7f9934067bb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9944000f60 tx=0x7f9944007ef0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:40.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.670+0000 7f994d7fa700 1 -- 172.21.15.125:0/3955383589 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f99500b2870 con 0x7f99500cdd90 2023-10-17T06:22:40.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.846+0000 7f9955dd5700 1 -- 172.21.15.125:0/3955383589 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99500b2870 con 0x7f99500cdd90 2023-10-17T06:22:40.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.850+0000 7f994d7fa700 1 -- 172.21.15.125:0/3955383589 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+18788 (secure 0 0 0) 0x7f99500b2870 con 0x7f99500cdd90 2023-10-17T06:22:40.857 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:22:40.857 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":55,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:16:02.394779+0000","last_up_change":"2023-10-17T06:16:01.390745+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:08:48.973490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-17T06:08:50.385778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":50,"up_from":54,"up_thru":54,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6801","nonce":1353754211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6803","nonce":1353754211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6807","nonce":1353754211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6805","nonce":1353754211}]},"public_addr":"172.21.15.125:6801/1353754211","cluster_addr":"172.21.15.125:6803/1353754211","heartbeat_back_addr":"172.21.15.125:6807/1353754211","heartbeat_front_addr":"172.21.15.125:6805/1353754211","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"2023-10-17T06:09:26.602656+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":51},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.12","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:0/3775054255":"2023-10-17T07:15:56.011706+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:22:40.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.854+0000 7f9955dd5700 1 -- 172.21.15.125:0/3955383589 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f99340656f0 msgr2=0x7f9934067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:40.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.854+0000 7f9955dd5700 1 --2- 172.21.15.125:0/3955383589 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f99340656f0 0x7f9934067bb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9944000f60 tx=0x7f9944007ef0 comp rx=0 tx=0).stop 2023-10-17T06:22:40.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.854+0000 7f9955dd5700 1 -- 172.21.15.125:0/3955383589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99500cdd90 msgr2=0x7f99500c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:40.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.854+0000 7f9955dd5700 1 --2- 172.21.15.125:0/3955383589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99500cdd90 0x7f99500c5e10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f99500ce2b0 tx=0x7f9948004af0 comp rx=0 tx=0).stop 2023-10-17T06:22:40.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.854+0000 7f9955dd5700 1 -- 172.21.15.125:0/3955383589 shutdown_connections 2023-10-17T06:22:40.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.854+0000 7f9955dd5700 1 --2- 172.21.15.125:0/3955383589 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f99340656f0 0x7f9934067bb0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:40.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.854+0000 7f9955dd5700 1 --2- 172.21.15.125:0/3955383589 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99500cdd90 0x7f99500c5e10 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:40.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.854+0000 7f9955dd5700 1 --2- 172.21.15.125:0/3955383589 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99500cc190 0x7f995014d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:40.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.854+0000 7f9955dd5700 1 --2- 172.21.15.125:0/3955383589 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f99500b4140 0x7f995015e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:40.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.854+0000 7f9955dd5700 1 -- 172.21.15.125:0/3955383589 >> 172.21.15.125:0/3955383589 conn(0x7f99500ce5c0 msgr2=0x7f99500cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:40.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.854+0000 7f9955dd5700 1 -- 172.21.15.125:0/3955383589 shutdown_connections 2023-10-17T06:22:40.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:40.854+0000 7f9955dd5700 1 -- 172.21.15.125:0/3955383589 wait complete. 2023-10-17T06:22:40.885 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-17T06:08:48.973490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-17T06:08:50.385778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-17T06:22:40.886 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:22:41.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.070+0000 7f3dab59e700 1 Processor -- start 2023-10-17T06:22:41.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.070+0000 7f3dab59e700 1 -- start start 2023-10-17T06:22:41.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.074+0000 7f3dab59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3dac160710 0x7f3dac0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:41.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.074+0000 7f3dab59e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3dac0b5ae0 0x7f3dac06db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:41.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.074+0000 7f3dab59e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dac15d0d0 con 0x7f3dac0d2e00 2023-10-17T06:22:41.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.074+0000 7f3dab59e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dac15df90 con 0x7f3dac0b5ae0 2023-10-17T06:22:41.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.074+0000 7f3dab59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dac06f0f0 con 0x7f3dac160710 2023-10-17T06:22:41.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.074+0000 7f3daad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3dac0b5ae0 0x7f3dac06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:41.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.074+0000 7f3daad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3dac0b5ae0 0x7f3dac06db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50280/0 (socket says 172.21.15.125:50280) 2023-10-17T06:22:41.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.074+0000 7f3da9d9b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3dac160710 0x7f3dac0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:41.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.074+0000 7f3daad9d700 1 -- 172.21.15.125:0/3746023848 learned_addr learned my addr 172.21.15.125:0/3746023848 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:41.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.074+0000 7f3daad9d700 1 -- 172.21.15.125:0/3746023848 >> v2:172.21.15.184:3300/0 conn(0x7f3dac160710 msgr2=0x7f3dac0b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:41.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.074+0000 7f3daad9d700 1 --2- 172.21.15.125:0/3746023848 >> v2:172.21.15.184:3300/0 conn(0x7f3dac160710 0x7f3dac0b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.074+0000 7f3daad9d700 1 -- 172.21.15.125:0/3746023848 >> v1:172.21.15.184:6789/0 conn(0x7f3dac0d2e00 legacy=0x7f3dac0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:41.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.074+0000 7f3daad9d700 1 -- 172.21.15.125:0/3746023848 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac15d310 con 0x7f3dac0b5ae0 2023-10-17T06:22:41.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.074+0000 7f3daad9d700 1 --2- 172.21.15.125:0/3746023848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dac0b5ae0 0x7f3dac06db60 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0d2420 tx=0x7f3da400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ecd44f091b1715 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:41.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.078+0000 7f3da959a700 1 -- 172.21.15.125:0/3746023848 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da400e070 con 0x7f3dac0b5ae0 2023-10-17T06:22:41.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.078+0000 7f3da959a700 1 -- 172.21.15.125:0/3746023848 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da400b910 con 0x7f3dac0b5ae0 2023-10-17T06:22:41.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.078+0000 7f3da959a700 1 -- 172.21.15.125:0/3746023848 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da400bcc0 con 0x7f3dac0b5ae0 2023-10-17T06:22:41.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.078+0000 7f3dab59e700 1 -- 172.21.15.125:0/3746023848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dac0b5ae0 msgr2=0x7f3dac06db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:41.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.078+0000 7f3dab59e700 1 --2- 172.21.15.125:0/3746023848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dac0b5ae0 0x7f3dac06db60 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0d2420 tx=0x7f3da400b330 comp rx=0 tx=0).stop 2023-10-17T06:22:41.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.078+0000 7f3dab59e700 1 -- 172.21.15.125:0/3746023848 shutdown_connections 2023-10-17T06:22:41.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.078+0000 7f3dab59e700 1 --2- 172.21.15.125:0/3746023848 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dac0b5ae0 0x7f3dac06db60 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.078+0000 7f3dab59e700 1 --2- 172.21.15.125:0/3746023848 >> v2:172.21.15.184:3300/0 conn(0x7f3dac160710 0x7f3dac0b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.078+0000 7f3dab59e700 1 -- 172.21.15.125:0/3746023848 >> 172.21.15.125:0/3746023848 conn(0x7f3dac069f20 msgr2=0x7f3dac06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:41.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.078+0000 7f3dab59e700 1 -- 172.21.15.125:0/3746023848 shutdown_connections 2023-10-17T06:22:41.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.078+0000 7f3dab59e700 1 -- 172.21.15.125:0/3746023848 wait complete. 2023-10-17T06:22:41.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.078+0000 7f3dab59e700 1 Processor -- start 2023-10-17T06:22:41.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.078+0000 7f3dab59e700 1 -- start start 2023-10-17T06:22:41.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3dab59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3dac0b5ae0 0x7f3dac154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:41.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3dab59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dac0d2e00 0x7f3dac143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:41.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3dab59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dac160710 0x7f3dac1f6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:41.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3dab59e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac144130 con 0x7f3dac0d2e00 2023-10-17T06:22:41.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3dab59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac144410 con 0x7f3dac160710 2023-10-17T06:22:41.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3dab59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac1446f0 con 0x7f3dac0b5ae0 2023-10-17T06:22:41.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3da9d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dac0d2e00 0x7f3dac143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:41.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3da9d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dac0d2e00 0x7f3dac143830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50282/0 (socket says 172.21.15.125:50282) 2023-10-17T06:22:41.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3da9d9b700 1 -- 172.21.15.125:0/4043959931 learned_addr learned my addr 172.21.15.125:0/4043959931 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:41.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3daa59c700 1 --2- 172.21.15.125:0/4043959931 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3dac0b5ae0 0x7f3dac154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:41.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3daad9d700 1 --2- 172.21.15.125:0/4043959931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dac160710 0x7f3dac1f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:41.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3da9d9b700 1 -- 172.21.15.125:0/4043959931 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3dac0b5ae0 msgr2=0x7f3dac154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:41.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3da9d9b700 1 --2- 172.21.15.125:0/4043959931 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3dac0b5ae0 0x7f3dac154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3da9d9b700 1 -- 172.21.15.125:0/4043959931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dac160710 msgr2=0x7f3dac1f6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:41.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3da9d9b700 1 --2- 172.21.15.125:0/4043959931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dac160710 0x7f3dac1f6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3da9d9b700 1 -- 172.21.15.125:0/4043959931 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da4009b30 con 0x7f3dac0d2e00 2023-10-17T06:22:41.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3daad9d700 1 --2- 172.21.15.125:0/4043959931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dac160710 0x7f3dac1f6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:22:41.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3da9d9b700 1 --2- 172.21.15.125:0/4043959931 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dac0d2e00 0x7f3dac143830 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3da000e9a0 tx=0x7f3da000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:41.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3d9affd700 1 -- 172.21.15.125:0/4043959931 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0009720 con 0x7f3dac0d2e00 2023-10-17T06:22:41.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3d9affd700 1 -- 172.21.15.125:0/4043959931 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da000c690 con 0x7f3dac0d2e00 2023-10-17T06:22:41.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3dab59e700 1 -- 172.21.15.125:0/4043959931 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dac1449d0 con 0x7f3dac0d2e00 2023-10-17T06:22:41.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3d9affd700 1 -- 172.21.15.125:0/4043959931 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da000ca20 con 0x7f3dac0d2e00 2023-10-17T06:22:41.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.082+0000 7f3dab59e700 1 -- 172.21.15.125:0/4043959931 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dac143d70 con 0x7f3dac0d2e00 2023-10-17T06:22:41.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.086+0000 7f3dab59e700 1 -- 172.21.15.125:0/4043959931 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dac04e910 con 0x7f3dac0d2e00 2023-10-17T06:22:41.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.086+0000 7f3d9affd700 1 -- 172.21.15.125:0/4043959931 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f3da000cb80 con 0x7f3dac0d2e00 2023-10-17T06:22:41.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.090+0000 7f3d9affd700 1 --2- 172.21.15.125:0/4043959931 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3d8c065720 0x7f3d8c067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:41.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.090+0000 7f3d9affd700 1 -- 172.21.15.125:0/4043959931 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f3da0082ff0 con 0x7f3dac0d2e00 2023-10-17T06:22:41.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.090+0000 7f3daa59c700 1 --2- 172.21.15.125:0/4043959931 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3d8c065720 0x7f3d8c067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:41.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.090+0000 7f3daa59c700 1 --2- 172.21.15.125:0/4043959931 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3d8c065720 0x7f3d8c067be0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c000f60 tx=0x7f3d9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:41.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.094+0000 7f3d9affd700 1 -- 172.21.15.125:0/4043959931 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f3da00b3d40 con 0x7f3dac0d2e00 2023-10-17T06:22:41.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.270+0000 7f3dab59e700 1 -- 172.21.15.125:0/4043959931 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3dac06d3e0 con 0x7f3dac0d2e00 2023-10-17T06:22:41.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.270+0000 7f3d9affd700 1 -- 172.21.15.125:0/4043959931 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3da00210a0 con 0x7f3dac0d2e00 2023-10-17T06:22:41.277 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:22:41.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.274+0000 7f3dab59e700 1 -- 172.21.15.125:0/4043959931 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3d8c065720 msgr2=0x7f3d8c067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:41.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.274+0000 7f3dab59e700 1 --2- 172.21.15.125:0/4043959931 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3d8c065720 0x7f3d8c067be0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c000f60 tx=0x7f3d9c009040 comp rx=0 tx=0).stop 2023-10-17T06:22:41.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.274+0000 7f3dab59e700 1 -- 172.21.15.125:0/4043959931 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dac0d2e00 msgr2=0x7f3dac143830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:41.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.274+0000 7f3dab59e700 1 --2- 172.21.15.125:0/4043959931 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dac0d2e00 0x7f3dac143830 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3da000e9a0 tx=0x7f3da000ecb0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.274+0000 7f3dab59e700 1 -- 172.21.15.125:0/4043959931 shutdown_connections 2023-10-17T06:22:41.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.274+0000 7f3dab59e700 1 --2- 172.21.15.125:0/4043959931 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f3d8c065720 0x7f3d8c067be0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.274+0000 7f3dab59e700 1 --2- 172.21.15.125:0/4043959931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3dac160710 0x7f3dac1f6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.274+0000 7f3dab59e700 1 --2- 172.21.15.125:0/4043959931 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dac0d2e00 0x7f3dac143830 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.274+0000 7f3dab59e700 1 --2- 172.21.15.125:0/4043959931 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3dac0b5ae0 0x7f3dac154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.274+0000 7f3dab59e700 1 -- 172.21.15.125:0/4043959931 >> 172.21.15.125:0/4043959931 conn(0x7f3dac069f20 msgr2=0x7f3dac160bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:41.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.274+0000 7f3dab59e700 1 -- 172.21.15.125:0/4043959931 shutdown_connections 2023-10-17T06:22:41.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.274+0000 7f3dab59e700 1 -- 172.21.15.125:0/4043959931 wait complete. 2023-10-17T06:22:41.302 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:22:41.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.482+0000 7feada447700 1 Processor -- start 2023-10-17T06:22:41.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.482+0000 7feada447700 1 -- start start 2023-10-17T06:22:41.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.486+0000 7feada447700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fead40b3d40 0x7fead40cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:41.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.486+0000 7feada447700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fead4164a20 0x7fead40c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:41.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.486+0000 7feada447700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead40ca200 con 0x7fead406ce20 2023-10-17T06:22:41.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.486+0000 7feada447700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead406e2d0 con 0x7fead40b3d40 2023-10-17T06:22:41.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.486+0000 7feada447700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead40ca4c0 con 0x7fead4164a20 2023-10-17T06:22:41.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.486+0000 7fead9445700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fead40b3d40 0x7fead40cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:41.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.486+0000 7fead9c46700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fead406ce20 0x7fead406f970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:60280/0 (socket says 172.21.15.125:60280) 2023-10-17T06:22:41.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.486+0000 7fead9c46700 1 -- 172.21.15.125:0/3766467299 learned_addr learned my addr 172.21.15.125:0/3766467299 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:22:41.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.486+0000 7fead8c44700 1 --2- 172.21.15.125:0/3766467299 >> v2:172.21.15.184:3300/0 conn(0x7fead4164a20 0x7fead40c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:41.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.486+0000 7fead9445700 1 -- 172.21.15.125:0/3766467299 >> v2:172.21.15.184:3300/0 conn(0x7fead4164a20 msgr2=0x7fead40c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:41.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.486+0000 7fead9445700 1 --2- 172.21.15.125:0/3766467299 >> v2:172.21.15.184:3300/0 conn(0x7fead4164a20 0x7fead40c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.486+0000 7fead9445700 1 -- 172.21.15.125:0/3766467299 >> v1:172.21.15.125:6789/0 conn(0x7fead406ce20 legacy=0x7fead406f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:41.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.486+0000 7fead9445700 1 -- 172.21.15.125:0/3766467299 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead40ca7a0 con 0x7fead40b3d40 2023-10-17T06:22:41.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.486+0000 7feacbfff700 1 -- 172.21.15.125:0/3766467299 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164030639 0 0) 0x7fead40ca200 con 0x7fead406ce20 2023-10-17T06:22:41.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.486+0000 7fead9445700 1 --2- 172.21.15.125:0/3766467299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fead40b3d40 0x7fead40cc190 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fead40c9830 tx=0x7fead0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c18f061223821a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:41.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.486+0000 7feacbfff700 1 -- 172.21.15.125:0/3766467299 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0011830 con 0x7fead40b3d40 2023-10-17T06:22:41.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.486+0000 7feacbfff700 1 -- 172.21.15.125:0/3766467299 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead0011990 con 0x7fead40b3d40 2023-10-17T06:22:41.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.486+0000 7feacbfff700 1 -- 172.21.15.125:0/3766467299 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0011d20 con 0x7fead40b3d40 2023-10-17T06:22:41.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.490+0000 7feada447700 1 -- 172.21.15.125:0/3766467299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fead40b3d40 msgr2=0x7fead40cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:41.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.490+0000 7feada447700 1 --2- 172.21.15.125:0/3766467299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fead40b3d40 0x7fead40cc190 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fead40c9830 tx=0x7fead0009b30 comp rx=0 tx=0).stop 2023-10-17T06:22:41.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.490+0000 7feada447700 1 -- 172.21.15.125:0/3766467299 shutdown_connections 2023-10-17T06:22:41.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.490+0000 7feada447700 1 --2- 172.21.15.125:0/3766467299 >> v2:172.21.15.184:3300/0 conn(0x7fead4164a20 0x7fead40c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.490+0000 7feada447700 1 --2- 172.21.15.125:0/3766467299 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fead40b3d40 0x7fead40cc190 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.490+0000 7feada447700 1 -- 172.21.15.125:0/3766467299 >> 172.21.15.125:0/3766467299 conn(0x7fead40ce5c0 msgr2=0x7fead40ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:41.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.490+0000 7feada447700 1 -- 172.21.15.125:0/3766467299 shutdown_connections 2023-10-17T06:22:41.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.490+0000 7feada447700 1 -- 172.21.15.125:0/3766467299 wait complete. 2023-10-17T06:22:41.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.490+0000 7feada447700 1 Processor -- start 2023-10-17T06:22:41.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.494+0000 7feada447700 1 -- start start 2023-10-17T06:22:41.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.494+0000 7feada447700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fead406ce20 0x7fead4158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:41.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.494+0000 7feada447700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fead40b3d40 0x7fead41574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:41.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.494+0000 7feada447700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fead4164a20 0x7fead40b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:41.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.494+0000 7feada447700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead41633c0 con 0x7fead406ce20 2023-10-17T06:22:41.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.494+0000 7feada447700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead4162ab0 con 0x7fead40b3d40 2023-10-17T06:22:41.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.494+0000 7feada447700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead41579f0 con 0x7fead4164a20 2023-10-17T06:22:41.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.494+0000 7fead9445700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fead406ce20 0x7fead4158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:41.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.494+0000 7fead9445700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fead406ce20 0x7fead4158eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50306/0 (socket says 172.21.15.125:50306) 2023-10-17T06:22:41.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.494+0000 7fead9445700 1 -- 172.21.15.125:0/3669436013 learned_addr learned my addr 172.21.15.125:0/3669436013 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:41.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.494+0000 7fead9c46700 1 --2- 172.21.15.125:0/3669436013 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fead4164a20 0x7fead40b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:41.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.494+0000 7fead8c44700 1 --2- 172.21.15.125:0/3669436013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fead40b3d40 0x7fead41574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:41.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.494+0000 7fead9445700 1 -- 172.21.15.125:0/3669436013 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fead4164a20 msgr2=0x7fead40b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:41.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.494+0000 7fead9445700 1 --2- 172.21.15.125:0/3669436013 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fead4164a20 0x7fead40b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.494+0000 7fead9445700 1 -- 172.21.15.125:0/3669436013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fead40b3d40 msgr2=0x7fead41574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:41.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.494+0000 7fead9445700 1 --2- 172.21.15.125:0/3669436013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fead40b3d40 0x7fead41574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.494+0000 7fead9445700 1 -- 172.21.15.125:0/3669436013 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead00094b0 con 0x7fead406ce20 2023-10-17T06:22:41.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.494+0000 7fead9445700 1 --2- 172.21.15.125:0/3669436013 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fead406ce20 0x7fead4158eb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fead0009b70 tx=0x7fead0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:41.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.494+0000 7feac9ffb700 1 -- 172.21.15.125:0/3669436013 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead00036c0 con 0x7fead406ce20 2023-10-17T06:22:41.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.498+0000 7feac9ffb700 1 -- 172.21.15.125:0/3669436013 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead001f070 con 0x7fead406ce20 2023-10-17T06:22:41.505 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.498+0000 7feac9ffb700 1 -- 172.21.15.125:0/3669436013 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0003a20 con 0x7fead406ce20 2023-10-17T06:22:41.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.498+0000 7feada447700 1 -- 172.21.15.125:0/3669436013 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead41eb3e0 con 0x7fead406ce20 2023-10-17T06:22:41.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.498+0000 7feada447700 1 -- 172.21.15.125:0/3669436013 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead4162fe0 con 0x7fead406ce20 2023-10-17T06:22:41.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.498+0000 7feada447700 1 -- 172.21.15.125:0/3669436013 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead404e910 con 0x7fead406ce20 2023-10-17T06:22:41.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.498+0000 7feac9ffb700 1 -- 172.21.15.125:0/3669436013 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fead0003b80 con 0x7fead406ce20 2023-10-17T06:22:41.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.502+0000 7feac9ffb700 1 --2- 172.21.15.125:0/3669436013 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7feab80656f0 0x7feab8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:41.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.502+0000 7feac9ffb700 1 -- 172.21.15.125:0/3669436013 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fead0021070 con 0x7fead406ce20 2023-10-17T06:22:41.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.502+0000 7fead8c44700 1 --2- 172.21.15.125:0/3669436013 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7feab80656f0 0x7feab8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:41.508 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.502+0000 7fead8c44700 1 --2- 172.21.15.125:0/3669436013 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7feab80656f0 0x7feab8067bb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fead41627f0 tx=0x7feac4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:41.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.506+0000 7feac9ffb700 1 -- 172.21.15.125:0/3669436013 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fead0052200 con 0x7fead406ce20 2023-10-17T06:22:41.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.678+0000 7feada447700 1 -- 172.21.15.125:0/3669436013 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fead40c9f20 con 0x7fead406ce20 2023-10-17T06:22:41.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.682+0000 7feac9ffb700 1 -- 172.21.15.125:0/3669436013 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v55) v1 ==== 92+0+10 (secure 0 0 0) 0x7fead0055820 con 0x7fead406ce20 2023-10-17T06:22:41.687 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:22:41.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.686+0000 7feada447700 1 -- 172.21.15.125:0/3669436013 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7feab80656f0 msgr2=0x7feab8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:41.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.686+0000 7feada447700 1 --2- 172.21.15.125:0/3669436013 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7feab80656f0 0x7feab8067bb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fead41627f0 tx=0x7feac4008040 comp rx=0 tx=0).stop 2023-10-17T06:22:41.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.686+0000 7feada447700 1 -- 172.21.15.125:0/3669436013 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fead406ce20 msgr2=0x7fead4158eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:41.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.686+0000 7feada447700 1 --2- 172.21.15.125:0/3669436013 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fead406ce20 0x7fead4158eb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fead0009b70 tx=0x7fead0004770 comp rx=0 tx=0).stop 2023-10-17T06:22:41.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.686+0000 7feada447700 1 -- 172.21.15.125:0/3669436013 shutdown_connections 2023-10-17T06:22:41.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.686+0000 7feada447700 1 --2- 172.21.15.125:0/3669436013 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7feab80656f0 0x7feab8067bb0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.686+0000 7feada447700 1 --2- 172.21.15.125:0/3669436013 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fead4164a20 0x7fead40b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.686+0000 7feada447700 1 --2- 172.21.15.125:0/3669436013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fead40b3d40 0x7fead41574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.686+0000 7feada447700 1 --2- 172.21.15.125:0/3669436013 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fead406ce20 0x7fead4158eb0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.686+0000 7feada447700 1 -- 172.21.15.125:0/3669436013 >> 172.21.15.125:0/3669436013 conn(0x7fead40ce5c0 msgr2=0x7fead4159940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:41.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.686+0000 7feada447700 1 -- 172.21.15.125:0/3669436013 shutdown_connections 2023-10-17T06:22:41.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.686+0000 7feada447700 1 -- 172.21.15.125:0/3669436013 wait complete. 2023-10-17T06:22:41.714 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-17T06:22:41.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.898+0000 7f0e4ba25700 1 Processor -- start 2023-10-17T06:22:41.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.898+0000 7f0e4ba25700 1 -- start start 2023-10-17T06:22:41.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.898+0000 7f0e4ba25700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0e4406f450 0x7f0e44161120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:41.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.898+0000 7f0e4ba25700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e440ca840 con 0x7f0e4415ce30 2023-10-17T06:22:41.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.898+0000 7f0e4ba25700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e440ca560 con 0x7f0e44161660 2023-10-17T06:22:41.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.898+0000 7f0e4ba25700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e440ccf30 con 0x7f0e4406f450 2023-10-17T06:22:41.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.898+0000 7f0e497c1700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0e4415ce30 0x7f0e44160a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:60282/0 (socket says 172.21.15.125:60282) 2023-10-17T06:22:41.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.898+0000 7f0e497c1700 1 -- 172.21.15.125:0/1677577855 learned_addr learned my addr 172.21.15.125:0/1677577855 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:22:41.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.898+0000 7f0e48fc0700 1 --2- 172.21.15.125:0/1677577855 >> v2:172.21.15.184:3300/0 conn(0x7f0e4406f450 0x7f0e44161120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:41.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.898+0000 7f0e48fc0700 1 -- 172.21.15.125:0/1677577855 >> v1:172.21.15.184:6789/0 conn(0x7f0e44161660 legacy=0x7f0e440c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:41.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.898+0000 7f0e48fc0700 1 -- 172.21.15.125:0/1677577855 >> v1:172.21.15.125:6789/0 conn(0x7f0e4415ce30 legacy=0x7f0e44160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:41.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.898+0000 7f0e3bfff700 1 -- 172.21.15.125:0/1677577855 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356697328 0 0) 0x7f0e440ca840 con 0x7f0e4415ce30 2023-10-17T06:22:41.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.898+0000 7f0e48fc0700 1 -- 172.21.15.125:0/1677577855 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e440cd210 con 0x7f0e4406f450 2023-10-17T06:22:41.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.902+0000 7f0e48fc0700 1 --2- 172.21.15.125:0/1677577855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e4406f450 0x7f0e44161120 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0e34009850 tx=0x7f0e34009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69f5d1e46b784e7c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:41.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.902+0000 7f0e3bfff700 1 -- 172.21.15.125:0/1677577855 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34011830 con 0x7f0e4406f450 2023-10-17T06:22:41.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.902+0000 7f0e3bfff700 1 -- 172.21.15.125:0/1677577855 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e34011990 con 0x7f0e4406f450 2023-10-17T06:22:41.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.902+0000 7f0e3bfff700 1 -- 172.21.15.125:0/1677577855 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34011d20 con 0x7f0e4406f450 2023-10-17T06:22:41.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.902+0000 7f0e4ba25700 1 -- 172.21.15.125:0/1677577855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e4406f450 msgr2=0x7f0e44161120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:41.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.902+0000 7f0e4ba25700 1 --2- 172.21.15.125:0/1677577855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e4406f450 0x7f0e44161120 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0e34009850 tx=0x7f0e34009b60 comp rx=0 tx=0).stop 2023-10-17T06:22:41.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.902+0000 7f0e4ba25700 1 -- 172.21.15.125:0/1677577855 shutdown_connections 2023-10-17T06:22:41.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.902+0000 7f0e4ba25700 1 --2- 172.21.15.125:0/1677577855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e4406f450 0x7f0e44161120 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.902+0000 7f0e4ba25700 1 -- 172.21.15.125:0/1677577855 >> 172.21.15.125:0/1677577855 conn(0x7f0e440ce820 msgr2=0x7f0e440cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:41.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.902+0000 7f0e4ba25700 1 -- 172.21.15.125:0/1677577855 shutdown_connections 2023-10-17T06:22:41.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.902+0000 7f0e4ba25700 1 -- 172.21.15.125:0/1677577855 wait complete. 2023-10-17T06:22:41.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.906+0000 7f0e4ba25700 1 Processor -- start 2023-10-17T06:22:41.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.906+0000 7f0e4ba25700 1 -- start start 2023-10-17T06:22:41.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.906+0000 7f0e4ba25700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e4406f450 0x7f0e440ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:41.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.906+0000 7f0e4ba25700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e4415ce30 0x7f0e440b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:41.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.906+0000 7f0e4ba25700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e44161660 0x7f0e440b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:41.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.906+0000 7f0e4ba25700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e441488e0 con 0x7f0e4415ce30 2023-10-17T06:22:41.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.906+0000 7f0e4ba25700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e44148b80 con 0x7f0e44161660 2023-10-17T06:22:41.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.906+0000 7f0e4ba25700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e44148e60 con 0x7f0e4406f450 2023-10-17T06:22:41.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.906+0000 7f0e48fc0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e4415ce30 0x7f0e440b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:41.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.906+0000 7f0e48fc0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e4415ce30 0x7f0e440b24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50322/0 (socket says 172.21.15.125:50322) 2023-10-17T06:22:41.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.906+0000 7f0e48fc0700 1 -- 172.21.15.125:0/2310967632 learned_addr learned my addr 172.21.15.125:0/2310967632 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:41.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.906+0000 7f0e497c1700 1 --2- 172.21.15.125:0/2310967632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e4406f450 0x7f0e440ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:41.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.906+0000 7f0e49fc2700 1 --2- 172.21.15.125:0/2310967632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e44161660 0x7f0e440b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:41.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.906+0000 7f0e48fc0700 1 -- 172.21.15.125:0/2310967632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e4406f450 msgr2=0x7f0e440ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:41.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.906+0000 7f0e48fc0700 1 --2- 172.21.15.125:0/2310967632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e4406f450 0x7f0e440ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.906+0000 7f0e48fc0700 1 -- 172.21.15.125:0/2310967632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e44161660 msgr2=0x7f0e440b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:41.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.906+0000 7f0e48fc0700 1 --2- 172.21.15.125:0/2310967632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e44161660 0x7f0e440b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:41.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.906+0000 7f0e48fc0700 1 -- 172.21.15.125:0/2310967632 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e340094b0 con 0x7f0e4415ce30 2023-10-17T06:22:41.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.906+0000 7f0e48fc0700 1 --2- 172.21.15.125:0/2310967632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e4415ce30 0x7f0e440b24b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0e34009fd0 tx=0x7f0e34004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:41.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.910+0000 7f0e39ffb700 1 -- 172.21.15.125:0/2310967632 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3400bc10 con 0x7f0e4415ce30 2023-10-17T06:22:41.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.910+0000 7f0e39ffb700 1 -- 172.21.15.125:0/2310967632 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3401f070 con 0x7f0e4415ce30 2023-10-17T06:22:41.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.910+0000 7f0e4ba25700 1 -- 172.21.15.125:0/2310967632 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e44149140 con 0x7f0e4415ce30 2023-10-17T06:22:41.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.910+0000 7f0e39ffb700 1 -- 172.21.15.125:0/2310967632 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3401a430 con 0x7f0e4415ce30 2023-10-17T06:22:41.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.910+0000 7f0e4ba25700 1 -- 172.21.15.125:0/2310967632 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e44149700 con 0x7f0e4415ce30 2023-10-17T06:22:41.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.910+0000 7f0e4ba25700 1 -- 172.21.15.125:0/2310967632 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e44072e60 con 0x7f0e4415ce30 2023-10-17T06:22:41.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.910+0000 7f0e39ffb700 1 -- 172.21.15.125:0/2310967632 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0e3401a590 con 0x7f0e4415ce30 2023-10-17T06:22:41.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.914+0000 7f0e39ffb700 1 --2- 172.21.15.125:0/2310967632 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0e28065720 0x7f0e28067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:41.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.914+0000 7f0e39ffb700 1 -- 172.21.15.125:0/2310967632 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f0e34021070 con 0x7f0e4415ce30 2023-10-17T06:22:41.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.914+0000 7f0e497c1700 1 --2- 172.21.15.125:0/2310967632 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0e28065720 0x7f0e28067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:41.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.914+0000 7f0e497c1700 1 --2- 172.21.15.125:0/2310967632 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0e28065720 0x7f0e28067be0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0e40000f60 tx=0x7f0e40007c40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:41.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:41.918+0000 7f0e39ffb700 1 -- 172.21.15.125:0/2310967632 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0e340521a0 con 0x7f0e4415ce30 2023-10-17T06:22:42.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.154+0000 7f0e4ba25700 1 -- 172.21.15.125:0/2310967632 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0e4406d0f0 con 0x7f0e4415ce30 2023-10-17T06:22:42.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.154+0000 7f0e39ffb700 1 -- 172.21.15.125:0/2310967632 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0e340557c0 con 0x7f0e4415ce30 2023-10-17T06:22:42.160 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:22:42.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.158+0000 7f0e4ba25700 1 -- 172.21.15.125:0/2310967632 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0e28065720 msgr2=0x7f0e28067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:42.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.158+0000 7f0e4ba25700 1 --2- 172.21.15.125:0/2310967632 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0e28065720 0x7f0e28067be0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0e40000f60 tx=0x7f0e40007c40 comp rx=0 tx=0).stop 2023-10-17T06:22:42.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.158+0000 7f0e4ba25700 1 -- 172.21.15.125:0/2310967632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e4415ce30 msgr2=0x7f0e440b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:42.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.158+0000 7f0e4ba25700 1 --2- 172.21.15.125:0/2310967632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e4415ce30 0x7f0e440b24b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0e34009fd0 tx=0x7f0e34004770 comp rx=0 tx=0).stop 2023-10-17T06:22:42.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.158+0000 7f0e4ba25700 1 -- 172.21.15.125:0/2310967632 shutdown_connections 2023-10-17T06:22:42.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.158+0000 7f0e4ba25700 1 --2- 172.21.15.125:0/2310967632 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0e28065720 0x7f0e28067be0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.158+0000 7f0e4ba25700 1 --2- 172.21.15.125:0/2310967632 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e44161660 0x7f0e440b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.158+0000 7f0e4ba25700 1 --2- 172.21.15.125:0/2310967632 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0e4415ce30 0x7f0e440b24b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.158+0000 7f0e4ba25700 1 --2- 172.21.15.125:0/2310967632 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e4406f450 0x7f0e440ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.158+0000 7f0e4ba25700 1 -- 172.21.15.125:0/2310967632 >> 172.21.15.125:0/2310967632 conn(0x7f0e440ce820 msgr2=0x7f0e440c4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:42.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.158+0000 7f0e4ba25700 1 -- 172.21.15.125:0/2310967632 shutdown_connections 2023-10-17T06:22:42.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.158+0000 7f0e4ba25700 1 -- 172.21.15.125:0/2310967632 wait complete. 2023-10-17T06:22:42.183 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-17T06:22:42.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.358+0000 7f1a14ad1700 1 Processor -- start 2023-10-17T06:22:42.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.358+0000 7f1a14ad1700 1 -- start start 2023-10-17T06:22:42.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.362+0000 7f1a14ad1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1a10159750 0x7f1a10070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:42.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.362+0000 7f1a14ad1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1a100ce040 0x7f1a1006cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:42.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.362+0000 7f1a14ad1700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a100b14f0 con 0x7f1a10070aa0 2023-10-17T06:22:42.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a14ad1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a100c9aa0 con 0x7f1a10159750 2023-10-17T06:22:42.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a14ad1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a10070f30 con 0x7f1a100ce040 2023-10-17T06:22:42.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a0f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1a10159750 0x7f1a10070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:42.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a0f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1a10159750 0x7f1a10070560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50332/0 (socket says 172.21.15.125:50332) 2023-10-17T06:22:42.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a0f7fe700 1 -- 172.21.15.125:0/1229983210 learned_addr learned my addr 172.21.15.125:0/1229983210 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:42.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a0ffff700 1 --2- 172.21.15.125:0/1229983210 >> v2:172.21.15.184:3300/0 conn(0x7f1a100ce040 0x7f1a1006cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:42.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a0f7fe700 1 -- 172.21.15.125:0/1229983210 >> v2:172.21.15.184:3300/0 conn(0x7f1a100ce040 msgr2=0x7f1a1006cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:42.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a0f7fe700 1 --2- 172.21.15.125:0/1229983210 >> v2:172.21.15.184:3300/0 conn(0x7f1a100ce040 0x7f1a1006cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a0f7fe700 1 -- 172.21.15.125:0/1229983210 >> v1:172.21.15.184:6789/0 conn(0x7f1a10070aa0 legacy=0x7f1a100cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:42.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a0f7fe700 1 -- 172.21.15.125:0/1229983210 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1015d590 con 0x7f1a10159750 2023-10-17T06:22:42.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a0f7fe700 1 --2- 172.21.15.125:0/1229983210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a10159750 0x7f1a10070560 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1a1015d350 tx=0x7f1a00009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84bd1b3123c00f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:42.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a0effd700 1 -- 172.21.15.125:0/1229983210 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a00004230 con 0x7f1a10159750 2023-10-17T06:22:42.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a0effd700 1 -- 172.21.15.125:0/1229983210 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a00004390 con 0x7f1a10159750 2023-10-17T06:22:42.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a0effd700 1 -- 172.21.15.125:0/1229983210 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a000036c0 con 0x7f1a10159750 2023-10-17T06:22:42.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a14ad1700 1 -- 172.21.15.125:0/1229983210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a10159750 msgr2=0x7f1a10070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:42.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a14ad1700 1 --2- 172.21.15.125:0/1229983210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a10159750 0x7f1a10070560 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1a1015d350 tx=0x7f1a00009bf0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a14ad1700 1 -- 172.21.15.125:0/1229983210 shutdown_connections 2023-10-17T06:22:42.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a14ad1700 1 --2- 172.21.15.125:0/1229983210 >> v2:172.21.15.184:3300/0 conn(0x7f1a100ce040 0x7f1a1006cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a14ad1700 1 --2- 172.21.15.125:0/1229983210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a10159750 0x7f1a10070560 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a14ad1700 1 -- 172.21.15.125:0/1229983210 >> 172.21.15.125:0/1229983210 conn(0x7f1a100ce5c0 msgr2=0x7f1a100ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:42.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a14ad1700 1 -- 172.21.15.125:0/1229983210 shutdown_connections 2023-10-17T06:22:42.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.366+0000 7f1a14ad1700 1 -- 172.21.15.125:0/1229983210 wait complete. 2023-10-17T06:22:42.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.370+0000 7f1a14ad1700 1 Processor -- start 2023-10-17T06:22:42.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.370+0000 7f1a14ad1700 1 -- start start 2023-10-17T06:22:42.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.370+0000 7f1a14ad1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a10070aa0 0x7f1a10157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:42.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.370+0000 7f1a14ad1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a100ce040 0x7f1a100c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:42.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.370+0000 7f1a14ad1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a10159750 0x7f1a100c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:42.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.370+0000 7f1a14ad1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a10139de0 con 0x7f1a10070aa0 2023-10-17T06:22:42.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.370+0000 7f1a14ad1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a10136ad0 con 0x7f1a100ce040 2023-10-17T06:22:42.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.370+0000 7f1a14ad1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a10139260 con 0x7f1a10159750 2023-10-17T06:22:42.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.370+0000 7f1a0f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a10070aa0 0x7f1a10157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:42.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.370+0000 7f1a0f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a10070aa0 0x7f1a10157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50340/0 (socket says 172.21.15.125:50340) 2023-10-17T06:22:42.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.370+0000 7f1a0f7fe700 1 -- 172.21.15.125:0/2475832369 learned_addr learned my addr 172.21.15.125:0/2475832369 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:42.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.370+0000 7f1a06ffd700 1 --2- 172.21.15.125:0/2475832369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a100ce040 0x7f1a100c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:42.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.374+0000 7f1a0ffff700 1 --2- 172.21.15.125:0/2475832369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a10159750 0x7f1a100c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:42.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.374+0000 7f1a0f7fe700 1 -- 172.21.15.125:0/2475832369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a10159750 msgr2=0x7f1a100c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:42.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.374+0000 7f1a0f7fe700 1 --2- 172.21.15.125:0/2475832369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a10159750 0x7f1a100c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.374+0000 7f1a0f7fe700 1 -- 172.21.15.125:0/2475832369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a100ce040 msgr2=0x7f1a100c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:42.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.374+0000 7f1a0f7fe700 1 --2- 172.21.15.125:0/2475832369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a100ce040 0x7f1a100c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.374+0000 7f1a0f7fe700 1 -- 172.21.15.125:0/2475832369 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a00009570 con 0x7f1a10070aa0 2023-10-17T06:22:42.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.374+0000 7f1a0f7fe700 1 --2- 172.21.15.125:0/2475832369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a10070aa0 0x7f1a10157100 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1a00004000 tx=0x7f1a00004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:42.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.374+0000 7f1a0cff9700 1 -- 172.21.15.125:0/2475832369 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0000b660 con 0x7f1a10070aa0 2023-10-17T06:22:42.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.374+0000 7f1a0cff9700 1 -- 172.21.15.125:0/2475832369 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0000b7c0 con 0x7f1a10070aa0 2023-10-17T06:22:42.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.374+0000 7f1a0cff9700 1 -- 172.21.15.125:0/2475832369 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0000bb50 con 0x7f1a10070aa0 2023-10-17T06:22:42.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.374+0000 7f1a14ad1700 1 -- 172.21.15.125:0/2475832369 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a10139540 con 0x7f1a10070aa0 2023-10-17T06:22:42.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.374+0000 7f1a14ad1700 1 -- 172.21.15.125:0/2475832369 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a10139b00 con 0x7f1a10070aa0 2023-10-17T06:22:42.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.374+0000 7f1a14ad1700 1 -- 172.21.15.125:0/2475832369 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1004e910 con 0x7f1a10070aa0 2023-10-17T06:22:42.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.378+0000 7f1a0cff9700 1 -- 172.21.15.125:0/2475832369 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1a0000bcb0 con 0x7f1a10070aa0 2023-10-17T06:22:42.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.378+0000 7f1a0cff9700 1 --2- 172.21.15.125:0/2475832369 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19f0065720 0x7f19f0067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:42.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.378+0000 7f1a0cff9700 1 -- 172.21.15.125:0/2475832369 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f1a00084870 con 0x7f1a10070aa0 2023-10-17T06:22:42.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.378+0000 7f1a06ffd700 1 --2- 172.21.15.125:0/2475832369 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19f0065720 0x7f19f0067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:42.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.378+0000 7f1a06ffd700 1 --2- 172.21.15.125:0/2475832369 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19f0065720 0x7f19f0067be0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1a1015cfd0 tx=0x7f19f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:42.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.386+0000 7f1a0cff9700 1 -- 172.21.15.125:0/2475832369 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f1a00052330 con 0x7f1a10070aa0 2023-10-17T06:22:42.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.574+0000 7f1a14ad1700 1 -- 172.21.15.125:0/2475832369 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a101559f0 con 0x7f1a10070aa0 2023-10-17T06:22:42.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.574+0000 7f1a0cff9700 1 -- 172.21.15.125:0/2475832369 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1a00055950 con 0x7f1a10070aa0 2023-10-17T06:22:42.582 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-17T06:22:42.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.582+0000 7f1a14ad1700 1 -- 172.21.15.125:0/2475832369 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19f0065720 msgr2=0x7f19f0067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:42.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.582+0000 7f1a14ad1700 1 --2- 172.21.15.125:0/2475832369 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19f0065720 0x7f19f0067be0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1a1015cfd0 tx=0x7f19f8009040 comp rx=0 tx=0).stop 2023-10-17T06:22:42.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.582+0000 7f1a14ad1700 1 -- 172.21.15.125:0/2475832369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a10070aa0 msgr2=0x7f1a10157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:42.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.582+0000 7f1a14ad1700 1 --2- 172.21.15.125:0/2475832369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a10070aa0 0x7f1a10157100 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1a00004000 tx=0x7f1a00004770 comp rx=0 tx=0).stop 2023-10-17T06:22:42.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.582+0000 7f1a14ad1700 1 -- 172.21.15.125:0/2475832369 shutdown_connections 2023-10-17T06:22:42.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.582+0000 7f1a14ad1700 1 --2- 172.21.15.125:0/2475832369 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f19f0065720 0x7f19f0067be0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.582+0000 7f1a14ad1700 1 --2- 172.21.15.125:0/2475832369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a10159750 0x7f1a100c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.582+0000 7f1a14ad1700 1 --2- 172.21.15.125:0/2475832369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a100ce040 0x7f1a100c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.582+0000 7f1a14ad1700 1 --2- 172.21.15.125:0/2475832369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a10070aa0 0x7f1a10157100 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.582+0000 7f1a14ad1700 1 -- 172.21.15.125:0/2475832369 >> 172.21.15.125:0/2475832369 conn(0x7f1a100ce5c0 msgr2=0x7f1a100cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:42.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.582+0000 7f1a14ad1700 1 -- 172.21.15.125:0/2475832369 shutdown_connections 2023-10-17T06:22:42.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.582+0000 7f1a14ad1700 1 -- 172.21.15.125:0/2475832369 wait complete. 2023-10-17T06:22:42.608 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-17T06:22:42.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.774+0000 7f7816a47700 1 Processor -- start 2023-10-17T06:22:42.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.774+0000 7f7816a47700 1 -- start start 2023-10-17T06:22:42.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.778+0000 7f7816a47700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7810160e50 0x7f781006e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:42.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.778+0000 7f7816a47700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78100cb500 0x7f78100b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:42.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.778+0000 7f7816a47700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f78100b2720 0x7f7810164af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:42.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.778+0000 7f7816a47700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78100b1ee0 con 0x7f7810160e50 2023-10-17T06:22:42.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.778+0000 7f7816a47700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78100b2b90 con 0x7f78100b2720 2023-10-17T06:22:42.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.778+0000 7f7816a47700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78100b16d0 con 0x7f78100cb500 2023-10-17T06:22:42.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.778+0000 7f7815a45700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7810160e50 0x7f781006e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:42.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.778+0000 7f7815a45700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7810160e50 0x7f781006e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50356/0 (socket says 172.21.15.125:50356) 2023-10-17T06:22:42.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.778+0000 7f7815a45700 1 -- 172.21.15.125:0/2391437512 learned_addr learned my addr 172.21.15.125:0/2391437512 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:42.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.778+0000 7f7815244700 1 --2- 172.21.15.125:0/2391437512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78100cb500 0x7f78100b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:42.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.778+0000 7f7816246700 1 --2- 172.21.15.125:0/2391437512 >> v2:172.21.15.184:3300/0 conn(0x7f78100b2720 0x7f7810164af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:42.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.778+0000 7f7815a45700 1 -- 172.21.15.125:0/2391437512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78100cb500 msgr2=0x7f78100b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:42.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.778+0000 7f7815a45700 1 --2- 172.21.15.125:0/2391437512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78100cb500 0x7f78100b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.778+0000 7f7815a45700 1 -- 172.21.15.125:0/2391437512 >> v2:172.21.15.184:3300/0 conn(0x7f78100b2720 msgr2=0x7f7810164af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:42.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.778+0000 7f7815a45700 1 --2- 172.21.15.125:0/2391437512 >> v2:172.21.15.184:3300/0 conn(0x7f78100b2720 0x7f7810164af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.778+0000 7f7815a45700 1 -- 172.21.15.125:0/2391437512 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78100ae0f0 con 0x7f7810160e50 2023-10-17T06:22:42.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.778+0000 7f7815a45700 1 --2- 172.21.15.125:0/2391437512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7810160e50 0x7f781006e3e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f78100b3cf0 tx=0x7f780c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb54cf7a0cb33b34 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:42.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.782+0000 7f7814a43700 1 -- 172.21.15.125:0/2391437512 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c011830 con 0x7f7810160e50 2023-10-17T06:22:42.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.782+0000 7f7814a43700 1 -- 172.21.15.125:0/2391437512 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c011990 con 0x7f7810160e50 2023-10-17T06:22:42.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.782+0000 7f7814a43700 1 -- 172.21.15.125:0/2391437512 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c011d40 con 0x7f7810160e50 2023-10-17T06:22:42.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.782+0000 7f7816a47700 1 -- 172.21.15.125:0/2391437512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7810160e50 msgr2=0x7f781006e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:42.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.782+0000 7f7816a47700 1 --2- 172.21.15.125:0/2391437512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7810160e50 0x7f781006e3e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f78100b3cf0 tx=0x7f780c009c20 comp rx=0 tx=0).stop 2023-10-17T06:22:42.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.782+0000 7f7816a47700 1 -- 172.21.15.125:0/2391437512 shutdown_connections 2023-10-17T06:22:42.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.782+0000 7f7816a47700 1 --2- 172.21.15.125:0/2391437512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78100cb500 0x7f78100b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.782+0000 7f7816a47700 1 --2- 172.21.15.125:0/2391437512 >> v2:172.21.15.184:3300/0 conn(0x7f78100b2720 0x7f7810164af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.782+0000 7f7816a47700 1 --2- 172.21.15.125:0/2391437512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7810160e50 0x7f781006e3e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.782+0000 7f7816a47700 1 -- 172.21.15.125:0/2391437512 >> 172.21.15.125:0/2391437512 conn(0x7f78100b0bf0 msgr2=0x7f78100ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:42.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.782+0000 7f7816a47700 1 -- 172.21.15.125:0/2391437512 shutdown_connections 2023-10-17T06:22:42.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.782+0000 7f7816a47700 1 -- 172.21.15.125:0/2391437512 wait complete. 2023-10-17T06:22:42.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.782+0000 7f7816a47700 1 Processor -- start 2023-10-17T06:22:42.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.782+0000 7f7816a47700 1 -- start start 2023-10-17T06:22:42.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f7816a47700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78100b2720 0x7f78101f9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:42.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f7816a47700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78100cb500 0x7f781015f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:42.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f7816a47700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7810160e50 0x7f78100a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:42.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f7816a47700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78101f7900 con 0x7f78100cb500 2023-10-17T06:22:42.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f7816a47700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78101faaa0 con 0x7f7810160e50 2023-10-17T06:22:42.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f7816a47700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78101fa200 con 0x7f78100b2720 2023-10-17T06:22:42.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f7815244700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78100cb500 0x7f781015f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:42.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f7815244700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78100cb500 0x7f781015f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50360/0 (socket says 172.21.15.125:50360) 2023-10-17T06:22:42.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f7815244700 1 -- 172.21.15.125:0/446666772 learned_addr learned my addr 172.21.15.125:0/446666772 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:42.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f7816246700 1 --2- 172.21.15.125:0/446666772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7810160e50 0x7f78100a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:42.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f7815a45700 1 --2- 172.21.15.125:0/446666772 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78100b2720 0x7f78101f9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:42.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f7815244700 1 -- 172.21.15.125:0/446666772 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78100b2720 msgr2=0x7f78101f9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:42.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f7815244700 1 --2- 172.21.15.125:0/446666772 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78100b2720 0x7f78101f9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f7815244700 1 -- 172.21.15.125:0/446666772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7810160e50 msgr2=0x7f78100a7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:42.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f7815244700 1 --2- 172.21.15.125:0/446666772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7810160e50 0x7f78100a7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:42.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f7815244700 1 -- 172.21.15.125:0/446666772 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c009570 con 0x7f78100cb500 2023-10-17T06:22:42.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f7815244700 1 --2- 172.21.15.125:0/446666772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78100cb500 0x7f781015f850 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f780000e980 tx=0x7f780000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:42.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f78067fc700 1 -- 172.21.15.125:0/446666772 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78000096e0 con 0x7f78100cb500 2023-10-17T06:22:42.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f78067fc700 1 -- 172.21.15.125:0/446666772 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780000c850 con 0x7f78100cb500 2023-10-17T06:22:42.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f7816a47700 1 -- 172.21.15.125:0/446666772 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78101fa4e0 con 0x7f78100cb500 2023-10-17T06:22:42.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f78067fc700 1 -- 172.21.15.125:0/446666772 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780000cbe0 con 0x7f78100cb500 2023-10-17T06:22:42.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.786+0000 7f7816a47700 1 -- 172.21.15.125:0/446666772 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78101635b0 con 0x7f78100cb500 2023-10-17T06:22:42.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.790+0000 7f7816a47700 1 -- 172.21.15.125:0/446666772 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7810072e60 con 0x7f78100cb500 2023-10-17T06:22:42.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.790+0000 7f78067fc700 1 -- 172.21.15.125:0/446666772 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7800013470 con 0x7f78100cb500 2023-10-17T06:22:42.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.790+0000 7f78067fc700 1 --2- 172.21.15.125:0/446666772 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f77f40656f0 0x7f77f4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:42.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.790+0000 7f78067fc700 1 -- 172.21.15.125:0/446666772 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f7800083060 con 0x7f78100cb500 2023-10-17T06:22:42.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.790+0000 7f7815a45700 1 --2- 172.21.15.125:0/446666772 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f77f40656f0 0x7f77f4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:42.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.794+0000 7f7815a45700 1 --2- 172.21.15.125:0/446666772 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f77f40656f0 0x7f77f4067bb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f780c014040 tx=0x7f780c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:42.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:42.794+0000 7f78067fc700 1 -- 172.21.15.125:0/446666772 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f78000b3d40 con 0x7f78100cb500 2023-10-17T06:22:43.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.014+0000 7f7816a47700 1 -- 172.21.15.125:0/446666772 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f781006d400 con 0x7f78100cb500 2023-10-17T06:22:43.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.014+0000 7f78067fc700 1 -- 172.21.15.125:0/446666772 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v55) v1 ==== 80+0+59 (secure 0 0 0) 0x7f78000544b0 con 0x7f78100cb500 2023-10-17T06:22:43.020 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:0/3775054255 2023-10-17T07:15:56.011706+0000 2023-10-17T06:22:43.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.018+0000 7f7816a47700 1 -- 172.21.15.125:0/446666772 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f77f40656f0 msgr2=0x7f77f4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:43.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.018+0000 7f7816a47700 1 --2- 172.21.15.125:0/446666772 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f77f40656f0 0x7f77f4067bb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f780c014040 tx=0x7f780c008030 comp rx=0 tx=0).stop 2023-10-17T06:22:43.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.018+0000 7f7816a47700 1 -- 172.21.15.125:0/446666772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78100cb500 msgr2=0x7f781015f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:43.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.018+0000 7f7816a47700 1 --2- 172.21.15.125:0/446666772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78100cb500 0x7f781015f850 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f780000e980 tx=0x7f780000ed40 comp rx=0 tx=0).stop 2023-10-17T06:22:43.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.018+0000 7f7816a47700 1 -- 172.21.15.125:0/446666772 shutdown_connections 2023-10-17T06:22:43.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.018+0000 7f7816a47700 1 --2- 172.21.15.125:0/446666772 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f77f40656f0 0x7f77f4067bb0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:43.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.018+0000 7f7816a47700 1 --2- 172.21.15.125:0/446666772 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7810160e50 0x7f78100a7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:43.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.018+0000 7f7816a47700 1 --2- 172.21.15.125:0/446666772 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78100cb500 0x7f781015f850 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:43.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.018+0000 7f7816a47700 1 --2- 172.21.15.125:0/446666772 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78100b2720 0x7f78101f9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:43.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.018+0000 7f7816a47700 1 -- 172.21.15.125:0/446666772 >> 172.21.15.125:0/446666772 conn(0x7f78100b0bf0 msgr2=0x7f78100ad7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:43.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.018+0000 7f7816a47700 1 -- 172.21.15.125:0/446666772 shutdown_connections 2023-10-17T06:22:43.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.018+0000 7f7816a47700 1 -- 172.21.15.125:0/446666772 wait complete. 2023-10-17T06:22:43.026 INFO:teuthology.orchestra.run.smithi125.stderr:listed 1 entries 2023-10-17T06:22:43.048 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-17T06:22:43.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:43.049 DEBUG:teuthology.orchestra.run.smithi125:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-17T06:22:43.095 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-10-17T06:22:43.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:43.095 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-17T06:22:43.161 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:22:43.161 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:22:43.180 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:22:43.181 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:22:43.243 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:22:43.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.422+0000 7f6d86d1a700 1 Processor -- start 2023-10-17T06:22:43.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.422+0000 7f6d86d1a700 1 -- start start 2023-10-17T06:22:43.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.426+0000 7f6d86d1a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6d8015ee50 0x7f6d800cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:43.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.426+0000 7f6d86d1a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6d8006e8a0 0x7f6d800caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:43.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.426+0000 7f6d86d1a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8006f450 con 0x7f6d800cb470 2023-10-17T06:22:43.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.426+0000 7f6d86d1a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d8006d4e0 con 0x7f6d8006e8a0 2023-10-17T06:22:43.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.426+0000 7f6d86d1a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d80162780 con 0x7f6d8015ee50 2023-10-17T06:22:43.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.426+0000 7f6d77fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6d8006e8a0 0x7f6d800caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:43.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.426+0000 7f6d84ab6700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6d8015ee50 0x7f6d800cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:43.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.426+0000 7f6d77fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6d8006e8a0 0x7f6d800caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40218/0 (socket says 172.21.15.125:40218) 2023-10-17T06:22:43.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.426+0000 7f6d77fff700 1 -- 172.21.15.125:0/3947969324 learned_addr learned my addr 172.21.15.125:0/3947969324 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:43.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.426+0000 7f6d77fff700 1 -- 172.21.15.125:0/3947969324 >> v2:172.21.15.184:3300/0 conn(0x7f6d8015ee50 msgr2=0x7f6d800cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:43.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.426+0000 7f6d77fff700 1 --2- 172.21.15.125:0/3947969324 >> v2:172.21.15.184:3300/0 conn(0x7f6d8015ee50 0x7f6d800cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:43.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.426+0000 7f6d77fff700 1 -- 172.21.15.125:0/3947969324 >> v1:172.21.15.125:6789/0 conn(0x7f6d800cb470 legacy=0x7f6d8006f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:43.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.426+0000 7f6d77fff700 1 -- 172.21.15.125:0/3947969324 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d800cb8a0 con 0x7f6d8006e8a0 2023-10-17T06:22:43.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.426+0000 7f6d77fff700 1 --2- 172.21.15.125:0/3947969324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d8006e8a0 0x7f6d800caf30 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6d8006b360 tx=0x7f6d70009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40714e899bf258f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:43.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.426+0000 7f6d777fe700 1 -- 172.21.15.125:0/3947969324 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d70011830 con 0x7f6d8006e8a0 2023-10-17T06:22:43.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.426+0000 7f6d777fe700 1 -- 172.21.15.125:0/3947969324 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d70011990 con 0x7f6d8006e8a0 2023-10-17T06:22:43.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.426+0000 7f6d777fe700 1 -- 172.21.15.125:0/3947969324 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d70011d20 con 0x7f6d8006e8a0 2023-10-17T06:22:43.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.430+0000 7f6d86d1a700 1 -- 172.21.15.125:0/3947969324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d8006e8a0 msgr2=0x7f6d800caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:43.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.430+0000 7f6d86d1a700 1 --2- 172.21.15.125:0/3947969324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d8006e8a0 0x7f6d800caf30 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6d8006b360 tx=0x7f6d70009bf0 comp rx=0 tx=0).stop 2023-10-17T06:22:43.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.430+0000 7f6d86d1a700 1 -- 172.21.15.125:0/3947969324 shutdown_connections 2023-10-17T06:22:43.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.430+0000 7f6d86d1a700 1 --2- 172.21.15.125:0/3947969324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d8006e8a0 0x7f6d800caf30 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:43.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.430+0000 7f6d86d1a700 1 --2- 172.21.15.125:0/3947969324 >> v2:172.21.15.184:3300/0 conn(0x7f6d8015ee50 0x7f6d800cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:43.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.430+0000 7f6d86d1a700 1 -- 172.21.15.125:0/3947969324 >> 172.21.15.125:0/3947969324 conn(0x7f6d8006a340 msgr2=0x7f6d800b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:43.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.430+0000 7f6d86d1a700 1 -- 172.21.15.125:0/3947969324 shutdown_connections 2023-10-17T06:22:43.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.430+0000 7f6d86d1a700 1 -- 172.21.15.125:0/3947969324 wait complete. 2023-10-17T06:22:43.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.430+0000 7f6d86d1a700 1 Processor -- start 2023-10-17T06:22:43.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.430+0000 7f6d86d1a700 1 -- start start 2023-10-17T06:22:43.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d86d1a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d8006e8a0 0x7f6d800acf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:43.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d86d1a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d800cb470 0x7f6d800aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:43.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d86d1a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d8015ee50 0x7f6d8014d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:43.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d86d1a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d801611c0 con 0x7f6d8006e8a0 2023-10-17T06:22:43.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d86d1a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d800ad470 con 0x7f6d800cb470 2023-10-17T06:22:43.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d86d1a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d80154570 con 0x7f6d8015ee50 2023-10-17T06:22:43.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d84ab6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d8006e8a0 0x7f6d800acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:43.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d84ab6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d8006e8a0 0x7f6d800acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40222/0 (socket says 172.21.15.125:40222) 2023-10-17T06:22:43.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d84ab6700 1 -- 172.21.15.125:0/69331413 learned_addr learned my addr 172.21.15.125:0/69331413 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:43.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d77fff700 1 --2- 172.21.15.125:0/69331413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d800cb470 0x7f6d800aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:43.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d852b7700 1 --2- 172.21.15.125:0/69331413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d8015ee50 0x7f6d8014d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:43.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d84ab6700 1 -- 172.21.15.125:0/69331413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d8015ee50 msgr2=0x7f6d8014d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:43.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d84ab6700 1 --2- 172.21.15.125:0/69331413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d8015ee50 0x7f6d8014d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:43.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d84ab6700 1 -- 172.21.15.125:0/69331413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d800cb470 msgr2=0x7f6d800aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:43.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d84ab6700 1 --2- 172.21.15.125:0/69331413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d800cb470 0x7f6d800aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:43.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d84ab6700 1 -- 172.21.15.125:0/69331413 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d70009570 con 0x7f6d8006e8a0 2023-10-17T06:22:43.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d77fff700 1 --2- 172.21.15.125:0/69331413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d800cb470 0x7f6d800aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:22:43.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d852b7700 1 --2- 172.21.15.125:0/69331413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d8015ee50 0x7f6d8014d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:22:43.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d84ab6700 1 --2- 172.21.15.125:0/69331413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d8006e8a0 0x7f6d800acf30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00e9d0 tx=0x7f6d7c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:43.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d757fa700 1 -- 172.21.15.125:0/69331413 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c009720 con 0x7f6d8006e8a0 2023-10-17T06:22:43.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d757fa700 1 -- 172.21.15.125:0/69331413 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7c00c850 con 0x7f6d8006e8a0 2023-10-17T06:22:43.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d757fa700 1 -- 172.21.15.125:0/69331413 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c00cbc0 con 0x7f6d8006e8a0 2023-10-17T06:22:43.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d86d1a700 1 -- 172.21.15.125:0/69331413 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d80160920 con 0x7f6d8006e8a0 2023-10-17T06:22:43.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.434+0000 7f6d86d1a700 1 -- 172.21.15.125:0/69331413 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d80160ee0 con 0x7f6d8006e8a0 2023-10-17T06:22:43.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.438+0000 7f6d86d1a700 1 -- 172.21.15.125:0/69331413 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d80072e60 con 0x7f6d8006e8a0 2023-10-17T06:22:43.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.438+0000 7f6d757fa700 1 -- 172.21.15.125:0/69331413 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6d7c00cd20 con 0x7f6d8006e8a0 2023-10-17T06:22:43.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.438+0000 7f6d757fa700 1 --2- 172.21.15.125:0/69331413 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6d6c0656f0 0x7f6d6c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:43.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.442+0000 7f6d757fa700 1 -- 172.21.15.125:0/69331413 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f6d7c083140 con 0x7f6d8006e8a0 2023-10-17T06:22:43.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.442+0000 7f6d77fff700 1 --2- 172.21.15.125:0/69331413 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6d6c0656f0 0x7f6d6c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:43.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.442+0000 7f6d77fff700 1 --2- 172.21.15.125:0/69331413 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6d6c0656f0 0x7f6d6c067bb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6d70000c00 tx=0x7f6d70008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:43.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.446+0000 7f6d757fa700 1 -- 172.21.15.125:0/69331413 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f6d7c0544d0 con 0x7f6d8006e8a0 2023-10-17T06:22:43.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.630+0000 7f6d86d1a700 1 -- 172.21.15.125:0/69331413 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d800b1160 con 0x7f6d8006e8a0 2023-10-17T06:22:43.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.634+0000 7f6d757fa700 1 -- 172.21.15.125:0/69331413 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+18788 (secure 0 0 0) 0x7f6d7c054060 con 0x7f6d8006e8a0 2023-10-17T06:22:43.640 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:22:43.640 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":55,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:16:02.394779+0000","last_up_change":"2023-10-17T06:16:01.390745+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:08:48.973490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-17T06:08:50.385778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":50,"up_from":54,"up_thru":54,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6801","nonce":1353754211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6803","nonce":1353754211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6807","nonce":1353754211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6805","nonce":1353754211}]},"public_addr":"172.21.15.125:6801/1353754211","cluster_addr":"172.21.15.125:6803/1353754211","heartbeat_back_addr":"172.21.15.125:6807/1353754211","heartbeat_front_addr":"172.21.15.125:6805/1353754211","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"2023-10-17T06:09:26.602656+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":51},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.12","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:0/3775054255":"2023-10-17T07:15:56.011706+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:22:43.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.638+0000 7f6d86d1a700 1 -- 172.21.15.125:0/69331413 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6d6c0656f0 msgr2=0x7f6d6c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:43.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.638+0000 7f6d86d1a700 1 --2- 172.21.15.125:0/69331413 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6d6c0656f0 0x7f6d6c067bb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6d70000c00 tx=0x7f6d70008030 comp rx=0 tx=0).stop 2023-10-17T06:22:43.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.638+0000 7f6d86d1a700 1 -- 172.21.15.125:0/69331413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d8006e8a0 msgr2=0x7f6d800acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:43.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.638+0000 7f6d86d1a700 1 --2- 172.21.15.125:0/69331413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d8006e8a0 0x7f6d800acf30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00e9d0 tx=0x7f6d7c00ed90 comp rx=0 tx=0).stop 2023-10-17T06:22:43.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.638+0000 7f6d86d1a700 1 -- 172.21.15.125:0/69331413 shutdown_connections 2023-10-17T06:22:43.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.638+0000 7f6d86d1a700 1 --2- 172.21.15.125:0/69331413 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6d6c0656f0 0x7f6d6c067bb0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:43.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.638+0000 7f6d86d1a700 1 --2- 172.21.15.125:0/69331413 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6d8015ee50 0x7f6d8014d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:43.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.638+0000 7f6d86d1a700 1 --2- 172.21.15.125:0/69331413 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6d800cb470 0x7f6d800aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:43.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.638+0000 7f6d86d1a700 1 --2- 172.21.15.125:0/69331413 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d8006e8a0 0x7f6d800acf30 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:43.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.638+0000 7f6d86d1a700 1 -- 172.21.15.125:0/69331413 >> 172.21.15.125:0/69331413 conn(0x7f6d8006a340 msgr2=0x7f6d800afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:43.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.638+0000 7f6d86d1a700 1 -- 172.21.15.125:0/69331413 shutdown_connections 2023-10-17T06:22:43.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.638+0000 7f6d86d1a700 1 -- 172.21.15.125:0/69331413 wait complete. 2023-10-17T06:22:43.664 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-17T06:08:48.973490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-17T06:08:50.385778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-17T06:22:43.665 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:22:43.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.834+0000 7f62cf01e700 1 Processor -- start 2023-10-17T06:22:43.839 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.834+0000 7f62cf01e700 1 -- start start 2023-10-17T06:22:43.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.834+0000 7f62cf01e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62c80cad50 0x7f62c806e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:43.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.834+0000 7f62cf01e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f62c806ea50 0x7f62c80c9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:43.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.834+0000 7f62cf01e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c80cc3f0 con 0x7f62c80c1e30 2023-10-17T06:22:43.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.834+0000 7f62cf01e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c80c2210 con 0x7f62c806ea50 2023-10-17T06:22:43.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.834+0000 7f62cf01e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c806d820 con 0x7f62c80cad50 2023-10-17T06:22:43.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62bffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62c80cad50 0x7f62c806e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:43.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62bffff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62c80cad50 0x7f62c806e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:49650/0 (socket says 172.21.15.125:49650) 2023-10-17T06:22:43.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62ccdba700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f62c80c1e30 0x7f62c806f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:46332/0 (socket says 172.21.15.125:46332) 2023-10-17T06:22:43.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62bffff700 1 -- 172.21.15.125:0/4069379821 learned_addr learned my addr 172.21.15.125:0/4069379821 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:43.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62cd5bb700 1 --2- 172.21.15.125:0/4069379821 >> v2:172.21.15.125:3300/0 conn(0x7f62c806ea50 0x7f62c80c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:43.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62bffff700 1 -- 172.21.15.125:0/4069379821 >> v2:172.21.15.125:3300/0 conn(0x7f62c806ea50 msgr2=0x7f62c80c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:43.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62bffff700 1 --2- 172.21.15.125:0/4069379821 >> v2:172.21.15.125:3300/0 conn(0x7f62c806ea50 0x7f62c80c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:43.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62bffff700 1 -- 172.21.15.125:0/4069379821 >> v1:172.21.15.184:6789/0 conn(0x7f62c80c1e30 legacy=0x7f62c806f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:43.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62bffff700 1 -- 172.21.15.125:0/4069379821 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c806e080 con 0x7f62c80cad50 2023-10-17T06:22:43.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62cd5bb700 1 --2- 172.21.15.125:0/4069379821 >> v2:172.21.15.125:3300/0 conn(0x7f62c806ea50 0x7f62c80c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:22:43.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62bf7fe700 1 -- 172.21.15.125:0/4069379821 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13184456 0 0) 0x7f62c80cc3f0 con 0x7f62c80c1e30 2023-10-17T06:22:43.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62bffff700 1 --2- 172.21.15.125:0/4069379821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62c80cad50 0x7f62c806e510 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f62b8009910 tx=0x7f62b8009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dae9215113738573 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:43.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62bf7fe700 1 -- 172.21.15.125:0/4069379821 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b800ba60 con 0x7f62c80cad50 2023-10-17T06:22:43.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62bf7fe700 1 -- 172.21.15.125:0/4069379821 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b800bbc0 con 0x7f62c80cad50 2023-10-17T06:22:43.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62bf7fe700 1 -- 172.21.15.125:0/4069379821 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b8009e60 con 0x7f62c80cad50 2023-10-17T06:22:43.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62cf01e700 1 -- 172.21.15.125:0/4069379821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62c80cad50 msgr2=0x7f62c806e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:43.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62cf01e700 1 --2- 172.21.15.125:0/4069379821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62c80cad50 0x7f62c806e510 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f62b8009910 tx=0x7f62b8009c20 comp rx=0 tx=0).stop 2023-10-17T06:22:43.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62cf01e700 1 -- 172.21.15.125:0/4069379821 shutdown_connections 2023-10-17T06:22:43.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62cf01e700 1 --2- 172.21.15.125:0/4069379821 >> v2:172.21.15.125:3300/0 conn(0x7f62c806ea50 0x7f62c80c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:43.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62cf01e700 1 --2- 172.21.15.125:0/4069379821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62c80cad50 0x7f62c806e510 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:43.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.838+0000 7f62cf01e700 1 -- 172.21.15.125:0/4069379821 >> 172.21.15.125:0/4069379821 conn(0x7f62c80ce820 msgr2=0x7f62c80cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:43.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.842+0000 7f62cf01e700 1 -- 172.21.15.125:0/4069379821 shutdown_connections 2023-10-17T06:22:43.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.842+0000 7f62cf01e700 1 -- 172.21.15.125:0/4069379821 wait complete. 2023-10-17T06:22:43.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.842+0000 7f62cf01e700 1 Processor -- start 2023-10-17T06:22:43.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.842+0000 7f62cf01e700 1 -- start start 2023-10-17T06:22:43.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62cf01e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c806ea50 0x7f62c815f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:43.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62cf01e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62c80c1e30 0x7f62c80c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:43.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62cf01e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62c80cad50 0x7f62c80c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:43.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62cf01e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c80c6e50 con 0x7f62c806ea50 2023-10-17T06:22:43.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62cf01e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c80c61d0 con 0x7f62c80cad50 2023-10-17T06:22:43.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62cf01e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c80c64b0 con 0x7f62c80c1e30 2023-10-17T06:22:43.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62ccdba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c806ea50 0x7f62c815f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:43.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62ccdba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c806ea50 0x7f62c815f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40236/0 (socket says 172.21.15.125:40236) 2023-10-17T06:22:43.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62ccdba700 1 -- 172.21.15.125:0/3190359751 learned_addr learned my addr 172.21.15.125:0/3190359751 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:43.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62bffff700 1 --2- 172.21.15.125:0/3190359751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62c80c1e30 0x7f62c80c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:43.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62cd5bb700 1 --2- 172.21.15.125:0/3190359751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62c80cad50 0x7f62c80c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:43.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62ccdba700 1 -- 172.21.15.125:0/3190359751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62c80c1e30 msgr2=0x7f62c80c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:43.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62ccdba700 1 --2- 172.21.15.125:0/3190359751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62c80c1e30 0x7f62c80c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:43.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62ccdba700 1 -- 172.21.15.125:0/3190359751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62c80cad50 msgr2=0x7f62c80c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:43.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62ccdba700 1 --2- 172.21.15.125:0/3190359751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62c80cad50 0x7f62c80c58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:43.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62ccdba700 1 -- 172.21.15.125:0/3190359751 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b8009570 con 0x7f62c806ea50 2023-10-17T06:22:43.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62bffff700 1 --2- 172.21.15.125:0/3190359751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62c80c1e30 0x7f62c80c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:22:43.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62cd5bb700 1 --2- 172.21.15.125:0/3190359751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62c80cad50 0x7f62c80c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:22:43.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62ccdba700 1 --2- 172.21.15.125:0/3190359751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c806ea50 0x7f62c815f050 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f62c400c580 tx=0x7f62c400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:43.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62bd7fa700 1 -- 172.21.15.125:0/3190359751 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c4004ca0 con 0x7f62c806ea50 2023-10-17T06:22:43.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62bd7fa700 1 -- 172.21.15.125:0/3190359751 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c4004e20 con 0x7f62c806ea50 2023-10-17T06:22:43.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62cf01e700 1 -- 172.21.15.125:0/3190359751 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c80c6790 con 0x7f62c806ea50 2023-10-17T06:22:43.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62bd7fa700 1 -- 172.21.15.125:0/3190359751 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c4007310 con 0x7f62c806ea50 2023-10-17T06:22:43.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62cf01e700 1 -- 172.21.15.125:0/3190359751 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c80c77b0 con 0x7f62c806ea50 2023-10-17T06:22:43.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.846+0000 7f62cf01e700 1 -- 172.21.15.125:0/3190359751 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c8072e60 con 0x7f62c806ea50 2023-10-17T06:22:43.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.850+0000 7f62bd7fa700 1 -- 172.21.15.125:0/3190359751 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f62c4007470 con 0x7f62c806ea50 2023-10-17T06:22:43.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.850+0000 7f62bd7fa700 1 --2- 172.21.15.125:0/3190359751 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f62b40656f0 0x7f62b4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:43.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.850+0000 7f62bd7fa700 1 -- 172.21.15.125:0/3190359751 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f62c4082e70 con 0x7f62c806ea50 2023-10-17T06:22:43.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.850+0000 7f62bffff700 1 --2- 172.21.15.125:0/3190359751 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f62b40656f0 0x7f62b4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:43.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.854+0000 7f62bffff700 1 --2- 172.21.15.125:0/3190359751 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f62b40656f0 0x7f62b4067bb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f62c80cd3c0 tx=0x7f62b8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:43.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:43.858+0000 7f62bd7fa700 1 -- 172.21.15.125:0/3190359751 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f62c4050660 con 0x7f62c806ea50 2023-10-17T06:22:44.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.034+0000 7f62cf01e700 1 -- 172.21.15.125:0/3190359751 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62c8164c10 con 0x7f62c806ea50 2023-10-17T06:22:44.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.034+0000 7f62bd7fa700 1 -- 172.21.15.125:0/3190359751 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f62c4007720 con 0x7f62c806ea50 2023-10-17T06:22:44.041 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:22:44.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.038+0000 7f62cf01e700 1 -- 172.21.15.125:0/3190359751 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f62b40656f0 msgr2=0x7f62b4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:44.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.038+0000 7f62cf01e700 1 --2- 172.21.15.125:0/3190359751 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f62b40656f0 0x7f62b4067bb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f62c80cd3c0 tx=0x7f62b8008030 comp rx=0 tx=0).stop 2023-10-17T06:22:44.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.038+0000 7f62cf01e700 1 -- 172.21.15.125:0/3190359751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c806ea50 msgr2=0x7f62c815f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:44.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.038+0000 7f62cf01e700 1 --2- 172.21.15.125:0/3190359751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c806ea50 0x7f62c815f050 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f62c400c580 tx=0x7f62c400c940 comp rx=0 tx=0).stop 2023-10-17T06:22:44.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.038+0000 7f62cf01e700 1 -- 172.21.15.125:0/3190359751 shutdown_connections 2023-10-17T06:22:44.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.038+0000 7f62cf01e700 1 --2- 172.21.15.125:0/3190359751 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f62b40656f0 0x7f62b4067bb0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.038+0000 7f62cf01e700 1 --2- 172.21.15.125:0/3190359751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f62c80cad50 0x7f62c80c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.038+0000 7f62cf01e700 1 --2- 172.21.15.125:0/3190359751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f62c80c1e30 0x7f62c80c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.038+0000 7f62cf01e700 1 --2- 172.21.15.125:0/3190359751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f62c806ea50 0x7f62c815f050 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.038+0000 7f62cf01e700 1 -- 172.21.15.125:0/3190359751 >> 172.21.15.125:0/3190359751 conn(0x7f62c80ce820 msgr2=0x7f62c80c2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:44.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.038+0000 7f62cf01e700 1 -- 172.21.15.125:0/3190359751 shutdown_connections 2023-10-17T06:22:44.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.038+0000 7f62cf01e700 1 -- 172.21.15.125:0/3190359751 wait complete. 2023-10-17T06:22:44.065 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:22:44.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.250+0000 7fc99c97e700 1 Processor -- start 2023-10-17T06:22:44.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.250+0000 7fc99c97e700 1 -- start start 2023-10-17T06:22:44.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.254+0000 7fc99c97e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc9980d2e00 0x7fc9980b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:44.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.254+0000 7fc99c97e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9980b5ae0 0x7fc99806db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:44.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.254+0000 7fc99c97e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc99815d0d0 con 0x7fc998160710 2023-10-17T06:22:44.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.254+0000 7fc99c97e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99815df90 con 0x7fc9980d2e00 2023-10-17T06:22:44.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.254+0000 7fc99c97e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99806f0f0 con 0x7fc9980b5ae0 2023-10-17T06:22:44.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.254+0000 7fc99659c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc998160710 0x7fc9980d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59186/0 (socket says 172.21.15.125:59186) 2023-10-17T06:22:44.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.254+0000 7fc99659c700 1 -- 172.21.15.125:0/3826854964 learned_addr learned my addr 172.21.15.125:0/3826854964 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:22:44.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.254+0000 7fc99759e700 1 --2- 172.21.15.125:0/3826854964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9980b5ae0 0x7fc99806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:44.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.254+0000 7fc996d9d700 1 --2- 172.21.15.125:0/3826854964 >> v2:172.21.15.184:3300/0 conn(0x7fc9980d2e00 0x7fc9980b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:44.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.254+0000 7fc995d9b700 1 -- 172.21.15.125:0/3826854964 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796756979 0 0) 0x7fc98c001110 con 0x7fc998160710 2023-10-17T06:22:44.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.254+0000 7fc995d9b700 1 -- 172.21.15.125:0/3826854964 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9800035d0 con 0x7fc998160710 2023-10-17T06:22:44.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.254+0000 7fc99759e700 1 -- 172.21.15.125:0/3826854964 >> v2:172.21.15.184:3300/0 conn(0x7fc9980d2e00 msgr2=0x7fc9980b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:44.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.254+0000 7fc99759e700 1 --2- 172.21.15.125:0/3826854964 >> v2:172.21.15.184:3300/0 conn(0x7fc9980d2e00 0x7fc9980b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.254+0000 7fc99759e700 1 -- 172.21.15.125:0/3826854964 >> v1:172.21.15.125:6789/0 conn(0x7fc998160710 legacy=0x7fc9980d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:44.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.254+0000 7fc99759e700 1 -- 172.21.15.125:0/3826854964 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99815d310 con 0x7fc9980b5ae0 2023-10-17T06:22:44.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.254+0000 7fc996d9d700 1 --2- 172.21.15.125:0/3826854964 >> v2:172.21.15.184:3300/0 conn(0x7fc9980d2e00 0x7fc9980b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:22:44.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.254+0000 7fc99759e700 1 --2- 172.21.15.125:0/3826854964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9980b5ae0 0x7fc99806db60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc990009d90 tx=0x7fc99000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c97c7b78f12dfb24 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:44.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.258+0000 7fc995d9b700 1 -- 172.21.15.125:0/3826854964 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99000e070 con 0x7fc9980b5ae0 2023-10-17T06:22:44.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.258+0000 7fc995d9b700 1 -- 172.21.15.125:0/3826854964 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99000bb20 con 0x7fc9980b5ae0 2023-10-17T06:22:44.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.258+0000 7fc995d9b700 1 -- 172.21.15.125:0/3826854964 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990012430 con 0x7fc9980b5ae0 2023-10-17T06:22:44.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.258+0000 7fc99c97e700 1 -- 172.21.15.125:0/3826854964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9980b5ae0 msgr2=0x7fc99806db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:44.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.258+0000 7fc99c97e700 1 --2- 172.21.15.125:0/3826854964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9980b5ae0 0x7fc99806db60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc990009d90 tx=0x7fc99000b330 comp rx=0 tx=0).stop 2023-10-17T06:22:44.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.258+0000 7fc99c97e700 1 -- 172.21.15.125:0/3826854964 shutdown_connections 2023-10-17T06:22:44.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.258+0000 7fc99c97e700 1 --2- 172.21.15.125:0/3826854964 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9980b5ae0 0x7fc99806db60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.258+0000 7fc99c97e700 1 --2- 172.21.15.125:0/3826854964 >> v2:172.21.15.184:3300/0 conn(0x7fc9980d2e00 0x7fc9980b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.258+0000 7fc99c97e700 1 -- 172.21.15.125:0/3826854964 >> 172.21.15.125:0/3826854964 conn(0x7fc998069f20 msgr2=0x7fc99806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:44.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.258+0000 7fc99c97e700 1 -- 172.21.15.125:0/3826854964 shutdown_connections 2023-10-17T06:22:44.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.258+0000 7fc99c97e700 1 -- 172.21.15.125:0/3826854964 wait complete. 2023-10-17T06:22:44.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.258+0000 7fc99c97e700 1 Processor -- start 2023-10-17T06:22:44.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.258+0000 7fc99c97e700 1 -- start start 2023-10-17T06:22:44.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc99c97e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9980b5ae0 0x7fc998148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:44.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc99c97e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9980d2e00 0x7fc998148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:44.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc99c97e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc998160710 0x7fc9980d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:44.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc99c97e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9980b0860 con 0x7fc9980d2e00 2023-10-17T06:22:44.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc99c97e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc998148650 con 0x7fc9980b5ae0 2023-10-17T06:22:44.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc99c97e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99814b7f0 con 0x7fc998160710 2023-10-17T06:22:44.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc99659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9980d2e00 0x7fc998148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:44.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc99659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9980d2e00 0x7fc998148910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40250/0 (socket says 172.21.15.125:40250) 2023-10-17T06:22:44.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc99659c700 1 -- 172.21.15.125:0/3769314276 learned_addr learned my addr 172.21.15.125:0/3769314276 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:44.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc996d9d700 1 --2- 172.21.15.125:0/3769314276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9980b5ae0 0x7fc998148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:44.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc99759e700 1 --2- 172.21.15.125:0/3769314276 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc998160710 0x7fc9980d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:44.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc99659c700 1 -- 172.21.15.125:0/3769314276 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc998160710 msgr2=0x7fc9980d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:44.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc99659c700 1 --2- 172.21.15.125:0/3769314276 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc998160710 0x7fc9980d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc99659c700 1 -- 172.21.15.125:0/3769314276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9980b5ae0 msgr2=0x7fc998148110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:44.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc99659c700 1 --2- 172.21.15.125:0/3769314276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9980b5ae0 0x7fc998148110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc99659c700 1 -- 172.21.15.125:0/3769314276 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9880094b0 con 0x7fc9980d2e00 2023-10-17T06:22:44.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc996d9d700 1 --2- 172.21.15.125:0/3769314276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9980b5ae0 0x7fc998148110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:22:44.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc99659c700 1 --2- 172.21.15.125:0/3769314276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9980d2e00 0x7fc998148910 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00c730 tx=0x7fc98c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:44.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc97f7fe700 1 -- 172.21.15.125:0/3769314276 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c005d90 con 0x7fc9980d2e00 2023-10-17T06:22:44.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc97f7fe700 1 -- 172.21.15.125:0/3769314276 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98c0070d0 con 0x7fc9980d2e00 2023-10-17T06:22:44.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc97f7fe700 1 -- 172.21.15.125:0/3769314276 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c007460 con 0x7fc9980d2e00 2023-10-17T06:22:44.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc99c97e700 1 -- 172.21.15.125:0/3769314276 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc990009a70 con 0x7fc9980d2e00 2023-10-17T06:22:44.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.262+0000 7fc99c97e700 1 -- 172.21.15.125:0/3769314276 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9980b04f0 con 0x7fc9980d2e00 2023-10-17T06:22:44.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.266+0000 7fc99c97e700 1 -- 172.21.15.125:0/3769314276 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99815db90 con 0x7fc9980d2e00 2023-10-17T06:22:44.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.266+0000 7fc97f7fe700 1 -- 172.21.15.125:0/3769314276 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc98c0075c0 con 0x7fc9980d2e00 2023-10-17T06:22:44.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.270+0000 7fc97f7fe700 1 --2- 172.21.15.125:0/3769314276 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc9840656f0 0x7fc984067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:44.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.270+0000 7fc97f7fe700 1 -- 172.21.15.125:0/3769314276 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fc98c082270 con 0x7fc9980d2e00 2023-10-17T06:22:44.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.270+0000 7fc996d9d700 1 --2- 172.21.15.125:0/3769314276 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc9840656f0 0x7fc984067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:44.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.270+0000 7fc996d9d700 1 --2- 172.21.15.125:0/3769314276 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc9840656f0 0x7fc984067bb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc9880113d0 tx=0x7fc988009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:44.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.274+0000 7fc97f7fe700 1 -- 172.21.15.125:0/3769314276 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc99815db90 con 0x7fc9980d2e00 2023-10-17T06:22:44.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.450+0000 7fc99c97e700 1 -- 172.21.15.125:0/3769314276 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc99815d0d0 con 0x7fc9980d2e00 2023-10-17T06:22:44.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.450+0000 7fc97f7fe700 1 -- 172.21.15.125:0/3769314276 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v55) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc98c017020 con 0x7fc9980d2e00 2023-10-17T06:22:44.458 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:22:44.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.454+0000 7fc99c97e700 1 -- 172.21.15.125:0/3769314276 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc9840656f0 msgr2=0x7fc984067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:44.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.454+0000 7fc99c97e700 1 --2- 172.21.15.125:0/3769314276 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc9840656f0 0x7fc984067bb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc9880113d0 tx=0x7fc988009240 comp rx=0 tx=0).stop 2023-10-17T06:22:44.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.454+0000 7fc99c97e700 1 -- 172.21.15.125:0/3769314276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9980d2e00 msgr2=0x7fc998148910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:44.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.454+0000 7fc99c97e700 1 --2- 172.21.15.125:0/3769314276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9980d2e00 0x7fc998148910 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00c730 tx=0x7fc98c00ca40 comp rx=0 tx=0).stop 2023-10-17T06:22:44.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.454+0000 7fc99c97e700 1 -- 172.21.15.125:0/3769314276 shutdown_connections 2023-10-17T06:22:44.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.454+0000 7fc99c97e700 1 --2- 172.21.15.125:0/3769314276 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc9840656f0 0x7fc984067bb0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.454+0000 7fc99c97e700 1 --2- 172.21.15.125:0/3769314276 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc998160710 0x7fc9980d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.454+0000 7fc99c97e700 1 --2- 172.21.15.125:0/3769314276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9980d2e00 0x7fc998148910 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.454+0000 7fc99c97e700 1 --2- 172.21.15.125:0/3769314276 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9980b5ae0 0x7fc998148110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.454+0000 7fc99c97e700 1 -- 172.21.15.125:0/3769314276 >> 172.21.15.125:0/3769314276 conn(0x7fc998069f20 msgr2=0x7fc99815e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:44.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.458+0000 7fc99c97e700 1 -- 172.21.15.125:0/3769314276 shutdown_connections 2023-10-17T06:22:44.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.458+0000 7fc99c97e700 1 -- 172.21.15.125:0/3769314276 wait complete. 2023-10-17T06:22:44.486 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-17T06:22:44.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.658+0000 7f677598d700 1 Processor -- start 2023-10-17T06:22:44.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.658+0000 7f677598d700 1 -- start start 2023-10-17T06:22:44.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f677598d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67700d2540 0x7f67700cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:44.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f677598d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f67700d3070 0x7f67700d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:44.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f677598d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67700b67a0 con 0x7f6770146840 2023-10-17T06:22:44.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f677598d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67700b70b0 con 0x7f67700d3070 2023-10-17T06:22:44.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f677598d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67700d0440 con 0x7f67700d2540 2023-10-17T06:22:44.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f676f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f67700d3070 0x7f67700d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:44.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f676f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f67700d3070 0x7f67700d34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40258/0 (socket says 172.21.15.125:40258) 2023-10-17T06:22:44.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f676f7fe700 1 -- 172.21.15.125:0/4131772382 learned_addr learned my addr 172.21.15.125:0/4131772382 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:44.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f676e7fc700 1 --2- 172.21.15.125:0/4131772382 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67700d2540 0x7f67700cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:44.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f676f7fe700 1 -- 172.21.15.125:0/4131772382 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67700d2540 msgr2=0x7f67700cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:44.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f676f7fe700 1 --2- 172.21.15.125:0/4131772382 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67700d2540 0x7f67700cff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f676f7fe700 1 -- 172.21.15.125:0/4131772382 >> v1:172.21.15.125:6789/0 conn(0x7f6770146840 legacy=0x7f677015d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:44.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f676f7fe700 1 -- 172.21.15.125:0/4131772382 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67700d29d0 con 0x7f67700d3070 2023-10-17T06:22:44.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f676f7fe700 1 --2- 172.21.15.125:0/4131772382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67700d3070 0x7f67700d34a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6768009e50 tx=0x7f676800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc30e5bbabb50eb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:44.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f676dffb700 1 -- 172.21.15.125:0/4131772382 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676800e070 con 0x7f67700d3070 2023-10-17T06:22:44.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f676dffb700 1 -- 172.21.15.125:0/4131772382 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676800b9c0 con 0x7f67700d3070 2023-10-17T06:22:44.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f676dffb700 1 -- 172.21.15.125:0/4131772382 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676800bd70 con 0x7f67700d3070 2023-10-17T06:22:44.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f677598d700 1 -- 172.21.15.125:0/4131772382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67700d3070 msgr2=0x7f67700d34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:44.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f677598d700 1 --2- 172.21.15.125:0/4131772382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67700d3070 0x7f67700d34a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6768009e50 tx=0x7f676800b330 comp rx=0 tx=0).stop 2023-10-17T06:22:44.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f677598d700 1 -- 172.21.15.125:0/4131772382 shutdown_connections 2023-10-17T06:22:44.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f677598d700 1 --2- 172.21.15.125:0/4131772382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67700d3070 0x7f67700d34a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f677598d700 1 --2- 172.21.15.125:0/4131772382 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67700d2540 0x7f67700cff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f677598d700 1 -- 172.21.15.125:0/4131772382 >> 172.21.15.125:0/4131772382 conn(0x7f677006a130 msgr2=0x7f677006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:44.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f677598d700 1 -- 172.21.15.125:0/4131772382 shutdown_connections 2023-10-17T06:22:44.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.662+0000 7f677598d700 1 -- 172.21.15.125:0/4131772382 wait complete. 2023-10-17T06:22:44.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.666+0000 7f677598d700 1 Processor -- start 2023-10-17T06:22:44.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.666+0000 7f677598d700 1 -- start start 2023-10-17T06:22:44.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.666+0000 7f677598d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67700d2540 0x7f67701f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:44.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.666+0000 7f677598d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67700d3070 0x7f67701f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:44.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.666+0000 7f677598d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6770146840 0x7f677013c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:44.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.666+0000 7f677598d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67701f55c0 con 0x7f67700d2540 2023-10-17T06:22:44.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.666+0000 7f677598d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677013d300 con 0x7f6770146840 2023-10-17T06:22:44.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.666+0000 7f677598d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677013d5e0 con 0x7f67700d3070 2023-10-17T06:22:44.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.666+0000 7f676effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67700d2540 0x7f67701f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.666+0000 7f676effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67700d2540 0x7f67701f22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40272/0 (socket says 172.21.15.125:40272) 2023-10-17T06:22:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.666+0000 7f676effd700 1 -- 172.21.15.125:0/4016623437 learned_addr learned my addr 172.21.15.125:0/4016623437 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.666+0000 7f676f7fe700 1 --2- 172.21.15.125:0/4016623437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6770146840 0x7f677013c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.666+0000 7f676e7fc700 1 --2- 172.21.15.125:0/4016623437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67700d3070 0x7f67701f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:44.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.670+0000 7f676effd700 1 -- 172.21.15.125:0/4016623437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67700d3070 msgr2=0x7f67701f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:44.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.670+0000 7f676effd700 1 --2- 172.21.15.125:0/4016623437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67700d3070 0x7f67701f5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.670+0000 7f676effd700 1 -- 172.21.15.125:0/4016623437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6770146840 msgr2=0x7f677013c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:44.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.670+0000 7f676effd700 1 --2- 172.21.15.125:0/4016623437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6770146840 0x7f677013c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.670+0000 7f676effd700 1 -- 172.21.15.125:0/4016623437 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6768009b30 con 0x7f67700d2540 2023-10-17T06:22:44.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.670+0000 7f676f7fe700 1 --2- 172.21.15.125:0/4016623437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6770146840 0x7f677013c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:22:44.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.670+0000 7f676effd700 1 --2- 172.21.15.125:0/4016623437 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67700d2540 0x7f67701f22b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f676000c500 tx=0x7f676000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:44.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.670+0000 7f6757fff700 1 -- 172.21.15.125:0/4016623437 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67600052d0 con 0x7f67700d2540 2023-10-17T06:22:44.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.670+0000 7f6757fff700 1 -- 172.21.15.125:0/4016623437 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6760005430 con 0x7f67700d2540 2023-10-17T06:22:44.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.670+0000 7f677598d700 1 -- 172.21.15.125:0/4016623437 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677013d8c0 con 0x7f67700d2540 2023-10-17T06:22:44.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.670+0000 7f6757fff700 1 -- 172.21.15.125:0/4016623437 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67600055a0 con 0x7f67700d2540 2023-10-17T06:22:44.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.670+0000 7f677598d700 1 -- 172.21.15.125:0/4016623437 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677013dba0 con 0x7f67700d2540 2023-10-17T06:22:44.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.670+0000 7f677598d700 1 -- 172.21.15.125:0/4016623437 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6770140b90 con 0x7f67700d2540 2023-10-17T06:22:44.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.670+0000 7f6757fff700 1 -- 172.21.15.125:0/4016623437 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f67600038e0 con 0x7f67700d2540 2023-10-17T06:22:44.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.674+0000 7f6757fff700 1 --2- 172.21.15.125:0/4016623437 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f675c0656f0 0x7f675c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:44.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.674+0000 7f6757fff700 1 -- 172.21.15.125:0/4016623437 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f6760082400 con 0x7f67700d2540 2023-10-17T06:22:44.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.674+0000 7f676e7fc700 1 --2- 172.21.15.125:0/4016623437 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f675c0656f0 0x7f675c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:44.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.674+0000 7f676e7fc700 1 --2- 172.21.15.125:0/4016623437 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f675c0656f0 0x7f675c067bb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f67700b8210 tx=0x7f6764008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:44.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.678+0000 7f6757fff700 1 -- 172.21.15.125:0/4016623437 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f676004fd10 con 0x7f67700d2540 2023-10-17T06:22:44.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.910+0000 7f677598d700 1 -- 172.21.15.125:0/4016623437 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f67700d0d80 con 0x7f67700d2540 2023-10-17T06:22:44.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.914+0000 7f6757fff700 1 -- 172.21.15.125:0/4016623437 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6760053330 con 0x7f67700d2540 2023-10-17T06:22:44.919 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:22:44.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.918+0000 7f677598d700 1 -- 172.21.15.125:0/4016623437 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f675c0656f0 msgr2=0x7f675c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:44.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.918+0000 7f677598d700 1 --2- 172.21.15.125:0/4016623437 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f675c0656f0 0x7f675c067bb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f67700b8210 tx=0x7f6764008040 comp rx=0 tx=0).stop 2023-10-17T06:22:44.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.918+0000 7f677598d700 1 -- 172.21.15.125:0/4016623437 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67700d2540 msgr2=0x7f67701f22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:44.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.918+0000 7f677598d700 1 --2- 172.21.15.125:0/4016623437 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67700d2540 0x7f67701f22b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f676000c500 tx=0x7f676000c8c0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.918+0000 7f677598d700 1 -- 172.21.15.125:0/4016623437 shutdown_connections 2023-10-17T06:22:44.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.918+0000 7f677598d700 1 --2- 172.21.15.125:0/4016623437 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f675c0656f0 0x7f675c067bb0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.918+0000 7f677598d700 1 --2- 172.21.15.125:0/4016623437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6770146840 0x7f677013c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.918+0000 7f677598d700 1 --2- 172.21.15.125:0/4016623437 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f67700d3070 0x7f67701f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.918+0000 7f677598d700 1 --2- 172.21.15.125:0/4016623437 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67700d2540 0x7f67701f22b0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:44.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.918+0000 7f677598d700 1 -- 172.21.15.125:0/4016623437 >> 172.21.15.125:0/4016623437 conn(0x7f677006a130 msgr2=0x7f677006a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:44.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.918+0000 7f677598d700 1 -- 172.21.15.125:0/4016623437 shutdown_connections 2023-10-17T06:22:44.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:44.918+0000 7f677598d700 1 -- 172.21.15.125:0/4016623437 wait complete. 2023-10-17T06:22:44.946 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-17T06:22:45.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.118+0000 7fc91d611700 1 Processor -- start 2023-10-17T06:22:45.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.118+0000 7fc91d611700 1 -- start start 2023-10-17T06:22:45.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.118+0000 7fc91d611700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc9180cad50 0x7fc91806e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:45.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.118+0000 7fc91d611700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9180cc3f0 con 0x7fc91806ea50 2023-10-17T06:22:45.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.118+0000 7fc91d611700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91806e080 con 0x7fc9180c1e30 2023-10-17T06:22:45.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.118+0000 7fc91d611700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9180c2210 con 0x7fc9180cad50 2023-10-17T06:22:45.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.118+0000 7fc9167fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc9180cad50 0x7fc91806e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:45.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.118+0000 7fc9167fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc9180cad50 0x7fc91806e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40288/0 (socket says 172.21.15.125:40288) 2023-10-17T06:22:45.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.118+0000 7fc9167fc700 1 -- 172.21.15.125:0/3920641796 learned_addr learned my addr 172.21.15.125:0/3920641796 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:45.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.118+0000 7fc916ffd700 1 --1- 172.21.15.125:0/3920641796 >> v1:172.21.15.184:6789/0 conn(0x7fc9180c1e30 0x7fc91806f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:46336/0 (socket says 172.21.15.125:46336) 2023-10-17T06:22:45.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.122+0000 7fc9167fc700 1 -- 172.21.15.125:0/3920641796 >> v1:172.21.15.184:6789/0 conn(0x7fc9180c1e30 legacy=0x7fc91806f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:45.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.122+0000 7fc9167fc700 1 -- 172.21.15.125:0/3920641796 >> v1:172.21.15.125:6789/0 conn(0x7fc91806ea50 legacy=0x7fc9180c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:45.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.122+0000 7fc9167fc700 1 -- 172.21.15.125:0/3920641796 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9180cc640 con 0x7fc9180cad50 2023-10-17T06:22:45.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.122+0000 7fc9167fc700 1 --2- 172.21.15.125:0/3920641796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9180cad50 0x7fc91806e510 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009910 tx=0x7fc90c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0bce6226066e65 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:45.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.122+0000 7fc915ffb700 1 -- 172.21.15.125:0/3920641796 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c00ba60 con 0x7fc9180cad50 2023-10-17T06:22:45.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.122+0000 7fc915ffb700 1 -- 172.21.15.125:0/3920641796 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c00bbc0 con 0x7fc9180cad50 2023-10-17T06:22:45.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.122+0000 7fc915ffb700 1 -- 172.21.15.125:0/3920641796 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c009e60 con 0x7fc9180cad50 2023-10-17T06:22:45.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.122+0000 7fc91d611700 1 -- 172.21.15.125:0/3920641796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9180cad50 msgr2=0x7fc91806e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:45.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.122+0000 7fc91d611700 1 --2- 172.21.15.125:0/3920641796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9180cad50 0x7fc91806e510 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009910 tx=0x7fc90c009c20 comp rx=0 tx=0).stop 2023-10-17T06:22:45.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.122+0000 7fc91d611700 1 -- 172.21.15.125:0/3920641796 shutdown_connections 2023-10-17T06:22:45.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.122+0000 7fc91d611700 1 --2- 172.21.15.125:0/3920641796 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9180cad50 0x7fc91806e510 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:45.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.122+0000 7fc91d611700 1 -- 172.21.15.125:0/3920641796 >> 172.21.15.125:0/3920641796 conn(0x7fc9180ce820 msgr2=0x7fc9180cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:45.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.122+0000 7fc91d611700 1 -- 172.21.15.125:0/3920641796 shutdown_connections 2023-10-17T06:22:45.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.122+0000 7fc91d611700 1 -- 172.21.15.125:0/3920641796 wait complete. 2023-10-17T06:22:45.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.126+0000 7fc91d611700 1 Processor -- start 2023-10-17T06:22:45.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.126+0000 7fc91d611700 1 -- start start 2023-10-17T06:22:45.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.126+0000 7fc91d611700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc91806ea50 0x7fc91814fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:45.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.126+0000 7fc91d611700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9180c1e30 0x7fc9180c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:45.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.126+0000 7fc91d611700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9180cad50 0x7fc9180c4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:45.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.126+0000 7fc91d611700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180c0130 con 0x7fc9180c1e30 2023-10-17T06:22:45.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.126+0000 7fc91d611700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9181502f0 con 0x7fc91806ea50 2023-10-17T06:22:45.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.126+0000 7fc91d611700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180c0f70 con 0x7fc9180cad50 2023-10-17T06:22:45.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.130+0000 7fc9167fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9180c1e30 0x7fc9180c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:45.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.130+0000 7fc9167fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9180c1e30 0x7fc9180c4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40290/0 (socket says 172.21.15.125:40290) 2023-10-17T06:22:45.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.130+0000 7fc9167fc700 1 -- 172.21.15.125:0/2456321658 learned_addr learned my addr 172.21.15.125:0/2456321658 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:45.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.130+0000 7fc916ffd700 1 --2- 172.21.15.125:0/2456321658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc91806ea50 0x7fc91814fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:45.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.130+0000 7fc9177fe700 1 --2- 172.21.15.125:0/2456321658 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9180cad50 0x7fc9180c4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:45.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.130+0000 7fc9167fc700 1 -- 172.21.15.125:0/2456321658 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9180cad50 msgr2=0x7fc9180c4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:45.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.130+0000 7fc9167fc700 1 --2- 172.21.15.125:0/2456321658 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9180cad50 0x7fc9180c4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:45.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.130+0000 7fc9167fc700 1 -- 172.21.15.125:0/2456321658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc91806ea50 msgr2=0x7fc91814fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:45.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.130+0000 7fc9167fc700 1 --2- 172.21.15.125:0/2456321658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc91806ea50 0x7fc91814fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:45.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.130+0000 7fc9167fc700 1 -- 172.21.15.125:0/2456321658 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c009570 con 0x7fc9180c1e30 2023-10-17T06:22:45.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.130+0000 7fc9167fc700 1 --2- 172.21.15.125:0/2456321658 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9180c1e30 0x7fc9180c4520 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc90c014040 tx=0x7fc90c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:45.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.130+0000 7fc8ff7fe700 1 -- 172.21.15.125:0/2456321658 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c004610 con 0x7fc9180c1e30 2023-10-17T06:22:45.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.130+0000 7fc8ff7fe700 1 -- 172.21.15.125:0/2456321658 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c01f070 con 0x7fc9180c1e30 2023-10-17T06:22:45.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.130+0000 7fc91d611700 1 -- 172.21.15.125:0/2456321658 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9180c1400 con 0x7fc9180c1e30 2023-10-17T06:22:45.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.130+0000 7fc8ff7fe700 1 -- 172.21.15.125:0/2456321658 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c0038e0 con 0x7fc9180c1e30 2023-10-17T06:22:45.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.130+0000 7fc91d611700 1 -- 172.21.15.125:0/2456321658 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9180c0640 con 0x7fc9180c1e30 2023-10-17T06:22:45.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.130+0000 7fc91d611700 1 -- 172.21.15.125:0/2456321658 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc918072e60 con 0x7fc9180c1e30 2023-10-17T06:22:45.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.134+0000 7fc8ff7fe700 1 -- 172.21.15.125:0/2456321658 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc90c003a40 con 0x7fc9180c1e30 2023-10-17T06:22:45.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.134+0000 7fc8ff7fe700 1 --2- 172.21.15.125:0/2456321658 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc9040656f0 0x7fc904067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:45.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.134+0000 7fc8ff7fe700 1 -- 172.21.15.125:0/2456321658 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fc90c021070 con 0x7fc9180c1e30 2023-10-17T06:22:45.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.134+0000 7fc916ffd700 1 --2- 172.21.15.125:0/2456321658 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc9040656f0 0x7fc904067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:45.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.138+0000 7fc916ffd700 1 --2- 172.21.15.125:0/2456321658 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc9040656f0 0x7fc904067bb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc908000f60 tx=0x7fc908007ef0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:45.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.142+0000 7fc8ff7fe700 1 -- 172.21.15.125:0/2456321658 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc90c052170 con 0x7fc9180c1e30 2023-10-17T06:22:45.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.314+0000 7fc91d611700 1 -- 172.21.15.125:0/2456321658 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc91806d0f0 con 0x7fc9180c1e30 2023-10-17T06:22:45.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.314+0000 7fc8ff7fe700 1 -- 172.21.15.125:0/2456321658 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc90c055790 con 0x7fc9180c1e30 2023-10-17T06:22:45.321 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-17T06:22:45.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.318+0000 7fc91d611700 1 -- 172.21.15.125:0/2456321658 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc9040656f0 msgr2=0x7fc904067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:45.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.318+0000 7fc91d611700 1 --2- 172.21.15.125:0/2456321658 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc9040656f0 0x7fc904067bb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc908000f60 tx=0x7fc908007ef0 comp rx=0 tx=0).stop 2023-10-17T06:22:45.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.318+0000 7fc91d611700 1 -- 172.21.15.125:0/2456321658 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9180c1e30 msgr2=0x7fc9180c4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:45.324 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.318+0000 7fc91d611700 1 --2- 172.21.15.125:0/2456321658 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9180c1e30 0x7fc9180c4520 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc90c014040 tx=0x7fc90c004770 comp rx=0 tx=0).stop 2023-10-17T06:22:45.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.318+0000 7fc91d611700 1 -- 172.21.15.125:0/2456321658 shutdown_connections 2023-10-17T06:22:45.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.318+0000 7fc91d611700 1 --2- 172.21.15.125:0/2456321658 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc9040656f0 0x7fc904067bb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:45.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.318+0000 7fc91d611700 1 --2- 172.21.15.125:0/2456321658 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc9180cad50 0x7fc9180c4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:45.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.318+0000 7fc91d611700 1 --2- 172.21.15.125:0/2456321658 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9180c1e30 0x7fc9180c4520 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:45.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.318+0000 7fc91d611700 1 --2- 172.21.15.125:0/2456321658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc91806ea50 0x7fc91814fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:45.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.318+0000 7fc91d611700 1 -- 172.21.15.125:0/2456321658 >> 172.21.15.125:0/2456321658 conn(0x7fc9180ce820 msgr2=0x7fc9180af890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:45.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.318+0000 7fc91d611700 1 -- 172.21.15.125:0/2456321658 shutdown_connections 2023-10-17T06:22:45.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.318+0000 7fc91d611700 1 -- 172.21.15.125:0/2456321658 wait complete. 2023-10-17T06:22:45.346 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-17T06:22:45.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.510+0000 7f1181975700 1 Processor -- start 2023-10-17T06:22:45.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.510+0000 7f1181975700 1 -- start start 2023-10-17T06:22:45.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.514+0000 7f1181975700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f117c0b6c70 0x7f117c06a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:45.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.514+0000 7f1181975700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117c06e390 con 0x7f117c0b5ae0 2023-10-17T06:22:45.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.514+0000 7f1181975700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117c15cfb0 con 0x7f117c15cbd0 2023-10-17T06:22:45.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.514+0000 7f1181975700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117c0b6050 con 0x7f117c0b6c70 2023-10-17T06:22:45.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.514+0000 7f117b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f117c0b5ae0 0x7f117c06a610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59212/0 (socket says 172.21.15.125:59212) 2023-10-17T06:22:45.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.514+0000 7f117b7fe700 1 -- 172.21.15.125:0/3738024076 learned_addr learned my addr 172.21.15.125:0/3738024076 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:22:45.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.514+0000 7f117a7fc700 1 --2- 172.21.15.125:0/3738024076 >> v2:172.21.15.184:3300/0 conn(0x7f117c0b6c70 0x7f117c06a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:45.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.514+0000 7f1179ffb700 1 -- 172.21.15.125:0/3738024076 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792307864 0 0) 0x7f117c06e390 con 0x7f117c0b5ae0 2023-10-17T06:22:45.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.514+0000 7f1179ffb700 1 -- 172.21.15.125:0/3738024076 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11640035d0 con 0x7f117c0b5ae0 2023-10-17T06:22:45.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.514+0000 7f117a7fc700 1 -- 172.21.15.125:0/3738024076 >> v1:172.21.15.184:6789/0 conn(0x7f117c15cbd0 legacy=0x7f117c0b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:45.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.514+0000 7f117a7fc700 1 -- 172.21.15.125:0/3738024076 >> v1:172.21.15.125:6789/0 conn(0x7f117c0b5ae0 legacy=0x7f117c06a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:45.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.514+0000 7f117a7fc700 1 -- 172.21.15.125:0/3738024076 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c06e5e0 con 0x7f117c0b6c70 2023-10-17T06:22:45.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.514+0000 7f117a7fc700 1 --2- 172.21.15.125:0/3738024076 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f117c0b6c70 0x7f117c06a0d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1170009850 tx=0x7f1170009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a67800ed8747723 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:45.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.518+0000 7f1179ffb700 1 -- 172.21.15.125:0/3738024076 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1170011830 con 0x7f117c0b6c70 2023-10-17T06:22:45.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.518+0000 7f1179ffb700 1 -- 172.21.15.125:0/3738024076 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1170011990 con 0x7f117c0b6c70 2023-10-17T06:22:45.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.518+0000 7f1179ffb700 1 -- 172.21.15.125:0/3738024076 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1170011d40 con 0x7f117c0b6c70 2023-10-17T06:22:45.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.518+0000 7f1181975700 1 -- 172.21.15.125:0/3738024076 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f117c0b6c70 msgr2=0x7f117c06a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:45.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.518+0000 7f1181975700 1 --2- 172.21.15.125:0/3738024076 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f117c0b6c70 0x7f117c06a0d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1170009850 tx=0x7f1170009b60 comp rx=0 tx=0).stop 2023-10-17T06:22:45.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.518+0000 7f1181975700 1 -- 172.21.15.125:0/3738024076 shutdown_connections 2023-10-17T06:22:45.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.518+0000 7f1181975700 1 --2- 172.21.15.125:0/3738024076 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f117c0b6c70 0x7f117c06a0d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:45.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.518+0000 7f1181975700 1 -- 172.21.15.125:0/3738024076 >> 172.21.15.125:0/3738024076 conn(0x7f117c06f450 msgr2=0x7f117c06f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:45.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.518+0000 7f1181975700 1 -- 172.21.15.125:0/3738024076 shutdown_connections 2023-10-17T06:22:45.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.518+0000 7f1181975700 1 -- 172.21.15.125:0/3738024076 wait complete. 2023-10-17T06:22:45.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.522+0000 7f1181975700 1 Processor -- start 2023-10-17T06:22:45.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.522+0000 7f1181975700 1 -- start start 2023-10-17T06:22:45.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.522+0000 7f1181975700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f117c0b5ae0 0x7f117c14d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:45.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.522+0000 7f1181975700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f117c0b6c70 0x7f117c14fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:45.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.522+0000 7f1181975700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f117c15cbd0 0x7f117c150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:45.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.522+0000 7f1181975700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c159600 con 0x7f117c15cbd0 2023-10-17T06:22:45.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.522+0000 7f1181975700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117c153070 con 0x7f117c0b5ae0 2023-10-17T06:22:45.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.522+0000 7f1181975700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117c154500 con 0x7f117c0b6c70 2023-10-17T06:22:45.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.526+0000 7f117b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f117c15cbd0 0x7f117c150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:45.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.526+0000 7f117affd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f117c0b5ae0 0x7f117c14d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:45.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.526+0000 7f117b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f117c15cbd0 0x7f117c150530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40298/0 (socket says 172.21.15.125:40298) 2023-10-17T06:22:45.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.526+0000 7f117b7fe700 1 -- 172.21.15.125:0/2210907684 learned_addr learned my addr 172.21.15.125:0/2210907684 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:45.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.526+0000 7f117a7fc700 1 --2- 172.21.15.125:0/2210907684 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f117c0b6c70 0x7f117c14fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:45.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.526+0000 7f117b7fe700 1 -- 172.21.15.125:0/2210907684 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f117c0b6c70 msgr2=0x7f117c14fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:45.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.526+0000 7f117b7fe700 1 --2- 172.21.15.125:0/2210907684 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f117c0b6c70 0x7f117c14fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:45.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.526+0000 7f117b7fe700 1 -- 172.21.15.125:0/2210907684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f117c0b5ae0 msgr2=0x7f117c14d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:45.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.526+0000 7f117b7fe700 1 --2- 172.21.15.125:0/2210907684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f117c0b5ae0 0x7f117c14d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:45.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.526+0000 7f117b7fe700 1 -- 172.21.15.125:0/2210907684 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11700094b0 con 0x7f117c15cbd0 2023-10-17T06:22:45.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.526+0000 7f117b7fe700 1 --2- 172.21.15.125:0/2210907684 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f117c15cbd0 0x7f117c150530 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f117400cb70 tx=0x7f117400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:45.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.526+0000 7f1163fff700 1 -- 172.21.15.125:0/2210907684 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174007480 con 0x7f117c15cbd0 2023-10-17T06:22:45.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.526+0000 7f1163fff700 1 -- 172.21.15.125:0/2210907684 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11740075e0 con 0x7f117c15cbd0 2023-10-17T06:22:45.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.526+0000 7f1181975700 1 -- 172.21.15.125:0/2210907684 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117c14dc70 con 0x7f117c15cbd0 2023-10-17T06:22:45.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.526+0000 7f1163fff700 1 -- 172.21.15.125:0/2210907684 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174007950 con 0x7f117c15cbd0 2023-10-17T06:22:45.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.526+0000 7f1181975700 1 -- 172.21.15.125:0/2210907684 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117c1527d0 con 0x7f117c15cbd0 2023-10-17T06:22:45.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.526+0000 7f1181975700 1 -- 172.21.15.125:0/2210907684 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117c159790 con 0x7f117c15cbd0 2023-10-17T06:22:45.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.530+0000 7f1163fff700 1 -- 172.21.15.125:0/2210907684 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f117401b3b0 con 0x7f117c15cbd0 2023-10-17T06:22:45.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.530+0000 7f1163fff700 1 --2- 172.21.15.125:0/2210907684 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1168065720 0x7f1168067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:45.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.530+0000 7f1163fff700 1 -- 172.21.15.125:0/2210907684 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f11740828c0 con 0x7f117c15cbd0 2023-10-17T06:22:45.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.530+0000 7f117affd700 1 --2- 172.21.15.125:0/2210907684 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1168065720 0x7f1168067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:45.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.534+0000 7f117affd700 1 --2- 172.21.15.125:0/2210907684 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1168065720 0x7f1168067be0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f116c000f60 tx=0x7f116c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:45.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.538+0000 7f1163fff700 1 -- 172.21.15.125:0/2210907684 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f117c159790 con 0x7f117c15cbd0 2023-10-17T06:22:45.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.742+0000 7f1181975700 1 -- 172.21.15.125:0/2210907684 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f117c159740 con 0x7f117c15cbd0 2023-10-17T06:22:45.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.742+0000 7f1163fff700 1 -- 172.21.15.125:0/2210907684 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v55) v1 ==== 80+0+59 (secure 0 0 0) 0x7f1174017020 con 0x7f117c15cbd0 2023-10-17T06:22:45.750 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125:0/3775054255 2023-10-17T07:15:56.011706+0000 2023-10-17T06:22:45.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.746+0000 7f1181975700 1 -- 172.21.15.125:0/2210907684 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1168065720 msgr2=0x7f1168067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:45.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.746+0000 7f1181975700 1 --2- 172.21.15.125:0/2210907684 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1168065720 0x7f1168067be0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f116c000f60 tx=0x7f116c009040 comp rx=0 tx=0).stop 2023-10-17T06:22:45.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.746+0000 7f1181975700 1 -- 172.21.15.125:0/2210907684 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f117c15cbd0 msgr2=0x7f117c150530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:45.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.746+0000 7f1181975700 1 --2- 172.21.15.125:0/2210907684 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f117c15cbd0 0x7f117c150530 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f117400cb70 tx=0x7f117400cba0 comp rx=0 tx=0).stop 2023-10-17T06:22:45.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.746+0000 7f1181975700 1 -- 172.21.15.125:0/2210907684 shutdown_connections 2023-10-17T06:22:45.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.746+0000 7f1181975700 1 --2- 172.21.15.125:0/2210907684 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1168065720 0x7f1168067be0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:45.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.746+0000 7f1181975700 1 --2- 172.21.15.125:0/2210907684 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f117c15cbd0 0x7f117c150530 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:45.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.746+0000 7f1181975700 1 --2- 172.21.15.125:0/2210907684 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f117c0b6c70 0x7f117c14fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:45.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.746+0000 7f1181975700 1 --2- 172.21.15.125:0/2210907684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f117c0b5ae0 0x7f117c14d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:45.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.746+0000 7f1181975700 1 -- 172.21.15.125:0/2210907684 >> 172.21.15.125:0/2210907684 conn(0x7f117c06f450 msgr2=0x7f117c0d0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:45.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.746+0000 7f1181975700 1 -- 172.21.15.125:0/2210907684 shutdown_connections 2023-10-17T06:22:45.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:45.746+0000 7f1181975700 1 -- 172.21.15.125:0/2210907684 wait complete. 2023-10-17T06:22:45.755 INFO:teuthology.orchestra.run.smithi125.stderr:listed 1 entries 2023-10-17T06:22:45.776 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-17T06:22:45.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:45.776 DEBUG:teuthology.orchestra.run.smithi184:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-17T06:22:45.825 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-10-17T06:22:45.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:45.826 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-17T06:22:45.893 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:22:45.893 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:22:45.915 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352252k,nr_inodes=4088063,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9382 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-17T06:22:45.916 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:22:45.916 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:22:45.954 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352328k,nr_inodes=4088082,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9370 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-17T06:22:45.955 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:22:46.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.134+0000 7fb02544d700 1 Processor -- start 2023-10-17T06:22:46.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.134+0000 7fb02544d700 1 -- start start 2023-10-17T06:22:46.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.138+0000 7fb02544d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb02015ee50 0x7fb0200cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:46.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.138+0000 7fb02544d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02006f450 con 0x7fb02006e8a0 2023-10-17T06:22:46.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.138+0000 7fb02544d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0200ccbc0 con 0x7fb0200cb640 2023-10-17T06:22:46.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.138+0000 7fb02544d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02006d4e0 con 0x7fb02015ee50 2023-10-17T06:22:46.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.138+0000 7fb01e7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb02006e8a0 0x7fb0200caf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59220/0 (socket says 172.21.15.125:59220) 2023-10-17T06:22:46.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.138+0000 7fb01e7fc700 1 -- 172.21.15.125:0/1436284246 learned_addr learned my addr 172.21.15.125:0/1436284246 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:22:46.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.138+0000 7fb01effd700 1 --2- 172.21.15.125:0/1436284246 >> v2:172.21.15.184:3300/0 conn(0x7fb02015ee50 0x7fb0200cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:46.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.142+0000 7fb01effd700 1 -- 172.21.15.125:0/1436284246 >> v1:172.21.15.184:6789/0 conn(0x7fb0200cb640 legacy=0x7fb02006f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:46.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.142+0000 7fb01effd700 1 -- 172.21.15.125:0/1436284246 >> v1:172.21.15.125:6789/0 conn(0x7fb02006e8a0 legacy=0x7fb0200caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:46.148 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.142+0000 7fb01effd700 1 -- 172.21.15.125:0/1436284246 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0201624a0 con 0x7fb02015ee50 2023-10-17T06:22:46.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.142+0000 7fb01effd700 1 --2- 172.21.15.125:0/1436284246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb02015ee50 0x7fb0200cc680 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb010009850 tx=0x7fb010009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da05f23090aa43a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:46.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.142+0000 7fb01dffb700 1 -- 172.21.15.125:0/1436284246 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb010011830 con 0x7fb02015ee50 2023-10-17T06:22:46.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.142+0000 7fb01dffb700 1 -- 172.21.15.125:0/1436284246 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb010011990 con 0x7fb02015ee50 2023-10-17T06:22:46.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.142+0000 7fb01dffb700 1 -- 172.21.15.125:0/1436284246 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb010011d20 con 0x7fb02015ee50 2023-10-17T06:22:46.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.142+0000 7fb02544d700 1 -- 172.21.15.125:0/1436284246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb02015ee50 msgr2=0x7fb0200cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:46.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.142+0000 7fb02544d700 1 --2- 172.21.15.125:0/1436284246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb02015ee50 0x7fb0200cc680 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb010009850 tx=0x7fb010009b60 comp rx=0 tx=0).stop 2023-10-17T06:22:46.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.142+0000 7fb02544d700 1 -- 172.21.15.125:0/1436284246 shutdown_connections 2023-10-17T06:22:46.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.142+0000 7fb02544d700 1 --2- 172.21.15.125:0/1436284246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb02015ee50 0x7fb0200cc680 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:46.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.142+0000 7fb02544d700 1 -- 172.21.15.125:0/1436284246 >> 172.21.15.125:0/1436284246 conn(0x7fb02006a340 msgr2=0x7fb0200b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:46.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.142+0000 7fb02544d700 1 -- 172.21.15.125:0/1436284246 shutdown_connections 2023-10-17T06:22:46.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.142+0000 7fb02544d700 1 -- 172.21.15.125:0/1436284246 wait complete. 2023-10-17T06:22:46.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.146+0000 7fb02544d700 1 Processor -- start 2023-10-17T06:22:46.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.146+0000 7fb02544d700 1 -- start start 2023-10-17T06:22:46.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb02544d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb02006e8a0 0x7fb02015d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:46.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb02544d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0200cb640 0x7fb02015db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:46.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb02544d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb02015ee50 0x7fb020155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:46.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb02544d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb020156fc0 con 0x7fb02006e8a0 2023-10-17T06:22:46.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb02544d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0200b1d90 con 0x7fb0200cb640 2023-10-17T06:22:46.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb02544d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0200b28a0 con 0x7fb02015ee50 2023-10-17T06:22:46.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb01effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb02006e8a0 0x7fb02015d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:46.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb01effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb02006e8a0 0x7fb02015d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40314/0 (socket says 172.21.15.125:40314) 2023-10-17T06:22:46.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb01effd700 1 -- 172.21.15.125:0/2189576151 learned_addr learned my addr 172.21.15.125:0/2189576151 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:46.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb01f7fe700 1 --2- 172.21.15.125:0/2189576151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb02015ee50 0x7fb020155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:46.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb01e7fc700 1 --2- 172.21.15.125:0/2189576151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0200cb640 0x7fb02015db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:46.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb01f7fe700 1 -- 172.21.15.125:0/2189576151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0200cb640 msgr2=0x7fb02015db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:46.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb01f7fe700 1 --2- 172.21.15.125:0/2189576151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0200cb640 0x7fb02015db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:46.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb01f7fe700 1 -- 172.21.15.125:0/2189576151 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb02006e8a0 msgr2=0x7fb02015d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:46.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb01f7fe700 1 --2- 172.21.15.125:0/2189576151 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb02006e8a0 0x7fb02015d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:46.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb01f7fe700 1 -- 172.21.15.125:0/2189576151 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0100094b0 con 0x7fb02015ee50 2023-10-17T06:22:46.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb01effd700 1 --2- 172.21.15.125:0/2189576151 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb02006e8a0 0x7fb02015d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:22:46.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb01f7fe700 1 --2- 172.21.15.125:0/2189576151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb02015ee50 0x7fb020155270 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb01800cb90 tx=0x7fb01800cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:46.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb0077fe700 1 -- 172.21.15.125:0/2189576151 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb018003c20 con 0x7fb02015ee50 2023-10-17T06:22:46.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb0077fe700 1 -- 172.21.15.125:0/2189576151 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb018003d80 con 0x7fb02015ee50 2023-10-17T06:22:46.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb02544d700 1 -- 172.21.15.125:0/2189576151 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0200b1f70 con 0x7fb02015ee50 2023-10-17T06:22:46.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb0077fe700 1 -- 172.21.15.125:0/2189576151 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01800aa80 con 0x7fb02015ee50 2023-10-17T06:22:46.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.150+0000 7fb02544d700 1 -- 172.21.15.125:0/2189576151 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0200b2530 con 0x7fb02015ee50 2023-10-17T06:22:46.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.154+0000 7fb02544d700 1 -- 172.21.15.125:0/2189576151 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb020072e60 con 0x7fb02015ee50 2023-10-17T06:22:46.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.154+0000 7fb0077fe700 1 -- 172.21.15.125:0/2189576151 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb01800abe0 con 0x7fb02015ee50 2023-10-17T06:22:46.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.154+0000 7fb0077fe700 1 --2- 172.21.15.125:0/2189576151 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb00c0656f0 0x7fb00c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:46.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.154+0000 7fb0077fe700 1 -- 172.21.15.125:0/2189576151 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fb018082f00 con 0x7fb02015ee50 2023-10-17T06:22:46.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.154+0000 7fb01effd700 1 --2- 172.21.15.125:0/2189576151 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb00c0656f0 0x7fb00c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:46.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.158+0000 7fb01effd700 1 --2- 172.21.15.125:0/2189576151 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb00c0656f0 0x7fb00c067bb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb010009ba0 tx=0x7fb010008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:46.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.166+0000 7fb0077fe700 1 -- 172.21.15.125:0/2189576151 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fb018050770 con 0x7fb02015ee50 2023-10-17T06:22:46.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.394+0000 7fb02544d700 1 -- 172.21.15.125:0/2189576151 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0200b29e0 con 0x7fb02015ee50 2023-10-17T06:22:46.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.394+0000 7fb0077fe700 1 -- 172.21.15.125:0/2189576151 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4889 (secure 0 0 0) 0x7fb018053d90 con 0x7fb02015ee50 2023-10-17T06:22:46.402 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:22:46.403 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:08:51.328615+0000","modified":"2023-10-17T06:16:00.378712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":111,"addr":"172.21.15.125:6837/2351050168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2351050168},{"type":"v1","addr":"172.21.15.125:6837","nonce":2351050168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-17T06:22:46.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.398+0000 7fb02544d700 1 -- 172.21.15.125:0/2189576151 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb00c0656f0 msgr2=0x7fb00c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:46.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.398+0000 7fb02544d700 1 --2- 172.21.15.125:0/2189576151 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb00c0656f0 0x7fb00c067bb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb010009ba0 tx=0x7fb010008030 comp rx=0 tx=0).stop 2023-10-17T06:22:46.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.398+0000 7fb02544d700 1 -- 172.21.15.125:0/2189576151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb02015ee50 msgr2=0x7fb020155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:46.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.398+0000 7fb02544d700 1 --2- 172.21.15.125:0/2189576151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb02015ee50 0x7fb020155270 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb01800cb90 tx=0x7fb01800cea0 comp rx=0 tx=0).stop 2023-10-17T06:22:46.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.398+0000 7fb02544d700 1 -- 172.21.15.125:0/2189576151 shutdown_connections 2023-10-17T06:22:46.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.398+0000 7fb02544d700 1 --2- 172.21.15.125:0/2189576151 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb00c0656f0 0x7fb00c067bb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:46.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.398+0000 7fb02544d700 1 --2- 172.21.15.125:0/2189576151 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb02015ee50 0x7fb020155270 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:46.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.398+0000 7fb02544d700 1 --2- 172.21.15.125:0/2189576151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0200cb640 0x7fb02015db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:46.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.398+0000 7fb02544d700 1 --2- 172.21.15.125:0/2189576151 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb02006e8a0 0x7fb02015d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:46.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.398+0000 7fb02544d700 1 -- 172.21.15.125:0/2189576151 >> 172.21.15.125:0/2189576151 conn(0x7fb02006a340 msgr2=0x7fb0200aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:46.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.398+0000 7fb02544d700 1 -- 172.21.15.125:0/2189576151 shutdown_connections 2023-10-17T06:22:46.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.398+0000 7fb02544d700 1 -- 172.21.15.125:0/2189576151 wait complete. 2023-10-17T06:22:46.407 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 19 2023-10-17T06:22:46.426 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:22:46.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.594+0000 7ff75a5f2700 1 Processor -- start 2023-10-17T06:22:46.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.594+0000 7ff75a5f2700 1 -- start start 2023-10-17T06:22:46.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.598+0000 7ff75a5f2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff754155420 0x7ff7540cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:46.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.598+0000 7ff75a5f2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7540ce320 0x7ff7540cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:46.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.598+0000 7ff75a5f2700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7540cbc80 con 0x7ff75415bf00 2023-10-17T06:22:46.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.598+0000 7ff75a5f2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff754155800 con 0x7ff754155420 2023-10-17T06:22:46.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.598+0000 7ff75a5f2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7540cb9a0 con 0x7ff7540ce320 2023-10-17T06:22:46.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.598+0000 7ff753fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff754155420 0x7ff7540cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:46.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.598+0000 7ff753fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff754155420 0x7ff7540cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40328/0 (socket says 172.21.15.125:40328) 2023-10-17T06:22:46.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.598+0000 7ff753fff700 1 -- 172.21.15.125:0/87640622 learned_addr learned my addr 172.21.15.125:0/87640622 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:46.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.598+0000 7ff758b8f700 1 --2- 172.21.15.125:0/87640622 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7540ce320 0x7ff7540cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:46.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.598+0000 7ff753fff700 1 -- 172.21.15.125:0/87640622 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7540ce320 msgr2=0x7ff7540cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:46.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.598+0000 7ff753fff700 1 --2- 172.21.15.125:0/87640622 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7540ce320 0x7ff7540cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:46.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.598+0000 7ff753fff700 1 -- 172.21.15.125:0/87640622 >> v1:172.21.15.184:6789/0 conn(0x7ff75415bf00 legacy=0x7ff7540cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:46.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.598+0000 7ff753fff700 1 -- 172.21.15.125:0/87640622 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75415b420 con 0x7ff754155420 2023-10-17T06:22:46.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.598+0000 7ff752ffd700 1 -- 172.21.15.125:0/87640622 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220350984 0 0) 0x7ff7540cbc80 con 0x7ff75415bf00 2023-10-17T06:22:46.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.598+0000 7ff753fff700 1 --2- 172.21.15.125:0/87640622 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff754155420 0x7ff7540cb150 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff744009910 tx=0x7ff744009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e010186b012e674 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:46.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.602+0000 7ff752ffd700 1 -- 172.21.15.125:0/87640622 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744011830 con 0x7ff754155420 2023-10-17T06:22:46.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.602+0000 7ff752ffd700 1 -- 172.21.15.125:0/87640622 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff744011990 con 0x7ff754155420 2023-10-17T06:22:46.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.602+0000 7ff752ffd700 1 -- 172.21.15.125:0/87640622 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744011d40 con 0x7ff754155420 2023-10-17T06:22:46.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.602+0000 7ff75a5f2700 1 -- 172.21.15.125:0/87640622 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff754155420 msgr2=0x7ff7540cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:46.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.602+0000 7ff75a5f2700 1 --2- 172.21.15.125:0/87640622 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff754155420 0x7ff7540cb150 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff744009910 tx=0x7ff744009c20 comp rx=0 tx=0).stop 2023-10-17T06:22:46.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.602+0000 7ff75a5f2700 1 -- 172.21.15.125:0/87640622 shutdown_connections 2023-10-17T06:22:46.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.602+0000 7ff75a5f2700 1 --2- 172.21.15.125:0/87640622 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff7540ce320 0x7ff7540cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:46.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.602+0000 7ff75a5f2700 1 --2- 172.21.15.125:0/87640622 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff754155420 0x7ff7540cb150 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:46.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.602+0000 7ff75a5f2700 1 -- 172.21.15.125:0/87640622 >> 172.21.15.125:0/87640622 conn(0x7ff75406a340 msgr2=0x7ff7540b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:46.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.602+0000 7ff75a5f2700 1 -- 172.21.15.125:0/87640622 shutdown_connections 2023-10-17T06:22:46.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.602+0000 7ff75a5f2700 1 -- 172.21.15.125:0/87640622 wait complete. 2023-10-17T06:22:46.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.602+0000 7ff75a5f2700 1 Processor -- start 2023-10-17T06:22:46.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff75a5f2700 1 -- start start 2023-10-17T06:22:46.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff75a5f2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7540ce320 0x7ff7541429c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:46.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff75a5f2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff75415bf00 0x7ff7540aa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:46.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff75a5f2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff754143650 0x7ff7540aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:46.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff75a5f2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7540a9360 con 0x7ff7540ce320 2023-10-17T06:22:46.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff75a5f2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff754142f00 con 0x7ff754143650 2023-10-17T06:22:46.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff75a5f2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7540afa60 con 0x7ff75415bf00 2023-10-17T06:22:46.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff753fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7540ce320 0x7ff7541429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:46.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff753fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7540ce320 0x7ff7541429c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40334/0 (socket says 172.21.15.125:40334) 2023-10-17T06:22:46.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff753fff700 1 -- 172.21.15.125:0/815494532 learned_addr learned my addr 172.21.15.125:0/815494532 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:46.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff7537fe700 1 --2- 172.21.15.125:0/815494532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff75415bf00 0x7ff7540aa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:46.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff758b8f700 1 --2- 172.21.15.125:0/815494532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff754143650 0x7ff7540aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:46.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff753fff700 1 -- 172.21.15.125:0/815494532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff75415bf00 msgr2=0x7ff7540aa9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:46.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff753fff700 1 --2- 172.21.15.125:0/815494532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff75415bf00 0x7ff7540aa9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:46.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff753fff700 1 -- 172.21.15.125:0/815494532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff754143650 msgr2=0x7ff7540aaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:46.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff753fff700 1 --2- 172.21.15.125:0/815494532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff754143650 0x7ff7540aaf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:46.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff753fff700 1 -- 172.21.15.125:0/815494532 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff744009570 con 0x7ff7540ce320 2023-10-17T06:22:46.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff758b8f700 1 --2- 172.21.15.125:0/815494532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff754143650 0x7ff7540aaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:22:46.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff753fff700 1 --2- 172.21.15.125:0/815494532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7540ce320 0x7ff7541429c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff744009f70 tx=0x7ff744004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:46.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff750ff9700 1 -- 172.21.15.125:0/815494532 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74400b9b0 con 0x7ff7540ce320 2023-10-17T06:22:46.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff750ff9700 1 -- 172.21.15.125:0/815494532 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74401f070 con 0x7ff7540ce320 2023-10-17T06:22:46.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff750ff9700 1 -- 172.21.15.125:0/815494532 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74400bd50 con 0x7ff7540ce320 2023-10-17T06:22:46.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff75a5f2700 1 -- 172.21.15.125:0/815494532 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7540afd40 con 0x7ff7540ce320 2023-10-17T06:22:46.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.606+0000 7ff75a5f2700 1 -- 172.21.15.125:0/815494532 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7540aa4b0 con 0x7ff7540ce320 2023-10-17T06:22:46.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.610+0000 7ff75a5f2700 1 -- 172.21.15.125:0/815494532 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7540aa6c0 con 0x7ff7540ce320 2023-10-17T06:22:46.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.610+0000 7ff750ff9700 1 -- 172.21.15.125:0/815494532 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff74401a430 con 0x7ff7540ce320 2023-10-17T06:22:46.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.610+0000 7ff750ff9700 1 --2- 172.21.15.125:0/815494532 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff740065720 0x7ff740067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:46.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.610+0000 7ff750ff9700 1 -- 172.21.15.125:0/815494532 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7ff744021070 con 0x7ff7540ce320 2023-10-17T06:22:46.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.610+0000 7ff7537fe700 1 --2- 172.21.15.125:0/815494532 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff740065720 0x7ff740067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:46.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.614+0000 7ff7537fe700 1 --2- 172.21.15.125:0/815494532 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff740065720 0x7ff740067be0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff7541f57e0 tx=0x7ff748009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:46.623 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.618+0000 7ff750ff9700 1 -- 172.21.15.125:0/815494532 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff744051aa0 con 0x7ff7540ce320 2023-10-17T06:22:46.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.794+0000 7ff75a5f2700 1 -- 172.21.15.125:0/815494532 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff754072e60 con 0x7ff7540ce320 2023-10-17T06:22:46.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.798+0000 7ff750ff9700 1 -- 172.21.15.125:0/815494532 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+18788 (secure 0 0 0) 0x7ff7440550c0 con 0x7ff7540ce320 2023-10-17T06:22:46.803 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:22:46.804 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":55,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:16:02.394779+0000","last_up_change":"2023-10-17T06:16:01.390745+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:08:48.973490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-17T06:08:50.385778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":50,"up_from":54,"up_thru":54,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6801","nonce":1353754211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6803","nonce":1353754211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6807","nonce":1353754211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6805","nonce":1353754211}]},"public_addr":"172.21.15.125:6801/1353754211","cluster_addr":"172.21.15.125:6803/1353754211","heartbeat_back_addr":"172.21.15.125:6807/1353754211","heartbeat_front_addr":"172.21.15.125:6805/1353754211","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"2023-10-17T06:09:26.602656+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":51},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.12","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:0/3775054255":"2023-10-17T07:15:56.011706+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:22:46.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.798+0000 7ff75a5f2700 1 -- 172.21.15.125:0/815494532 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff740065720 msgr2=0x7ff740067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:46.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.798+0000 7ff75a5f2700 1 --2- 172.21.15.125:0/815494532 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff740065720 0x7ff740067be0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff7541f57e0 tx=0x7ff748009040 comp rx=0 tx=0).stop 2023-10-17T06:22:46.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.798+0000 7ff75a5f2700 1 -- 172.21.15.125:0/815494532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7540ce320 msgr2=0x7ff7541429c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:46.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.798+0000 7ff75a5f2700 1 --2- 172.21.15.125:0/815494532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7540ce320 0x7ff7541429c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff744009f70 tx=0x7ff744004770 comp rx=0 tx=0).stop 2023-10-17T06:22:46.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.798+0000 7ff75a5f2700 1 -- 172.21.15.125:0/815494532 shutdown_connections 2023-10-17T06:22:46.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.798+0000 7ff75a5f2700 1 --2- 172.21.15.125:0/815494532 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff740065720 0x7ff740067be0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:46.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.798+0000 7ff75a5f2700 1 --2- 172.21.15.125:0/815494532 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff754143650 0x7ff7540aaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:46.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.798+0000 7ff75a5f2700 1 --2- 172.21.15.125:0/815494532 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff75415bf00 0x7ff7540aa9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:46.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.798+0000 7ff75a5f2700 1 --2- 172.21.15.125:0/815494532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7540ce320 0x7ff7541429c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:46.807 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.798+0000 7ff75a5f2700 1 -- 172.21.15.125:0/815494532 >> 172.21.15.125:0/815494532 conn(0x7ff75406a340 msgr2=0x7ff75415ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:46.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.798+0000 7ff75a5f2700 1 -- 172.21.15.125:0/815494532 shutdown_connections 2023-10-17T06:22:46.808 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.798+0000 7ff75a5f2700 1 -- 172.21.15.125:0/815494532 wait complete. 2023-10-17T06:22:46.826 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-17T06:06:54.031184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-17T06:07:01.467445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-17T06:08:48.973490+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-17T06:08:50.385778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-17T06:22:46.827 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-17T06:22:47.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.998+0000 7fb0910f4700 1 Processor -- start 2023-10-17T06:22:47.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:46.998+0000 7fb0910f4700 1 -- start start 2023-10-17T06:22:47.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.002+0000 7fb0910f4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb08c0cdd90 0x7fb08c0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:47.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.002+0000 7fb0910f4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb08c06d060 0x7fb08c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:47.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.002+0000 7fb0910f4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c15e000 con 0x7fb08c0b3c00 2023-10-17T06:22:47.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.002+0000 7fb0910f4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08c0ce170 con 0x7fb08c06d060 2023-10-17T06:22:47.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.002+0000 7fb0910f4700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c15d3f0 con 0x7fb08c0cdd90 2023-10-17T06:22:47.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.002+0000 7fb0837fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb08c06d060 0x7fb08c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:47.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.002+0000 7fb0908f3700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb08c0b3c00 0x7fb08c0ca0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59226/0 (socket says 172.21.15.125:59226) 2023-10-17T06:22:47.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.002+0000 7fb0908f3700 1 -- 172.21.15.125:0/3840753992 learned_addr learned my addr 172.21.15.125:0/3840753992 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:22:47.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.002+0000 7fb08bfff700 1 --2- 172.21.15.125:0/3840753992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb08c0cdd90 0x7fb08c0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:47.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.002+0000 7fb0837fe700 1 -- 172.21.15.125:0/3840753992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb08c0cdd90 msgr2=0x7fb08c0cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:47.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.002+0000 7fb0837fe700 1 --2- 172.21.15.125:0/3840753992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb08c0cdd90 0x7fb08c0cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.002+0000 7fb0837fe700 1 -- 172.21.15.125:0/3840753992 >> v1:172.21.15.125:6789/0 conn(0x7fb08c0b3c00 legacy=0x7fb08c0ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:47.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.002+0000 7fb0837fe700 1 -- 172.21.15.125:0/3840753992 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c15d6d0 con 0x7fb08c06d060 2023-10-17T06:22:47.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.002+0000 7fb08b7fe700 1 -- 172.21.15.125:0/3840753992 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19598111 0 0) 0x7fb08c15e000 con 0x7fb08c0b3c00 2023-10-17T06:22:47.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.006+0000 7fb0837fe700 1 --2- 172.21.15.125:0/3840753992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb08c06d060 0x7fb08c06d4e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb074009850 tx=0x7fb074009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3b7ad4c52390 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:47.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.006+0000 7fb08b7fe700 1 -- 172.21.15.125:0/3840753992 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074011830 con 0x7fb08c06d060 2023-10-17T06:22:47.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.006+0000 7fb08b7fe700 1 -- 172.21.15.125:0/3840753992 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb074011990 con 0x7fb08c06d060 2023-10-17T06:22:47.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.006+0000 7fb08b7fe700 1 -- 172.21.15.125:0/3840753992 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074011d40 con 0x7fb08c06d060 2023-10-17T06:22:47.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.006+0000 7fb0910f4700 1 -- 172.21.15.125:0/3840753992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb08c06d060 msgr2=0x7fb08c06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:47.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.006+0000 7fb0910f4700 1 --2- 172.21.15.125:0/3840753992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb08c06d060 0x7fb08c06d4e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb074009850 tx=0x7fb074009b60 comp rx=0 tx=0).stop 2023-10-17T06:22:47.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.006+0000 7fb0910f4700 1 -- 172.21.15.125:0/3840753992 shutdown_connections 2023-10-17T06:22:47.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.006+0000 7fb0910f4700 1 --2- 172.21.15.125:0/3840753992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb08c06d060 0x7fb08c06d4e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.006+0000 7fb0910f4700 1 --2- 172.21.15.125:0/3840753992 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb08c0cdd90 0x7fb08c0cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.006+0000 7fb0910f4700 1 -- 172.21.15.125:0/3840753992 >> 172.21.15.125:0/3840753992 conn(0x7fb08c0ce5c0 msgr2=0x7fb08c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:47.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.006+0000 7fb0910f4700 1 -- 172.21.15.125:0/3840753992 shutdown_connections 2023-10-17T06:22:47.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.006+0000 7fb0910f4700 1 -- 172.21.15.125:0/3840753992 wait complete. 2023-10-17T06:22:47.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.010+0000 7fb0910f4700 1 Processor -- start 2023-10-17T06:22:47.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.010+0000 7fb0910f4700 1 -- start start 2023-10-17T06:22:47.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.010+0000 7fb0910f4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb08c06d060 0x7fb08c146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:47.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.010+0000 7fb0910f4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb08c0b3c00 0x7fb08c149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:47.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb0910f4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb08c0cdd90 0x7fb08c0c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:47.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb0910f4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c0c61d0 con 0x7fb08c0b3c00 2023-10-17T06:22:47.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb0910f4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c149100 con 0x7fb08c0cdd90 2023-10-17T06:22:47.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb0910f4700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c0c84b0 con 0x7fb08c06d060 2023-10-17T06:22:47.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb0837fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb08c0b3c00 0x7fb08c149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:47.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb0837fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb08c0b3c00 0x7fb08c149590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40356/0 (socket says 172.21.15.125:40356) 2023-10-17T06:22:47.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb0837fe700 1 -- 172.21.15.125:0/3236977084 learned_addr learned my addr 172.21.15.125:0/3236977084 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:47.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb08bfff700 1 --2- 172.21.15.125:0/3236977084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb08c06d060 0x7fb08c146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:47.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb0908f3700 1 --2- 172.21.15.125:0/3236977084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb08c0cdd90 0x7fb08c0c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:47.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb0837fe700 1 -- 172.21.15.125:0/3236977084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb08c06d060 msgr2=0x7fb08c146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb0837fe700 1 --2- 172.21.15.125:0/3236977084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb08c06d060 0x7fb08c146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb0837fe700 1 -- 172.21.15.125:0/3236977084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb08c0cdd90 msgr2=0x7fb08c0c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb0837fe700 1 --2- 172.21.15.125:0/3236977084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb08c0cdd90 0x7fb08c0c75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb0837fe700 1 -- 172.21.15.125:0/3236977084 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0740094b0 con 0x7fb08c0b3c00 2023-10-17T06:22:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb0837fe700 1 --2- 172.21.15.125:0/3236977084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb08c0b3c00 0x7fb08c149590 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb074014040 tx=0x7fb074004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb0897fa700 1 -- 172.21.15.125:0/3236977084 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074019ab0 con 0x7fb08c0b3c00 2023-10-17T06:22:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb0897fa700 1 -- 172.21.15.125:0/3236977084 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07401e070 con 0x7fb08c0b3c00 2023-10-17T06:22:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb0897fa700 1 -- 172.21.15.125:0/3236977084 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074019e50 con 0x7fb08c0b3c00 2023-10-17T06:22:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb0910f4700 1 -- 172.21.15.125:0/3236977084 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08c0c7ef0 con 0x7fb08c0b3c00 2023-10-17T06:22:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb0910f4700 1 -- 172.21.15.125:0/3236977084 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08c148d90 con 0x7fb08c0b3c00 2023-10-17T06:22:47.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.014+0000 7fb0910f4700 1 -- 172.21.15.125:0/3236977084 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08c04e910 con 0x7fb08c0b3c00 2023-10-17T06:22:47.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.018+0000 7fb0897fa700 1 -- 172.21.15.125:0/3236977084 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb07402d450 con 0x7fb08c0b3c00 2023-10-17T06:22:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.018+0000 7fb0897fa700 1 --2- 172.21.15.125:0/3236977084 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb06c0656f0 0x7fb06c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.018+0000 7fb0897fa700 1 -- 172.21.15.125:0/3236977084 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fb0740840b0 con 0x7fb08c0b3c00 2023-10-17T06:22:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.022+0000 7fb08bfff700 1 --2- 172.21.15.125:0/3236977084 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb06c0656f0 0x7fb06c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:47.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.022+0000 7fb08bfff700 1 --2- 172.21.15.125:0/3236977084 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb06c0656f0 0x7fb06c067bb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009b80 tx=0x7fb07c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:47.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.026+0000 7fb0897fa700 1 -- 172.21.15.125:0/3236977084 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fb0740519b0 con 0x7fb08c0b3c00 2023-10-17T06:22:47.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.202+0000 7fb0910f4700 1 -- 172.21.15.125:0/3236977084 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb08c0c95c0 con 0x7fb08c0b3c00 2023-10-17T06:22:47.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.206+0000 7fb0897fa700 1 -- 172.21.15.125:0/3236977084 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0740200a0 con 0x7fb08c0b3c00 2023-10-17T06:22:47.211 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-17T06:22:47.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.206+0000 7fb0910f4700 1 -- 172.21.15.125:0/3236977084 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb06c0656f0 msgr2=0x7fb06c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:47.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.206+0000 7fb0910f4700 1 --2- 172.21.15.125:0/3236977084 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb06c0656f0 0x7fb06c067bb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb07c009b80 tx=0x7fb07c008040 comp rx=0 tx=0).stop 2023-10-17T06:22:47.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.206+0000 7fb0910f4700 1 -- 172.21.15.125:0/3236977084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb08c0b3c00 msgr2=0x7fb08c149590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:47.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.206+0000 7fb0910f4700 1 --2- 172.21.15.125:0/3236977084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb08c0b3c00 0x7fb08c149590 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb074014040 tx=0x7fb074004770 comp rx=0 tx=0).stop 2023-10-17T06:22:47.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.206+0000 7fb0910f4700 1 -- 172.21.15.125:0/3236977084 shutdown_connections 2023-10-17T06:22:47.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.210+0000 7fb0910f4700 1 --2- 172.21.15.125:0/3236977084 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb06c0656f0 0x7fb06c067bb0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.210+0000 7fb0910f4700 1 --2- 172.21.15.125:0/3236977084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb08c0cdd90 0x7fb08c0c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.210+0000 7fb0910f4700 1 --2- 172.21.15.125:0/3236977084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb08c0b3c00 0x7fb08c149590 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.210+0000 7fb0910f4700 1 --2- 172.21.15.125:0/3236977084 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb08c06d060 0x7fb08c146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.210+0000 7fb0910f4700 1 -- 172.21.15.125:0/3236977084 >> 172.21.15.125:0/3236977084 conn(0x7fb08c0ce5c0 msgr2=0x7fb08c0c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:47.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.210+0000 7fb0910f4700 1 -- 172.21.15.125:0/3236977084 shutdown_connections 2023-10-17T06:22:47.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.210+0000 7fb0910f4700 1 -- 172.21.15.125:0/3236977084 wait complete. 2023-10-17T06:22:47.235 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-17T06:22:47.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.410+0000 7fec07ca2700 1 Processor -- start 2023-10-17T06:22:47.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.410+0000 7fec07ca2700 1 -- start start 2023-10-17T06:22:47.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.414+0000 7fec07ca2700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fec000cdb10 0x7fec000cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:47.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.414+0000 7fec07ca2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec000cae50 0x7fec000cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:47.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.414+0000 7fec07ca2700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec000add20 con 0x7fec00159e70 2023-10-17T06:22:47.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.414+0000 7fec07ca2700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec000cd930 con 0x7fec000cdb10 2023-10-17T06:22:47.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.414+0000 7fec07ca2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec000ce430 con 0x7fec000cae50 2023-10-17T06:22:47.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.414+0000 7fec0523d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec000cae50 0x7fec000cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:47.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.414+0000 7fec05a3e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fec000cdb10 0x7fec000cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:47.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.414+0000 7fec0523d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec000cae50 0x7fec000cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:49744/0 (socket says 172.21.15.125:49744) 2023-10-17T06:22:47.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.414+0000 7fec0523d700 1 -- 172.21.15.125:0/3643765871 learned_addr learned my addr 172.21.15.125:0/3643765871 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:47.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.414+0000 7fec0523d700 1 -- 172.21.15.125:0/3643765871 >> v2:172.21.15.184:3300/0 conn(0x7fec000cdb10 msgr2=0x7fec000cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:47.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.414+0000 7fec0523d700 1 --2- 172.21.15.125:0/3643765871 >> v2:172.21.15.184:3300/0 conn(0x7fec000cdb10 0x7fec000cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.414+0000 7fec0523d700 1 -- 172.21.15.125:0/3643765871 >> v1:172.21.15.184:6789/0 conn(0x7fec00159e70 legacy=0x7fec000cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:47.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.414+0000 7fec0523d700 1 -- 172.21.15.125:0/3643765871 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec000adf70 con 0x7fec000cae50 2023-10-17T06:22:47.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.414+0000 7fec0523d700 1 --2- 172.21.15.125:0/3643765871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec000cae50 0x7fec000cc3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7febf000bbb0 tx=0x7febf000bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35671ff2b5294f52 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:47.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.418+0000 7fec04a3c700 1 -- 172.21.15.125:0/3643765871 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf000dd30 con 0x7fec000cae50 2023-10-17T06:22:47.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.418+0000 7fec04a3c700 1 -- 172.21.15.125:0/3643765871 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf000de90 con 0x7fec000cae50 2023-10-17T06:22:47.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.418+0000 7fec04a3c700 1 -- 172.21.15.125:0/3643765871 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf0010690 con 0x7fec000cae50 2023-10-17T06:22:47.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.418+0000 7fec07ca2700 1 -- 172.21.15.125:0/3643765871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec000cae50 msgr2=0x7fec000cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:47.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.418+0000 7fec07ca2700 1 --2- 172.21.15.125:0/3643765871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec000cae50 0x7fec000cc3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7febf000bbb0 tx=0x7febf000bec0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.418+0000 7fec07ca2700 1 -- 172.21.15.125:0/3643765871 shutdown_connections 2023-10-17T06:22:47.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.418+0000 7fec07ca2700 1 --2- 172.21.15.125:0/3643765871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec000cae50 0x7fec000cc3f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.418+0000 7fec07ca2700 1 --2- 172.21.15.125:0/3643765871 >> v2:172.21.15.184:3300/0 conn(0x7fec000cdb10 0x7fec000cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.418+0000 7fec07ca2700 1 -- 172.21.15.125:0/3643765871 >> 172.21.15.125:0/3643765871 conn(0x7fec000ce820 msgr2=0x7fec000cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:47.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.418+0000 7fec07ca2700 1 -- 172.21.15.125:0/3643765871 shutdown_connections 2023-10-17T06:22:47.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.418+0000 7fec07ca2700 1 -- 172.21.15.125:0/3643765871 wait complete. 2023-10-17T06:22:47.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.422+0000 7fec07ca2700 1 Processor -- start 2023-10-17T06:22:47.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.422+0000 7fec07ca2700 1 -- start start 2023-10-17T06:22:47.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.422+0000 7fec07ca2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec000cae50 0x7fec001f6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:47.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.422+0000 7fec07ca2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec000cdb10 0x7fec00157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:47.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.422+0000 7fec07ca2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec00159e70 0x7fec000ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:47.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.422+0000 7fec07ca2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec001f2330 con 0x7fec00159e70 2023-10-17T06:22:47.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.422+0000 7fec07ca2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec001f6940 con 0x7fec000cae50 2023-10-17T06:22:47.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.422+0000 7fec07ca2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec001579a0 con 0x7fec000cdb10 2023-10-17T06:22:47.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.426+0000 7fec0523d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec000cdb10 0x7fec00157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.426+0000 7fec05a3e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec000cae50 0x7fec001f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.426+0000 7fec0623f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec00159e70 0x7fec000ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.426+0000 7fec0523d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec000cdb10 0x7fec00157460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:49750/0 (socket says 172.21.15.125:49750) 2023-10-17T06:22:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.426+0000 7fec0523d700 1 -- 172.21.15.125:0/3015427088 learned_addr learned my addr 172.21.15.125:0/3015427088 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.426+0000 7fec0523d700 1 -- 172.21.15.125:0/3015427088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec000cae50 msgr2=0x7fec001f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:47.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.426+0000 7fec0523d700 1 --2- 172.21.15.125:0/3015427088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec000cae50 0x7fec001f6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.426+0000 7fec0523d700 1 -- 172.21.15.125:0/3015427088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec00159e70 msgr2=0x7fec000ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:47.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.426+0000 7fec0523d700 1 --2- 172.21.15.125:0/3015427088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec00159e70 0x7fec000ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.426+0000 7fec0523d700 1 -- 172.21.15.125:0/3015427088 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf000b810 con 0x7fec000cdb10 2023-10-17T06:22:47.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.426+0000 7fec0523d700 1 --2- 172.21.15.125:0/3015427088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec000cdb10 0x7fec00157460 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fec000ce570 tx=0x7febf0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:47.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.426+0000 7febf67fc700 1 -- 172.21.15.125:0/3015427088 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf0003c10 con 0x7fec000cdb10 2023-10-17T06:22:47.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.426+0000 7febf67fc700 1 -- 172.21.15.125:0/3015427088 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf0003d70 con 0x7fec000cdb10 2023-10-17T06:22:47.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.426+0000 7febf67fc700 1 -- 172.21.15.125:0/3015427088 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf00106b0 con 0x7fec000cdb10 2023-10-17T06:22:47.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.426+0000 7fec07ca2700 1 -- 172.21.15.125:0/3015427088 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0015bd10 con 0x7fec000cdb10 2023-10-17T06:22:47.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.426+0000 7fec07ca2700 1 -- 172.21.15.125:0/3015427088 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0015c2d0 con 0x7fec000cdb10 2023-10-17T06:22:47.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.430+0000 7fec07ca2700 1 -- 172.21.15.125:0/3015427088 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec00072e60 con 0x7fec000cdb10 2023-10-17T06:22:47.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.430+0000 7febf67fc700 1 -- 172.21.15.125:0/3015427088 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7febf002c440 con 0x7fec000cdb10 2023-10-17T06:22:47.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.430+0000 7febf67fc700 1 --2- 172.21.15.125:0/3015427088 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7febe40657f0 0x7febe4067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:47.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.430+0000 7febf67fc700 1 -- 172.21.15.125:0/3015427088 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7febf00846a0 con 0x7fec000cdb10 2023-10-17T06:22:47.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.430+0000 7fec05a3e700 1 --2- 172.21.15.125:0/3015427088 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7febe40657f0 0x7febe4067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:47.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.430+0000 7fec05a3e700 1 --2- 172.21.15.125:0/3015427088 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7febe40657f0 0x7febe4067cb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7febfc009b50 tx=0x7febfc009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:47.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.442+0000 7febf67fc700 1 -- 172.21.15.125:0/3015427088 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7febf0052020 con 0x7fec000cdb10 2023-10-17T06:22:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.626+0000 7fec07ca2700 1 -- 172.21.15.125:0/3015427088 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fec0006f780 con 0x7fec000cdb10 2023-10-17T06:22:47.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.626+0000 7febf67fc700 1 -- 172.21.15.125:0/3015427088 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v55) v1 ==== 92+0+10 (secure 0 0 0) 0x7febf0055640 con 0x7fec000cdb10 2023-10-17T06:22:47.632 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-17T06:22:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.630+0000 7fec07ca2700 1 -- 172.21.15.125:0/3015427088 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7febe40657f0 msgr2=0x7febe4067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.630+0000 7fec07ca2700 1 --2- 172.21.15.125:0/3015427088 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7febe40657f0 0x7febe4067cb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7febfc009b50 tx=0x7febfc009240 comp rx=0 tx=0).stop 2023-10-17T06:22:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.630+0000 7fec07ca2700 1 -- 172.21.15.125:0/3015427088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec000cdb10 msgr2=0x7fec00157460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.630+0000 7fec07ca2700 1 --2- 172.21.15.125:0/3015427088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec000cdb10 0x7fec00157460 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fec000ce570 tx=0x7febf0004770 comp rx=0 tx=0).stop 2023-10-17T06:22:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.630+0000 7fec07ca2700 1 -- 172.21.15.125:0/3015427088 shutdown_connections 2023-10-17T06:22:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.630+0000 7fec07ca2700 1 --2- 172.21.15.125:0/3015427088 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7febe40657f0 0x7febe4067cb0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.630+0000 7fec07ca2700 1 --2- 172.21.15.125:0/3015427088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec00159e70 0x7fec000ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.630+0000 7fec07ca2700 1 --2- 172.21.15.125:0/3015427088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec000cdb10 0x7fec00157460 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.630+0000 7fec07ca2700 1 --2- 172.21.15.125:0/3015427088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec000cae50 0x7fec001f6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.630+0000 7fec07ca2700 1 -- 172.21.15.125:0/3015427088 >> 172.21.15.125:0/3015427088 conn(0x7fec000ce820 msgr2=0x7fec000cb230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:47.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.630+0000 7fec07ca2700 1 -- 172.21.15.125:0/3015427088 shutdown_connections 2023-10-17T06:22:47.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.630+0000 7fec07ca2700 1 -- 172.21.15.125:0/3015427088 wait complete. 2023-10-17T06:22:47.660 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-17T06:22:47.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.830+0000 7fd2199af700 1 Processor -- start 2023-10-17T06:22:47.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.830+0000 7fd2199af700 1 -- start start 2023-10-17T06:22:47.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.834+0000 7fd2199af700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd2140c5400 0x7fd2140ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:47.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.834+0000 7fd2199af700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd2140ce950 0x7fd2140cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:47.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.834+0000 7fd2199af700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2140cb3d0 con 0x7fd214070a30 2023-10-17T06:22:47.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.834+0000 7fd2199af700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2140cda80 con 0x7fd2140ce950 2023-10-17T06:22:47.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.834+0000 7fd2199af700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd21406bc30 con 0x7fd2140c5400 2023-10-17T06:22:47.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.834+0000 7fd213fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd2140ce950 0x7fd2140cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:47.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.834+0000 7fd2189ad700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd2140c5400 0x7fd2140ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:47.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.834+0000 7fd213fff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd2140ce950 0x7fd2140cae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40372/0 (socket says 172.21.15.125:40372) 2023-10-17T06:22:47.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.834+0000 7fd213fff700 1 -- 172.21.15.125:0/2659882086 learned_addr learned my addr 172.21.15.125:0/2659882086 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:47.842 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.834+0000 7fd2191ae700 1 --1- 172.21.15.125:0/2659882086 >> v1:172.21.15.125:6789/0 conn(0x7fd214070a30 0x7fd21415d3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59232/0 (socket says 172.21.15.125:59232) 2023-10-17T06:22:47.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.834+0000 7fd213fff700 1 -- 172.21.15.125:0/2659882086 >> v2:172.21.15.184:3300/0 conn(0x7fd2140c5400 msgr2=0x7fd2140ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:47.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.834+0000 7fd213fff700 1 --2- 172.21.15.125:0/2659882086 >> v2:172.21.15.184:3300/0 conn(0x7fd2140c5400 0x7fd2140ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.834+0000 7fd213fff700 1 -- 172.21.15.125:0/2659882086 >> v1:172.21.15.125:6789/0 conn(0x7fd214070a30 legacy=0x7fd21415d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:47.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.834+0000 7fd213fff700 1 -- 172.21.15.125:0/2659882086 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21415a090 con 0x7fd2140ce950 2023-10-17T06:22:47.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.834+0000 7fd213fff700 1 --2- 172.21.15.125:0/2659882086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2140ce950 0x7fd2140cae90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd2140cb880 tx=0x7fd20000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45145f68e4b75b29 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:47.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.838+0000 7fd2137fe700 1 -- 172.21.15.125:0/2659882086 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20000dd30 con 0x7fd2140ce950 2023-10-17T06:22:47.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.838+0000 7fd2137fe700 1 -- 172.21.15.125:0/2659882086 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20000de90 con 0x7fd2140ce950 2023-10-17T06:22:47.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.838+0000 7fd2137fe700 1 -- 172.21.15.125:0/2659882086 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd200010690 con 0x7fd2140ce950 2023-10-17T06:22:47.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.838+0000 7fd2199af700 1 -- 172.21.15.125:0/2659882086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2140ce950 msgr2=0x7fd2140cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:47.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.838+0000 7fd2199af700 1 --2- 172.21.15.125:0/2659882086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2140ce950 0x7fd2140cae90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd2140cb880 tx=0x7fd20000be90 comp rx=0 tx=0).stop 2023-10-17T06:22:47.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.838+0000 7fd2199af700 1 -- 172.21.15.125:0/2659882086 shutdown_connections 2023-10-17T06:22:47.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.838+0000 7fd2199af700 1 --2- 172.21.15.125:0/2659882086 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2140ce950 0x7fd2140cae90 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.838+0000 7fd2199af700 1 --2- 172.21.15.125:0/2659882086 >> v2:172.21.15.184:3300/0 conn(0x7fd2140c5400 0x7fd2140ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.838+0000 7fd2199af700 1 -- 172.21.15.125:0/2659882086 >> 172.21.15.125:0/2659882086 conn(0x7fd2140cb920 msgr2=0x7fd2140cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:47.846 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.838+0000 7fd2199af700 1 -- 172.21.15.125:0/2659882086 shutdown_connections 2023-10-17T06:22:47.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.838+0000 7fd2199af700 1 -- 172.21.15.125:0/2659882086 wait complete. 2023-10-17T06:22:47.847 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.842+0000 7fd2199af700 1 Processor -- start 2023-10-17T06:22:47.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.842+0000 7fd2199af700 1 -- start start 2023-10-17T06:22:47.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.842+0000 7fd2199af700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd214070a30 0x7fd214150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:47.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.842+0000 7fd2199af700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2140c5400 0x7fd214069d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:47.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.842+0000 7fd2199af700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2140ce950 0x7fd21406a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:47.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.842+0000 7fd2199af700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21414b230 con 0x7fd214070a30 2023-10-17T06:22:47.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.842+0000 7fd2199af700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2141514d0 con 0x7fd2140c5400 2023-10-17T06:22:47.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.842+0000 7fd2199af700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140c6800 con 0x7fd2140ce950 2023-10-17T06:22:47.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.842+0000 7fd2189ad700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd214070a30 0x7fd214150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:47.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.842+0000 7fd2189ad700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd214070a30 0x7fd214150f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40374/0 (socket says 172.21.15.125:40374) 2023-10-17T06:22:47.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.842+0000 7fd2189ad700 1 -- 172.21.15.125:0/2847587187 learned_addr learned my addr 172.21.15.125:0/2847587187 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:47.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.846+0000 7fd213fff700 1 --2- 172.21.15.125:0/2847587187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2140c5400 0x7fd214069d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:47.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.846+0000 7fd2191ae700 1 --2- 172.21.15.125:0/2847587187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2140ce950 0x7fd21406a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:47.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.846+0000 7fd2189ad700 1 -- 172.21.15.125:0/2847587187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2140ce950 msgr2=0x7fd21406a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:47.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.846+0000 7fd2189ad700 1 --2- 172.21.15.125:0/2847587187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2140ce950 0x7fd21406a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.846+0000 7fd2189ad700 1 -- 172.21.15.125:0/2847587187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2140c5400 msgr2=0x7fd214069d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:47.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.846+0000 7fd2189ad700 1 --2- 172.21.15.125:0/2847587187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2140c5400 0x7fd214069d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:47.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.846+0000 7fd2189ad700 1 -- 172.21.15.125:0/2847587187 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20000b810 con 0x7fd214070a30 2023-10-17T06:22:47.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.846+0000 7fd2189ad700 1 --2- 172.21.15.125:0/2847587187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd214070a30 0x7fd214150f90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd20800e9d0 tx=0x7fd20800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:47.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.846+0000 7fd2117fa700 1 -- 172.21.15.125:0/2847587187 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208009720 con 0x7fd214070a30 2023-10-17T06:22:47.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.846+0000 7fd2117fa700 1 -- 172.21.15.125:0/2847587187 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20800c850 con 0x7fd214070a30 2023-10-17T06:22:47.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.846+0000 7fd2117fa700 1 -- 172.21.15.125:0/2847587187 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20800cbc0 con 0x7fd214070a30 2023-10-17T06:22:47.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.846+0000 7fd2199af700 1 -- 172.21.15.125:0/2847587187 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2140c6ae0 con 0x7fd214070a30 2023-10-17T06:22:47.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.846+0000 7fd2199af700 1 -- 172.21.15.125:0/2847587187 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2140c70a0 con 0x7fd214070a30 2023-10-17T06:22:47.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.846+0000 7fd2199af700 1 -- 172.21.15.125:0/2847587187 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21404e910 con 0x7fd214070a30 2023-10-17T06:22:47.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.850+0000 7fd2117fa700 1 -- 172.21.15.125:0/2847587187 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd20800cd20 con 0x7fd214070a30 2023-10-17T06:22:47.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.850+0000 7fd2117fa700 1 --2- 172.21.15.125:0/2847587187 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd1f80656f0 0x7fd1f8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:47.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.850+0000 7fd2117fa700 1 -- 172.21.15.125:0/2847587187 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fd208083020 con 0x7fd214070a30 2023-10-17T06:22:47.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.850+0000 7fd213fff700 1 --2- 172.21.15.125:0/2847587187 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd1f80656f0 0x7fd1f8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:47.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.850+0000 7fd213fff700 1 --2- 172.21.15.125:0/2847587187 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd1f80656f0 0x7fd1f8067bb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd2140ced50 tx=0x7fd200013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:47.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:47.858+0000 7fd2117fa700 1 -- 172.21.15.125:0/2847587187 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fd208050920 con 0x7fd214070a30 2023-10-17T06:22:48.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.038+0000 7fd2199af700 1 -- 172.21.15.125:0/2847587187 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd214070330 con 0x7fd214070a30 2023-10-17T06:22:48.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.038+0000 7fd2117fa700 1 -- 172.21.15.125:0/2847587187 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd2080170a0 con 0x7fd214070a30 2023-10-17T06:22:48.044 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-17T06:22:48.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.042+0000 7fd2199af700 1 -- 172.21.15.125:0/2847587187 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd1f80656f0 msgr2=0x7fd1f8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:48.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.042+0000 7fd2199af700 1 --2- 172.21.15.125:0/2847587187 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd1f80656f0 0x7fd1f8067bb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd2140ced50 tx=0x7fd200013000 comp rx=0 tx=0).stop 2023-10-17T06:22:48.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.042+0000 7fd2199af700 1 -- 172.21.15.125:0/2847587187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd214070a30 msgr2=0x7fd214150f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:48.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.042+0000 7fd2199af700 1 --2- 172.21.15.125:0/2847587187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd214070a30 0x7fd214150f90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd20800e9d0 tx=0x7fd20800ece0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.042+0000 7fd2199af700 1 -- 172.21.15.125:0/2847587187 shutdown_connections 2023-10-17T06:22:48.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.042+0000 7fd2199af700 1 --2- 172.21.15.125:0/2847587187 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fd1f80656f0 0x7fd1f8067bb0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.042+0000 7fd2199af700 1 --2- 172.21.15.125:0/2847587187 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd2140ce950 0x7fd21406a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.042+0000 7fd2199af700 1 --2- 172.21.15.125:0/2847587187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2140c5400 0x7fd214069d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.042+0000 7fd2199af700 1 --2- 172.21.15.125:0/2847587187 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd214070a30 0x7fd214150f90 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.042+0000 7fd2199af700 1 -- 172.21.15.125:0/2847587187 >> 172.21.15.125:0/2847587187 conn(0x7fd2140cb920 msgr2=0x7fd2140cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:48.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.042+0000 7fd2199af700 1 -- 172.21.15.125:0/2847587187 shutdown_connections 2023-10-17T06:22:48.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.042+0000 7fd2199af700 1 -- 172.21.15.125:0/2847587187 wait complete. 2023-10-17T06:22:48.067 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-17T06:22:48.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.238+0000 7f7437acd700 1 Processor -- start 2023-10-17T06:22:48.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.238+0000 7f7437acd700 1 -- start start 2023-10-17T06:22:48.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.238+0000 7f7437acd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f74300c1e30 0x7f743006f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:48.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.238+0000 7f7437acd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f743006ec20 0x7f74300c9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:48.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.238+0000 7f7437acd700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74300cc3f0 con 0x7f74300cad50 2023-10-17T06:22:48.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.238+0000 7f7437acd700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74300c2210 con 0x7f743006ec20 2023-10-17T06:22:48.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.238+0000 7f7437acd700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743006d820 con 0x7f74300c1e30 2023-10-17T06:22:48.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.238+0000 7f743606a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f743006ec20 0x7f74300c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:48.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.242+0000 7f743606a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f743006ec20 0x7f74300c9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40390/0 (socket says 172.21.15.125:40390) 2023-10-17T06:22:48.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.242+0000 7f743606a700 1 -- 172.21.15.125:0/2473094681 learned_addr learned my addr 172.21.15.125:0/2473094681 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:48.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.242+0000 7f7435869700 1 --2- 172.21.15.125:0/2473094681 >> v2:172.21.15.184:3300/0 conn(0x7f74300c1e30 0x7f743006f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:48.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.242+0000 7f743606a700 1 -- 172.21.15.125:0/2473094681 >> v2:172.21.15.184:3300/0 conn(0x7f74300c1e30 msgr2=0x7f743006f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:48.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.242+0000 7f743606a700 1 --2- 172.21.15.125:0/2473094681 >> v2:172.21.15.184:3300/0 conn(0x7f74300c1e30 0x7f743006f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.242+0000 7f743606a700 1 -- 172.21.15.125:0/2473094681 >> v1:172.21.15.184:6789/0 conn(0x7f74300cad50 legacy=0x7f743006e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:48.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.242+0000 7f743606a700 1 -- 172.21.15.125:0/2473094681 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743006e080 con 0x7f743006ec20 2023-10-17T06:22:48.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.242+0000 7f743606a700 1 --2- 172.21.15.125:0/2473094681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f743006ec20 0x7f74300c9190 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7430072510 tx=0x7f742800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08f4230b84aa567 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:48.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.242+0000 7f7434867700 1 -- 172.21.15.125:0/2473094681 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742800e070 con 0x7f743006ec20 2023-10-17T06:22:48.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.242+0000 7f7434867700 1 -- 172.21.15.125:0/2473094681 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742800b910 con 0x7f743006ec20 2023-10-17T06:22:48.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.242+0000 7f7434867700 1 -- 172.21.15.125:0/2473094681 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742800bcc0 con 0x7f743006ec20 2023-10-17T06:22:48.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.242+0000 7f7437acd700 1 -- 172.21.15.125:0/2473094681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f743006ec20 msgr2=0x7f74300c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:48.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.242+0000 7f7437acd700 1 --2- 172.21.15.125:0/2473094681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f743006ec20 0x7f74300c9190 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7430072510 tx=0x7f742800b330 comp rx=0 tx=0).stop 2023-10-17T06:22:48.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.242+0000 7f7437acd700 1 -- 172.21.15.125:0/2473094681 shutdown_connections 2023-10-17T06:22:48.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.242+0000 7f7437acd700 1 --2- 172.21.15.125:0/2473094681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f743006ec20 0x7f74300c9190 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.242+0000 7f7437acd700 1 --2- 172.21.15.125:0/2473094681 >> v2:172.21.15.184:3300/0 conn(0x7f74300c1e30 0x7f743006f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.242+0000 7f7437acd700 1 -- 172.21.15.125:0/2473094681 >> 172.21.15.125:0/2473094681 conn(0x7f74300ce820 msgr2=0x7f74300cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:48.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.242+0000 7f7437acd700 1 -- 172.21.15.125:0/2473094681 shutdown_connections 2023-10-17T06:22:48.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.242+0000 7f7437acd700 1 -- 172.21.15.125:0/2473094681 wait complete. 2023-10-17T06:22:48.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.246+0000 7f7437acd700 1 Processor -- start 2023-10-17T06:22:48.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.246+0000 7f7437acd700 1 -- start start 2023-10-17T06:22:48.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.246+0000 7f7437acd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f743006ec20 0x7f743015f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:48.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.246+0000 7f7437acd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74300c1e30 0x7f743015b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:48.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.246+0000 7f7437acd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74300cad50 0x7f74300c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:48.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.250+0000 7f7437acd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74300c4b10 con 0x7f743006ec20 2023-10-17T06:22:48.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.250+0000 7f7437acd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743015f800 con 0x7f74300cad50 2023-10-17T06:22:48.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.250+0000 7f7437acd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74300c4db0 con 0x7f74300c1e30 2023-10-17T06:22:48.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.250+0000 7f7435869700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f743006ec20 0x7f743015f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:48.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.250+0000 7f7435869700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f743006ec20 0x7f743015f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40406/0 (socket says 172.21.15.125:40406) 2023-10-17T06:22:48.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.250+0000 7f7435869700 1 -- 172.21.15.125:0/2027588306 learned_addr learned my addr 172.21.15.125:0/2027588306 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:48.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.250+0000 7f743606a700 1 --2- 172.21.15.125:0/2027588306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74300cad50 0x7f74300c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:48.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.250+0000 7f7435068700 1 --2- 172.21.15.125:0/2027588306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74300c1e30 0x7f743015b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:48.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.250+0000 7f7435869700 1 -- 172.21.15.125:0/2027588306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74300c1e30 msgr2=0x7f743015b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:48.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.250+0000 7f7435869700 1 --2- 172.21.15.125:0/2027588306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74300c1e30 0x7f743015b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.250+0000 7f7435869700 1 -- 172.21.15.125:0/2027588306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74300cad50 msgr2=0x7f74300c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:48.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.250+0000 7f7435869700 1 --2- 172.21.15.125:0/2027588306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74300cad50 0x7f74300c3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.250+0000 7f7435869700 1 -- 172.21.15.125:0/2027588306 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7428009b30 con 0x7f743006ec20 2023-10-17T06:22:48.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.250+0000 7f7435869700 1 --2- 172.21.15.125:0/2027588306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f743006ec20 0x7f743015f2c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f742c00e9d0 tx=0x7f742c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:48.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.250+0000 7f74267fc700 1 -- 172.21.15.125:0/2027588306 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c009720 con 0x7f743006ec20 2023-10-17T06:22:48.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.250+0000 7f74267fc700 1 -- 172.21.15.125:0/2027588306 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c00ee70 con 0x7f743006ec20 2023-10-17T06:22:48.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.250+0000 7f7437acd700 1 -- 172.21.15.125:0/2027588306 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74300c5090 con 0x7f743006ec20 2023-10-17T06:22:48.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.250+0000 7f74267fc700 1 -- 172.21.15.125:0/2027588306 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c00ca50 con 0x7f743006ec20 2023-10-17T06:22:48.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.250+0000 7f7437acd700 1 -- 172.21.15.125:0/2027588306 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743015b650 con 0x7f743006ec20 2023-10-17T06:22:48.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.250+0000 7f7437acd700 1 -- 172.21.15.125:0/2027588306 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7430072e60 con 0x7f743006ec20 2023-10-17T06:22:48.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.254+0000 7f74267fc700 1 -- 172.21.15.125:0/2027588306 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f742c00cbb0 con 0x7f743006ec20 2023-10-17T06:22:48.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.254+0000 7f74267fc700 1 --2- 172.21.15.125:0/2027588306 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7414065740 0x7f7414067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:48.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.254+0000 7f74267fc700 1 -- 172.21.15.125:0/2027588306 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f742c082f20 con 0x7f743006ec20 2023-10-17T06:22:48.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.254+0000 7f7435068700 1 --2- 172.21.15.125:0/2027588306 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7414065740 0x7f7414067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:48.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.258+0000 7f7435068700 1 --2- 172.21.15.125:0/2027588306 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7414065740 0x7f7414067c00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f74300b4360 tx=0x7f7420009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:48.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.262+0000 7f74267fc700 1 -- 172.21.15.125:0/2027588306 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f742c054340 con 0x7f743006ec20 2023-10-17T06:22:48.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.438+0000 7f7437acd700 1 -- 172.21.15.125:0/2027588306 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f743006d0f0 con 0x7f743006ec20 2023-10-17T06:22:48.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.438+0000 7f74267fc700 1 -- 172.21.15.125:0/2027588306 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7f742c00ce60 con 0x7f743006ec20 2023-10-17T06:22:48.445 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-17T06:22:48.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.442+0000 7f7437acd700 1 -- 172.21.15.125:0/2027588306 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7414065740 msgr2=0x7f7414067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:48.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.442+0000 7f7437acd700 1 --2- 172.21.15.125:0/2027588306 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7414065740 0x7f7414067c00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f74300b4360 tx=0x7f7420009040 comp rx=0 tx=0).stop 2023-10-17T06:22:48.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.442+0000 7f7437acd700 1 -- 172.21.15.125:0/2027588306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f743006ec20 msgr2=0x7f743015f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:48.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.442+0000 7f7437acd700 1 --2- 172.21.15.125:0/2027588306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f743006ec20 0x7f743015f2c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f742c00e9d0 tx=0x7f742c00ece0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.442+0000 7f7437acd700 1 -- 172.21.15.125:0/2027588306 shutdown_connections 2023-10-17T06:22:48.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.442+0000 7f7437acd700 1 --2- 172.21.15.125:0/2027588306 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f7414065740 0x7f7414067c00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.442+0000 7f7437acd700 1 --2- 172.21.15.125:0/2027588306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74300cad50 0x7f74300c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.442+0000 7f7437acd700 1 --2- 172.21.15.125:0/2027588306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f74300c1e30 0x7f743015b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.442+0000 7f7437acd700 1 --2- 172.21.15.125:0/2027588306 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f743006ec20 0x7f743015f2c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.442+0000 7f7437acd700 1 -- 172.21.15.125:0/2027588306 >> 172.21.15.125:0/2027588306 conn(0x7f74300ce820 msgr2=0x7f74300c9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:48.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.442+0000 7f7437acd700 1 -- 172.21.15.125:0/2027588306 shutdown_connections 2023-10-17T06:22:48.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.442+0000 7f7437acd700 1 -- 172.21.15.125:0/2027588306 wait complete. 2023-10-17T06:22:48.466 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:22:48.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.634+0000 7efd7b59e700 1 Processor -- start 2023-10-17T06:22:48.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.634+0000 7efd7b59e700 1 -- start start 2023-10-17T06:22:48.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.638+0000 7efd7b59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd7c0d2e00 0x7efd7c0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:48.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.638+0000 7efd7b59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efd7c160710 0x7efd7c0d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:48.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.638+0000 7efd7b59e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7c15d0d0 con 0x7efd7c0b5ae0 2023-10-17T06:22:48.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.638+0000 7efd7b59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7c15df90 con 0x7efd7c160710 2023-10-17T06:22:48.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.638+0000 7efd7b59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c06f0f0 con 0x7efd7c0d2e00 2023-10-17T06:22:48.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.638+0000 7efd7ad9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7efd7c0b5ae0 0x7efd7c06db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59242/0 (socket says 172.21.15.125:59242) 2023-10-17T06:22:48.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.638+0000 7efd7ad9d700 1 -- 172.21.15.125:0/1634687206 learned_addr learned my addr 172.21.15.125:0/1634687206 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:22:48.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.638+0000 7efd71d9b700 1 --2- 172.21.15.125:0/1634687206 >> v2:172.21.15.184:3300/0 conn(0x7efd7c160710 0x7efd7c0d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:48.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.638+0000 7efd7a59c700 1 --2- 172.21.15.125:0/1634687206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd7c0d2e00 0x7efd7c0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:48.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.638+0000 7efd79d9b700 1 -- 172.21.15.125:0/1634687206 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677902120 0 0) 0x7efd740014e0 con 0x7efd7c0b5ae0 2023-10-17T06:22:48.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.638+0000 7efd79d9b700 1 -- 172.21.15.125:0/1634687206 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd680035d0 con 0x7efd7c0b5ae0 2023-10-17T06:22:48.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.638+0000 7efd7a59c700 1 -- 172.21.15.125:0/1634687206 >> v2:172.21.15.184:3300/0 conn(0x7efd7c160710 msgr2=0x7efd7c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:48.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.638+0000 7efd7a59c700 1 --2- 172.21.15.125:0/1634687206 >> v2:172.21.15.184:3300/0 conn(0x7efd7c160710 0x7efd7c0d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.638+0000 7efd7a59c700 1 -- 172.21.15.125:0/1634687206 >> v1:172.21.15.125:6789/0 conn(0x7efd7c0b5ae0 legacy=0x7efd7c06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:48.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.638+0000 7efd7a59c700 1 -- 172.21.15.125:0/1634687206 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c0d3720 con 0x7efd7c0d2e00 2023-10-17T06:22:48.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.638+0000 7efd7a59c700 1 --2- 172.21.15.125:0/1634687206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd7c0d2e00 0x7efd7c0b6e00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009880 tx=0x7efd6c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa9cf24e41600965 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:48.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.642+0000 7efd79d9b700 1 -- 172.21.15.125:0/1634687206 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c011830 con 0x7efd7c0d2e00 2023-10-17T06:22:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.642+0000 7efd79d9b700 1 -- 172.21.15.125:0/1634687206 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c011990 con 0x7efd7c0d2e00 2023-10-17T06:22:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.642+0000 7efd79d9b700 1 -- 172.21.15.125:0/1634687206 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c011d20 con 0x7efd7c0d2e00 2023-10-17T06:22:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.642+0000 7efd7b59e700 1 -- 172.21.15.125:0/1634687206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd7c0d2e00 msgr2=0x7efd7c0b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.642+0000 7efd7b59e700 1 --2- 172.21.15.125:0/1634687206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd7c0d2e00 0x7efd7c0b6e00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009880 tx=0x7efd6c009b90 comp rx=0 tx=0).stop 2023-10-17T06:22:48.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.642+0000 7efd7b59e700 1 -- 172.21.15.125:0/1634687206 shutdown_connections 2023-10-17T06:22:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.642+0000 7efd7b59e700 1 --2- 172.21.15.125:0/1634687206 >> v2:172.21.15.184:3300/0 conn(0x7efd7c160710 0x7efd7c0d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.642+0000 7efd7b59e700 1 --2- 172.21.15.125:0/1634687206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd7c0d2e00 0x7efd7c0b6e00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.642+0000 7efd7b59e700 1 -- 172.21.15.125:0/1634687206 >> 172.21.15.125:0/1634687206 conn(0x7efd7c069f20 msgr2=0x7efd7c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.642+0000 7efd7b59e700 1 -- 172.21.15.125:0/1634687206 shutdown_connections 2023-10-17T06:22:48.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.642+0000 7efd7b59e700 1 -- 172.21.15.125:0/1634687206 wait complete. 2023-10-17T06:22:48.652 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.646+0000 7efd7b59e700 1 Processor -- start 2023-10-17T06:22:48.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.646+0000 7efd7b59e700 1 -- start start 2023-10-17T06:22:48.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.646+0000 7efd7b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd7c0b5ae0 0x7efd7c08a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:48.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.646+0000 7efd7b59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd7c0d2e00 0x7efd7c0b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:48.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.646+0000 7efd7b59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd7c160710 0x7efd7c1fa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:48.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.646+0000 7efd7b59e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c1fa7e0 con 0x7efd7c0b5ae0 2023-10-17T06:22:48.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.646+0000 7efd7b59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0b2750 con 0x7efd7c160710 2023-10-17T06:22:48.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.646+0000 7efd7b59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0b2960 con 0x7efd7c0d2e00 2023-10-17T06:22:48.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.650+0000 7efd7a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd7c0b5ae0 0x7efd7c08a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:48.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.650+0000 7efd7a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd7c0b5ae0 0x7efd7c08a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40410/0 (socket says 172.21.15.125:40410) 2023-10-17T06:22:48.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.650+0000 7efd7a59c700 1 -- 172.21.15.125:0/3626007668 learned_addr learned my addr 172.21.15.125:0/3626007668 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:48.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.650+0000 7efd71d9b700 1 --2- 172.21.15.125:0/3626007668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd7c0d2e00 0x7efd7c0b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:48.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.650+0000 7efd7ad9d700 1 --2- 172.21.15.125:0/3626007668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd7c160710 0x7efd7c1fa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:48.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.650+0000 7efd7a59c700 1 -- 172.21.15.125:0/3626007668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd7c0d2e00 msgr2=0x7efd7c0b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:48.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.650+0000 7efd7a59c700 1 --2- 172.21.15.125:0/3626007668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd7c0d2e00 0x7efd7c0b14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.650+0000 7efd7a59c700 1 -- 172.21.15.125:0/3626007668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd7c160710 msgr2=0x7efd7c1fa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:48.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.650+0000 7efd7a59c700 1 --2- 172.21.15.125:0/3626007668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd7c160710 0x7efd7c1fa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.658 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.650+0000 7efd7a59c700 1 -- 172.21.15.125:0/3626007668 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c0094b0 con 0x7efd7c0b5ae0 2023-10-17T06:22:48.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.650+0000 7efd7a59c700 1 --2- 172.21.15.125:0/3626007668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd7c0b5ae0 0x7efd7c08a000 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009bd0 tx=0x7efd6c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:48.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.650+0000 7efd737fe700 1 -- 172.21.15.125:0/3626007668 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c0044d0 con 0x7efd7c0b5ae0 2023-10-17T06:22:48.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.650+0000 7efd737fe700 1 -- 172.21.15.125:0/3626007668 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c01e070 con 0x7efd7c0b5ae0 2023-10-17T06:22:48.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.650+0000 7efd7b59e700 1 -- 172.21.15.125:0/3626007668 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7c0b2c40 con 0x7efd7c0b5ae0 2023-10-17T06:22:48.659 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.650+0000 7efd737fe700 1 -- 172.21.15.125:0/3626007668 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c0038e0 con 0x7efd7c0b5ae0 2023-10-17T06:22:48.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.650+0000 7efd7b59e700 1 -- 172.21.15.125:0/3626007668 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7c0b3200 con 0x7efd7c0b5ae0 2023-10-17T06:22:48.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.650+0000 7efd7b59e700 1 -- 172.21.15.125:0/3626007668 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd7c0b3420 con 0x7efd7c0b5ae0 2023-10-17T06:22:48.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.654+0000 7efd737fe700 1 -- 172.21.15.125:0/3626007668 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7efd6c003a40 con 0x7efd7c0b5ae0 2023-10-17T06:22:48.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.654+0000 7efd737fe700 1 --2- 172.21.15.125:0/3626007668 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efd5c0656f0 0x7efd5c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:48.661 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.654+0000 7efd737fe700 1 -- 172.21.15.125:0/3626007668 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7efd6c083c50 con 0x7efd7c0b5ae0 2023-10-17T06:22:48.662 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.654+0000 7efd71d9b700 1 --2- 172.21.15.125:0/3626007668 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efd5c0656f0 0x7efd5c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:48.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.658+0000 7efd71d9b700 1 --2- 172.21.15.125:0/3626007668 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efd5c0656f0 0x7efd5c067bb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efd7c06d720 tx=0x7efd64009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:48.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.662+0000 7efd737fe700 1 -- 172.21.15.125:0/3626007668 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7efd6c089020 con 0x7efd7c0b5ae0 2023-10-17T06:22:48.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.894+0000 7efd7b59e700 1 -- 172.21.15.125:0/3626007668 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd7c072e60 con 0x7efd7c0b5ae0 2023-10-17T06:22:48.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.894+0000 7efd737fe700 1 -- 172.21.15.125:0/3626007668 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4889 (secure 0 0 0) 0x7efd6c015090 con 0x7efd7c0b5ae0 2023-10-17T06:22:48.902 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:22:48.902 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:08:51.328615+0000","modified":"2023-10-17T06:16:00.378712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":111,"addr":"172.21.15.125:6837/2351050168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2351050168},{"type":"v1","addr":"172.21.15.125:6837","nonce":2351050168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-17T06:22:48.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.898+0000 7efd7b59e700 1 -- 172.21.15.125:0/3626007668 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efd5c0656f0 msgr2=0x7efd5c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:48.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.898+0000 7efd7b59e700 1 --2- 172.21.15.125:0/3626007668 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efd5c0656f0 0x7efd5c067bb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efd7c06d720 tx=0x7efd64009240 comp rx=0 tx=0).stop 2023-10-17T06:22:48.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.898+0000 7efd7b59e700 1 -- 172.21.15.125:0/3626007668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd7c0b5ae0 msgr2=0x7efd7c08a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:48.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.898+0000 7efd7b59e700 1 --2- 172.21.15.125:0/3626007668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd7c0b5ae0 0x7efd7c08a000 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009bd0 tx=0x7efd6c004770 comp rx=0 tx=0).stop 2023-10-17T06:22:48.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.898+0000 7efd7b59e700 1 -- 172.21.15.125:0/3626007668 shutdown_connections 2023-10-17T06:22:48.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.898+0000 7efd7b59e700 1 --2- 172.21.15.125:0/3626007668 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efd5c0656f0 0x7efd5c067bb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.898+0000 7efd7b59e700 1 --2- 172.21.15.125:0/3626007668 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd7c160710 0x7efd7c1fa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.898+0000 7efd7b59e700 1 --2- 172.21.15.125:0/3626007668 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd7c0d2e00 0x7efd7c0b14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.898+0000 7efd7b59e700 1 --2- 172.21.15.125:0/3626007668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd7c0b5ae0 0x7efd7c08a000 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:48.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.898+0000 7efd7b59e700 1 -- 172.21.15.125:0/3626007668 >> 172.21.15.125:0/3626007668 conn(0x7efd7c069f20 msgr2=0x7efd7c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:48.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.898+0000 7efd7b59e700 1 -- 172.21.15.125:0/3626007668 shutdown_connections 2023-10-17T06:22:48.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:48.898+0000 7efd7b59e700 1 -- 172.21.15.125:0/3626007668 wait complete. 2023-10-17T06:22:48.907 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 19 2023-10-17T06:22:48.926 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:22:49.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.094+0000 7fcb41dd2700 1 Processor -- start 2023-10-17T06:22:49.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.094+0000 7fcb41dd2700 1 -- start start 2023-10-17T06:22:49.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.098+0000 7fcb41dd2700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcb3c06d090 0x7fcb3c0b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:49.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.098+0000 7fcb41dd2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb3c15a410 0x7fcb3c15a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:49.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.098+0000 7fcb41dd2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb3c071120 con 0x7fcb3c06d470 2023-10-17T06:22:49.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.098+0000 7fcb41dd2700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb3c15f4f0 con 0x7fcb3c06d090 2023-10-17T06:22:49.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.098+0000 7fcb41dd2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c15e990 con 0x7fcb3c15a410 2023-10-17T06:22:49.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.098+0000 7fcb3bfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fcb3c06d470 0x7fcb3c070a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59256/0 (socket says 172.21.15.125:59256) 2023-10-17T06:22:49.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.098+0000 7fcb3bfff700 1 -- 172.21.15.125:0/4265473774 learned_addr learned my addr 172.21.15.125:0/4265473774 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:22:49.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.098+0000 7fcb40dd0700 1 --2- 172.21.15.125:0/4265473774 >> v2:172.21.15.184:3300/0 conn(0x7fcb3c06d090 0x7fcb3c0b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:49.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.098+0000 7fcb415d1700 1 --2- 172.21.15.125:0/4265473774 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb3c15a410 0x7fcb3c15a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:49.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.098+0000 7fcb3b7fe700 1 -- 172.21.15.125:0/4265473774 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627188086 0 0) 0x7fcb3c071120 con 0x7fcb3c06d470 2023-10-17T06:22:49.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.098+0000 7fcb3b7fe700 1 -- 172.21.15.125:0/4265473774 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb240035d0 con 0x7fcb3c06d470 2023-10-17T06:22:49.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.098+0000 7fcb415d1700 1 -- 172.21.15.125:0/4265473774 >> v2:172.21.15.184:3300/0 conn(0x7fcb3c06d090 msgr2=0x7fcb3c0b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:49.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.098+0000 7fcb415d1700 1 --2- 172.21.15.125:0/4265473774 >> v2:172.21.15.184:3300/0 conn(0x7fcb3c06d090 0x7fcb3c0b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.098+0000 7fcb415d1700 1 -- 172.21.15.125:0/4265473774 >> v1:172.21.15.125:6789/0 conn(0x7fcb3c06d470 legacy=0x7fcb3c070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:49.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.098+0000 7fcb415d1700 1 -- 172.21.15.125:0/4265473774 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c15ec50 con 0x7fcb3c15a410 2023-10-17T06:22:49.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.098+0000 7fcb415d1700 1 --2- 172.21.15.125:0/4265473774 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb3c15a410 0x7fcb3c15a8c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009d90 tx=0x7fcb3400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b80cc01eba022ff1 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:49.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.098+0000 7fcb3b7fe700 1 -- 172.21.15.125:0/4265473774 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3400e070 con 0x7fcb3c15a410 2023-10-17T06:22:49.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.098+0000 7fcb3b7fe700 1 -- 172.21.15.125:0/4265473774 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3400bb20 con 0x7fcb3c15a410 2023-10-17T06:22:49.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.098+0000 7fcb3b7fe700 1 -- 172.21.15.125:0/4265473774 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb34012430 con 0x7fcb3c15a410 2023-10-17T06:22:49.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.102+0000 7fcb41dd2700 1 -- 172.21.15.125:0/4265473774 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb3c15a410 msgr2=0x7fcb3c15a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:49.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.102+0000 7fcb41dd2700 1 --2- 172.21.15.125:0/4265473774 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb3c15a410 0x7fcb3c15a8c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009d90 tx=0x7fcb3400b330 comp rx=0 tx=0).stop 2023-10-17T06:22:49.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.102+0000 7fcb41dd2700 1 -- 172.21.15.125:0/4265473774 shutdown_connections 2023-10-17T06:22:49.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.102+0000 7fcb41dd2700 1 --2- 172.21.15.125:0/4265473774 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb3c15a410 0x7fcb3c15a8c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.102+0000 7fcb41dd2700 1 --2- 172.21.15.125:0/4265473774 >> v2:172.21.15.184:3300/0 conn(0x7fcb3c06d090 0x7fcb3c0b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.102+0000 7fcb41dd2700 1 -- 172.21.15.125:0/4265473774 >> 172.21.15.125:0/4265473774 conn(0x7fcb3c0ce5c0 msgr2=0x7fcb3c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:49.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.102+0000 7fcb41dd2700 1 -- 172.21.15.125:0/4265473774 shutdown_connections 2023-10-17T06:22:49.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.102+0000 7fcb41dd2700 1 -- 172.21.15.125:0/4265473774 wait complete. 2023-10-17T06:22:49.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.102+0000 7fcb41dd2700 1 Processor -- start 2023-10-17T06:22:49.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.102+0000 7fcb41dd2700 1 -- start start 2023-10-17T06:22:49.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb41dd2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb3c06d090 0x7fcb3c148810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:49.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb41dd2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb3c06d470 0x7fcb3c1f18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:49.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb41dd2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb3c15a410 0x7fcb3c1f5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:49.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb41dd2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c0c6250 con 0x7fcb3c06d470 2023-10-17T06:22:49.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb41dd2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c149110 con 0x7fcb3c15a410 2023-10-17T06:22:49.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb41dd2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c1493f0 con 0x7fcb3c06d090 2023-10-17T06:22:49.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb3bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb3c06d470 0x7fcb3c1f18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:49.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb40dd0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb3c06d090 0x7fcb3c148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:49.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb3bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb3c06d470 0x7fcb3c1f18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40424/0 (socket says 172.21.15.125:40424) 2023-10-17T06:22:49.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb3bfff700 1 -- 172.21.15.125:0/2781663613 learned_addr learned my addr 172.21.15.125:0/2781663613 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:49.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb415d1700 1 --2- 172.21.15.125:0/2781663613 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb3c15a410 0x7fcb3c1f5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:49.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb3bfff700 1 -- 172.21.15.125:0/2781663613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb3c06d090 msgr2=0x7fcb3c148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:49.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb3bfff700 1 --2- 172.21.15.125:0/2781663613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb3c06d090 0x7fcb3c148810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb3bfff700 1 -- 172.21.15.125:0/2781663613 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb3c15a410 msgr2=0x7fcb3c1f5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:49.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb3bfff700 1 --2- 172.21.15.125:0/2781663613 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb3c15a410 0x7fcb3c1f5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb3bfff700 1 -- 172.21.15.125:0/2781663613 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb34009a70 con 0x7fcb3c06d470 2023-10-17T06:22:49.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb40dd0700 1 --2- 172.21.15.125:0/2781663613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb3c06d090 0x7fcb3c148810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:22:49.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb3bfff700 1 --2- 172.21.15.125:0/2781663613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb3c06d470 0x7fcb3c1f18b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000c700 tx=0x7fcb3000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:49.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb397fa700 1 -- 172.21.15.125:0/2781663613 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb30005d90 con 0x7fcb3c06d470 2023-10-17T06:22:49.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb397fa700 1 -- 172.21.15.125:0/2781663613 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb300070d0 con 0x7fcb3c06d470 2023-10-17T06:22:49.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb41dd2700 1 -- 172.21.15.125:0/2781663613 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3c1496d0 con 0x7fcb3c06d470 2023-10-17T06:22:49.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb397fa700 1 -- 172.21.15.125:0/2781663613 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb30007480 con 0x7fcb3c06d470 2023-10-17T06:22:49.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.106+0000 7fcb41dd2700 1 -- 172.21.15.125:0/2781663613 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3c1f59b0 con 0x7fcb3c06d470 2023-10-17T06:22:49.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.110+0000 7fcb41dd2700 1 -- 172.21.15.125:0/2781663613 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3c1f5bd0 con 0x7fcb3c06d470 2023-10-17T06:22:49.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.110+0000 7fcb397fa700 1 -- 172.21.15.125:0/2781663613 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fcb300075e0 con 0x7fcb3c06d470 2023-10-17T06:22:49.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.114+0000 7fcb397fa700 1 --2- 172.21.15.125:0/2781663613 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fcb280656f0 0x7fcb28067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:49.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.114+0000 7fcb397fa700 1 -- 172.21.15.125:0/2781663613 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fcb30082440 con 0x7fcb3c06d470 2023-10-17T06:22:49.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.114+0000 7fcb40dd0700 1 --2- 172.21.15.125:0/2781663613 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fcb280656f0 0x7fcb28067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:49.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.114+0000 7fcb40dd0700 1 --2- 172.21.15.125:0/2781663613 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fcb280656f0 0x7fcb28067bb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c0112c0 tx=0x7fcb2c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:49.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.118+0000 7fcb397fa700 1 -- 172.21.15.125:0/2781663613 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fcb3004fcb0 con 0x7fcb3c06d470 2023-10-17T06:22:49.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.302+0000 7fcb41dd2700 1 -- 172.21.15.125:0/2781663613 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb3c072e60 con 0x7fcb3c06d470 2023-10-17T06:22:49.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.306+0000 7fcb397fa700 1 -- 172.21.15.125:0/2781663613 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+18788 (secure 0 0 0) 0x7fcb30017090 con 0x7fcb3c06d470 2023-10-17T06:22:49.312 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:22:49.312 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":55,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:16:02.394779+0000","last_up_change":"2023-10-17T06:16:01.390745+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:08:48.973490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-17T06:08:50.385778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":50,"up_from":54,"up_thru":54,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6801","nonce":1353754211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6803","nonce":1353754211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6807","nonce":1353754211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6805","nonce":1353754211}]},"public_addr":"172.21.15.125:6801/1353754211","cluster_addr":"172.21.15.125:6803/1353754211","heartbeat_back_addr":"172.21.15.125:6807/1353754211","heartbeat_front_addr":"172.21.15.125:6805/1353754211","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"2023-10-17T06:09:26.602656+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":51},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.12","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:0/3775054255":"2023-10-17T07:15:56.011706+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:22:49.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.310+0000 7fcb41dd2700 1 -- 172.21.15.125:0/2781663613 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fcb280656f0 msgr2=0x7fcb28067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:49.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.310+0000 7fcb41dd2700 1 --2- 172.21.15.125:0/2781663613 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fcb280656f0 0x7fcb28067bb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c0112c0 tx=0x7fcb2c009240 comp rx=0 tx=0).stop 2023-10-17T06:22:49.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.310+0000 7fcb41dd2700 1 -- 172.21.15.125:0/2781663613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb3c06d470 msgr2=0x7fcb3c1f18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:49.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.310+0000 7fcb41dd2700 1 --2- 172.21.15.125:0/2781663613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb3c06d470 0x7fcb3c1f18b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000c700 tx=0x7fcb3000ca10 comp rx=0 tx=0).stop 2023-10-17T06:22:49.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.310+0000 7fcb41dd2700 1 -- 172.21.15.125:0/2781663613 shutdown_connections 2023-10-17T06:22:49.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.310+0000 7fcb41dd2700 1 --2- 172.21.15.125:0/2781663613 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fcb280656f0 0x7fcb28067bb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.310+0000 7fcb41dd2700 1 --2- 172.21.15.125:0/2781663613 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb3c15a410 0x7fcb3c1f5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.310+0000 7fcb41dd2700 1 --2- 172.21.15.125:0/2781663613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb3c06d470 0x7fcb3c1f18b0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.310+0000 7fcb41dd2700 1 --2- 172.21.15.125:0/2781663613 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb3c06d090 0x7fcb3c148810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.310+0000 7fcb41dd2700 1 -- 172.21.15.125:0/2781663613 >> 172.21.15.125:0/2781663613 conn(0x7fcb3c0ce5c0 msgr2=0x7fcb3c0c9020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:49.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.310+0000 7fcb41dd2700 1 -- 172.21.15.125:0/2781663613 shutdown_connections 2023-10-17T06:22:49.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.310+0000 7fcb41dd2700 1 -- 172.21.15.125:0/2781663613 wait complete. 2023-10-17T06:22:49.337 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-17T06:22:49.337 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:22:49.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.510+0000 7f1d3d6dd700 1 Processor -- start 2023-10-17T06:22:49.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.510+0000 7f1d3d6dd700 1 -- start start 2023-10-17T06:22:49.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.514+0000 7f1d3d6dd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d380ce320 0x7f1d380cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:49.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.514+0000 7f1d3d6dd700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d380cbc80 con 0x7f1d3815bf00 2023-10-17T06:22:49.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.514+0000 7f1d3d6dd700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d380cb9a0 con 0x7f1d38155420 2023-10-17T06:22:49.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.514+0000 7f1d3d6dd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d38155800 con 0x7f1d380ce320 2023-10-17T06:22:49.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.514+0000 7f1d367fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1d3815bf00 0x7f1d380cdc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59264/0 (socket says 172.21.15.125:59264) 2023-10-17T06:22:49.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.514+0000 7f1d367fc700 1 -- 172.21.15.125:0/558683749 learned_addr learned my addr 172.21.15.125:0/558683749 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:22:49.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.514+0000 7f1d377fe700 1 --2- 172.21.15.125:0/558683749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d380ce320 0x7f1d380cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:49.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.514+0000 7f1d35ffb700 1 -- 172.21.15.125:0/558683749 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793680911 0 0) 0x7f1d380cbc80 con 0x7f1d3815bf00 2023-10-17T06:22:49.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.514+0000 7f1d35ffb700 1 -- 172.21.15.125:0/558683749 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d200035d0 con 0x7f1d3815bf00 2023-10-17T06:22:49.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.514+0000 7f1d377fe700 1 -- 172.21.15.125:0/558683749 >> v1:172.21.15.184:6789/0 conn(0x7f1d38155420 legacy=0x7f1d380cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:49.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.514+0000 7f1d377fe700 1 -- 172.21.15.125:0/558683749 >> v1:172.21.15.125:6789/0 conn(0x7f1d3815bf00 legacy=0x7f1d380cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:49.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.514+0000 7f1d377fe700 1 -- 172.21.15.125:0/558683749 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3815b420 con 0x7f1d380ce320 2023-10-17T06:22:49.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.514+0000 7f1d377fe700 1 --2- 172.21.15.125:0/558683749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d380ce320 0x7f1d380cc680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1d30009dc0 tx=0x7f1d3000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b09b40947f04b3a server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:49.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.514+0000 7f1d35ffb700 1 -- 172.21.15.125:0/558683749 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3000e070 con 0x7f1d380ce320 2023-10-17T06:22:49.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.514+0000 7f1d35ffb700 1 -- 172.21.15.125:0/558683749 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3000bb20 con 0x7f1d380ce320 2023-10-17T06:22:49.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.514+0000 7f1d35ffb700 1 -- 172.21.15.125:0/558683749 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d30012430 con 0x7f1d380ce320 2023-10-17T06:22:49.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.518+0000 7f1d3d6dd700 1 -- 172.21.15.125:0/558683749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d380ce320 msgr2=0x7f1d380cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:49.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.518+0000 7f1d3d6dd700 1 --2- 172.21.15.125:0/558683749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d380ce320 0x7f1d380cc680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1d30009dc0 tx=0x7f1d3000b330 comp rx=0 tx=0).stop 2023-10-17T06:22:49.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.518+0000 7f1d3d6dd700 1 -- 172.21.15.125:0/558683749 shutdown_connections 2023-10-17T06:22:49.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.518+0000 7f1d3d6dd700 1 --2- 172.21.15.125:0/558683749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d380ce320 0x7f1d380cc680 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.518+0000 7f1d3d6dd700 1 -- 172.21.15.125:0/558683749 >> 172.21.15.125:0/558683749 conn(0x7f1d3806a340 msgr2=0x7f1d380b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:49.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.518+0000 7f1d3d6dd700 1 -- 172.21.15.125:0/558683749 shutdown_connections 2023-10-17T06:22:49.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.518+0000 7f1d3d6dd700 1 -- 172.21.15.125:0/558683749 wait complete. 2023-10-17T06:22:49.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.522+0000 7f1d3d6dd700 1 Processor -- start 2023-10-17T06:22:49.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.522+0000 7f1d3d6dd700 1 -- start start 2023-10-17T06:22:49.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.522+0000 7f1d3d6dd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d380ce320 0x7f1d380aae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:49.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.522+0000 7f1d3d6dd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d38155420 0x7f1d3815a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:49.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.522+0000 7f1d3d6dd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d3815bf00 0x7f1d380ce700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:49.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.522+0000 7f1d3d6dd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d38139d10 con 0x7f1d3815bf00 2023-10-17T06:22:49.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.522+0000 7f1d3d6dd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d38139100 con 0x7f1d380ce320 2023-10-17T06:22:49.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.522+0000 7f1d3d6dd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d381393e0 con 0x7f1d38155420 2023-10-17T06:22:49.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.522+0000 7f1d377fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d3815bf00 0x7f1d380ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:49.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.522+0000 7f1d377fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d3815bf00 0x7f1d380ce700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40436/0 (socket says 172.21.15.125:40436) 2023-10-17T06:22:49.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.522+0000 7f1d377fe700 1 -- 172.21.15.125:0/3558516617 learned_addr learned my addr 172.21.15.125:0/3558516617 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:49.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.522+0000 7f1d367fc700 1 --2- 172.21.15.125:0/3558516617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d38155420 0x7f1d3815a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:49.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.522+0000 7f1d36ffd700 1 --2- 172.21.15.125:0/3558516617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d380ce320 0x7f1d380aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:49.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.522+0000 7f1d377fe700 1 -- 172.21.15.125:0/3558516617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d38155420 msgr2=0x7f1d3815a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:49.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.522+0000 7f1d377fe700 1 --2- 172.21.15.125:0/3558516617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d38155420 0x7f1d3815a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.522+0000 7f1d377fe700 1 -- 172.21.15.125:0/3558516617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d380ce320 msgr2=0x7f1d380aae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:49.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.522+0000 7f1d377fe700 1 --2- 172.21.15.125:0/3558516617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d380ce320 0x7f1d380aae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.522+0000 7f1d377fe700 1 -- 172.21.15.125:0/3558516617 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d30009a70 con 0x7f1d3815bf00 2023-10-17T06:22:49.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.522+0000 7f1d36ffd700 1 --2- 172.21.15.125:0/3558516617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d380ce320 0x7f1d380aae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:22:49.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.522+0000 7f1d367fc700 1 --2- 172.21.15.125:0/3558516617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d38155420 0x7f1d3815a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:22:49.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.526+0000 7f1d377fe700 1 --2- 172.21.15.125:0/3558516617 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d3815bf00 0x7f1d380ce700 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1d30014040 tx=0x7f1d30004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:49.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.526+0000 7f1d1f7fe700 1 -- 172.21.15.125:0/3558516617 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d30012430 con 0x7f1d3815bf00 2023-10-17T06:22:49.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.526+0000 7f1d1f7fe700 1 -- 172.21.15.125:0/3558516617 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d30020070 con 0x7f1d3815bf00 2023-10-17T06:22:49.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.526+0000 7f1d3d6dd700 1 -- 172.21.15.125:0/3558516617 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d381396c0 con 0x7f1d3815bf00 2023-10-17T06:22:49.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.526+0000 7f1d1f7fe700 1 -- 172.21.15.125:0/3558516617 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d30004280 con 0x7f1d3815bf00 2023-10-17T06:22:49.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.526+0000 7f1d3d6dd700 1 -- 172.21.15.125:0/3558516617 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3815a640 con 0x7f1d3815bf00 2023-10-17T06:22:49.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.526+0000 7f1d3d6dd700 1 -- 172.21.15.125:0/3558516617 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3815a800 con 0x7f1d3815bf00 2023-10-17T06:22:49.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.530+0000 7f1d1f7fe700 1 -- 172.21.15.125:0/3558516617 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1d300043e0 con 0x7f1d3815bf00 2023-10-17T06:22:49.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.530+0000 7f1d1f7fe700 1 --2- 172.21.15.125:0/3558516617 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1d240656f0 0x7f1d24067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:49.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.530+0000 7f1d1f7fe700 1 -- 172.21.15.125:0/3558516617 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f1d30022070 con 0x7f1d3815bf00 2023-10-17T06:22:49.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.530+0000 7f1d36ffd700 1 --2- 172.21.15.125:0/3558516617 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1d240656f0 0x7f1d24067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:49.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.534+0000 7f1d36ffd700 1 --2- 172.21.15.125:0/3558516617 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1d240656f0 0x7f1d24067bb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1d28000f60 tx=0x7f1d28009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:49.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.534+0000 7f1d1f7fe700 1 -- 172.21.15.125:0/3558516617 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f1d30052b70 con 0x7f1d3815bf00 2023-10-17T06:22:49.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.758+0000 7f1d3d6dd700 1 -- 172.21.15.125:0/3558516617 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d38072e60 con 0x7f1d3815bf00 2023-10-17T06:22:49.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.762+0000 7f1d1f7fe700 1 -- 172.21.15.125:0/3558516617 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4889 (secure 0 0 0) 0x7f1d30056190 con 0x7f1d3815bf00 2023-10-17T06:22:49.767 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:22:49.767 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:08:51.328615+0000","modified":"2023-10-17T06:16:00.378712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":111,"addr":"172.21.15.125:6837/2351050168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2351050168},{"type":"v1","addr":"172.21.15.125:6837","nonce":2351050168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-17T06:22:49.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.766+0000 7f1d3d6dd700 1 -- 172.21.15.125:0/3558516617 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1d240656f0 msgr2=0x7f1d24067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:49.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.766+0000 7f1d3d6dd700 1 --2- 172.21.15.125:0/3558516617 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1d240656f0 0x7f1d24067bb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1d28000f60 tx=0x7f1d28009040 comp rx=0 tx=0).stop 2023-10-17T06:22:49.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.766+0000 7f1d3d6dd700 1 -- 172.21.15.125:0/3558516617 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d3815bf00 msgr2=0x7f1d380ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:49.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.766+0000 7f1d3d6dd700 1 --2- 172.21.15.125:0/3558516617 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d3815bf00 0x7f1d380ce700 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1d30014040 tx=0x7f1d30004af0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.766+0000 7f1d3d6dd700 1 -- 172.21.15.125:0/3558516617 shutdown_connections 2023-10-17T06:22:49.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.766+0000 7f1d3d6dd700 1 --2- 172.21.15.125:0/3558516617 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1d240656f0 0x7f1d24067bb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.766+0000 7f1d3d6dd700 1 --2- 172.21.15.125:0/3558516617 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d3815bf00 0x7f1d380ce700 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.766+0000 7f1d3d6dd700 1 --2- 172.21.15.125:0/3558516617 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d38155420 0x7f1d3815a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.766+0000 7f1d3d6dd700 1 --2- 172.21.15.125:0/3558516617 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d380ce320 0x7f1d380aae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.766+0000 7f1d3d6dd700 1 -- 172.21.15.125:0/3558516617 >> 172.21.15.125:0/3558516617 conn(0x7f1d3806a340 msgr2=0x7f1d3815c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:49.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.766+0000 7f1d3d6dd700 1 -- 172.21.15.125:0/3558516617 shutdown_connections 2023-10-17T06:22:49.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.766+0000 7f1d3d6dd700 1 -- 172.21.15.125:0/3558516617 wait complete. 2023-10-17T06:22:49.773 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 19 2023-10-17T06:22:49.791 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:22:49.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.954+0000 7f2b3a984700 1 Processor -- start 2023-10-17T06:22:49.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.954+0000 7f2b3a984700 1 -- start start 2023-10-17T06:22:49.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.958+0000 7f2b3a984700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b340d2e00 0x7f2b340b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:49.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.958+0000 7f2b3a984700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2b34160710 0x7f2b340d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:49.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.958+0000 7f2b3a984700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3415d0d0 con 0x7f2b340b5ae0 2023-10-17T06:22:49.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.958+0000 7f2b3a984700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b3415df90 con 0x7f2b34160710 2023-10-17T06:22:49.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.958+0000 7f2b3a984700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3406f0f0 con 0x7f2b340d2e00 2023-10-17T06:22:49.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.958+0000 7f2b39181700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2b34160710 0x7f2b340d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:49.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.958+0000 7f2b39181700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2b34160710 0x7f2b340d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40438/0 (socket says 172.21.15.125:40438) 2023-10-17T06:22:49.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.958+0000 7f2b39181700 1 -- 172.21.15.125:0/421434132 learned_addr learned my addr 172.21.15.125:0/421434132 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:49.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.958+0000 7f2b39982700 1 --2- 172.21.15.125:0/421434132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b340d2e00 0x7f2b340b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:49.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.958+0000 7f2b39181700 1 -- 172.21.15.125:0/421434132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b340d2e00 msgr2=0x7f2b340b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:49.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.958+0000 7f2b39181700 1 --2- 172.21.15.125:0/421434132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b340d2e00 0x7f2b340b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.958+0000 7f2b39181700 1 -- 172.21.15.125:0/421434132 >> v1:172.21.15.125:6789/0 conn(0x7f2b340b5ae0 legacy=0x7f2b3406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:49.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.958+0000 7f2b39181700 1 -- 172.21.15.125:0/421434132 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b340d3720 con 0x7f2b34160710 2023-10-17T06:22:49.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.958+0000 7f2b39181700 1 --2- 172.21.15.125:0/421434132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b34160710 0x7f2b340d31e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009940 tx=0x7f2b24009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7d1edc42f82d4d server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:49.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.958+0000 7f2b38980700 1 -- 172.21.15.125:0/421434132 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24011830 con 0x7f2b34160710 2023-10-17T06:22:49.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.958+0000 7f2b38980700 1 -- 172.21.15.125:0/421434132 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b24011990 con 0x7f2b34160710 2023-10-17T06:22:49.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.958+0000 7f2b38980700 1 -- 172.21.15.125:0/421434132 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24011d20 con 0x7f2b34160710 2023-10-17T06:22:49.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.962+0000 7f2b3a984700 1 -- 172.21.15.125:0/421434132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b34160710 msgr2=0x7f2b340d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:49.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.962+0000 7f2b3a984700 1 --2- 172.21.15.125:0/421434132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b34160710 0x7f2b340d31e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2b24009940 tx=0x7f2b24009c50 comp rx=0 tx=0).stop 2023-10-17T06:22:49.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.962+0000 7f2b3a984700 1 -- 172.21.15.125:0/421434132 shutdown_connections 2023-10-17T06:22:49.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.962+0000 7f2b3a984700 1 --2- 172.21.15.125:0/421434132 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b34160710 0x7f2b340d31e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.962+0000 7f2b3a984700 1 --2- 172.21.15.125:0/421434132 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b340d2e00 0x7f2b340b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.962+0000 7f2b3a984700 1 -- 172.21.15.125:0/421434132 >> 172.21.15.125:0/421434132 conn(0x7f2b34069f20 msgr2=0x7f2b3406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:49.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.962+0000 7f2b3a984700 1 -- 172.21.15.125:0/421434132 shutdown_connections 2023-10-17T06:22:49.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.962+0000 7f2b3a984700 1 -- 172.21.15.125:0/421434132 wait complete. 2023-10-17T06:22:49.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b3a984700 1 Processor -- start 2023-10-17T06:22:49.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b3a984700 1 -- start start 2023-10-17T06:22:49.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b3a984700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b340b5ae0 0x7f2b3415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:49.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b3a984700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b340d2e00 0x7f2b341f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:49.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b3a984700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b34160710 0x7f2b3415f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:49.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b3a984700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b340ac600 con 0x7f2b340b5ae0 2023-10-17T06:22:49.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b3a984700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b340ab980 con 0x7f2b340d2e00 2023-10-17T06:22:49.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b3a984700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b340abc60 con 0x7f2b34160710 2023-10-17T06:22:49.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b39982700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b340b5ae0 0x7f2b3415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:49.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b39982700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b340b5ae0 0x7f2b3415a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40442/0 (socket says 172.21.15.125:40442) 2023-10-17T06:22:49.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b39982700 1 -- 172.21.15.125:0/3875363839 learned_addr learned my addr 172.21.15.125:0/3875363839 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:49.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b39181700 1 --2- 172.21.15.125:0/3875363839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b340d2e00 0x7f2b341f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:49.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b39982700 1 -- 172.21.15.125:0/3875363839 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b34160710 msgr2=0x7f2b3415f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:49.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b3a183700 1 --2- 172.21.15.125:0/3875363839 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b34160710 0x7f2b3415f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:49.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b39982700 1 --2- 172.21.15.125:0/3875363839 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b34160710 0x7f2b3415f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b39982700 1 -- 172.21.15.125:0/3875363839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b340d2e00 msgr2=0x7f2b341f62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:49.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b39982700 1 --2- 172.21.15.125:0/3875363839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b340d2e00 0x7f2b341f62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:49.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b39982700 1 -- 172.21.15.125:0/3875363839 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b24009570 con 0x7f2b340b5ae0 2023-10-17T06:22:49.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b39181700 1 --2- 172.21.15.125:0/3875363839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b340d2e00 0x7f2b341f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:22:49.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b3a183700 1 --2- 172.21.15.125:0/3875363839 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b34160710 0x7f2b3415f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:22:49.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b39982700 1 --2- 172.21.15.125:0/3875363839 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b340b5ae0 0x7f2b3415a6f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000e840 tx=0x7f2b3000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:49.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b2a7fc700 1 -- 172.21.15.125:0/3875363839 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b300095a0 con 0x7f2b340b5ae0 2023-10-17T06:22:49.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b2a7fc700 1 -- 172.21.15.125:0/3875363839 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3000c690 con 0x7f2b340b5ae0 2023-10-17T06:22:49.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b3a984700 1 -- 172.21.15.125:0/3875363839 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b340abf40 con 0x7f2b340b5ae0 2023-10-17T06:22:49.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.966+0000 7f2b2a7fc700 1 -- 172.21.15.125:0/3875363839 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3000ca00 con 0x7f2b340b5ae0 2023-10-17T06:22:49.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.970+0000 7f2b3a984700 1 -- 172.21.15.125:0/3875363839 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3415ac30 con 0x7f2b340b5ae0 2023-10-17T06:22:49.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.970+0000 7f2b3a984700 1 -- 172.21.15.125:0/3875363839 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b34072e60 con 0x7f2b340b5ae0 2023-10-17T06:22:49.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.970+0000 7f2b2a7fc700 1 -- 172.21.15.125:0/3875363839 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2b3000cb60 con 0x7f2b340b5ae0 2023-10-17T06:22:49.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.974+0000 7f2b2a7fc700 1 --2- 172.21.15.125:0/3875363839 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2b180656f0 0x7f2b18067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:49.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.974+0000 7f2b2a7fc700 1 -- 172.21.15.125:0/3875363839 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f2b30082f50 con 0x7f2b340b5ae0 2023-10-17T06:22:49.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.974+0000 7f2b39181700 1 --2- 172.21.15.125:0/3875363839 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2b180656f0 0x7f2b18067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:49.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.974+0000 7f2b39181700 1 --2- 172.21.15.125:0/3875363839 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2b180656f0 0x7f2b18067bb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2b340d27c0 tx=0x7f2b24008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:49.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:49.978+0000 7f2b2a7fc700 1 -- 172.21.15.125:0/3875363839 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2b30050860 con 0x7f2b340b5ae0 2023-10-17T06:22:50.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.190+0000 7f2b3a984700 1 -- 172.21.15.125:0/3875363839 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b3406d3e0 con 0x7f2b340b5ae0 2023-10-17T06:22:50.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.190+0000 7f2b2a7fc700 1 -- 172.21.15.125:0/3875363839 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4889 (secure 0 0 0) 0x7f2b30053e80 con 0x7f2b340b5ae0 2023-10-17T06:22:50.197 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:22:50.197 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-17T06:08:51.328615+0000","modified":"2023-10-17T06:16:00.378712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":111,"addr":"172.21.15.125:6837/2351050168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":2351050168},{"type":"v1","addr":"172.21.15.125:6837","nonce":2351050168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-17T06:22:50.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.194+0000 7f2b3a984700 1 -- 172.21.15.125:0/3875363839 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2b180656f0 msgr2=0x7f2b18067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:50.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.194+0000 7f2b3a984700 1 --2- 172.21.15.125:0/3875363839 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2b180656f0 0x7f2b18067bb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2b340d27c0 tx=0x7f2b24008030 comp rx=0 tx=0).stop 2023-10-17T06:22:50.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.194+0000 7f2b3a984700 1 -- 172.21.15.125:0/3875363839 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b340b5ae0 msgr2=0x7f2b3415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:50.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.194+0000 7f2b3a984700 1 --2- 172.21.15.125:0/3875363839 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b340b5ae0 0x7f2b3415a6f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000e840 tx=0x7f2b3000ec00 comp rx=0 tx=0).stop 2023-10-17T06:22:50.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.194+0000 7f2b3a984700 1 -- 172.21.15.125:0/3875363839 shutdown_connections 2023-10-17T06:22:50.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.194+0000 7f2b3a984700 1 --2- 172.21.15.125:0/3875363839 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2b180656f0 0x7f2b18067bb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:50.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.194+0000 7f2b3a984700 1 --2- 172.21.15.125:0/3875363839 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b34160710 0x7f2b3415f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:50.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.194+0000 7f2b3a984700 1 --2- 172.21.15.125:0/3875363839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b340d2e00 0x7f2b341f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:50.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.194+0000 7f2b3a984700 1 --2- 172.21.15.125:0/3875363839 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b340b5ae0 0x7f2b3415a6f0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:50.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.194+0000 7f2b3a984700 1 -- 172.21.15.125:0/3875363839 >> 172.21.15.125:0/3875363839 conn(0x7f2b34069f20 msgr2=0x7f2b340b5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:50.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.194+0000 7f2b3a984700 1 -- 172.21.15.125:0/3875363839 shutdown_connections 2023-10-17T06:22:50.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.194+0000 7f2b3a984700 1 -- 172.21.15.125:0/3875363839 wait complete. 2023-10-17T06:22:50.202 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 19 2023-10-17T06:22:50.223 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:22:50.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.394+0000 7f8cd06df700 1 Processor -- start 2023-10-17T06:22:50.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.394+0000 7f8cd06df700 1 -- start start 2023-10-17T06:22:50.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.394+0000 7f8cd06df700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cc80cb8a0 0x7f8cc806f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:50.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.394+0000 7f8cd06df700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc815e130 con 0x7f8cc806e8a0 2023-10-17T06:22:50.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.394+0000 7f8cd06df700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc80ce1b0 con 0x7f8cc8154040 2023-10-17T06:22:50.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.394+0000 7f8cd06df700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc80cdfa0 con 0x7f8cc80cb8a0 2023-10-17T06:22:50.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.394+0000 7f8ccdc7a700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8cc806e8a0 0x7f8cc80cb190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59274/0 (socket says 172.21.15.125:59274) 2023-10-17T06:22:50.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.394+0000 7f8ccdc7a700 1 -- 172.21.15.125:0/4261295286 learned_addr learned my addr 172.21.15.125:0/4261295286 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:22:50.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.394+0000 7f8ccec7c700 1 --2- 172.21.15.125:0/4261295286 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cc80cb8a0 0x7f8cc806f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:50.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.398+0000 7f8ccd479700 1 -- 172.21.15.125:0/4261295286 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383565109 0 0) 0x7f8cc815e130 con 0x7f8cc806e8a0 2023-10-17T06:22:50.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.398+0000 7f8ccd479700 1 -- 172.21.15.125:0/4261295286 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cb40035d0 con 0x7f8cc806e8a0 2023-10-17T06:22:50.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.398+0000 7f8ccd479700 1 -- 172.21.15.125:0/4261295286 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715170153 0 0) 0x7f8cc80ce1b0 con 0x7f8cc8154040 2023-10-17T06:22:50.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.398+0000 7f8ccd479700 1 -- 172.21.15.125:0/4261295286 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cc815e130 con 0x7f8cc8154040 2023-10-17T06:22:50.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.398+0000 7f8ccec7c700 1 -- 172.21.15.125:0/4261295286 >> v1:172.21.15.184:6789/0 conn(0x7f8cc8154040 legacy=0x7f8cc80cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:50.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.398+0000 7f8ccec7c700 1 -- 172.21.15.125:0/4261295286 >> v1:172.21.15.125:6789/0 conn(0x7f8cc806e8a0 legacy=0x7f8cc80cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:50.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.398+0000 7f8ccec7c700 1 -- 172.21.15.125:0/4261295286 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc80ce490 con 0x7f8cc80cb8a0 2023-10-17T06:22:50.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.398+0000 7f8ccec7c700 1 --2- 172.21.15.125:0/4261295286 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cc80cb8a0 0x7f8cc806f970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009dc0 tx=0x7f8cc000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4dfce8baf65cd22 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:50.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.398+0000 7f8ccd479700 1 -- 172.21.15.125:0/4261295286 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000e070 con 0x7f8cc80cb8a0 2023-10-17T06:22:50.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.398+0000 7f8ccd479700 1 -- 172.21.15.125:0/4261295286 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc000bb20 con 0x7f8cc80cb8a0 2023-10-17T06:22:50.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.398+0000 7f8ccd479700 1 -- 172.21.15.125:0/4261295286 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0012430 con 0x7f8cc80cb8a0 2023-10-17T06:22:50.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.398+0000 7f8cd06df700 1 -- 172.21.15.125:0/4261295286 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cc80cb8a0 msgr2=0x7f8cc806f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:50.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.398+0000 7f8cd06df700 1 --2- 172.21.15.125:0/4261295286 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cc80cb8a0 0x7f8cc806f970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009dc0 tx=0x7f8cc000b330 comp rx=0 tx=0).stop 2023-10-17T06:22:50.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.402+0000 7f8cd06df700 1 -- 172.21.15.125:0/4261295286 shutdown_connections 2023-10-17T06:22:50.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.402+0000 7f8cd06df700 1 --2- 172.21.15.125:0/4261295286 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cc80cb8a0 0x7f8cc806f970 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:50.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.402+0000 7f8cd06df700 1 -- 172.21.15.125:0/4261295286 >> 172.21.15.125:0/4261295286 conn(0x7f8cc806a340 msgr2=0x7f8cc80b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:50.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.402+0000 7f8cd06df700 1 -- 172.21.15.125:0/4261295286 shutdown_connections 2023-10-17T06:22:50.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.402+0000 7f8cd06df700 1 -- 172.21.15.125:0/4261295286 wait complete. 2023-10-17T06:22:50.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.402+0000 7f8cd06df700 1 Processor -- start 2023-10-17T06:22:50.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.402+0000 7f8cd06df700 1 -- start start 2023-10-17T06:22:50.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.402+0000 7f8cd06df700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cc806e8a0 0x7f8cc81552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:50.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.402+0000 7f8cd06df700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8cc80cb8a0 0x7f8cc81f24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:50.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.402+0000 7f8cd06df700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cc8154040 0x7f8cc81564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:50.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.402+0000 7f8cd06df700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc80b2100 con 0x7f8cc806e8a0 2023-10-17T06:22:50.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.402+0000 7f8cd06df700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc80b14a0 con 0x7f8cc80cb8a0 2023-10-17T06:22:50.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.402+0000 7f8cd06df700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc80b1760 con 0x7f8cc8154040 2023-10-17T06:22:50.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.406+0000 7f8cce47b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cc806e8a0 0x7f8cc81552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:50.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.406+0000 7f8cce47b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cc806e8a0 0x7f8cc81552c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40446/0 (socket says 172.21.15.125:40446) 2023-10-17T06:22:50.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.406+0000 7f8cce47b700 1 -- 172.21.15.125:0/455538054 learned_addr learned my addr 172.21.15.125:0/455538054 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:50.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.406+0000 7f8ccec7c700 1 --2- 172.21.15.125:0/455538054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cc8154040 0x7f8cc81564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:50.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.406+0000 7f8ccdc7a700 1 --2- 172.21.15.125:0/455538054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8cc80cb8a0 0x7f8cc81f24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:50.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.406+0000 7f8cce47b700 1 -- 172.21.15.125:0/455538054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cc8154040 msgr2=0x7f8cc81564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:50.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.406+0000 7f8cce47b700 1 --2- 172.21.15.125:0/455538054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cc8154040 0x7f8cc81564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:50.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.406+0000 7f8cce47b700 1 -- 172.21.15.125:0/455538054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8cc80cb8a0 msgr2=0x7f8cc81f24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:50.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.406+0000 7f8cce47b700 1 --2- 172.21.15.125:0/455538054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8cc80cb8a0 0x7f8cc81f24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:50.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.406+0000 7f8cce47b700 1 -- 172.21.15.125:0/455538054 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc0009a70 con 0x7f8cc806e8a0 2023-10-17T06:22:50.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.406+0000 7f8cce47b700 1 --2- 172.21.15.125:0/455538054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cc806e8a0 0x7f8cc81552c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400c490 tx=0x7f8cc400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:50.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.406+0000 7f8cbeffd700 1 -- 172.21.15.125:0/455538054 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc400cea0 con 0x7f8cc806e8a0 2023-10-17T06:22:50.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.406+0000 7f8cbeffd700 1 -- 172.21.15.125:0/455538054 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc40052f0 con 0x7f8cc806e8a0 2023-10-17T06:22:50.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.406+0000 7f8cbeffd700 1 -- 172.21.15.125:0/455538054 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40036a0 con 0x7f8cc806e8a0 2023-10-17T06:22:50.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.406+0000 7f8cd06df700 1 -- 172.21.15.125:0/455538054 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc80b1a40 con 0x7f8cc806e8a0 2023-10-17T06:22:50.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.406+0000 7f8cd06df700 1 -- 172.21.15.125:0/455538054 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc8155800 con 0x7f8cc806e8a0 2023-10-17T06:22:50.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.406+0000 7f8cd06df700 1 -- 172.21.15.125:0/455538054 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc8072e60 con 0x7f8cc806e8a0 2023-10-17T06:22:50.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.410+0000 7f8cbeffd700 1 -- 172.21.15.125:0/455538054 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8cc4003800 con 0x7f8cc806e8a0 2023-10-17T06:22:50.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.410+0000 7f8cbeffd700 1 --2- 172.21.15.125:0/455538054 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8cac0656f0 0x7f8cac067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:50.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.410+0000 7f8cbeffd700 1 -- 172.21.15.125:0/455538054 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f8cc40823b0 con 0x7f8cc806e8a0 2023-10-17T06:22:50.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.410+0000 7f8ccdc7a700 1 --2- 172.21.15.125:0/455538054 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8cac0656f0 0x7f8cac067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:50.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.414+0000 7f8ccdc7a700 1 --2- 172.21.15.125:0/455538054 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8cac0656f0 0x7f8cac067bb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80ada50 tx=0x7f8cb8007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:50.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.418+0000 7f8cbeffd700 1 -- 172.21.15.125:0/455538054 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f8cc404fc20 con 0x7f8cc806e8a0 2023-10-17T06:22:50.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.598+0000 7f8cd06df700 1 -- 172.21.15.125:0/455538054 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cc80b1160 con 0x7f8cc806e8a0 2023-10-17T06:22:50.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.598+0000 7f8cbeffd700 1 -- 172.21.15.125:0/455538054 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+18788 (secure 0 0 0) 0x7f8cc4053240 con 0x7f8cc806e8a0 2023-10-17T06:22:50.606 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:22:50.607 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":55,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:16:02.394779+0000","last_up_change":"2023-10-17T06:16:01.390745+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-17T06:08:48.973490+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-17T06:08:50.385778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":50,"up_from":54,"up_thru":54,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6801","nonce":1353754211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6803","nonce":1353754211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6807","nonce":1353754211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6805","nonce":1353754211}]},"public_addr":"172.21.15.125:6801/1353754211","cluster_addr":"172.21.15.125:6803/1353754211","heartbeat_back_addr":"172.21.15.125:6807/1353754211","heartbeat_front_addr":"172.21.15.125:6805/1353754211","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"2023-10-17T06:09:26.602656+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":51},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.4","mappings":[{"from":0,"to":5}]},{"pgid":"7.12","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:0/3775054255":"2023-10-17T07:15:56.011706+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:22:50.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.602+0000 7f8cd06df700 1 -- 172.21.15.125:0/455538054 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8cac0656f0 msgr2=0x7f8cac067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:50.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.602+0000 7f8cd06df700 1 --2- 172.21.15.125:0/455538054 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8cac0656f0 0x7f8cac067bb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80ada50 tx=0x7f8cb8007de0 comp rx=0 tx=0).stop 2023-10-17T06:22:50.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.602+0000 7f8cd06df700 1 -- 172.21.15.125:0/455538054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cc806e8a0 msgr2=0x7f8cc81552c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:50.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.602+0000 7f8cd06df700 1 --2- 172.21.15.125:0/455538054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cc806e8a0 0x7f8cc81552c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400c490 tx=0x7f8cc400c7a0 comp rx=0 tx=0).stop 2023-10-17T06:22:50.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.602+0000 7f8cd06df700 1 -- 172.21.15.125:0/455538054 shutdown_connections 2023-10-17T06:22:50.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.602+0000 7f8cd06df700 1 --2- 172.21.15.125:0/455538054 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8cac0656f0 0x7f8cac067bb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:50.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.602+0000 7f8cd06df700 1 --2- 172.21.15.125:0/455538054 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8cc8154040 0x7f8cc81564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:50.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.602+0000 7f8cd06df700 1 --2- 172.21.15.125:0/455538054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8cc80cb8a0 0x7f8cc81f24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:50.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.602+0000 7f8cd06df700 1 --2- 172.21.15.125:0/455538054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8cc806e8a0 0x7f8cc81552c0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:50.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.602+0000 7f8cd06df700 1 -- 172.21.15.125:0/455538054 >> 172.21.15.125:0/455538054 conn(0x7f8cc806a340 msgr2=0x7f8cc806f870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:50.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.602+0000 7f8cd06df700 1 -- 172.21.15.125:0/455538054 shutdown_connections 2023-10-17T06:22:50.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.602+0000 7f8cd06df700 1 -- 172.21.15.125:0/455538054 wait complete. 2023-10-17T06:22:50.633 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-17T06:22:50.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.806+0000 7f9fe1074700 1 Processor -- start 2023-10-17T06:22:50.814 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.806+0000 7f9fe1074700 1 -- start start 2023-10-17T06:22:50.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.810+0000 7f9fe1074700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9fdc0adaa0 0x7f9fdc15b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:50.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.810+0000 7f9fe1074700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fdc0ade80 0x7f9fdc0cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:50.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.810+0000 7f9fe1074700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fdc06ce20 con 0x7f9fdc0cd650 2023-10-17T06:22:50.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.810+0000 7f9fe1074700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fdc06da60 con 0x7f9fdc0adaa0 2023-10-17T06:22:50.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.810+0000 7f9fe1074700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc15b6a0 con 0x7f9fdc0ade80 2023-10-17T06:22:50.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.814+0000 7f9fdbfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9fdc0adaa0 0x7f9fdc15b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:50.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.814+0000 7f9fe0873700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f9fdc0cd650 0x7f9fdc15d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:46426/0 (socket says 172.21.15.125:46426) 2023-10-17T06:22:50.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.814+0000 7f9fe0873700 1 -- 172.21.15.125:0/274701294 learned_addr learned my addr 172.21.15.125:0/274701294 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:22:50.819 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.814+0000 7f9fdb7fe700 1 --2- 172.21.15.125:0/274701294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fdc0ade80 0x7f9fdc0cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:50.820 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.814+0000 7f9fdbfff700 1 -- 172.21.15.125:0/274701294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fdc0ade80 msgr2=0x7f9fdc0cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:50.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.814+0000 7f9fdbfff700 1 --2- 172.21.15.125:0/274701294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fdc0ade80 0x7f9fdc0cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:50.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.814+0000 7f9fdbfff700 1 -- 172.21.15.125:0/274701294 >> v1:172.21.15.184:6789/0 conn(0x7f9fdc0cd650 legacy=0x7f9fdc15d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:50.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.814+0000 7f9fdbfff700 1 -- 172.21.15.125:0/274701294 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fdc06d0c0 con 0x7f9fdc0adaa0 2023-10-17T06:22:50.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.814+0000 7f9fdbfff700 1 --2- 172.21.15.125:0/274701294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc0adaa0 0x7f9fdc15b010 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009d90 tx=0x7f9fcc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e6271f548c64458 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:50.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.814+0000 7f9fdaffd700 1 -- 172.21.15.125:0/274701294 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc00e070 con 0x7f9fdc0adaa0 2023-10-17T06:22:50.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.814+0000 7f9fdaffd700 1 -- 172.21.15.125:0/274701294 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fcc00bb20 con 0x7f9fdc0adaa0 2023-10-17T06:22:50.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.814+0000 7f9fdaffd700 1 -- 172.21.15.125:0/274701294 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc012430 con 0x7f9fdc0adaa0 2023-10-17T06:22:50.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.814+0000 7f9fe1074700 1 -- 172.21.15.125:0/274701294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc0adaa0 msgr2=0x7f9fdc15b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:50.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.814+0000 7f9fe1074700 1 --2- 172.21.15.125:0/274701294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc0adaa0 0x7f9fdc15b010 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009d90 tx=0x7f9fcc00b330 comp rx=0 tx=0).stop 2023-10-17T06:22:50.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.814+0000 7f9fe1074700 1 -- 172.21.15.125:0/274701294 shutdown_connections 2023-10-17T06:22:50.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.814+0000 7f9fe1074700 1 --2- 172.21.15.125:0/274701294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fdc0ade80 0x7f9fdc0cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:50.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.814+0000 7f9fe1074700 1 --2- 172.21.15.125:0/274701294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc0adaa0 0x7f9fdc15b010 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:50.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.814+0000 7f9fe1074700 1 -- 172.21.15.125:0/274701294 >> 172.21.15.125:0/274701294 conn(0x7f9fdc0b0bf0 msgr2=0x7f9fdc0ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:50.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.814+0000 7f9fe1074700 1 -- 172.21.15.125:0/274701294 shutdown_connections 2023-10-17T06:22:50.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.814+0000 7f9fe1074700 1 -- 172.21.15.125:0/274701294 wait complete. 2023-10-17T06:22:50.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.818+0000 7f9fe1074700 1 Processor -- start 2023-10-17T06:22:50.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.818+0000 7f9fe1074700 1 -- start start 2023-10-17T06:22:50.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.818+0000 7f9fe1074700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9fdc0adaa0 0x7f9fdc1ef9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:50.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.818+0000 7f9fe1074700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc0ade80 0x7f9fdc151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:50.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.818+0000 7f9fe1074700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fdc0cd650 0x7f9fdc151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:50.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.818+0000 7f9fe1074700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc0a7720 con 0x7f9fdc0adaa0 2023-10-17T06:22:50.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.818+0000 7f9fe1074700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc154e50 con 0x7f9fdc0ade80 2023-10-17T06:22:50.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.818+0000 7f9fe1074700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc152890 con 0x7f9fdc0cd650 2023-10-17T06:22:50.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.822+0000 7f9fdbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9fdc0adaa0 0x7f9fdc1ef9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:50.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.822+0000 7f9fdbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9fdc0adaa0 0x7f9fdc1ef9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40458/0 (socket says 172.21.15.125:40458) 2023-10-17T06:22:50.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.822+0000 7f9fdbfff700 1 -- 172.21.15.125:0/390386838 learned_addr learned my addr 172.21.15.125:0/390386838 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:50.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.822+0000 7f9fe0873700 1 --2- 172.21.15.125:0/390386838 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fdc0cd650 0x7f9fdc151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:50.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.822+0000 7f9fdb7fe700 1 --2- 172.21.15.125:0/390386838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc0ade80 0x7f9fdc151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:50.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.822+0000 7f9fdbfff700 1 -- 172.21.15.125:0/390386838 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fdc0cd650 msgr2=0x7f9fdc151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:50.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.822+0000 7f9fdbfff700 1 --2- 172.21.15.125:0/390386838 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fdc0cd650 0x7f9fdc151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:50.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.822+0000 7f9fdbfff700 1 -- 172.21.15.125:0/390386838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc0ade80 msgr2=0x7f9fdc151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:50.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.822+0000 7f9fdbfff700 1 --2- 172.21.15.125:0/390386838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc0ade80 0x7f9fdc151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:50.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.822+0000 7f9fdbfff700 1 -- 172.21.15.125:0/390386838 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc009a70 con 0x7f9fdc0adaa0 2023-10-17T06:22:50.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.822+0000 7f9fdbfff700 1 --2- 172.21.15.125:0/390386838 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9fdc0adaa0 0x7f9fdc1ef9f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc014040 tx=0x7f9fcc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:50.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.822+0000 7f9fd8ff9700 1 -- 172.21.15.125:0/390386838 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc012430 con 0x7f9fdc0adaa0 2023-10-17T06:22:50.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.822+0000 7f9fd8ff9700 1 -- 172.21.15.125:0/390386838 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fcc020070 con 0x7f9fdc0adaa0 2023-10-17T06:22:50.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.822+0000 7f9fe1074700 1 -- 172.21.15.125:0/390386838 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fdc1525b0 con 0x7f9fdc0adaa0 2023-10-17T06:22:50.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.822+0000 7f9fd8ff9700 1 -- 172.21.15.125:0/390386838 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc004280 con 0x7f9fdc0adaa0 2023-10-17T06:22:50.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.822+0000 7f9fe1074700 1 -- 172.21.15.125:0/390386838 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fdc154a70 con 0x7f9fdc0adaa0 2023-10-17T06:22:50.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.822+0000 7f9fe1074700 1 -- 172.21.15.125:0/390386838 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fdc072e60 con 0x7f9fdc0adaa0 2023-10-17T06:22:50.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.826+0000 7f9fd8ff9700 1 -- 172.21.15.125:0/390386838 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9fcc0043e0 con 0x7f9fdc0adaa0 2023-10-17T06:22:50.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.826+0000 7f9fd8ff9700 1 --2- 172.21.15.125:0/390386838 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9fbc065720 0x7f9fbc067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:50.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.826+0000 7f9fd8ff9700 1 -- 172.21.15.125:0/390386838 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f9fcc022070 con 0x7f9fdc0adaa0 2023-10-17T06:22:50.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.826+0000 7f9fdb7fe700 1 --2- 172.21.15.125:0/390386838 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9fbc065720 0x7f9fbc067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:50.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.830+0000 7f9fdb7fe700 1 --2- 172.21.15.125:0/390386838 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9fbc065720 0x7f9fbc067be0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc146680 tx=0x7f9fc4009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:50.838 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:50.834+0000 7f9fd8ff9700 1 -- 172.21.15.125:0/390386838 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f9fcc052910 con 0x7f9fdc0adaa0 2023-10-17T06:22:51.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.334+0000 7f9fe1074700 1 -- 172.21.15.125:0/390386838 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9fdc06efb0 con 0x7f9fdc0adaa0 2023-10-17T06:22:51.341 INFO:tasks.ceph.mon.a.smithi125.stderr:2023-10-17T06:22:51.334+0000 7fa0d23f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-17T06:22:51.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.342+0000 7f9fd8ff9700 1 -- 172.21.15.125:0/390386838 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9fcc055f30 con 0x7f9fdc0adaa0 2023-10-17T06:22:51.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.346+0000 7f9fe1074700 1 -- 172.21.15.125:0/390386838 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9fbc065720 msgr2=0x7f9fbc067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:51.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.346+0000 7f9fe1074700 1 --2- 172.21.15.125:0/390386838 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9fbc065720 0x7f9fbc067be0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc146680 tx=0x7f9fc4009240 comp rx=0 tx=0).stop 2023-10-17T06:22:51.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.346+0000 7f9fe1074700 1 -- 172.21.15.125:0/390386838 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9fdc0adaa0 msgr2=0x7f9fdc1ef9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:51.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.346+0000 7f9fe1074700 1 --2- 172.21.15.125:0/390386838 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9fdc0adaa0 0x7f9fdc1ef9f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc014040 tx=0x7f9fcc004af0 comp rx=0 tx=0).stop 2023-10-17T06:22:51.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.346+0000 7f9fe1074700 1 -- 172.21.15.125:0/390386838 shutdown_connections 2023-10-17T06:22:51.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.346+0000 7f9fe1074700 1 --2- 172.21.15.125:0/390386838 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9fbc065720 0x7f9fbc067be0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:51.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.346+0000 7f9fe1074700 1 --2- 172.21.15.125:0/390386838 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9fdc0cd650 0x7f9fdc151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:51.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.346+0000 7f9fe1074700 1 --2- 172.21.15.125:0/390386838 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc0ade80 0x7f9fdc151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:51.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.346+0000 7f9fe1074700 1 --2- 172.21.15.125:0/390386838 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9fdc0adaa0 0x7f9fdc1ef9f0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:51.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.346+0000 7f9fe1074700 1 -- 172.21.15.125:0/390386838 >> 172.21.15.125:0/390386838 conn(0x7f9fdc0b0bf0 msgr2=0x7f9fdc06e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:51.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.346+0000 7f9fe1074700 1 -- 172.21.15.125:0/390386838 shutdown_connections 2023-10-17T06:22:51.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.346+0000 7f9fe1074700 1 -- 172.21.15.125:0/390386838 wait complete. 2023-10-17T06:22:51.355 INFO:teuthology.orchestra.run.smithi125.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-17T06:22:51.372 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-17T06:22:51.426 INFO:tasks.ceph.mds.c.smithi125.stdout:starting mds.c at 2023-10-17T06:22:51.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.550+0000 7f52901e8700 1 Processor -- start 2023-10-17T06:22:51.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.550+0000 7f52901e8700 1 -- start start 2023-10-17T06:22:51.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.554+0000 7f52901e8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f52881467c0 0x7f52880b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:51.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.554+0000 7f52901e8700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f52881612e0 0x7f528815d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:51.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.554+0000 7f52901e8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f528806f9a0 0x7f528806fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:51.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.554+0000 7f52901e8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5288146ba0 con 0x7f52881467c0 2023-10-17T06:22:51.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.554+0000 7f52901e8700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52880d0920 con 0x7f52881612e0 2023-10-17T06:22:51.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.554+0000 7f52901e8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5288070320 con 0x7f528806f9a0 2023-10-17T06:22:51.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.554+0000 7f528df84700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f52881467c0 0x7f52880b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:51.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.554+0000 7f528df84700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f52881467c0 0x7f52880b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40488/0 (socket says 172.21.15.125:40488) 2023-10-17T06:22:51.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.554+0000 7f528df84700 1 -- 172.21.15.125:0/2382552265 learned_addr learned my addr 172.21.15.125:0/2382552265 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:51.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.554+0000 7f528d783700 1 --2- 172.21.15.125:0/2382552265 >> v2:172.21.15.184:3300/0 conn(0x7f52881612e0 0x7f528815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:51.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.554+0000 7f528e785700 1 --2- 172.21.15.125:0/2382552265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f528806f9a0 0x7f528806fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:51.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.554+0000 7f528df84700 1 -- 172.21.15.125:0/2382552265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f528806f9a0 msgr2=0x7f528806fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:51.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.554+0000 7f528df84700 1 --2- 172.21.15.125:0/2382552265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f528806f9a0 0x7f528806fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:51.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.554+0000 7f528df84700 1 -- 172.21.15.125:0/2382552265 >> v2:172.21.15.184:3300/0 conn(0x7f52881612e0 msgr2=0x7f528815d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:51.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.554+0000 7f528df84700 1 --2- 172.21.15.125:0/2382552265 >> v2:172.21.15.184:3300/0 conn(0x7f52881612e0 0x7f528815d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:51.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.554+0000 7f528df84700 1 -- 172.21.15.125:0/2382552265 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52880b6160 con 0x7f52881467c0 2023-10-17T06:22:51.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.554+0000 7f528d783700 1 --2- 172.21.15.125:0/2382552265 >> v2:172.21.15.184:3300/0 conn(0x7f52881612e0 0x7f528815d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:22:51.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.554+0000 7f528df84700 1 --2- 172.21.15.125:0/2382552265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52881467c0 0x7f52880b5b80 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f52880b6ed0 tx=0x7f5284009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5d88be7a03b466 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:51.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.558+0000 7f528cf82700 1 -- 172.21.15.125:0/2382552265 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528400b8a0 con 0x7f52881467c0 2023-10-17T06:22:51.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.558+0000 7f528cf82700 1 -- 172.21.15.125:0/2382552265 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528400ba00 con 0x7f52881467c0 2023-10-17T06:22:51.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.558+0000 7f528cf82700 1 -- 172.21.15.125:0/2382552265 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528400bd90 con 0x7f52881467c0 2023-10-17T06:22:51.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.558+0000 7f52901e8700 1 -- 172.21.15.125:0/2382552265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52881467c0 msgr2=0x7f52880b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:51.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.558+0000 7f52901e8700 1 --2- 172.21.15.125:0/2382552265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52881467c0 0x7f52880b5b80 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f52880b6ed0 tx=0x7f5284009bf0 comp rx=0 tx=0).stop 2023-10-17T06:22:51.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.558+0000 7f52901e8700 1 -- 172.21.15.125:0/2382552265 shutdown_connections 2023-10-17T06:22:51.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.558+0000 7f52901e8700 1 --2- 172.21.15.125:0/2382552265 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f528806f9a0 0x7f528806fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:51.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.558+0000 7f52901e8700 1 --2- 172.21.15.125:0/2382552265 >> v2:172.21.15.184:3300/0 conn(0x7f52881612e0 0x7f528815d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:51.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.558+0000 7f52901e8700 1 --2- 172.21.15.125:0/2382552265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52881467c0 0x7f52880b5b80 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:51.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.558+0000 7f52901e8700 1 -- 172.21.15.125:0/2382552265 >> 172.21.15.125:0/2382552265 conn(0x7f528806a130 msgr2=0x7f528806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:51.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.558+0000 7f52901e8700 1 -- 172.21.15.125:0/2382552265 shutdown_connections 2023-10-17T06:22:51.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.558+0000 7f52901e8700 1 -- 172.21.15.125:0/2382552265 wait complete. 2023-10-17T06:22:51.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f52901e8700 1 Processor -- start 2023-10-17T06:22:51.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f52901e8700 1 -- start start 2023-10-17T06:22:51.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f52901e8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f528806f9a0 0x7f528813f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:51.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f52901e8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52881467c0 0x7f528813daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:51.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f52901e8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52881612e0 0x7f528815f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:51.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f52901e8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5288141010 con 0x7f52881467c0 2023-10-17T06:22:51.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f52901e8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528813e030 con 0x7f52881612e0 2023-10-17T06:22:51.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f52901e8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5288140390 con 0x7f528806f9a0 2023-10-17T06:22:51.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f528d783700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52881467c0 0x7f528813daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:51.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f528d783700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52881467c0 0x7f528813daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40492/0 (socket says 172.21.15.125:40492) 2023-10-17T06:22:51.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f528d783700 1 -- 172.21.15.125:0/2713037811 learned_addr learned my addr 172.21.15.125:0/2713037811 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f528e785700 1 --2- 172.21.15.125:0/2713037811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52881612e0 0x7f528815f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f528df84700 1 --2- 172.21.15.125:0/2713037811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f528806f9a0 0x7f528813f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f528d783700 1 -- 172.21.15.125:0/2713037811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f528806f9a0 msgr2=0x7f528813f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:51.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f528d783700 1 --2- 172.21.15.125:0/2713037811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f528806f9a0 0x7f528813f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f528d783700 1 -- 172.21.15.125:0/2713037811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52881612e0 msgr2=0x7f528815f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f528d783700 1 --2- 172.21.15.125:0/2713037811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52881612e0 0x7f528815f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f528d783700 1 -- 172.21.15.125:0/2713037811 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5284009570 con 0x7f52881467c0 2023-10-17T06:22:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f528d783700 1 --2- 172.21.15.125:0/2713037811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52881467c0 0x7f528813daf0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f527800c7c0 tx=0x7f527800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:51.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f527e7fc700 1 -- 172.21.15.125:0/2713037811 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5278011800 con 0x7f52881467c0 2023-10-17T06:22:51.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f527e7fc700 1 -- 172.21.15.125:0/2713037811 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5278011960 con 0x7f52881467c0 2023-10-17T06:22:51.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f527e7fc700 1 -- 172.21.15.125:0/2713037811 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5278011cf0 con 0x7f52881467c0 2023-10-17T06:22:51.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.562+0000 7f52901e8700 1 -- 172.21.15.125:0/2713037811 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5288140670 con 0x7f52881467c0 2023-10-17T06:22:51.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.566+0000 7f52901e8700 1 -- 172.21.15.125:0/2713037811 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5288140c30 con 0x7f52881467c0 2023-10-17T06:22:51.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.566+0000 7f52901e8700 1 -- 172.21.15.125:0/2713037811 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5288072e60 con 0x7f52881467c0 2023-10-17T06:22:51.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.566+0000 7f527e7fc700 1 -- 172.21.15.125:0/2713037811 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5278021350 con 0x7f52881467c0 2023-10-17T06:22:51.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.566+0000 7f527e7fc700 1 --2- 172.21.15.125:0/2713037811 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f526c0656f0 0x7f526c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:51.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.566+0000 7f527e7fc700 1 -- 172.21.15.125:0/2713037811 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6569+0+0 (secure 0 0 0) 0x7f5278082ed0 con 0x7f52881467c0 2023-10-17T06:22:51.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.566+0000 7f528df84700 1 --2- 172.21.15.125:0/2713037811 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f526c0656f0 0x7f526c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:51.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.570+0000 7f528df84700 1 --2- 172.21.15.125:0/2713037811 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f526c0656f0 0x7f526c067bb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5284000c00 tx=0x7f5284008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:51.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:51.574+0000 7f527e7fc700 1 -- 172.21.15.125:0/2713037811 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f5278054230 con 0x7f52881467c0 2023-10-17T06:22:52.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.102+0000 7f52901e8700 1 -- 172.21.15.125:0/2713037811 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f52880b69d0 con 0x7f52881467c0 2023-10-17T06:22:52.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.350+0000 7f527e7fc700 1 -- 172.21.15.125:0/2713037811 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5278053dc0 con 0x7f52881467c0 2023-10-17T06:22:52.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.354+0000 7f52901e8700 1 -- 172.21.15.125:0/2713037811 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f526c0656f0 msgr2=0x7f526c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:52.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.354+0000 7f52901e8700 1 --2- 172.21.15.125:0/2713037811 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f526c0656f0 0x7f526c067bb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5284000c00 tx=0x7f5284008030 comp rx=0 tx=0).stop 2023-10-17T06:22:52.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.354+0000 7f52901e8700 1 -- 172.21.15.125:0/2713037811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52881467c0 msgr2=0x7f528813daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:52.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.354+0000 7f52901e8700 1 --2- 172.21.15.125:0/2713037811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52881467c0 0x7f528813daf0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f527800c7c0 tx=0x7f527800cb80 comp rx=0 tx=0).stop 2023-10-17T06:22:52.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.354+0000 7f52901e8700 1 -- 172.21.15.125:0/2713037811 shutdown_connections 2023-10-17T06:22:52.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.354+0000 7f52901e8700 1 --2- 172.21.15.125:0/2713037811 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f526c0656f0 0x7f526c067bb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:52.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.354+0000 7f52901e8700 1 --2- 172.21.15.125:0/2713037811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f52881612e0 0x7f528815f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:52.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.354+0000 7f52901e8700 1 --2- 172.21.15.125:0/2713037811 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f52881467c0 0x7f528813daf0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:52.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.354+0000 7f52901e8700 1 --2- 172.21.15.125:0/2713037811 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f528806f9a0 0x7f528813f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:52.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.354+0000 7f52901e8700 1 -- 172.21.15.125:0/2713037811 >> 172.21.15.125:0/2713037811 conn(0x7f528806a130 msgr2=0x7f5288160890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:52.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.354+0000 7f52901e8700 1 -- 172.21.15.125:0/2713037811 shutdown_connections 2023-10-17T06:22:52.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.354+0000 7f52901e8700 1 -- 172.21.15.125:0/2713037811 wait complete. 2023-10-17T06:22:52.382 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-17T06:22:52.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.602+0000 7fa67a061700 1 Processor -- start 2023-10-17T06:22:52.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.606+0000 7fa67a061700 1 -- start start 2023-10-17T06:22:52.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.606+0000 7fa67a061700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa6740adaa0 0x7fa67415b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:52.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.606+0000 7fa67a061700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa67406ce20 con 0x7fa6740ade80 2023-10-17T06:22:52.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.606+0000 7fa67a061700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa67415b6a0 con 0x7fa67415d4f0 2023-10-17T06:22:52.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.606+0000 7fa67a061700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa67406da60 con 0x7fa6740adaa0 2023-10-17T06:22:52.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.606+0000 7fa67885e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa6740ade80 0x7fa6740cd110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59278/0 (socket says 172.21.15.125:59278) 2023-10-17T06:22:52.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.606+0000 7fa67885e700 1 -- 172.21.15.125:0/1342656402 learned_addr learned my addr 172.21.15.125:0/1342656402 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:22:52.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.606+0000 7fa67905f700 1 --2- 172.21.15.125:0/1342656402 >> v2:172.21.15.184:3300/0 conn(0x7fa6740adaa0 0x7fa67415b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:52.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.610+0000 7fa66bfff700 1 -- 172.21.15.125:0/1342656402 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639526109 0 0) 0x7fa67406ce20 con 0x7fa6740ade80 2023-10-17T06:22:52.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.610+0000 7fa66bfff700 1 -- 172.21.15.125:0/1342656402 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6600035d0 con 0x7fa6740ade80 2023-10-17T06:22:52.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.610+0000 7fa66bfff700 1 -- 172.21.15.125:0/1342656402 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897601570 0 0) 0x7fa67415b6a0 con 0x7fa67415d4f0 2023-10-17T06:22:52.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.610+0000 7fa66bfff700 1 -- 172.21.15.125:0/1342656402 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa67406ce20 con 0x7fa67415d4f0 2023-10-17T06:22:52.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.610+0000 7fa67905f700 1 -- 172.21.15.125:0/1342656402 >> v1:172.21.15.184:6789/0 conn(0x7fa67415d4f0 legacy=0x7fa67406de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:52.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.610+0000 7fa67905f700 1 -- 172.21.15.125:0/1342656402 >> v1:172.21.15.125:6789/0 conn(0x7fa6740ade80 legacy=0x7fa6740cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:52.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.610+0000 7fa67905f700 1 -- 172.21.15.125:0/1342656402 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67406d0c0 con 0x7fa6740adaa0 2023-10-17T06:22:52.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.610+0000 7fa67905f700 1 --2- 172.21.15.125:0/1342656402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6740adaa0 0x7fa67415b010 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa670009850 tx=0x7fa670009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fef73a023629e3e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:52.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.610+0000 7fa66bfff700 1 -- 172.21.15.125:0/1342656402 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670011830 con 0x7fa6740adaa0 2023-10-17T06:22:52.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.610+0000 7fa66bfff700 1 -- 172.21.15.125:0/1342656402 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa670011990 con 0x7fa6740adaa0 2023-10-17T06:22:52.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.610+0000 7fa66bfff700 1 -- 172.21.15.125:0/1342656402 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670011d40 con 0x7fa6740adaa0 2023-10-17T06:22:52.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.610+0000 7fa67a061700 1 -- 172.21.15.125:0/1342656402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6740adaa0 msgr2=0x7fa67415b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:52.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.610+0000 7fa67a061700 1 --2- 172.21.15.125:0/1342656402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6740adaa0 0x7fa67415b010 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa670009850 tx=0x7fa670009b60 comp rx=0 tx=0).stop 2023-10-17T06:22:52.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.610+0000 7fa67a061700 1 -- 172.21.15.125:0/1342656402 shutdown_connections 2023-10-17T06:22:52.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.610+0000 7fa67a061700 1 --2- 172.21.15.125:0/1342656402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6740adaa0 0x7fa67415b010 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:52.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.610+0000 7fa67a061700 1 -- 172.21.15.125:0/1342656402 >> 172.21.15.125:0/1342656402 conn(0x7fa6740b0bf0 msgr2=0x7fa6740ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:52.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.610+0000 7fa67a061700 1 -- 172.21.15.125:0/1342656402 shutdown_connections 2023-10-17T06:22:52.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.610+0000 7fa67a061700 1 -- 172.21.15.125:0/1342656402 wait complete. 2023-10-17T06:22:52.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.614+0000 7fa67a061700 1 Processor -- start 2023-10-17T06:22:52.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.614+0000 7fa67a061700 1 -- start start 2023-10-17T06:22:52.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.614+0000 7fa67a061700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6740adaa0 0x7fa6741582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:52.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.614+0000 7fa67a061700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6740ade80 0x7fa674149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:52.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.614+0000 7fa67a061700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa67415d4f0 0x7fa6741f6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:52.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.614+0000 7fa67a061700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67414a290 con 0x7fa67415d4f0 2023-10-17T06:22:52.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.614+0000 7fa67a061700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6741f6680 con 0x7fa6740adaa0 2023-10-17T06:22:52.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.614+0000 7fa67a061700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa674156fa0 con 0x7fa6740ade80 2023-10-17T06:22:52.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.614+0000 7fa679860700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa67415d4f0 0x7fa6741f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:52.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.614+0000 7fa679860700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa67415d4f0 0x7fa6741f6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40496/0 (socket says 172.21.15.125:40496) 2023-10-17T06:22:52.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.614+0000 7fa679860700 1 -- 172.21.15.125:0/1448221813 learned_addr learned my addr 172.21.15.125:0/1448221813 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:52.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.614+0000 7fa67905f700 1 --2- 172.21.15.125:0/1448221813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6740adaa0 0x7fa6741582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:52.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.614+0000 7fa67885e700 1 --2- 172.21.15.125:0/1448221813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6740ade80 0x7fa674149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:52.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.618+0000 7fa679860700 1 -- 172.21.15.125:0/1448221813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6740ade80 msgr2=0x7fa674149d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:52.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.618+0000 7fa679860700 1 --2- 172.21.15.125:0/1448221813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6740ade80 0x7fa674149d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:52.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.618+0000 7fa679860700 1 -- 172.21.15.125:0/1448221813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6740adaa0 msgr2=0x7fa6741582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:52.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.618+0000 7fa679860700 1 --2- 172.21.15.125:0/1448221813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6740adaa0 0x7fa6741582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:52.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.618+0000 7fa679860700 1 -- 172.21.15.125:0/1448221813 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6700094b0 con 0x7fa67415d4f0 2023-10-17T06:22:52.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.618+0000 7fa679860700 1 --2- 172.21.15.125:0/1448221813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa67415d4f0 0x7fa6741f6140 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00cc20 tx=0x7fa66c00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:52.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.618+0000 7fa669ffb700 1 -- 172.21.15.125:0/1448221813 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c003c20 con 0x7fa67415d4f0 2023-10-17T06:22:52.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.618+0000 7fa669ffb700 1 -- 172.21.15.125:0/1448221813 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c003d80 con 0x7fa67415d4f0 2023-10-17T06:22:52.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.618+0000 7fa67a061700 1 -- 172.21.15.125:0/1448221813 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa674157240 con 0x7fa67415d4f0 2023-10-17T06:22:52.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.618+0000 7fa669ffb700 1 -- 172.21.15.125:0/1448221813 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c00ab90 con 0x7fa67415d4f0 2023-10-17T06:22:52.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.618+0000 7fa67a061700 1 -- 172.21.15.125:0/1448221813 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa674157800 con 0x7fa67415d4f0 2023-10-17T06:22:52.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.618+0000 7fa67a061700 1 -- 172.21.15.125:0/1448221813 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa674072e60 con 0x7fa67415d4f0 2023-10-17T06:22:52.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.622+0000 7fa669ffb700 1 -- 172.21.15.125:0/1448221813 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa66c00acf0 con 0x7fa67415d4f0 2023-10-17T06:22:52.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.622+0000 7fa669ffb700 1 --2- 172.21.15.125:0/1448221813 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fa6580656f0 0x7fa658067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:52.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.622+0000 7fa669ffb700 1 -- 172.21.15.125:0/1448221813 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6569+0+0 (secure 0 0 0) 0x7fa66c083100 con 0x7fa67415d4f0 2023-10-17T06:22:52.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.622+0000 7fa67905f700 1 --2- 172.21.15.125:0/1448221813 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fa6580656f0 0x7fa658067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:52.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.622+0000 7fa67905f700 1 --2- 172.21.15.125:0/1448221813 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fa6580656f0 0x7fa658067bb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa6700090b0 tx=0x7fa67001c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:52.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.630+0000 7fa669ffb700 1 -- 172.21.15.125:0/1448221813 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fa66c050920 con 0x7fa67415d4f0 2023-10-17T06:22:52.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:52.810+0000 7fa67a061700 1 -- 172.21.15.125:0/1448221813 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa674151b70 con 0x7fa67415d4f0 2023-10-17T06:22:53.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.354+0000 7fa669ffb700 1 -- 172.21.15.125:0/1448221813 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v57) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa66c053f40 con 0x7fa67415d4f0 2023-10-17T06:22:53.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.362+0000 7fa67a061700 1 -- 172.21.15.125:0/1448221813 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fa6580656f0 msgr2=0x7fa658067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:53.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.362+0000 7fa67a061700 1 --2- 172.21.15.125:0/1448221813 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fa6580656f0 0x7fa658067bb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa6700090b0 tx=0x7fa67001c040 comp rx=0 tx=0).stop 2023-10-17T06:22:53.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.362+0000 7fa67a061700 1 -- 172.21.15.125:0/1448221813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa67415d4f0 msgr2=0x7fa6741f6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:53.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.362+0000 7fa67a061700 1 --2- 172.21.15.125:0/1448221813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa67415d4f0 0x7fa6741f6140 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00cc20 tx=0x7fa66c00cf30 comp rx=0 tx=0).stop 2023-10-17T06:22:53.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.362+0000 7fa67a061700 1 -- 172.21.15.125:0/1448221813 shutdown_connections 2023-10-17T06:22:53.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.362+0000 7fa67a061700 1 --2- 172.21.15.125:0/1448221813 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fa6580656f0 0x7fa658067bb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:53.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.362+0000 7fa67a061700 1 --2- 172.21.15.125:0/1448221813 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa67415d4f0 0x7fa6741f6140 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:53.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.362+0000 7fa67a061700 1 --2- 172.21.15.125:0/1448221813 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6740ade80 0x7fa674149d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:53.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.362+0000 7fa67a061700 1 --2- 172.21.15.125:0/1448221813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6740adaa0 0x7fa6741582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:53.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.362+0000 7fa67a061700 1 -- 172.21.15.125:0/1448221813 >> 172.21.15.125:0/1448221813 conn(0x7fa6740b0bf0 msgr2=0x7fa6740cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:53.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.362+0000 7fa67a061700 1 -- 172.21.15.125:0/1448221813 shutdown_connections 2023-10-17T06:22:53.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.362+0000 7fa67a061700 1 -- 172.21.15.125:0/1448221813 wait complete. 2023-10-17T06:22:53.370 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_metadata' removed 2023-10-17T06:22:53.391 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-17T06:22:53.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.574+0000 7f2c23611700 1 Processor -- start 2023-10-17T06:22:53.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.574+0000 7f2c23611700 1 -- start start 2023-10-17T06:22:53.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.578+0000 7f2c23611700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2c1c1443d0 0x7f2c1c070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:53.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.578+0000 7f2c23611700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c1c0cc150 0x7f2c1c0b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:53.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.578+0000 7f2c23611700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1c1447b0 con 0x7f2c1c0709a0 2023-10-17T06:22:53.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.578+0000 7f2c23611700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1c0cc620 con 0x7f2c1c1443d0 2023-10-17T06:22:53.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.578+0000 7f2c23611700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c070e30 con 0x7f2c1c0cc150 2023-10-17T06:22:53.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.578+0000 7f2c213ad700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2c1c1443d0 0x7f2c1c070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:53.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.578+0000 7f2c21bae700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c1c0cc150 0x7f2c1c0b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:53.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.578+0000 7f2c20bac700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2c1c0709a0 0x7f2c1c0cba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:37712/0 (socket says 172.21.15.125:37712) 2023-10-17T06:22:53.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.578+0000 7f2c20bac700 1 -- 172.21.15.125:0/4142811906 learned_addr learned my addr 172.21.15.125:0/4142811906 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:22:53.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.578+0000 7f2c13fff700 1 -- 172.21.15.125:0/4142811906 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042120344 0 0) 0x7f2c1c1447b0 con 0x7f2c1c0709a0 2023-10-17T06:22:53.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.578+0000 7f2c13fff700 1 -- 172.21.15.125:0/4142811906 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c080035d0 con 0x7f2c1c0709a0 2023-10-17T06:22:53.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.578+0000 7f2c213ad700 1 -- 172.21.15.125:0/4142811906 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c1c0cc150 msgr2=0x7f2c1c0b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:53.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.578+0000 7f2c213ad700 1 --2- 172.21.15.125:0/4142811906 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c1c0cc150 0x7f2c1c0b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:53.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.578+0000 7f2c213ad700 1 -- 172.21.15.125:0/4142811906 >> v1:172.21.15.184:6789/0 conn(0x7f2c1c0709a0 legacy=0x7f2c1c0cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:53.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.578+0000 7f2c213ad700 1 -- 172.21.15.125:0/4142811906 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c0b11e0 con 0x7f2c1c1443d0 2023-10-17T06:22:53.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.578+0000 7f2c21bae700 1 --2- 172.21.15.125:0/4142811906 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c1c0cc150 0x7f2c1c0b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:22:53.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.582+0000 7f2c213ad700 1 --2- 172.21.15.125:0/4142811906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c1c1443d0 0x7f2c1c070460 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009d90 tx=0x7f2c1800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fff68e6b2834cb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:53.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.582+0000 7f2c13fff700 1 -- 172.21.15.125:0/4142811906 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1800e070 con 0x7f2c1c1443d0 2023-10-17T06:22:53.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.582+0000 7f2c13fff700 1 -- 172.21.15.125:0/4142811906 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1800bb20 con 0x7f2c1c1443d0 2023-10-17T06:22:53.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.582+0000 7f2c13fff700 1 -- 172.21.15.125:0/4142811906 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c18012430 con 0x7f2c1c1443d0 2023-10-17T06:22:53.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.582+0000 7f2c23611700 1 -- 172.21.15.125:0/4142811906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c1c1443d0 msgr2=0x7f2c1c070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:53.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.582+0000 7f2c23611700 1 --2- 172.21.15.125:0/4142811906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c1c1443d0 0x7f2c1c070460 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009d90 tx=0x7f2c1800b330 comp rx=0 tx=0).stop 2023-10-17T06:22:53.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.582+0000 7f2c23611700 1 -- 172.21.15.125:0/4142811906 shutdown_connections 2023-10-17T06:22:53.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.582+0000 7f2c23611700 1 --2- 172.21.15.125:0/4142811906 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c1c0cc150 0x7f2c1c0b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:53.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.582+0000 7f2c23611700 1 --2- 172.21.15.125:0/4142811906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c1c1443d0 0x7f2c1c070460 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:53.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.582+0000 7f2c23611700 1 -- 172.21.15.125:0/4142811906 >> 172.21.15.125:0/4142811906 conn(0x7f2c1c06a3c0 msgr2=0x7f2c1c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:53.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.582+0000 7f2c23611700 1 -- 172.21.15.125:0/4142811906 shutdown_connections 2023-10-17T06:22:53.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.582+0000 7f2c23611700 1 -- 172.21.15.125:0/4142811906 wait complete. 2023-10-17T06:22:53.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.586+0000 7f2c23611700 1 Processor -- start 2023-10-17T06:22:53.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.586+0000 7f2c23611700 1 -- start start 2023-10-17T06:22:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.586+0000 7f2c23611700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c1c0709a0 0x7f2c1c15eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.586+0000 7f2c23611700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c1c0cc150 0x7f2c1c1f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.590+0000 7f2c23611700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c1c1443d0 0x7f2c1c1f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.590+0000 7f2c23611700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c1f58a0 con 0x7f2c1c0cc150 2023-10-17T06:22:53.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.590+0000 7f2c23611700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c1f5b60 con 0x7f2c1c0709a0 2023-10-17T06:22:53.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.590+0000 7f2c23611700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c1f48a0 con 0x7f2c1c1443d0 2023-10-17T06:22:53.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.590+0000 7f2c20bac700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c1c0cc150 0x7f2c1c1f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:53.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.590+0000 7f2c20bac700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c1c0cc150 0x7f2c1c1f4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48458/0 (socket says 172.21.15.125:48458) 2023-10-17T06:22:53.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.590+0000 7f2c20bac700 1 -- 172.21.15.125:0/3778999448 learned_addr learned my addr 172.21.15.125:0/3778999448 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:53.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.590+0000 7f2c213ad700 1 --2- 172.21.15.125:0/3778999448 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c1c0709a0 0x7f2c1c15eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:53.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.590+0000 7f2c21bae700 1 --2- 172.21.15.125:0/3778999448 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c1c1443d0 0x7f2c1c1f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:53.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.590+0000 7f2c20bac700 1 -- 172.21.15.125:0/3778999448 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c1c1443d0 msgr2=0x7f2c1c1f5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:53.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.590+0000 7f2c20bac700 1 --2- 172.21.15.125:0/3778999448 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c1c1443d0 0x7f2c1c1f5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:53.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.590+0000 7f2c20bac700 1 -- 172.21.15.125:0/3778999448 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c1c0709a0 msgr2=0x7f2c1c15eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:53.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.590+0000 7f2c20bac700 1 --2- 172.21.15.125:0/3778999448 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c1c0709a0 0x7f2c1c15eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:53.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.590+0000 7f2c20bac700 1 -- 172.21.15.125:0/3778999448 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c140094b0 con 0x7f2c1c0cc150 2023-10-17T06:22:53.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.590+0000 7f2c20bac700 1 --2- 172.21.15.125:0/3778999448 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c1c0cc150 0x7f2c1c1f4e20 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c001200 tx=0x7f2c0c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:53.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.590+0000 7f2c11ffb700 1 -- 172.21.15.125:0/3778999448 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c005d90 con 0x7f2c1c0cc150 2023-10-17T06:22:53.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.590+0000 7f2c11ffb700 1 -- 172.21.15.125:0/3778999448 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c0070d0 con 0x7f2c1c0cc150 2023-10-17T06:22:53.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.590+0000 7f2c23611700 1 -- 172.21.15.125:0/3778999448 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c18009a70 con 0x7f2c1c0cc150 2023-10-17T06:22:53.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.590+0000 7f2c11ffb700 1 -- 172.21.15.125:0/3778999448 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c007460 con 0x7f2c1c0cc150 2023-10-17T06:22:53.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.590+0000 7f2c23611700 1 -- 172.21.15.125:0/3778999448 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1c1f60b0 con 0x7f2c1c0cc150 2023-10-17T06:22:53.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.594+0000 7f2c23611700 1 -- 172.21.15.125:0/3778999448 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c1c1f68b0 con 0x7f2c1c0cc150 2023-10-17T06:22:53.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.594+0000 7f2c11ffb700 1 -- 172.21.15.125:0/3778999448 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2c0c0075c0 con 0x7f2c1c0cc150 2023-10-17T06:22:53.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.594+0000 7f2c11ffb700 1 --2- 172.21.15.125:0/3778999448 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2c000656f0 0x7f2c00067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:53.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.594+0000 7f2c11ffb700 1 -- 172.21.15.125:0/3778999448 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6131+0+0 (secure 0 0 0) 0x7f2c0c0821f0 con 0x7f2c1c0cc150 2023-10-17T06:22:53.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.594+0000 7f2c213ad700 1 --2- 172.21.15.125:0/3778999448 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2c000656f0 0x7f2c00067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:53.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.598+0000 7f2c213ad700 1 --2- 172.21.15.125:0/3778999448 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2c000656f0 0x7f2c00067bb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2c18014040 tx=0x7f2c18011000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:53.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.602+0000 7f2c11ffb700 1 -- 172.21.15.125:0/3778999448 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2c1c1f68b0 con 0x7f2c1c0cc150 2023-10-17T06:22:53.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:53.794+0000 7f2c23611700 1 -- 172.21.15.125:0/3778999448 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2c1c1f68b0 con 0x7f2c1c0cc150 2023-10-17T06:22:54.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.362+0000 7f2c11ffb700 1 -- 172.21.15.125:0/3778999448 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v58) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2c1c1f68b0 con 0x7f2c1c0cc150 2023-10-17T06:22:54.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.370+0000 7f2c23611700 1 -- 172.21.15.125:0/3778999448 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2c000656f0 msgr2=0x7f2c00067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:54.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.370+0000 7f2c23611700 1 --2- 172.21.15.125:0/3778999448 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2c000656f0 0x7f2c00067bb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2c18014040 tx=0x7f2c18011000 comp rx=0 tx=0).stop 2023-10-17T06:22:54.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.370+0000 7f2c23611700 1 -- 172.21.15.125:0/3778999448 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c1c0cc150 msgr2=0x7f2c1c1f4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:54.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.370+0000 7f2c23611700 1 --2- 172.21.15.125:0/3778999448 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c1c0cc150 0x7f2c1c1f4e20 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c001200 tx=0x7f2c0c00c9e0 comp rx=0 tx=0).stop 2023-10-17T06:22:54.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.370+0000 7f2c23611700 1 -- 172.21.15.125:0/3778999448 shutdown_connections 2023-10-17T06:22:54.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.370+0000 7f2c23611700 1 --2- 172.21.15.125:0/3778999448 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f2c000656f0 0x7f2c00067bb0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:54.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.370+0000 7f2c23611700 1 --2- 172.21.15.125:0/3778999448 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c1c1443d0 0x7f2c1c1f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:54.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.370+0000 7f2c23611700 1 --2- 172.21.15.125:0/3778999448 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c1c0cc150 0x7f2c1c1f4e20 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:54.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.370+0000 7f2c23611700 1 --2- 172.21.15.125:0/3778999448 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c1c0709a0 0x7f2c1c15eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:54.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.370+0000 7f2c23611700 1 -- 172.21.15.125:0/3778999448 >> 172.21.15.125:0/3778999448 conn(0x7f2c1c06a3c0 msgr2=0x7f2c1c1585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:54.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.370+0000 7f2c23611700 1 -- 172.21.15.125:0/3778999448 shutdown_connections 2023-10-17T06:22:54.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.370+0000 7f2c23611700 1 -- 172.21.15.125:0/3778999448 wait complete. 2023-10-17T06:22:54.378 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data' removed 2023-10-17T06:22:54.397 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_osd_laggy_weight 2023-10-17T06:22:54.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.570+0000 7f6f15701700 1 Processor -- start 2023-10-17T06:22:54.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.570+0000 7f6f15701700 1 -- start start 2023-10-17T06:22:54.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.574+0000 7f6f15701700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6f100d2610 0x7f6f1006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:54.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.574+0000 7f6f15701700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6f1015e7d0 0x7f6f100d2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:54.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.574+0000 7f6f15701700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f100d29f0 con 0x7f6f100b1e60 2023-10-17T06:22:54.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.574+0000 7f6f15701700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f100b64b0 con 0x7f6f100d2610 2023-10-17T06:22:54.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.574+0000 7f6f15701700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f100b6750 con 0x7f6f1015e7d0 2023-10-17T06:22:54.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.574+0000 7f6f0effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6f100d2610 0x7f6f1006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:54.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.574+0000 7f6f0effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6f100d2610 0x7f6f1006e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48462/0 (socket says 172.21.15.125:48462) 2023-10-17T06:22:54.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.574+0000 7f6f0effd700 1 -- 172.21.15.125:0/3890791859 learned_addr learned my addr 172.21.15.125:0/3890791859 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:54.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.574+0000 7f6f0e7fc700 1 --2- 172.21.15.125:0/3890791859 >> v2:172.21.15.184:3300/0 conn(0x7f6f1015e7d0 0x7f6f100d2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:54.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.574+0000 7f6f0effd700 1 -- 172.21.15.125:0/3890791859 >> v2:172.21.15.184:3300/0 conn(0x7f6f1015e7d0 msgr2=0x7f6f100d2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.574+0000 7f6f0effd700 1 --2- 172.21.15.125:0/3890791859 >> v2:172.21.15.184:3300/0 conn(0x7f6f1015e7d0 0x7f6f100d2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.574+0000 7f6f0effd700 1 -- 172.21.15.125:0/3890791859 >> v1:172.21.15.184:6789/0 conn(0x7f6f100b1e60 legacy=0x7f6f1006f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.574+0000 7f6f0effd700 1 -- 172.21.15.125:0/3890791859 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f100b6a30 con 0x7f6f100d2610 2023-10-17T06:22:54.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.574+0000 7f6f0dffb700 1 -- 172.21.15.125:0/3890791859 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615909749 0 0) 0x7f6f100d29f0 con 0x7f6f100b1e60 2023-10-17T06:22:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.574+0000 7f6f0effd700 1 --2- 172.21.15.125:0/3890791859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f100d2610 0x7f6f1006e6f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f6f10160830 tx=0x7f6f0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f2ac089a2e6e2c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:54.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.578+0000 7f6f0dffb700 1 -- 172.21.15.125:0/3890791859 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0000e070 con 0x7f6f100d2610 2023-10-17T06:22:54.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.578+0000 7f6f0dffb700 1 -- 172.21.15.125:0/3890791859 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0000b910 con 0x7f6f100d2610 2023-10-17T06:22:54.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.578+0000 7f6f0dffb700 1 -- 172.21.15.125:0/3890791859 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0000bcc0 con 0x7f6f100d2610 2023-10-17T06:22:54.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.578+0000 7f6f15701700 1 -- 172.21.15.125:0/3890791859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f100d2610 msgr2=0x7f6f1006e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:54.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.578+0000 7f6f15701700 1 --2- 172.21.15.125:0/3890791859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f100d2610 0x7f6f1006e6f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f6f10160830 tx=0x7f6f0000b330 comp rx=0 tx=0).stop 2023-10-17T06:22:54.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.578+0000 7f6f15701700 1 -- 172.21.15.125:0/3890791859 shutdown_connections 2023-10-17T06:22:54.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.578+0000 7f6f15701700 1 --2- 172.21.15.125:0/3890791859 >> v2:172.21.15.184:3300/0 conn(0x7f6f1015e7d0 0x7f6f100d2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:54.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.578+0000 7f6f15701700 1 --2- 172.21.15.125:0/3890791859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f100d2610 0x7f6f1006e6f0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:54.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.578+0000 7f6f15701700 1 -- 172.21.15.125:0/3890791859 >> 172.21.15.125:0/3890791859 conn(0x7f6f10069f20 msgr2=0x7f6f1006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:54.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.578+0000 7f6f15701700 1 -- 172.21.15.125:0/3890791859 shutdown_connections 2023-10-17T06:22:54.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.578+0000 7f6f15701700 1 -- 172.21.15.125:0/3890791859 wait complete. 2023-10-17T06:22:54.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.578+0000 7f6f15701700 1 Processor -- start 2023-10-17T06:22:54.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.578+0000 7f6f15701700 1 -- start start 2023-10-17T06:22:54.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6f15701700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f100b1e60 0x7f6f101527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:54.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6f15701700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f100d2610 0x7f6f10155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6f15701700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f1015e7d0 0x7f6f10155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6f15701700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f10157510 con 0x7f6f100d2610 2023-10-17T06:22:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6f15701700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f10152d10 con 0x7f6f100b1e60 2023-10-17T06:22:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6f15701700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f10153060 con 0x7f6f1015e7d0 2023-10-17T06:22:54.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6f0e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f100d2610 0x7f6f10155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:54.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6f0e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f100d2610 0x7f6f10155990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48470/0 (socket says 172.21.15.125:48470) 2023-10-17T06:22:54.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6f0e7fc700 1 -- 172.21.15.125:0/4084189097 learned_addr learned my addr 172.21.15.125:0/4084189097 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:54.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6f0effd700 1 --2- 172.21.15.125:0/4084189097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f100b1e60 0x7f6f101527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:54.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6f0f7fe700 1 --2- 172.21.15.125:0/4084189097 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f1015e7d0 0x7f6f10155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:54.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6f0e7fc700 1 -- 172.21.15.125:0/4084189097 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f1015e7d0 msgr2=0x7f6f10155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:54.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6f0e7fc700 1 --2- 172.21.15.125:0/4084189097 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f1015e7d0 0x7f6f10155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:54.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6f0e7fc700 1 -- 172.21.15.125:0/4084189097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f100b1e60 msgr2=0x7f6f101527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:54.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6f0e7fc700 1 --2- 172.21.15.125:0/4084189097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f100b1e60 0x7f6f101527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:54.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6f0e7fc700 1 -- 172.21.15.125:0/4084189097 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f00009b30 con 0x7f6f100d2610 2023-10-17T06:22:54.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6f0effd700 1 --2- 172.21.15.125:0/4084189097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f100b1e60 0x7f6f101527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:22:54.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6f0e7fc700 1 --2- 172.21.15.125:0/4084189097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f100d2610 0x7f6f10155990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6f0400e870 tx=0x7f6f0400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:54.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6ef77fe700 1 -- 172.21.15.125:0/4084189097 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f040095c0 con 0x7f6f100d2610 2023-10-17T06:22:54.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6ef77fe700 1 -- 172.21.15.125:0/4084189097 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0400ee70 con 0x7f6f100d2610 2023-10-17T06:22:54.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6ef77fe700 1 -- 172.21.15.125:0/4084189097 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0400ca70 con 0x7f6f100d2610 2023-10-17T06:22:54.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6f15701700 1 -- 172.21.15.125:0/4084189097 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f10153340 con 0x7f6f100d2610 2023-10-17T06:22:54.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.582+0000 7f6f15701700 1 -- 172.21.15.125:0/4084189097 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f10153900 con 0x7f6f100d2610 2023-10-17T06:22:54.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.586+0000 7f6f15701700 1 -- 172.21.15.125:0/4084189097 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f10072e60 con 0x7f6f100d2610 2023-10-17T06:22:54.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.586+0000 7f6ef77fe700 1 -- 172.21.15.125:0/4084189097 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6f0400cbd0 con 0x7f6f100d2610 2023-10-17T06:22:54.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.590+0000 7f6ef77fe700 1 --2- 172.21.15.125:0/4084189097 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6efc065720 0x7f6efc067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:54.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.590+0000 7f6ef77fe700 1 -- 172.21.15.125:0/4084189097 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f6f04082d20 con 0x7f6f100d2610 2023-10-17T06:22:54.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.590+0000 7f6f0effd700 1 --2- 172.21.15.125:0/4084189097 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6efc065720 0x7f6efc067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:54.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.590+0000 7f6f0effd700 1 --2- 172.21.15.125:0/4084189097 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6efc065720 0x7f6efc067be0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000b370 tx=0x7f6f00009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:54.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.594+0000 7f6ef77fe700 1 -- 172.21.15.125:0/4084189097 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f6f040508d0 con 0x7f6f100d2610 2023-10-17T06:22:54.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.778+0000 7f6f15701700 1 -- 172.21.15.125:0/4084189097 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_osd_laggy_weight"} v 0) v1 -- 0x7f6f1006eb40 con 0x7f6f100d2610 2023-10-17T06:22:54.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.790+0000 7f6ef77fe700 1 -- 172.21.15.125:0/4084189097 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_osd_laggy_weight"}]=0 v14) v1 ==== 103+0+0 (secure 0 0 0) 0x7f6f04053ef0 con 0x7f6f100d2610 2023-10-17T06:22:54.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.794+0000 7f6f15701700 1 -- 172.21.15.125:0/4084189097 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6efc065720 msgr2=0x7f6efc067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:54.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.794+0000 7f6f15701700 1 --2- 172.21.15.125:0/4084189097 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6efc065720 0x7f6efc067be0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000b370 tx=0x7f6f00009000 comp rx=0 tx=0).stop 2023-10-17T06:22:54.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.794+0000 7f6f15701700 1 -- 172.21.15.125:0/4084189097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f100d2610 msgr2=0x7f6f10155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:54.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.794+0000 7f6f15701700 1 --2- 172.21.15.125:0/4084189097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f100d2610 0x7f6f10155990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6f0400e870 tx=0x7f6f0400ec30 comp rx=0 tx=0).stop 2023-10-17T06:22:54.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.794+0000 7f6f15701700 1 -- 172.21.15.125:0/4084189097 shutdown_connections 2023-10-17T06:22:54.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.794+0000 7f6f15701700 1 --2- 172.21.15.125:0/4084189097 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6efc065720 0x7f6efc067be0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:54.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.794+0000 7f6f15701700 1 --2- 172.21.15.125:0/4084189097 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f1015e7d0 0x7f6f10155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:54.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.794+0000 7f6f15701700 1 --2- 172.21.15.125:0/4084189097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f100d2610 0x7f6f10155990 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:54.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.794+0000 7f6f15701700 1 --2- 172.21.15.125:0/4084189097 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f100b1e60 0x7f6f101527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:54.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.794+0000 7f6f15701700 1 -- 172.21.15.125:0/4084189097 >> 172.21.15.125:0/4084189097 conn(0x7f6f10069f20 msgr2=0x7f6f100d2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:54.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.794+0000 7f6f15701700 1 -- 172.21.15.125:0/4084189097 shutdown_connections 2023-10-17T06:22:54.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:54.794+0000 7f6f15701700 1 -- 172.21.15.125:0/4084189097 wait complete. 2023-10-17T06:22:54.822 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds defer_client_eviction_on_laggy_osds 2023-10-17T06:22:55.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.002+0000 7fae1a3bc700 1 Processor -- start 2023-10-17T06:22:55.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.002+0000 7fae1a3bc700 1 -- start start 2023-10-17T06:22:55.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.006+0000 7fae1a3bc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fae140cb5c0 0x7fae1406fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:55.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.006+0000 7fae1a3bc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae140cada0 con 0x7fae140cd1b0 2023-10-17T06:22:55.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.006+0000 7fae1a3bc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae140caac0 con 0x7fae1406e550 2023-10-17T06:22:55.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.006+0000 7fae1a3bc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1406e9e0 con 0x7fae140cb5c0 2023-10-17T06:22:55.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.006+0000 7fae193ba700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fae140cd1b0 0x7fae140cd590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42516/0 (socket says 172.21.15.125:42516) 2023-10-17T06:22:55.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.006+0000 7fae193ba700 1 -- 172.21.15.125:0/2231074708 learned_addr learned my addr 172.21.15.125:0/2231074708 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:22:55.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.006+0000 7fae19bbb700 1 --2- 172.21.15.125:0/2231074708 >> v2:172.21.15.125:3300/0 conn(0x7fae140cb5c0 0x7fae1406fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:55.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.006+0000 7fae0bfff700 1 -- 172.21.15.125:0/2231074708 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501015238 0 0) 0x7fae140cada0 con 0x7fae140cd1b0 2023-10-17T06:22:55.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.006+0000 7fae0bfff700 1 -- 172.21.15.125:0/2231074708 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae000035d0 con 0x7fae140cd1b0 2023-10-17T06:22:55.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.006+0000 7fae19bbb700 1 -- 172.21.15.125:0/2231074708 >> v1:172.21.15.184:6789/0 conn(0x7fae1406e550 legacy=0x7fae1406f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:55.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.006+0000 7fae19bbb700 1 -- 172.21.15.125:0/2231074708 >> v1:172.21.15.125:6789/0 conn(0x7fae140cd1b0 legacy=0x7fae140cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:55.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.006+0000 7fae19bbb700 1 -- 172.21.15.125:0/2231074708 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae140ccc50 con 0x7fae140cb5c0 2023-10-17T06:22:55.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.010+0000 7fae19bbb700 1 --2- 172.21.15.125:0/2231074708 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae140cb5c0 0x7fae1406fe00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009850 tx=0x7fae0c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b863ecd8708702 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:55.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.010+0000 7fae0bfff700 1 -- 172.21.15.125:0/2231074708 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c011830 con 0x7fae140cb5c0 2023-10-17T06:22:55.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.010+0000 7fae0bfff700 1 -- 172.21.15.125:0/2231074708 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c011990 con 0x7fae140cb5c0 2023-10-17T06:22:55.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.010+0000 7fae0bfff700 1 -- 172.21.15.125:0/2231074708 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c011d40 con 0x7fae140cb5c0 2023-10-17T06:22:55.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.010+0000 7fae1a3bc700 1 -- 172.21.15.125:0/2231074708 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae140cb5c0 msgr2=0x7fae1406fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:55.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.010+0000 7fae1a3bc700 1 --2- 172.21.15.125:0/2231074708 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae140cb5c0 0x7fae1406fe00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009850 tx=0x7fae0c009b60 comp rx=0 tx=0).stop 2023-10-17T06:22:55.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.010+0000 7fae1a3bc700 1 -- 172.21.15.125:0/2231074708 shutdown_connections 2023-10-17T06:22:55.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.010+0000 7fae1a3bc700 1 --2- 172.21.15.125:0/2231074708 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae140cb5c0 0x7fae1406fe00 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:55.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.010+0000 7fae1a3bc700 1 -- 172.21.15.125:0/2231074708 >> 172.21.15.125:0/2231074708 conn(0x7fae140cb9f0 msgr2=0x7fae140cbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:55.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.010+0000 7fae1a3bc700 1 -- 172.21.15.125:0/2231074708 shutdown_connections 2023-10-17T06:22:55.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.010+0000 7fae1a3bc700 1 -- 172.21.15.125:0/2231074708 wait complete. 2023-10-17T06:22:55.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.014+0000 7fae1a3bc700 1 Processor -- start 2023-10-17T06:22:55.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.014+0000 7fae1a3bc700 1 -- start start 2023-10-17T06:22:55.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.014+0000 7fae1a3bc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae140cb5c0 0x7fae140c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:55.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.014+0000 7fae1a3bc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae140cd1b0 0x7fae141e62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:55.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.014+0000 7fae1a3bc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae141e6830 0x7fae140c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:55.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.014+0000 7fae1a3bc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae141f57a0 con 0x7fae140cd1b0 2023-10-17T06:22:55.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.014+0000 7fae1a3bc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae141f6320 con 0x7fae140cb5c0 2023-10-17T06:22:55.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.014+0000 7fae1a3bc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae141e6ce0 con 0x7fae141e6830 2023-10-17T06:22:55.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.014+0000 7fae18bb9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae140cd1b0 0x7fae141e62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:55.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.014+0000 7fae18bb9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae140cd1b0 0x7fae141e62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48492/0 (socket says 172.21.15.125:48492) 2023-10-17T06:22:55.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.014+0000 7fae18bb9700 1 -- 172.21.15.125:0/50415307 learned_addr learned my addr 172.21.15.125:0/50415307 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:55.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.018+0000 7fae193ba700 1 --2- 172.21.15.125:0/50415307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae140cb5c0 0x7fae140c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:55.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.018+0000 7fae19bbb700 1 --2- 172.21.15.125:0/50415307 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae141e6830 0x7fae140c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:55.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.018+0000 7fae18bb9700 1 -- 172.21.15.125:0/50415307 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae141e6830 msgr2=0x7fae140c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:55.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.018+0000 7fae18bb9700 1 --2- 172.21.15.125:0/50415307 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae141e6830 0x7fae140c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:55.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.018+0000 7fae18bb9700 1 -- 172.21.15.125:0/50415307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae140cb5c0 msgr2=0x7fae140c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:55.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.018+0000 7fae18bb9700 1 --2- 172.21.15.125:0/50415307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae140cb5c0 0x7fae140c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:55.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.018+0000 7fae18bb9700 1 -- 172.21.15.125:0/50415307 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c0094b0 con 0x7fae140cd1b0 2023-10-17T06:22:55.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.018+0000 7fae18bb9700 1 --2- 172.21.15.125:0/50415307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae140cd1b0 0x7fae141e62f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fae0400c500 tx=0x7fae0400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:55.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.018+0000 7fae09ffb700 1 -- 172.21.15.125:0/50415307 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae040052d0 con 0x7fae140cd1b0 2023-10-17T06:22:55.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.018+0000 7fae09ffb700 1 -- 172.21.15.125:0/50415307 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae04005430 con 0x7fae140cd1b0 2023-10-17T06:22:55.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.018+0000 7fae09ffb700 1 -- 172.21.15.125:0/50415307 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae040055a0 con 0x7fae140cd1b0 2023-10-17T06:22:55.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.018+0000 7fae1a3bc700 1 -- 172.21.15.125:0/50415307 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae141f59f0 con 0x7fae140cd1b0 2023-10-17T06:22:55.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.018+0000 7fae1a3bc700 1 -- 172.21.15.125:0/50415307 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae141f5fb0 con 0x7fae140cd1b0 2023-10-17T06:22:55.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.022+0000 7fae1a3bc700 1 -- 172.21.15.125:0/50415307 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae141f6490 con 0x7fae140cd1b0 2023-10-17T06:22:55.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.022+0000 7fae09ffb700 1 -- 172.21.15.125:0/50415307 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fae040038e0 con 0x7fae140cd1b0 2023-10-17T06:22:55.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.022+0000 7fae09ffb700 1 --2- 172.21.15.125:0/50415307 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fadf8065720 0x7fadf8067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:55.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.022+0000 7fae09ffb700 1 -- 172.21.15.125:0/50415307 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fae04081ff0 con 0x7fae140cd1b0 2023-10-17T06:22:55.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.022+0000 7fae193ba700 1 --2- 172.21.15.125:0/50415307 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fadf8065720 0x7fadf8067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:55.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.026+0000 7fae193ba700 1 --2- 172.21.15.125:0/50415307 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fadf8065720 0x7fadf8067be0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fae10001560 tx=0x7fae100019f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:55.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.030+0000 7fae09ffb700 1 -- 172.21.15.125:0/50415307 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fae0404fc30 con 0x7fae140cd1b0 2023-10-17T06:22:55.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.322+0000 7fae1a3bc700 1 -- 172.21.15.125:0/50415307 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "defer_client_eviction_on_laggy_osds"} v 0) v1 -- 0x7fae1404e910 con 0x7fae140cd1b0 2023-10-17T06:22:55.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.330+0000 7fae09ffb700 1 -- 172.21.15.125:0/50415307 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "defer_client_eviction_on_laggy_osds"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fae04053250 con 0x7fae140cd1b0 2023-10-17T06:22:55.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.334+0000 7fae1a3bc700 1 -- 172.21.15.125:0/50415307 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fadf8065720 msgr2=0x7fadf8067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:55.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.334+0000 7fae1a3bc700 1 --2- 172.21.15.125:0/50415307 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fadf8065720 0x7fadf8067be0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fae10001560 tx=0x7fae100019f0 comp rx=0 tx=0).stop 2023-10-17T06:22:55.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.334+0000 7fae1a3bc700 1 -- 172.21.15.125:0/50415307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae140cd1b0 msgr2=0x7fae141e62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:55.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.334+0000 7fae1a3bc700 1 --2- 172.21.15.125:0/50415307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae140cd1b0 0x7fae141e62f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fae0400c500 tx=0x7fae0400c810 comp rx=0 tx=0).stop 2023-10-17T06:22:55.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.334+0000 7fae1a3bc700 1 -- 172.21.15.125:0/50415307 shutdown_connections 2023-10-17T06:22:55.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.334+0000 7fae1a3bc700 1 --2- 172.21.15.125:0/50415307 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fadf8065720 0x7fadf8067be0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:55.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.334+0000 7fae1a3bc700 1 --2- 172.21.15.125:0/50415307 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fae141e6830 0x7fae140c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:55.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.334+0000 7fae1a3bc700 1 --2- 172.21.15.125:0/50415307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae140cd1b0 0x7fae141e62f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:55.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.334+0000 7fae1a3bc700 1 --2- 172.21.15.125:0/50415307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae140cb5c0 0x7fae140c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:55.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.334+0000 7fae1a3bc700 1 -- 172.21.15.125:0/50415307 >> 172.21.15.125:0/50415307 conn(0x7fae140cb9f0 msgr2=0x7fae1406f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:55.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.334+0000 7fae1a3bc700 1 -- 172.21.15.125:0/50415307 shutdown_connections 2023-10-17T06:22:55.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.334+0000 7fae1a3bc700 1 -- 172.21.15.125:0/50415307 wait complete. 2023-10-17T06:22:55.360 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-17T06:22:55.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.538+0000 7fcdbf5c1700 1 Processor -- start 2023-10-17T06:22:55.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.538+0000 7fcdbf5c1700 1 -- start start 2023-10-17T06:22:55.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.542+0000 7fcdbf5c1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcdb80b61f0 0x7fcdb815bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:55.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.542+0000 7fcdbf5c1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcdb80afb00 0x7fcdb8070670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:55.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.542+0000 7fcdbf5c1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb815c0f0 con 0x7fcdb8070bb0 2023-10-17T06:22:55.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.542+0000 7fcdbf5c1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb806f5d0 con 0x7fcdb80afb00 2023-10-17T06:22:55.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.542+0000 7fcdbf5c1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb806f8b0 con 0x7fcdb80b61f0 2023-10-17T06:22:55.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.542+0000 7fcdbcb5c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcdb80afb00 0x7fcdb8070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:55.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.542+0000 7fcdbdb5e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fcdb8070bb0 0x7fcdb80cb1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42520/0 (socket says 172.21.15.125:42520) 2023-10-17T06:22:55.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.542+0000 7fcdbdb5e700 1 -- 172.21.15.125:0/1064388552 learned_addr learned my addr 172.21.15.125:0/1064388552 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:22:55.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.542+0000 7fcdbcb5c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcdb80afb00 0x7fcdb8070670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48508/0 (socket says 172.21.15.125:48508) 2023-10-17T06:22:55.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.542+0000 7fcdbd35d700 1 --2- 172.21.15.125:0/1064388552 >> v2:172.21.15.184:3300/0 conn(0x7fcdb80b61f0 0x7fcdb815bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:55.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.542+0000 7fcdbcb5c700 1 -- 172.21.15.125:0/1064388552 >> v2:172.21.15.184:3300/0 conn(0x7fcdb80b61f0 msgr2=0x7fcdb815bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:55.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.542+0000 7fcdbcb5c700 1 --2- 172.21.15.125:0/1064388552 >> v2:172.21.15.184:3300/0 conn(0x7fcdb80b61f0 0x7fcdb815bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:55.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.542+0000 7fcdbcb5c700 1 -- 172.21.15.125:0/1064388552 >> v1:172.21.15.125:6789/0 conn(0x7fcdb8070bb0 legacy=0x7fcdb80cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:55.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.542+0000 7fcdbcb5c700 1 -- 172.21.15.125:0/1064388552 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb806fb90 con 0x7fcdb80afb00 2023-10-17T06:22:55.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.542+0000 7fcdaffff700 1 -- 172.21.15.125:0/1064388552 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368301518 0 0) 0x7fcdb815c0f0 con 0x7fcdb8070bb0 2023-10-17T06:22:55.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.542+0000 7fcdbd35d700 1 --2- 172.21.15.125:0/1064388552 >> v2:172.21.15.184:3300/0 conn(0x7fcdb80b61f0 0x7fcdb815bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:22:55.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.542+0000 7fcdbcb5c700 1 --2- 172.21.15.125:0/1064388552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdb80afb00 0x7fcdb8070670 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8071340 tx=0x7fcda8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bd60859f2486b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:55.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.542+0000 7fcdaffff700 1 -- 172.21.15.125:0/1064388552 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8011830 con 0x7fcdb80afb00 2023-10-17T06:22:55.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.542+0000 7fcdaffff700 1 -- 172.21.15.125:0/1064388552 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda8011990 con 0x7fcdb80afb00 2023-10-17T06:22:55.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.542+0000 7fcdaffff700 1 -- 172.21.15.125:0/1064388552 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8011d40 con 0x7fcdb80afb00 2023-10-17T06:22:55.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.546+0000 7fcdbf5c1700 1 -- 172.21.15.125:0/1064388552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdb80afb00 msgr2=0x7fcdb8070670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:55.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.546+0000 7fcdbf5c1700 1 --2- 172.21.15.125:0/1064388552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdb80afb00 0x7fcdb8070670 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8071340 tx=0x7fcda8009b30 comp rx=0 tx=0).stop 2023-10-17T06:22:55.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.546+0000 7fcdbf5c1700 1 -- 172.21.15.125:0/1064388552 shutdown_connections 2023-10-17T06:22:55.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.546+0000 7fcdbf5c1700 1 --2- 172.21.15.125:0/1064388552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdb80afb00 0x7fcdb8070670 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:55.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.546+0000 7fcdbf5c1700 1 --2- 172.21.15.125:0/1064388552 >> v2:172.21.15.184:3300/0 conn(0x7fcdb80b61f0 0x7fcdb815bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:55.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.546+0000 7fcdbf5c1700 1 -- 172.21.15.125:0/1064388552 >> 172.21.15.125:0/1064388552 conn(0x7fcdb80d0990 msgr2=0x7fcdb80d0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:55.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.546+0000 7fcdbf5c1700 1 -- 172.21.15.125:0/1064388552 shutdown_connections 2023-10-17T06:22:55.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.546+0000 7fcdbf5c1700 1 -- 172.21.15.125:0/1064388552 wait complete. 2023-10-17T06:22:55.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdbf5c1700 1 Processor -- start 2023-10-17T06:22:55.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdbf5c1700 1 -- start start 2023-10-17T06:22:55.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdbf5c1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdb8070bb0 0x7fcdb80cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:55.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdbf5c1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdb80afb00 0x7fcdb80c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:55.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdbf5c1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdb80b61f0 0x7fcdb8154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:55.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdbf5c1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb80c7390 con 0x7fcdb80afb00 2023-10-17T06:22:55.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdbf5c1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb8154880 con 0x7fcdb8070bb0 2023-10-17T06:22:55.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdbf5c1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb80d01e0 con 0x7fcdb80b61f0 2023-10-17T06:22:55.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdbcb5c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdb80afb00 0x7fcdb80c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:55.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdbcb5c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdb80afb00 0x7fcdb80c6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48512/0 (socket says 172.21.15.125:48512) 2023-10-17T06:22:55.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdbcb5c700 1 -- 172.21.15.125:0/4191449342 learned_addr learned my addr 172.21.15.125:0/4191449342 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:55.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdbd35d700 1 --2- 172.21.15.125:0/4191449342 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdb8070bb0 0x7fcdb80cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:55.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdbdb5e700 1 --2- 172.21.15.125:0/4191449342 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdb80b61f0 0x7fcdb8154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:55.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdbcb5c700 1 -- 172.21.15.125:0/4191449342 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdb80b61f0 msgr2=0x7fcdb8154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:55.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdbcb5c700 1 --2- 172.21.15.125:0/4191449342 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdb80b61f0 0x7fcdb8154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:55.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdbcb5c700 1 -- 172.21.15.125:0/4191449342 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdb8070bb0 msgr2=0x7fcdb80cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:55.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdbcb5c700 1 --2- 172.21.15.125:0/4191449342 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdb8070bb0 0x7fcdb80cfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:55.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdbcb5c700 1 -- 172.21.15.125:0/4191449342 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda80094b0 con 0x7fcdb80afb00 2023-10-17T06:22:55.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdbcb5c700 1 --2- 172.21.15.125:0/4191449342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdb80afb00 0x7fcdb80c6e50 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fcda80090b0 tx=0x7fcda8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:55.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdadffb700 1 -- 172.21.15.125:0/4191449342 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda80036c0 con 0x7fcdb80afb00 2023-10-17T06:22:55.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdadffb700 1 -- 172.21.15.125:0/4191449342 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda801f070 con 0x7fcdb80afb00 2023-10-17T06:22:55.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdbf5c1700 1 -- 172.21.15.125:0/4191449342 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb80c6370 con 0x7fcdb80afb00 2023-10-17T06:22:55.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.550+0000 7fcdadffb700 1 -- 172.21.15.125:0/4191449342 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8003a80 con 0x7fcdb80afb00 2023-10-17T06:22:55.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.554+0000 7fcdbf5c1700 1 -- 172.21.15.125:0/4191449342 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb80c6930 con 0x7fcdb80afb00 2023-10-17T06:22:55.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.554+0000 7fcdbf5c1700 1 -- 172.21.15.125:0/4191449342 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb8072e60 con 0x7fcdb80afb00 2023-10-17T06:22:55.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.554+0000 7fcdadffb700 1 -- 172.21.15.125:0/4191449342 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fcda8003be0 con 0x7fcdb80afb00 2023-10-17T06:22:55.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.558+0000 7fcdadffb700 1 --2- 172.21.15.125:0/4191449342 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fcd9c0656f0 0x7fcd9c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:55.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.558+0000 7fcdadffb700 1 -- 172.21.15.125:0/4191449342 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fcda8021070 con 0x7fcdb80afb00 2023-10-17T06:22:55.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.558+0000 7fcdbd35d700 1 --2- 172.21.15.125:0/4191449342 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fcd9c0656f0 0x7fcd9c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:55.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.558+0000 7fcdbd35d700 1 --2- 172.21.15.125:0/4191449342 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fcd9c0656f0 0x7fcd9c067bb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009a80 tx=0x7fcdb4003aa0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:55.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.562+0000 7fcdadffb700 1 -- 172.21.15.125:0/4191449342 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fcda8052300 con 0x7fcdb80afb00 2023-10-17T06:22:55.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.858+0000 7fcdbf5c1700 1 -- 172.21.15.125:0/4191449342 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcdb80b6910 con 0x7fcdb80afb00 2023-10-17T06:22:55.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.870+0000 7fcdadffb700 1 -- 172.21.15.125:0/4191449342 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcda8055920 con 0x7fcdb80afb00 2023-10-17T06:22:55.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.874+0000 7fcdbf5c1700 1 -- 172.21.15.125:0/4191449342 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fcd9c0656f0 msgr2=0x7fcd9c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:55.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.874+0000 7fcdbf5c1700 1 --2- 172.21.15.125:0/4191449342 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fcd9c0656f0 0x7fcd9c067bb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009a80 tx=0x7fcdb4003aa0 comp rx=0 tx=0).stop 2023-10-17T06:22:55.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.874+0000 7fcdbf5c1700 1 -- 172.21.15.125:0/4191449342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdb80afb00 msgr2=0x7fcdb80c6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:55.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.874+0000 7fcdbf5c1700 1 --2- 172.21.15.125:0/4191449342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdb80afb00 0x7fcdb80c6e50 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fcda80090b0 tx=0x7fcda8004770 comp rx=0 tx=0).stop 2023-10-17T06:22:55.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.874+0000 7fcdbf5c1700 1 -- 172.21.15.125:0/4191449342 shutdown_connections 2023-10-17T06:22:55.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.874+0000 7fcdbf5c1700 1 --2- 172.21.15.125:0/4191449342 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fcd9c0656f0 0x7fcd9c067bb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:55.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.874+0000 7fcdbf5c1700 1 --2- 172.21.15.125:0/4191449342 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcdb80b61f0 0x7fcdb8154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:55.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.874+0000 7fcdbf5c1700 1 --2- 172.21.15.125:0/4191449342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdb80afb00 0x7fcdb80c6e50 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:55.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.874+0000 7fcdbf5c1700 1 --2- 172.21.15.125:0/4191449342 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdb8070bb0 0x7fcdb80cfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:55.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.874+0000 7fcdbf5c1700 1 -- 172.21.15.125:0/4191449342 >> 172.21.15.125:0/4191449342 conn(0x7fcdb80d0990 msgr2=0x7fcdb80d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:55.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.874+0000 7fcdbf5c1700 1 -- 172.21.15.125:0/4191449342 shutdown_connections 2023-10-17T06:22:55.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:55.874+0000 7fcdbf5c1700 1 -- 172.21.15.125:0/4191449342 wait complete. 2023-10-17T06:22:55.901 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD.test_client_eviction_if_config_is_set' 2023-10-17T06:22:56.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.066+0000 7f0ff5901700 1 Processor -- start 2023-10-17T06:22:56.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.066+0000 7f0ff5901700 1 -- start start 2023-10-17T06:22:56.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0ff5901700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ff015ac00 0x7f0ff0070180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:56.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0ff5901700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0ff00b2950 0x7f0ff00cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:56.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0ff5901700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff006f450 con 0x7f0ff00cb0b0 2023-10-17T06:22:56.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0ff5901700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff015afe0 con 0x7f0ff015ac00 2023-10-17T06:22:56.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0ff5901700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff00cbb70 con 0x7f0ff00b2950 2023-10-17T06:22:56.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0feeffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ff015ac00 0x7f0ff0070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:56.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0feeffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ff015ac00 0x7f0ff0070180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48526/0 (socket says 172.21.15.125:48526) 2023-10-17T06:22:56.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0feeffd700 1 -- 172.21.15.125:0/238614457 learned_addr learned my addr 172.21.15.125:0/238614457 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:56.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0fef7fe700 1 --2- 172.21.15.125:0/238614457 >> v2:172.21.15.184:3300/0 conn(0x7f0ff00b2950 0x7f0ff00cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:56.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0feeffd700 1 -- 172.21.15.125:0/238614457 >> v2:172.21.15.184:3300/0 conn(0x7f0ff00b2950 msgr2=0x7f0ff00cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:56.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0feeffd700 1 --2- 172.21.15.125:0/238614457 >> v2:172.21.15.184:3300/0 conn(0x7f0ff00b2950 0x7f0ff00cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:56.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0feeffd700 1 -- 172.21.15.125:0/238614457 >> v1:172.21.15.184:6789/0 conn(0x7f0ff00cb0b0 legacy=0x7f0ff00b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:56.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0feeffd700 1 -- 172.21.15.125:0/238614457 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff006f6a0 con 0x7f0ff015ac00 2023-10-17T06:22:56.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0feeffd700 1 --2- 172.21.15.125:0/238614457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ff015ac00 0x7f0ff0070180 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00b33b0 tx=0x7f0fe0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf43ca2c7a1007be server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:56.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0fee7fc700 1 -- 172.21.15.125:0/238614457 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe000b8a0 con 0x7f0ff015ac00 2023-10-17T06:22:56.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0fee7fc700 1 -- 172.21.15.125:0/238614457 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe000ba00 con 0x7f0ff015ac00 2023-10-17T06:22:56.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0fee7fc700 1 -- 172.21.15.125:0/238614457 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe000bd90 con 0x7f0ff015ac00 2023-10-17T06:22:56.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0ff5901700 1 -- 172.21.15.125:0/238614457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ff015ac00 msgr2=0x7f0ff0070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:56.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0ff5901700 1 --2- 172.21.15.125:0/238614457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ff015ac00 0x7f0ff0070180 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00b33b0 tx=0x7f0fe0009bf0 comp rx=0 tx=0).stop 2023-10-17T06:22:56.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0ff5901700 1 -- 172.21.15.125:0/238614457 shutdown_connections 2023-10-17T06:22:56.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0ff5901700 1 --2- 172.21.15.125:0/238614457 >> v2:172.21.15.184:3300/0 conn(0x7f0ff00b2950 0x7f0ff00cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:56.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0ff5901700 1 --2- 172.21.15.125:0/238614457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ff015ac00 0x7f0ff0070180 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:56.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0ff5901700 1 -- 172.21.15.125:0/238614457 >> 172.21.15.125:0/238614457 conn(0x7f0ff00cd240 msgr2=0x7f0ff00cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:56.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0ff5901700 1 -- 172.21.15.125:0/238614457 shutdown_connections 2023-10-17T06:22:56.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.070+0000 7f0ff5901700 1 -- 172.21.15.125:0/238614457 wait complete. 2023-10-17T06:22:56.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.074+0000 7f0ff5901700 1 Processor -- start 2023-10-17T06:22:56.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.074+0000 7f0ff5901700 1 -- start start 2023-10-17T06:22:56.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.074+0000 7f0ff5901700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ff00b2950 0x7f0ff015c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:56.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.074+0000 7f0ff5901700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ff00cb0b0 0x7f0ff01498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:56.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.074+0000 7f0ff5901700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ff015ac00 0x7f0ff0149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:56.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.074+0000 7f0ff5901700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff01f1d30 con 0x7f0ff00cb0b0 2023-10-17T06:22:56.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.074+0000 7f0ff5901700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff01f1100 con 0x7f0ff015ac00 2023-10-17T06:22:56.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.074+0000 7f0ff5901700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff01f1390 con 0x7f0ff00b2950 2023-10-17T06:22:56.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.074+0000 7f0fe7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ff00cb0b0 0x7f0ff01498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:56.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.078+0000 7f0fe7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ff00cb0b0 0x7f0ff01498d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48528/0 (socket says 172.21.15.125:48528) 2023-10-17T06:22:56.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.078+0000 7f0fe7fff700 1 -- 172.21.15.125:0/1898056200 learned_addr learned my addr 172.21.15.125:0/1898056200 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:56.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.078+0000 7f0fef7fe700 1 --2- 172.21.15.125:0/1898056200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ff015ac00 0x7f0ff0149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:56.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.078+0000 7f0feeffd700 1 --2- 172.21.15.125:0/1898056200 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ff00b2950 0x7f0ff015c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:56.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.078+0000 7f0fe7fff700 1 -- 172.21.15.125:0/1898056200 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ff00b2950 msgr2=0x7f0ff015c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:56.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.078+0000 7f0fe7fff700 1 --2- 172.21.15.125:0/1898056200 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ff00b2950 0x7f0ff015c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:56.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.078+0000 7f0fe7fff700 1 -- 172.21.15.125:0/1898056200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ff015ac00 msgr2=0x7f0ff0149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:56.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.078+0000 7f0fe7fff700 1 --2- 172.21.15.125:0/1898056200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ff015ac00 0x7f0ff0149e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:56.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.078+0000 7f0fe7fff700 1 -- 172.21.15.125:0/1898056200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe0009570 con 0x7f0ff00cb0b0 2023-10-17T06:22:56.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.078+0000 7f0fe7fff700 1 --2- 172.21.15.125:0/1898056200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ff00cb0b0 0x7f0ff01498d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800c410 tx=0x7f0fd800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:56.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.078+0000 7f0fecff9700 1 -- 172.21.15.125:0/1898056200 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd80052d0 con 0x7f0ff00cb0b0 2023-10-17T06:22:56.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.078+0000 7f0fecff9700 1 -- 172.21.15.125:0/1898056200 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd8005430 con 0x7f0ff00cb0b0 2023-10-17T06:22:56.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.078+0000 7f0ff5901700 1 -- 172.21.15.125:0/1898056200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff01f1670 con 0x7f0ff00cb0b0 2023-10-17T06:22:56.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.078+0000 7f0fecff9700 1 -- 172.21.15.125:0/1898056200 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd80055a0 con 0x7f0ff00cb0b0 2023-10-17T06:22:56.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.078+0000 7f0ff5901700 1 -- 172.21.15.125:0/1898056200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff015c930 con 0x7f0ff00cb0b0 2023-10-17T06:22:56.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.078+0000 7f0ff5901700 1 -- 172.21.15.125:0/1898056200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff01f1e70 con 0x7f0ff00cb0b0 2023-10-17T06:22:56.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.082+0000 7f0fecff9700 1 -- 172.21.15.125:0/1898056200 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0fd80036a0 con 0x7f0ff00cb0b0 2023-10-17T06:22:56.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.082+0000 7f0fecff9700 1 --2- 172.21.15.125:0/1898056200 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0fd00656f0 0x7f0fd0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:56.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.082+0000 7f0fecff9700 1 -- 172.21.15.125:0/1898056200 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f0fd8081f00 con 0x7f0ff00cb0b0 2023-10-17T06:22:56.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.082+0000 7f0feeffd700 1 --2- 172.21.15.125:0/1898056200 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0fd00656f0 0x7f0fd0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:56.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.086+0000 7f0feeffd700 1 --2- 172.21.15.125:0/1898056200 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0fd00656f0 0x7f0fd0067bb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0000c00 tx=0x7f0fe0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:56.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.090+0000 7f0fecff9700 1 -- 172.21.15.125:0/1898056200 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0ff01f1e70 con 0x7f0ff00cb0b0 2023-10-17T06:22:56.329 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.322+0000 7f0ff5901700 1 -- 172.21.15.125:0/1898056200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD.test_client_eviction_if_config_is_set"]} v 0) v1 -- 0x7f0ff01f1e70 con 0x7f0ff00cb0b0 2023-10-17T06:22:56.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.374+0000 7f0fecff9700 1 -- 172.21.15.125:0/1898056200 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD.test_client_eviction_if_config_is_set"]}]=0 v579) v1 ==== 171+0+0 (secure 0 0 0) 0x7f0ff01f1e70 con 0x7f0ff00cb0b0 2023-10-17T06:22:56.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.374+0000 7f0ff5901700 1 -- 172.21.15.125:0/1898056200 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0fd00656f0 msgr2=0x7f0fd0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:56.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.374+0000 7f0ff5901700 1 --2- 172.21.15.125:0/1898056200 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0fd00656f0 0x7f0fd0067bb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0000c00 tx=0x7f0fe0008030 comp rx=0 tx=0).stop 2023-10-17T06:22:56.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.374+0000 7f0ff5901700 1 -- 172.21.15.125:0/1898056200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ff00cb0b0 msgr2=0x7f0ff01498d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:56.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.374+0000 7f0ff5901700 1 --2- 172.21.15.125:0/1898056200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ff00cb0b0 0x7f0ff01498d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0fd800c410 tx=0x7f0fd800c7d0 comp rx=0 tx=0).stop 2023-10-17T06:22:56.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.378+0000 7f0ff5901700 1 -- 172.21.15.125:0/1898056200 shutdown_connections 2023-10-17T06:22:56.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.378+0000 7f0ff5901700 1 --2- 172.21.15.125:0/1898056200 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f0fd00656f0 0x7f0fd0067bb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:56.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.378+0000 7f0ff5901700 1 --2- 172.21.15.125:0/1898056200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ff015ac00 0x7f0ff0149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:56.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.378+0000 7f0ff5901700 1 --2- 172.21.15.125:0/1898056200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ff00cb0b0 0x7f0ff01498d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:56.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.378+0000 7f0ff5901700 1 --2- 172.21.15.125:0/1898056200 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0ff00b2950 0x7f0ff015c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:56.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.378+0000 7f0ff5901700 1 -- 172.21.15.125:0/1898056200 >> 172.21.15.125:0/1898056200 conn(0x7f0ff00cd240 msgr2=0x7f0ff00cd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:56.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.378+0000 7f0ff5901700 1 -- 172.21.15.125:0/1898056200 shutdown_connections 2023-10-17T06:22:56.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:56.378+0000 7f0ff5901700 1 -- 172.21.15.125:0/1898056200 wait complete. 2023-10-17T06:22:56.402 INFO:tasks.cephfs_test_runner:If any client gets unresponsive/it's session get idle due to lagginess ... ERROR 2023-10-17T06:22:56.403 INFO:tasks.cephfs_test_runner: 2023-10-17T06:22:56.403 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-17T06:22:56.403 INFO:tasks.cephfs_test_runner:ERROR: test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD) 2023-10-17T06:22:56.403 INFO:tasks.cephfs_test_runner:If any client gets unresponsive/it's session get idle due to lagginess 2023-10-17T06:22:56.404 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-17T06:22:56.404 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-17T06:22:56.404 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3aa759a2d032371ce26212d0251f10b9c2613685/qa/tasks/cephfs/test_client_recovery.py", line 827, in test_client_eviction_if_config_is_set 2023-10-17T06:22:56.404 INFO:tasks.cephfs_test_runner: while proceed(): 2023-10-17T06:22:56.405 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 134, in __call__ 2023-10-17T06:22:56.405 INFO:tasks.cephfs_test_runner: raise MaxWhileTries(error_msg) 2023-10-17T06:22:56.405 INFO:tasks.cephfs_test_runner:teuthology.exceptions.MaxWhileTries: reached maximum tries (7) after waiting for 30 seconds 2023-10-17T06:22:56.405 INFO:tasks.cephfs_test_runner: 2023-10-17T06:22:56.406 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-17T06:22:56.406 INFO:tasks.cephfs_test_runner:Ran 2 tests in 886.478s 2023-10-17T06:22:56.406 INFO:tasks.cephfs_test_runner: 2023-10-17T06:22:56.407 INFO:tasks.cephfs_test_runner:FAILED (errors=1, skipped=1) 2023-10-17T06:22:56.407 INFO:tasks.cephfs_test_runner: 2023-10-17T06:22:56.407 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-17T06:22:56.407 INFO:tasks.cephfs_test_runner:ERROR: test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD) 2023-10-17T06:22:56.408 INFO:tasks.cephfs_test_runner:If any client gets unresponsive/it's session get idle due to lagginess 2023-10-17T06:22:56.408 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-17T06:22:56.408 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-17T06:22:56.408 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3aa759a2d032371ce26212d0251f10b9c2613685/qa/tasks/cephfs/test_client_recovery.py", line 827, in test_client_eviction_if_config_is_set 2023-10-17T06:22:56.409 INFO:tasks.cephfs_test_runner: while proceed(): 2023-10-17T06:22:56.409 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 134, in __call__ 2023-10-17T06:22:56.409 INFO:tasks.cephfs_test_runner: raise MaxWhileTries(error_msg) 2023-10-17T06:22:56.409 INFO:tasks.cephfs_test_runner:teuthology.exceptions.MaxWhileTries: reached maximum tries (7) after waiting for 30 seconds 2023-10-17T06:22:56.410 INFO:tasks.cephfs_test_runner: 2023-10-17T06:22:56.410 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_3aa759a2d032371ce26212d0251f10b9c2613685/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD) 2023-10-17T06:22:56.475 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=705eaadc5b634befbe5850b99effd50d Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_3aa759a2d032371ce26212d0251f10b9c2613685/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD) 2023-10-17T06:22:56.477 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-17T06:22:56.487 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-17T06:22:56.526 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-17T06:22:56.527 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:22:56.527 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:22:56.561 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352252k,nr_inodes=4088063,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9382 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-17T06:22:56.561 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-17T06:22:56.562 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:22:56.626 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352252k,nr_inodes=4088063,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9382 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-17T06:22:56.626 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:22:56.626 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:22:56.645 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352328k,nr_inodes=4088082,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9370 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-17T06:22:56.646 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-10-17T06:22:56.646 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-17T06:22:56.710 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352328k,nr_inodes=4088082,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9370 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-17T06:22:56.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:56.710 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-10-17T06:22:56.732 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-17T06:22:56.733 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-17T06:22:56.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:56.734 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-17T06:22:56.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:56.816 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-17T06:22:56.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:56.919 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link delete ceph-brx 2023-10-17T06:22:57.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:57.115 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-10-17T06:22:57.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:57.132 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link delete ceph-brx 2023-10-17T06:22:57.217 INFO:teuthology.orchestra.run.smithi125.stderr:Cannot find device "ceph-brx" 2023-10-17T06:22:57.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-17T06:22:57.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:57.222 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-17T06:22:57.242 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-17T06:22:57.242 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-17T06:22:57.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:57.244 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-17T06:22:57.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:57.326 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-17T06:22:57.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:57.442 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-10-17T06:22:57.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:57.595 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-10-17T06:22:57.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-17T06:22:57.609 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-10-17T06:22:57.688 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2023-10-17T06:22:57.691 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-17T06:22:57.692 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-17T06:22:57.702 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-17T06:22:57.703 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-17T06:22:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.874+0000 7f6b16000700 1 Processor -- start 2023-10-17T06:22:57.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.874+0000 7f6b16000700 1 -- start start 2023-10-17T06:22:57.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b16000700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b100d2e00 0x7f6b100b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:57.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b16000700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6b100b5ae0 0x7f6b1006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:57.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b16000700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b1015d0d0 con 0x7f6b10160710 2023-10-17T06:22:57.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b16000700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1015df90 con 0x7f6b100b5ae0 2023-10-17T06:22:57.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b16000700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1006f0f0 con 0x7f6b100d2e00 2023-10-17T06:22:57.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b157ff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6b100b5ae0 0x7f6b1006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:57.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b0ffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6b10160710 0x7f6b100d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42532/0 (socket says 172.21.15.125:42532) 2023-10-17T06:22:57.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b0ffff700 1 -- 172.21.15.125:0/1664056734 learned_addr learned my addr 172.21.15.125:0/1664056734 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:22:57.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b14ffe700 1 --2- 172.21.15.125:0/1664056734 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b100d2e00 0x7f6b100b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:57.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b157ff700 1 -- 172.21.15.125:0/1664056734 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b100d2e00 msgr2=0x7f6b100b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:57.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b157ff700 1 --2- 172.21.15.125:0/1664056734 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b100d2e00 0x7f6b100b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:57.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b157ff700 1 -- 172.21.15.125:0/1664056734 >> v1:172.21.15.125:6789/0 conn(0x7f6b10160710 legacy=0x7f6b100d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:57.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b157ff700 1 -- 172.21.15.125:0/1664056734 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1015d310 con 0x7f6b100b5ae0 2023-10-17T06:22:57.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b157ff700 1 --2- 172.21.15.125:0/1664056734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b100b5ae0 0x7f6b1006db60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f6b08009dc0 tx=0x7f6b0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32c500fd7c9c78b server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:57.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b0f7fe700 1 -- 172.21.15.125:0/1664056734 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0800e070 con 0x7f6b100b5ae0 2023-10-17T06:22:57.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b0f7fe700 1 -- 172.21.15.125:0/1664056734 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0800bb90 con 0x7f6b100b5ae0 2023-10-17T06:22:57.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b0f7fe700 1 -- 172.21.15.125:0/1664056734 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b08012430 con 0x7f6b100b5ae0 2023-10-17T06:22:57.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b16000700 1 -- 172.21.15.125:0/1664056734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b100b5ae0 msgr2=0x7f6b1006db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:57.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b16000700 1 --2- 172.21.15.125:0/1664056734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b100b5ae0 0x7f6b1006db60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f6b08009dc0 tx=0x7f6b0800b330 comp rx=0 tx=0).stop 2023-10-17T06:22:57.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b16000700 1 -- 172.21.15.125:0/1664056734 shutdown_connections 2023-10-17T06:22:57.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.878+0000 7f6b16000700 1 --2- 172.21.15.125:0/1664056734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b100b5ae0 0x7f6b1006db60 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:57.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.882+0000 7f6b16000700 1 --2- 172.21.15.125:0/1664056734 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b100d2e00 0x7f6b100b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:57.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.882+0000 7f6b16000700 1 -- 172.21.15.125:0/1664056734 >> 172.21.15.125:0/1664056734 conn(0x7f6b10069f20 msgr2=0x7f6b1006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:57.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.882+0000 7f6b16000700 1 -- 172.21.15.125:0/1664056734 shutdown_connections 2023-10-17T06:22:57.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.882+0000 7f6b16000700 1 -- 172.21.15.125:0/1664056734 wait complete. 2023-10-17T06:22:57.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.882+0000 7f6b16000700 1 Processor -- start 2023-10-17T06:22:57.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.882+0000 7f6b16000700 1 -- start start 2023-10-17T06:22:57.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b16000700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b100b5ae0 0x7f6b101f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:57.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b16000700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b100d2e00 0x7f6b100b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:57.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b16000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b10160710 0x7f6b100b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:57.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b16000700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b100b4fc0 con 0x7f6b100b5ae0 2023-10-17T06:22:57.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b16000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b100b52a0 con 0x7f6b10160710 2023-10-17T06:22:57.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b16000700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b100b5580 con 0x7f6b100d2e00 2023-10-17T06:22:57.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b14ffe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b100b5ae0 0x7f6b101f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:57.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b14ffe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b100b5ae0 0x7f6b101f6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48536/0 (socket says 172.21.15.125:48536) 2023-10-17T06:22:57.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b14ffe700 1 -- 172.21.15.125:0/2338247814 learned_addr learned my addr 172.21.15.125:0/2338247814 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:57.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b0ffff700 1 --2- 172.21.15.125:0/2338247814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b100d2e00 0x7f6b100b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:57.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b157ff700 1 --2- 172.21.15.125:0/2338247814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b10160710 0x7f6b100b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:57.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b14ffe700 1 -- 172.21.15.125:0/2338247814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b100d2e00 msgr2=0x7f6b100b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:57.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b14ffe700 1 --2- 172.21.15.125:0/2338247814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b100d2e00 0x7f6b100b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:57.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b14ffe700 1 -- 172.21.15.125:0/2338247814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b10160710 msgr2=0x7f6b100b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:57.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b14ffe700 1 --2- 172.21.15.125:0/2338247814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b10160710 0x7f6b100b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:57.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b14ffe700 1 -- 172.21.15.125:0/2338247814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b08009a70 con 0x7f6b100b5ae0 2023-10-17T06:22:57.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b14ffe700 1 --2- 172.21.15.125:0/2338247814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b100b5ae0 0x7f6b101f6250 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400d800 tx=0x7f6b0400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:57.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b0d7fa700 1 -- 172.21.15.125:0/2338247814 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b040125f0 con 0x7f6b100b5ae0 2023-10-17T06:22:57.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b0d7fa700 1 -- 172.21.15.125:0/2338247814 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b04012750 con 0x7f6b100b5ae0 2023-10-17T06:22:57.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b16000700 1 -- 172.21.15.125:0/2338247814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b100b2c20 con 0x7f6b100b5ae0 2023-10-17T06:22:57.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b0d7fa700 1 -- 172.21.15.125:0/2338247814 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04012ac0 con 0x7f6b100b5ae0 2023-10-17T06:22:57.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.886+0000 7f6b16000700 1 -- 172.21.15.125:0/2338247814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b100b4bc0 con 0x7f6b100b5ae0 2023-10-17T06:22:57.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.890+0000 7f6b16000700 1 -- 172.21.15.125:0/2338247814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b10072e60 con 0x7f6b100b5ae0 2023-10-17T06:22:57.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.890+0000 7f6b0d7fa700 1 -- 172.21.15.125:0/2338247814 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6b04012c20 con 0x7f6b100b5ae0 2023-10-17T06:22:57.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.894+0000 7f6b0d7fa700 1 --2- 172.21.15.125:0/2338247814 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6af40656f0 0x7f6af4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:57.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.894+0000 7f6b0d7fa700 1 -- 172.21.15.125:0/2338247814 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f6b04082c80 con 0x7f6b100b5ae0 2023-10-17T06:22:57.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.894+0000 7f6b0ffff700 1 --2- 172.21.15.125:0/2338247814 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6af40656f0 0x7f6af4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:57.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.894+0000 7f6b0ffff700 1 --2- 172.21.15.125:0/2338247814 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6af40656f0 0x7f6af4067bb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6b100b74f0 tx=0x7f6afc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:57.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:57.898+0000 7f6b0d7fa700 1 -- 172.21.15.125:0/2338247814 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f6b040508d0 con 0x7f6b100b5ae0 2023-10-17T06:22:58.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.066+0000 7f6b16000700 1 -- 172.21.15.125:0/2338247814 --> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6b1015d8d0 con 0x7f6af40656f0 2023-10-17T06:22:58.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.074+0000 7f6b0d7fa700 1 -- 172.21.15.125:0/2338247814 <== mgr.4107 v2:172.21.15.125:6832/2516570548 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70167 (secure 0 0 0) 0x7f6afc001d00 con 0x7f6af40656f0 2023-10-17T06:22:58.082 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:22:58.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.078+0000 7f6b16000700 1 -- 172.21.15.125:0/2338247814 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6af40656f0 msgr2=0x7f6af4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:58.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.078+0000 7f6b16000700 1 --2- 172.21.15.125:0/2338247814 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6af40656f0 0x7f6af4067bb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6b100b74f0 tx=0x7f6afc009040 comp rx=0 tx=0).stop 2023-10-17T06:22:58.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.078+0000 7f6b16000700 1 -- 172.21.15.125:0/2338247814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b100b5ae0 msgr2=0x7f6b101f6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:58.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.078+0000 7f6b16000700 1 --2- 172.21.15.125:0/2338247814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b100b5ae0 0x7f6b101f6250 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400d800 tx=0x7f6b0400db10 comp rx=0 tx=0).stop 2023-10-17T06:22:58.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.078+0000 7f6b16000700 1 -- 172.21.15.125:0/2338247814 shutdown_connections 2023-10-17T06:22:58.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.078+0000 7f6b16000700 1 --2- 172.21.15.125:0/2338247814 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6af40656f0 0x7f6af4067bb0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.078+0000 7f6b16000700 1 --2- 172.21.15.125:0/2338247814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b10160710 0x7f6b100b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.078+0000 7f6b16000700 1 --2- 172.21.15.125:0/2338247814 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6b100d2e00 0x7f6b100b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.078+0000 7f6b16000700 1 --2- 172.21.15.125:0/2338247814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b100b5ae0 0x7f6b101f6250 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.078+0000 7f6b16000700 1 -- 172.21.15.125:0/2338247814 >> 172.21.15.125:0/2338247814 conn(0x7f6b10069f20 msgr2=0x7f6b1006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:58.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.078+0000 7f6b16000700 1 -- 172.21.15.125:0/2338247814 shutdown_connections 2023-10-17T06:22:58.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.078+0000 7f6b16000700 1 -- 172.21.15.125:0/2338247814 wait complete. 2023-10-17T06:22:58.088 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-17T06:22:58.107 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":532,"stamp":"2023-10-17T06:22:56.325352+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223128,"kb_used_data":6380,"kb_used_omap":24,"kb_used_meta":216615,"kb_avail":754751592,"statfs":{"total":773094113280,"available":772865630208,"internally_reserved":0,"allocated":6533120,"data_stored":3730220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24831,"internal_metadata":221814529},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13419,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-64,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002501"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:22:54.878932+0000","last_change":"2023-10-17T06:07:02.749481+0000","last_active":"2023-10-17T06:22:54.878932+0000","last_peered":"2023-10-17T06:22:54.878932+0000","last_clean":"2023-10-17T06:22:54.878932+0000","last_became_active":"2023-10-17T06:07:02.748983+0000","last_became_peered":"2023-10-17T06:07:02.748983+0000","last_unstale":"2023-10-17T06:22:54.878932+0000","last_undegraded":"2023-10-17T06:22:54.878932+0000","last_fullsized":"2023-10-17T06:22:54.878932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:23:44.065030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":84,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-17T06:22:53.611469+0000","last_change":"2023-10-17T06:07:02.746809+0000","last_active":"2023-10-17T06:22:53.611469+0000","last_peered":"2023-10-17T06:22:53.611469+0000","last_clean":"2023-10-17T06:22:53.611469+0000","last_became_active":"2023-10-17T06:07:02.746404+0000","last_became_peered":"2023-10-17T06:07:02.746404+0000","last_unstale":"2023-10-17T06:22:53.611469+0000","last_undegraded":"2023-10-17T06:22:53.611469+0000","last_fullsized":"2023-10-17T06:22:53.611469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:47:09.774009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":90,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-17T06:22:53.683252+0000","last_change":"2023-10-17T06:07:02.943274+0000","last_active":"2023-10-17T06:22:53.683252+0000","last_peered":"2023-10-17T06:22:53.683252+0000","last_clean":"2023-10-17T06:22:53.683252+0000","last_became_active":"2023-10-17T06:07:02.942674+0000","last_became_peered":"2023-10-17T06:07:02.942674+0000","last_unstale":"2023-10-17T06:22:53.683252+0000","last_undegraded":"2023-10-17T06:22:53.683252+0000","last_fullsized":"2023-10-17T06:22:53.683252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:46:44.391983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":84,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-17T06:22:53.610311+0000","last_change":"2023-10-17T06:07:02.943009+0000","last_active":"2023-10-17T06:22:53.610311+0000","last_peered":"2023-10-17T06:22:53.610311+0000","last_clean":"2023-10-17T06:22:53.610311+0000","last_became_active":"2023-10-17T06:07:02.942298+0000","last_became_peered":"2023-10-17T06:07:02.942298+0000","last_unstale":"2023-10-17T06:22:53.610311+0000","last_undegraded":"2023-10-17T06:22:53.610311+0000","last_fullsized":"2023-10-17T06:22:53.610311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:32:49.773674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":88,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:22:54.370213+0000","last_change":"2023-10-17T06:07:02.747287+0000","last_active":"2023-10-17T06:22:54.370213+0000","last_peered":"2023-10-17T06:22:54.370213+0000","last_clean":"2023-10-17T06:22:54.370213+0000","last_became_active":"2023-10-17T06:07:02.746659+0000","last_became_peered":"2023-10-17T06:07:02.746659+0000","last_unstale":"2023-10-17T06:22:54.370213+0000","last_undegraded":"2023-10-17T06:22:54.370213+0000","last_fullsized":"2023-10-17T06:22:54.370213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:23:13.558569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-17T06:22:53.682378+0000","last_change":"2023-10-17T06:16:02.426582+0000","last_active":"2023-10-17T06:22:53.682378+0000","last_peered":"2023-10-17T06:22:53.682378+0000","last_clean":"2023-10-17T06:22:53.682378+0000","last_became_active":"2023-10-17T06:16:02.425947+0000","last_became_peered":"2023-10-17T06:16:02.425947+0000","last_unstale":"2023-10-17T06:22:53.682378+0000","last_undegraded":"2023-10-17T06:22:53.682378+0000","last_fullsized":"2023-10-17T06:22:53.682378+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:58:17.427886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":90,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-17T06:22:53.680630+0000","last_change":"2023-10-17T06:07:02.746953+0000","last_active":"2023-10-17T06:22:53.680630+0000","last_peered":"2023-10-17T06:22:53.680630+0000","last_clean":"2023-10-17T06:22:53.680630+0000","last_became_active":"2023-10-17T06:07:02.746344+0000","last_became_peered":"2023-10-17T06:07:02.746344+0000","last_unstale":"2023-10-17T06:22:53.680630+0000","last_undegraded":"2023-10-17T06:22:53.680630+0000","last_fullsized":"2023-10-17T06:22:53.680630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:41:51.226826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":88,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:22:54.373452+0000","last_change":"2023-10-17T06:07:02.747957+0000","last_active":"2023-10-17T06:22:54.373452+0000","last_peered":"2023-10-17T06:22:54.373452+0000","last_clean":"2023-10-17T06:22:54.373452+0000","last_became_active":"2023-10-17T06:07:02.747569+0000","last_became_peered":"2023-10-17T06:07:02.747569+0000","last_unstale":"2023-10-17T06:22:54.373452+0000","last_undegraded":"2023-10-17T06:22:54.373452+0000","last_fullsized":"2023-10-17T06:22:54.373452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:29:49.927806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":246,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-17T06:22:53.681040+0000","last_change":"2023-10-17T06:06:55.916050+0000","last_active":"2023-10-17T06:22:53.681040+0000","last_peered":"2023-10-17T06:22:53.681040+0000","last_clean":"2023-10-17T06:22:53.681040+0000","last_became_active":"2023-10-17T06:06:55.914009+0000","last_became_peered":"2023-10-17T06:06:55.914009+0000","last_unstale":"2023-10-17T06:22:53.681040+0000","last_undegraded":"2023-10-17T06:22:53.681040+0000","last_fullsized":"2023-10-17T06:22:53.681040+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:06:54.658926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:06:54.658926+0000","last_clean_scrub_stamp":"2023-10-17T06:06:54.658926+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:47:30.458420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509634,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":663552,"data_stored":317980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1240000000000001,"15min":1.111},"min":{"1min":0.69499999999999995,"5min":0.69399999999999995,"15min":0.41799999999999998},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5840000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.1719999999999999,"15min":1.1419999999999999},"min":{"1min":0.86899999999999999,"5min":0.76800000000000002,"15min":0.74199999999999999},"max":{"1min":1.635,"5min":1.79,"15min":1.79},"last":1.552}]},{"osd":1,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.181,"15min":1.149},"min":{"1min":0.83499999999999996,"5min":0.80900000000000005,"15min":0.71599999999999997},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.698},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.282,"5min":1.1899999999999999,"15min":1.1719999999999999},"min":{"1min":0.90800000000000003,"5min":0.77200000000000002,"15min":0.75},"max":{"1min":1.6080000000000001,"5min":1.625,"15min":1.73},"last":0.99099999999999999}]},{"osd":2,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.212,"15min":1.181},"min":{"1min":0.84199999999999997,"5min":0.80300000000000005,"15min":0.70599999999999996},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.8360000000000001},"last":1.405},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2310000000000001,"15min":1.21},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.617,"5min":1.655,"15min":1.744},"last":1.212}]},{"osd":3,"last update":"Tue Oct 17 06:22:17 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.2490000000000001,"15min":1.2250000000000001},"min":{"1min":0.97799999999999998,"5min":0.871,"15min":0.66700000000000004},"max":{"1min":1.639,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.083},{"interface":"front","average":{"1min":1.369,"5min":1.3169999999999999,"15min":1.306},"min":{"1min":1.081,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.732,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.294}]},{"osd":4,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.153,"15min":1.153},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.56100000000000005},"max":{"1min":1.5049999999999999,"5min":1.6759999999999999,"15min":2.2349999999999999},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.226,"15min":1.2230000000000001},"min":{"1min":0.82999999999999996,"5min":0.67100000000000004,"15min":0.624},"max":{"1min":1.694,"5min":1.891,"15min":2.0030000000000001},"last":1.879}]},{"osd":5,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.2070000000000001,"15min":1.228},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5660000000000001,"5min":1.6240000000000001,"15min":2.113},"last":1.51},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.411,"15min":1.395},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.51800000000000002},"max":{"1min":1.7390000000000001,"5min":1.8340000000000001,"15min":1.988},"last":1.446}]},{"osd":7,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.365,"15min":1.3480000000000001},"min":{"1min":0.92900000000000005,"5min":0.79000000000000004,"15min":0.61899999999999999},"max":{"1min":1.712,"5min":1.9790000000000001,"15min":2.157},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.329,"15min":1.3280000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.60799999999999998},"max":{"1min":1.7749999999999999,"5min":1.8620000000000001,"15min":2.1989999999999998},"last":1.5780000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509635,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":325505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1679999999999999,"15min":1.151},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.63700000000000001},"max":{"1min":1.5229999999999999,"5min":1.677,"15min":1.6799999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.2110000000000001,"15min":1.1870000000000001},"min":{"1min":0.79600000000000004,"5min":0.70599999999999996,"15min":0.66000000000000003},"max":{"1min":1.49,"5min":1.726,"15min":5.2919999999999998},"last":1.3320000000000001}]},{"osd":1,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.1799999999999999,"15min":1.1579999999999999},"min":{"1min":0.86499999999999999,"5min":0.66500000000000004,"15min":0.55400000000000005},"max":{"1min":1.427,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.482},{"interface":"front","average":{"1min":1.222,"5min":1.2490000000000001,"15min":1.2090000000000001},"min":{"1min":0.97499999999999998,"5min":0.74299999999999999,"15min":0.68999999999999995},"max":{"1min":1.6220000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.4019999999999999}]},{"osd":2,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.238,"15min":1.2290000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.66100000000000003},"max":{"1min":1.607,"5min":1.7070000000000001,"15min":5.3700000000000001},"last":1.157},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2250000000000001,"15min":1.2310000000000001},"min":{"1min":0.96199999999999997,"5min":0.76200000000000001,"15min":0.60199999999999998},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":2.2080000000000002},"last":1.2649999999999999}]},{"osd":3,"last update":"Tue Oct 17 06:22:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2589999999999999,"15min":1.28},"min":{"1min":0.85399999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.71,"5min":1.794,"15min":1.794},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.298,"15min":1.3009999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.5820000000000001,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.0760000000000001}]},{"osd":4,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.216,"15min":1.204},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.55800000000000005},"max":{"1min":1.6240000000000001,"5min":1.679,"15min":2.653},"last":1.6759999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2470000000000001,"15min":1.2370000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":3.3820000000000001},"last":1.444}]},{"osd":6,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.169,"15min":1.2230000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.494,"5min":1.851,"15min":2.7879999999999998},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.73599999999999999,"5min":0.68799999999999994,"15min":0.623},"max":{"1min":1.569,"5min":1.861,"15min":2.702},"last":1.595}]},{"osd":7,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.369,"15min":1.3460000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.669,"5min":1.827,"15min":2.544},"last":1.53},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.327,"15min":1.3779999999999999},"min":{"1min":0.98799999999999999,"5min":0.73099999999999998,"15min":0.70999999999999996},"max":{"1min":1.5549999999999999,"5min":1.738,"15min":2.8929999999999998},"last":1.6279999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":319190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.175,"15min":1.147},"min":{"1min":0.81899999999999995,"5min":0.64500000000000002,"15min":0.496},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6850000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1319999999999999,"15min":1.105},"min":{"1min":0.80800000000000005,"5min":0.71199999999999997,"15min":0.57699999999999996},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.5369999999999999},"last":1.1020000000000001}]},{"osd":1,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1870000000000001,"15min":1.159},"min":{"1min":0.754,"5min":0.73299999999999998,"15min":0.70199999999999996},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7270000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2350000000000001,"15min":1.224},"min":{"1min":1.0109999999999999,"5min":0.747,"15min":0.66400000000000003},"max":{"1min":1.901,"5min":1.901,"15min":1.9910000000000001},"last":0.90300000000000002}]},{"osd":2,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.206,"15min":1.2},"min":{"1min":0.93600000000000005,"5min":0.70399999999999996,"15min":0.66800000000000004},"max":{"1min":1.488,"5min":1.694,"15min":1.903},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.28,"15min":1.2549999999999999},"min":{"1min":0.94799999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.635,"5min":1.7130000000000001,"15min":1.847},"last":1.121}]},{"osd":3,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.278,"15min":1.306},"min":{"1min":0.86399999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.417,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.373,"5min":1.339,"15min":1.3819999999999999},"min":{"1min":1.034,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.069}]},{"osd":5,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.2490000000000001,"15min":1.2230000000000001},"min":{"1min":0.85899999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6459999999999999,"5min":1.702,"15min":2.25},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.091,"15min":1.1259999999999999},"min":{"1min":0.81699999999999995,"5min":0.627,"15min":0.627},"max":{"1min":1.4379999999999999,"5min":1.667,"15min":2.024},"last":0.64700000000000002}]},{"osd":6,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.212,"15min":1.2230000000000001},"min":{"1min":0.872,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5409999999999999,"5min":1.7509999999999999,"15min":3.2120000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.403,"15min":1.3660000000000001},"min":{"1min":0.83299999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.764,"5min":1.7729999999999999,"15min":2.1099999999999999},"last":0.58399999999999996}]},{"osd":7,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.206,"15min":1.244},"min":{"1min":0.80500000000000005,"5min":0.434,"15min":0.434},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.913},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3740000000000001,"15min":1.381},"min":{"1min":1.1040000000000001,"5min":0.622,"15min":0.622},"max":{"1min":1.6519999999999999,"5min":1.9670000000000001,"15min":2.3079999999999998},"last":0.68799999999999994}]}]},{"osd":7,"up_from":14,"seq":60129542338,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1261568,"data_stored":909558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2010000000000001,"15min":1.1639999999999999},"min":{"1min":0.85299999999999998,"5min":0.73299999999999998,"15min":0.68600000000000005},"max":{"1min":1.4119999999999999,"5min":1.6240000000000001,"15min":1.9890000000000001},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.276,"5min":1.1839999999999999,"15min":1.1419999999999999},"min":{"1min":0.96899999999999997,"5min":0.79000000000000004,"15min":0.54900000000000004},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.718},"last":1.3759999999999999}]},{"osd":1,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.1899999999999999,"15min":1.161},"min":{"1min":0.98499999999999999,"5min":0.78000000000000003,"15min":0.54900000000000004},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":5.0519999999999996},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2350000000000001,"15min":1.208},"min":{"1min":0.90600000000000003,"5min":0.82899999999999996,"15min":0.67800000000000005},"max":{"1min":1.6539999999999999,"5min":1.7430000000000001,"15min":2.2109999999999999},"last":1.151}]},{"osd":2,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.329,"15min":1.284},"min":{"1min":1.1519999999999999,"5min":0.71199999999999997,"15min":0.64700000000000002},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":2.1739999999999999},"last":1.03},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.21,"15min":1.208},"min":{"1min":0.95399999999999996,"5min":0.80400000000000005,"15min":0.73699999999999999},"max":{"1min":1.5580000000000001,"5min":1.6519999999999999,"15min":1.7250000000000001},"last":0.96799999999999997}]},{"osd":3,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.254,"15min":1.2709999999999999},"min":{"1min":1.014,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.55,"5min":1.617,"15min":1.617},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3360000000000001,"15min":1.345},"min":{"1min":1.254,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.5840000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.4319999999999999}]},{"osd":4,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.1950000000000001,"15min":1.204},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.57399999999999995},"max":{"1min":1.625,"5min":1.6779999999999999,"15min":1.857},"last":1.345},{"interface":"front","average":{"1min":1.097,"5min":1.175,"15min":1.1930000000000001},"min":{"1min":0.78000000000000003,"5min":0.70799999999999996,"15min":0.67000000000000004},"max":{"1min":1.661,"5min":1.843,"15min":2.1499999999999999},"last":1.2190000000000001}]},{"osd":5,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.258,"15min":1.194},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.45900000000000002},"max":{"1min":1.5549999999999999,"5min":1.6919999999999999,"15min":1.895},"last":1.554},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.371,"15min":1.373},"min":{"1min":1.121,"5min":0.95699999999999996,"15min":0.78800000000000003},"max":{"1min":1.702,"5min":1.802,"15min":2.1139999999999999},"last":1.8620000000000001}]},{"osd":6,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.3129999999999999,"15min":1.327},"min":{"1min":0.88900000000000001,"5min":0.83999999999999997,"15min":0.69199999999999995},"max":{"1min":1.6659999999999999,"5min":1.7290000000000001,"15min":2.218},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.4139999999999999,"15min":1.3440000000000001},"min":{"1min":0.92500000000000004,"5min":0.81499999999999995,"15min":0.71299999999999997},"max":{"1min":1.6619999999999999,"5min":1.748,"15min":1.9710000000000001},"last":1.5049999999999999}]}]},{"osd":3,"up_from":54,"seq":231928234068,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":668,"kb_used_omap":12,"kb_used_meta":27571,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":684032,"data_stored":325505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12364,"internal_metadata":28233652},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88100000000000001,"15min":0.89800000000000002},"min":{"1min":0.61299999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2789999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.92600000000000005,"15min":0.95599999999999996},"min":{"1min":0.76800000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.2529999999999999,"5min":1.482,"15min":1.482},"last":1.0409999999999999}]},{"osd":1,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.98899999999999999,"15min":1.0329999999999999},"min":{"1min":0.71499999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.238,"5min":1.458,"15min":1.458},"last":1},{"interface":"front","average":{"1min":1.032,"5min":1.044,"15min":1.0649999999999999},"min":{"1min":0.78200000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.3440000000000001,"5min":1.4770000000000001,"15min":1.4850000000000001},"last":1.3140000000000001}]},{"osd":2,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.21,"15min":1.2410000000000001},"min":{"1min":0.81899999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.623,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0009999999999999,"15min":0.97799999999999998},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.67000000000000004},"max":{"1min":1.339,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.274}]},{"osd":4,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.228,"15min":1.3260000000000001},"min":{"1min":1.028,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.4239999999999999,"5min":1.5649999999999999,"15min":1.78},"last":1.409},{"interface":"front","average":{"1min":1.3,"5min":1.3240000000000001,"15min":1.377},"min":{"1min":1.0600000000000001,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":1.5549999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.4299999999999999}]},{"osd":5,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2929999999999999,"15min":1.3620000000000001},"min":{"1min":1.03,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.518,"5min":1.607,"15min":1.849},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.373,"15min":1.425},"min":{"1min":1.0800000000000001,"5min":1.012,"15min":1.012},"max":{"1min":1.581,"5min":1.962,"15min":1.962},"last":1.5069999999999999}]},{"osd":6,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2150000000000001,"15min":1.246},"min":{"1min":1.028,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.492,"5min":1.629,"15min":1.8120000000000001},"last":1.167},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.454,"15min":1.4730000000000001},"min":{"1min":1.2709999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":1.766,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.472}]},{"osd":7,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.3799999999999999,"15min":1.4079999999999999},"min":{"1min":1.1830000000000001,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.7010000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.476,"5min":1.5109999999999999,"15min":1.5629999999999999},"min":{"1min":1.248,"5min":1.1899999999999999,"15min":1.1899999999999999},"max":{"1min":1.6639999999999999,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.375}]}]},{"osd":2,"up_from":14,"seq":60129542339,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":667648,"data_stored":319190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.86499999999999999,"15min":0.83699999999999997},"min":{"1min":0.623,"5min":0.54300000000000004,"15min":0.35899999999999999},"max":{"1min":1.2170000000000001,"5min":1.3979999999999999,"15min":1.409},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.93899999999999995,"15min":0.93000000000000005},"min":{"1min":0.69499999999999995,"5min":0.56000000000000005,"15min":0.39200000000000002},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.881},"last":0.92100000000000004}]},{"osd":1,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.96299999999999997,"15min":0.94999999999999996},"min":{"1min":0.77700000000000002,"5min":0.57999999999999996,"15min":0.40400000000000003},"max":{"1min":1.474,"5min":1.5489999999999999,"15min":1.605},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0389999999999999,"15min":1.0309999999999999},"min":{"1min":0.80200000000000005,"5min":0.69499999999999995,"15min":0.49399999999999999},"max":{"1min":1.482,"5min":1.482,"15min":2.1440000000000001},"last":1.157}]},{"osd":3,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.143,"15min":1.181},"min":{"1min":0.89800000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.335,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.1279999999999999,"15min":1.1100000000000001},"min":{"1min":0.875,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4099999999999999,"5min":1.573,"15min":1.573},"last":1.393}]},{"osd":4,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.327,"15min":1.3180000000000001},"min":{"1min":1.004,"5min":1.004,"15min":0.70299999999999996},"max":{"1min":1.7070000000000001,"5min":1.756,"15min":2.3719999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.135,"5min":1.2030000000000001,"15min":1.2250000000000001},"min":{"1min":0.96099999999999997,"5min":0.92700000000000005,"15min":0.81899999999999995},"max":{"1min":1.3220000000000001,"5min":1.8140000000000001,"15min":2.0579999999999998},"last":1.048}]},{"osd":5,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.3160000000000001,"15min":1.2689999999999999},"min":{"1min":1.0609999999999999,"5min":0.99299999999999999,"15min":0.63300000000000001},"max":{"1min":1.556,"5min":1.657,"15min":2.2650000000000001},"last":1.268},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3919999999999999,"15min":1.3580000000000001},"min":{"1min":1.204,"5min":1.0649999999999999,"15min":0.75900000000000001},"max":{"1min":1.4750000000000001,"5min":1.954,"15min":2.5190000000000001},"last":1.5629999999999999}]},{"osd":6,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2809999999999999,"15min":1.284},"min":{"1min":1.085,"5min":0.77000000000000002,"15min":0.76900000000000002},"max":{"1min":1.4950000000000001,"5min":1.841,"15min":2.2109999999999999},"last":1.341},{"interface":"front","average":{"1min":1.367,"5min":1.3640000000000001,"15min":1.3400000000000001},"min":{"1min":1.212,"5min":0.90800000000000003,"15min":0.64100000000000001},"max":{"1min":1.5700000000000001,"5min":1.7849999999999999,"15min":2.1720000000000002},"last":0.99199999999999999}]},{"osd":7,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4530000000000001,"15min":1.4350000000000001},"min":{"1min":1.246,"5min":1.054,"15min":0.80800000000000005},"max":{"1min":1.6419999999999999,"5min":1.8640000000000001,"15min":2.9809999999999999},"last":1.736},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3600000000000001,"15min":1.3500000000000001},"min":{"1min":1.194,"5min":1.036,"15min":0.65100000000000002},"max":{"1min":1.607,"5min":1.728,"15min":2.1379999999999999},"last":1.52}]}]},{"osd":1,"up_from":14,"seq":60129542339,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":659456,"data_stored":312526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86399999999999999,"15min":0.88},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.34100000000000003},"max":{"1min":1.1299999999999999,"5min":1.28,"15min":1.6659999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0309999999999999,"15min":0.999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.505},"max":{"1min":1.3640000000000001,"5min":1.367,"15min":2.169},"last":0.72799999999999998}]},{"osd":2,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.98299999999999998,"15min":0.95799999999999996},"min":{"1min":0.75700000000000001,"5min":0.54700000000000004,"15min":0.40500000000000003},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":2.7789999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.93100000000000005,"15min":0.90200000000000002},"min":{"1min":0.68899999999999995,"5min":0.495,"15min":0.44},"max":{"1min":1.298,"5min":1.5169999999999999,"15min":2.468},"last":0.69599999999999995}]},{"osd":3,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0349999999999999,"15min":1.0589999999999999},"min":{"1min":0.745,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.3109999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.028,"15min":1.028},"min":{"1min":0.68700000000000006,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.306,"5min":1.5740000000000001,"15min":1.6339999999999999},"last":0.52300000000000002}]},{"osd":4,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.268,"15min":1.2470000000000001},"min":{"1min":0.93999999999999995,"5min":0.90300000000000002,"15min":0.745},"max":{"1min":1.5389999999999999,"5min":1.671,"15min":2.2000000000000002},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.159,"5min":1.2470000000000001,"15min":1.2410000000000001},"min":{"1min":0.89000000000000001,"5min":0.86299999999999999,"15min":0.503},"max":{"1min":1.3819999999999999,"5min":1.675,"15min":2.871},"last":0.95799999999999996}]},{"osd":5,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.278,"15min":1.2689999999999999},"min":{"1min":1.044,"5min":0.86299999999999999,"15min":0.54100000000000004},"max":{"1min":1.4830000000000001,"5min":1.7350000000000001,"15min":3.032},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.262,"15min":1.2529999999999999},"min":{"1min":0.95599999999999996,"5min":0.81100000000000005,"15min":0.58799999999999997},"max":{"1min":1.504,"5min":1.6120000000000001,"15min":4.819},"last":1.0389999999999999}]},{"osd":6,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2929999999999999,"15min":1.284},"min":{"1min":1.0580000000000001,"5min":0.91000000000000003,"15min":0.68200000000000005},"max":{"1min":1.488,"5min":1.6319999999999999,"15min":4.9900000000000002},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.331,"15min":1.304},"min":{"1min":1.034,"5min":0.93000000000000005,"15min":0.874},"max":{"1min":1.5980000000000001,"5min":1.8280000000000001,"15min":2.8159999999999998},"last":1.0009999999999999}]},{"osd":7,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.397,"15min":1.3879999999999999},"min":{"1min":1.028,"5min":1.028,"15min":0.84399999999999997},"max":{"1min":1.5840000000000001,"5min":1.9059999999999999,"15min":2.677},"last":1.079},{"interface":"front","average":{"1min":1.397,"5min":1.4159999999999999,"15min":1.393},"min":{"1min":1.2110000000000001,"5min":1.0409999999999999,"15min":0.65400000000000003},"max":{"1min":1.607,"5min":1.9019999999999999,"15min":2.9529999999999998},"last":1.0189999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542339,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1245184,"data_stored":900766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.83199999999999996,"15min":0.81899999999999995},"min":{"1min":0.67100000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.615},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.92800000000000005,"15min":0.89200000000000002},"min":{"1min":0.71499999999999997,"5min":0.61799999999999999,"15min":0.33500000000000002},"max":{"1min":1.391,"5min":1.6020000000000001,"15min":2.3340000000000001},"last":0.59599999999999997}]},{"osd":2,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.175,"15min":1.151},"min":{"1min":0.78500000000000003,"5min":0.59499999999999997,"15min":0.55500000000000005},"max":{"1min":1.589,"5min":1.7889999999999999,"15min":4.407},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.97999999999999998,"15min":0.97299999999999998},"min":{"1min":0.55900000000000005,"5min":0.52300000000000002,"15min":0.42499999999999999},"max":{"1min":1.52,"5min":1.6559999999999999,"15min":2.5659999999999998},"last":1.2509999999999999}]},{"osd":3,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.995,"15min":1},"min":{"1min":0.71499999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3360000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.069,"15min":1.1180000000000001},"min":{"1min":0.63500000000000001,"5min":0.622,"15min":0.622},"max":{"1min":1.452,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.86399999999999999}]},{"osd":4,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1919999999999999,"15min":1.1890000000000001},"min":{"1min":0.97299999999999998,"5min":0.88100000000000001,"15min":0.67200000000000004},"max":{"1min":1.3819999999999999,"5min":1.996,"15min":3.4820000000000002},"last":1.127},{"interface":"front","average":{"1min":1.194,"5min":1.224,"15min":1.232},"min":{"1min":1.0349999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.458,"5min":1.758,"15min":3.8079999999999998},"last":0.90400000000000003}]},{"osd":5,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2649999999999999,"15min":1.2569999999999999},"min":{"1min":1.048,"5min":0.79800000000000004,"15min":0.748},"max":{"1min":1.4299999999999999,"5min":1.8360000000000001,"15min":3.2120000000000002},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.337,"15min":1.3120000000000001},"min":{"1min":1.0740000000000001,"5min":0.91100000000000003,"15min":0.85699999999999998},"max":{"1min":1.585,"5min":1.7849999999999999,"15min":4.3849999999999998},"last":0.92700000000000005}]},{"osd":6,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3759999999999999,"15min":1.3540000000000001},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.79100000000000004},"max":{"1min":1.522,"5min":1.873,"15min":4.3499999999999996},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.274,"15min":1.2569999999999999},"min":{"1min":1.0569999999999999,"5min":0.92600000000000005,"15min":0.61799999999999999},"max":{"1min":1.484,"5min":1.859,"15min":1.925},"last":1.014}]},{"osd":7,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3640000000000001,"15min":1.361},"min":{"1min":0.99399999999999999,"5min":0.97599999999999998,"15min":0.73499999999999999},"max":{"1min":1.5629999999999999,"5min":1.9430000000000001,"15min":2.0840000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.415,"15min":1.403},"min":{"1min":1.27,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.5680000000000001,"5min":1.887,"15min":2.7410000000000001},"last":1.331}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-17T06:22:58.109 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-17T06:22:58.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.282+0000 7fe4860c2700 1 Processor -- start 2023-10-17T06:22:58.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.282+0000 7fe4860c2700 1 -- start start 2023-10-17T06:22:58.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.282+0000 7fe4860c2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe4800b3d40 0x7fe4800cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:58.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.282+0000 7fe4860c2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe48006ce20 0x7fe48006d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:58.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.282+0000 7fe4860c2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48006d7b0 con 0x7fe480164a20 2023-10-17T06:22:58.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.282+0000 7fe4860c2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48006e2d0 con 0x7fe4800b3d40 2023-10-17T06:22:58.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.282+0000 7fe4860c2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800ca4c0 con 0x7fe48006ce20 2023-10-17T06:22:58.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.282+0000 7fe4850c0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe4800b3d40 0x7fe4800cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:58.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.282+0000 7fe4848bf700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe480164a20 0x7fe4800c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42544/0 (socket says 172.21.15.125:42544) 2023-10-17T06:22:58.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.282+0000 7fe4848bf700 1 -- 172.21.15.125:0/2267091714 learned_addr learned my addr 172.21.15.125:0/2267091714 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:22:58.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.282+0000 7fe4858c1700 1 --2- 172.21.15.125:0/2267091714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe48006ce20 0x7fe48006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:58.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.282+0000 7fe4850c0700 1 -- 172.21.15.125:0/2267091714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe48006ce20 msgr2=0x7fe48006d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:58.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.282+0000 7fe4850c0700 1 --2- 172.21.15.125:0/2267091714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe48006ce20 0x7fe48006d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.282+0000 7fe4850c0700 1 -- 172.21.15.125:0/2267091714 >> v1:172.21.15.125:6789/0 conn(0x7fe480164a20 legacy=0x7fe4800c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:58.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.282+0000 7fe4850c0700 1 -- 172.21.15.125:0/2267091714 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4800ca7a0 con 0x7fe4800b3d40 2023-10-17T06:22:58.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.282+0000 7fe477fff700 1 -- 172.21.15.125:0/2267091714 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035664627 0 0) 0x7fe470001110 con 0x7fe480164a20 2023-10-17T06:22:58.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.282+0000 7fe4850c0700 1 --2- 172.21.15.125:0/2267091714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4800b3d40 0x7fe4800cc190 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe47c009850 tx=0x7fe47c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd6aef83b9986a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:58.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.286+0000 7fe477fff700 1 -- 172.21.15.125:0/2267091714 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c011830 con 0x7fe4800b3d40 2023-10-17T06:22:58.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.286+0000 7fe477fff700 1 -- 172.21.15.125:0/2267091714 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47c011990 con 0x7fe4800b3d40 2023-10-17T06:22:58.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.286+0000 7fe477fff700 1 -- 172.21.15.125:0/2267091714 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c011d20 con 0x7fe4800b3d40 2023-10-17T06:22:58.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.286+0000 7fe4860c2700 1 -- 172.21.15.125:0/2267091714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4800b3d40 msgr2=0x7fe4800cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:58.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.286+0000 7fe4860c2700 1 --2- 172.21.15.125:0/2267091714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4800b3d40 0x7fe4800cc190 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe47c009850 tx=0x7fe47c009b60 comp rx=0 tx=0).stop 2023-10-17T06:22:58.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.286+0000 7fe4860c2700 1 -- 172.21.15.125:0/2267091714 shutdown_connections 2023-10-17T06:22:58.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.286+0000 7fe4860c2700 1 --2- 172.21.15.125:0/2267091714 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe48006ce20 0x7fe48006d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.286+0000 7fe4860c2700 1 --2- 172.21.15.125:0/2267091714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4800b3d40 0x7fe4800cc190 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.286+0000 7fe4860c2700 1 -- 172.21.15.125:0/2267091714 >> 172.21.15.125:0/2267091714 conn(0x7fe4800ce5c0 msgr2=0x7fe4800ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:58.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.286+0000 7fe4860c2700 1 -- 172.21.15.125:0/2267091714 shutdown_connections 2023-10-17T06:22:58.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.286+0000 7fe4860c2700 1 -- 172.21.15.125:0/2267091714 wait complete. 2023-10-17T06:22:58.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.290+0000 7fe4860c2700 1 Processor -- start 2023-10-17T06:22:58.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.290+0000 7fe4860c2700 1 -- start start 2023-10-17T06:22:58.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.290+0000 7fe4860c2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe48006ce20 0x7fe4801624d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:58.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.290+0000 7fe4860c2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4800b3d40 0x7fe480158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:58.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.290+0000 7fe4860c2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe480164a20 0x7fe480154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:58.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.290+0000 7fe4860c2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4801634e0 con 0x7fe4800b3d40 2023-10-17T06:22:58.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.290+0000 7fe4860c2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe480162a10 con 0x7fe48006ce20 2023-10-17T06:22:58.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.290+0000 7fe4860c2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800c59b0 con 0x7fe480164a20 2023-10-17T06:22:58.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.290+0000 7fe4848bf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4800b3d40 0x7fe480158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:58.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.290+0000 7fe4848bf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4800b3d40 0x7fe480158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48554/0 (socket says 172.21.15.125:48554) 2023-10-17T06:22:58.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.290+0000 7fe4850c0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe48006ce20 0x7fe4801624d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:58.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.290+0000 7fe4848bf700 1 -- 172.21.15.125:0/3727696951 learned_addr learned my addr 172.21.15.125:0/3727696951 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:58.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.290+0000 7fe4858c1700 1 --2- 172.21.15.125:0/3727696951 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe480164a20 0x7fe480154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:58.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.294+0000 7fe4848bf700 1 -- 172.21.15.125:0/3727696951 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe480164a20 msgr2=0x7fe480154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:58.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.294+0000 7fe4848bf700 1 --2- 172.21.15.125:0/3727696951 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe480164a20 0x7fe480154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.294+0000 7fe4848bf700 1 -- 172.21.15.125:0/3727696951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe48006ce20 msgr2=0x7fe4801624d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:58.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.294+0000 7fe4848bf700 1 --2- 172.21.15.125:0/3727696951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe48006ce20 0x7fe4801624d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.294+0000 7fe4848bf700 1 -- 172.21.15.125:0/3727696951 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c0094b0 con 0x7fe4800b3d40 2023-10-17T06:22:58.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.294+0000 7fe4848bf700 1 --2- 172.21.15.125:0/3727696951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4800b3d40 0x7fe480158050 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe47000c4d0 tx=0x7fe47000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:58.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.294+0000 7fe475ffb700 1 -- 172.21.15.125:0/3727696951 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470004ca0 con 0x7fe4800b3d40 2023-10-17T06:22:58.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.294+0000 7fe475ffb700 1 -- 172.21.15.125:0/3727696951 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe470004e00 con 0x7fe4800b3d40 2023-10-17T06:22:58.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.294+0000 7fe475ffb700 1 -- 172.21.15.125:0/3727696951 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470007310 con 0x7fe4800b3d40 2023-10-17T06:22:58.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.294+0000 7fe4860c2700 1 -- 172.21.15.125:0/3727696951 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe480162c40 con 0x7fe4800b3d40 2023-10-17T06:22:58.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.294+0000 7fe4860c2700 1 -- 172.21.15.125:0/3727696951 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe480163200 con 0x7fe4800b3d40 2023-10-17T06:22:58.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.294+0000 7fe4860c2700 1 -- 172.21.15.125:0/3727696951 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe480072e60 con 0x7fe4800b3d40 2023-10-17T06:22:58.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.298+0000 7fe475ffb700 1 -- 172.21.15.125:0/3727696951 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe470007470 con 0x7fe4800b3d40 2023-10-17T06:22:58.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.298+0000 7fe475ffb700 1 --2- 172.21.15.125:0/3727696951 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe464065720 0x7fe464067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:58.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.298+0000 7fe475ffb700 1 -- 172.21.15.125:0/3727696951 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fe470082640 con 0x7fe4800b3d40 2023-10-17T06:22:58.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.298+0000 7fe4850c0700 1 --2- 172.21.15.125:0/3727696951 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe464065720 0x7fe464067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:58.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.298+0000 7fe4850c0700 1 --2- 172.21.15.125:0/3727696951 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe464065720 0x7fe464067be0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe47c000c00 tx=0x7fe47c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:58.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.306+0000 7fe475ffb700 1 -- 172.21.15.125:0/3727696951 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe4700501f0 con 0x7fe4800b3d40 2023-10-17T06:22:58.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.478+0000 7fe4860c2700 1 -- 172.21.15.125:0/3727696951 --> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe4800cad60 con 0x7fe464065720 2023-10-17T06:22:58.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.482+0000 7fe475ffb700 1 -- 172.21.15.125:0/3727696951 <== mgr.4107 v2:172.21.15.125:6832/2516570548 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70167 (secure 0 0 0) 0x7fe47c011c00 con 0x7fe464065720 2023-10-17T06:22:58.491 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:22:58.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.486+0000 7fe4860c2700 1 -- 172.21.15.125:0/3727696951 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe464065720 msgr2=0x7fe464067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:58.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.486+0000 7fe4860c2700 1 --2- 172.21.15.125:0/3727696951 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe464065720 0x7fe464067be0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe47c000c00 tx=0x7fe47c008030 comp rx=0 tx=0).stop 2023-10-17T06:22:58.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.486+0000 7fe4860c2700 1 -- 172.21.15.125:0/3727696951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4800b3d40 msgr2=0x7fe480158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:58.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.486+0000 7fe4860c2700 1 --2- 172.21.15.125:0/3727696951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4800b3d40 0x7fe480158050 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe47000c4d0 tx=0x7fe47000c7e0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.486+0000 7fe4860c2700 1 -- 172.21.15.125:0/3727696951 shutdown_connections 2023-10-17T06:22:58.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.486+0000 7fe4860c2700 1 --2- 172.21.15.125:0/3727696951 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe464065720 0x7fe464067be0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.486+0000 7fe4860c2700 1 --2- 172.21.15.125:0/3727696951 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe480164a20 0x7fe480154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.486+0000 7fe4860c2700 1 --2- 172.21.15.125:0/3727696951 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4800b3d40 0x7fe480158050 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.486+0000 7fe4860c2700 1 --2- 172.21.15.125:0/3727696951 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe48006ce20 0x7fe4801624d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.486+0000 7fe4860c2700 1 -- 172.21.15.125:0/3727696951 >> 172.21.15.125:0/3727696951 conn(0x7fe4800ce5c0 msgr2=0x7fe480159960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:58.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.486+0000 7fe4860c2700 1 -- 172.21.15.125:0/3727696951 shutdown_connections 2023-10-17T06:22:58.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.486+0000 7fe4860c2700 1 -- 172.21.15.125:0/3727696951 wait complete. 2023-10-17T06:22:58.497 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-17T06:22:58.519 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":533,"stamp":"2023-10-17T06:22:58.325935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223128,"kb_used_data":6380,"kb_used_omap":24,"kb_used_meta":216615,"kb_avail":754751592,"statfs":{"total":773094113280,"available":772865630208,"internally_reserved":0,"allocated":6533120,"data_stored":3730220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24831,"internal_metadata":221814529},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13419,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-66,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.981535"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:22:54.878932+0000","last_change":"2023-10-17T06:07:02.749481+0000","last_active":"2023-10-17T06:22:54.878932+0000","last_peered":"2023-10-17T06:22:54.878932+0000","last_clean":"2023-10-17T06:22:54.878932+0000","last_became_active":"2023-10-17T06:07:02.748983+0000","last_became_peered":"2023-10-17T06:07:02.748983+0000","last_unstale":"2023-10-17T06:22:54.878932+0000","last_undegraded":"2023-10-17T06:22:54.878932+0000","last_fullsized":"2023-10-17T06:22:54.878932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:23:44.065030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":84,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-17T06:22:53.611469+0000","last_change":"2023-10-17T06:07:02.746809+0000","last_active":"2023-10-17T06:22:53.611469+0000","last_peered":"2023-10-17T06:22:53.611469+0000","last_clean":"2023-10-17T06:22:53.611469+0000","last_became_active":"2023-10-17T06:07:02.746404+0000","last_became_peered":"2023-10-17T06:07:02.746404+0000","last_unstale":"2023-10-17T06:22:53.611469+0000","last_undegraded":"2023-10-17T06:22:53.611469+0000","last_fullsized":"2023-10-17T06:22:53.611469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:47:09.774009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":90,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-17T06:22:53.683252+0000","last_change":"2023-10-17T06:07:02.943274+0000","last_active":"2023-10-17T06:22:53.683252+0000","last_peered":"2023-10-17T06:22:53.683252+0000","last_clean":"2023-10-17T06:22:53.683252+0000","last_became_active":"2023-10-17T06:07:02.942674+0000","last_became_peered":"2023-10-17T06:07:02.942674+0000","last_unstale":"2023-10-17T06:22:53.683252+0000","last_undegraded":"2023-10-17T06:22:53.683252+0000","last_fullsized":"2023-10-17T06:22:53.683252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:46:44.391983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":84,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-17T06:22:53.610311+0000","last_change":"2023-10-17T06:07:02.943009+0000","last_active":"2023-10-17T06:22:53.610311+0000","last_peered":"2023-10-17T06:22:53.610311+0000","last_clean":"2023-10-17T06:22:53.610311+0000","last_became_active":"2023-10-17T06:07:02.942298+0000","last_became_peered":"2023-10-17T06:07:02.942298+0000","last_unstale":"2023-10-17T06:22:53.610311+0000","last_undegraded":"2023-10-17T06:22:53.610311+0000","last_fullsized":"2023-10-17T06:22:53.610311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:32:49.773674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":88,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:22:54.370213+0000","last_change":"2023-10-17T06:07:02.747287+0000","last_active":"2023-10-17T06:22:54.370213+0000","last_peered":"2023-10-17T06:22:54.370213+0000","last_clean":"2023-10-17T06:22:54.370213+0000","last_became_active":"2023-10-17T06:07:02.746659+0000","last_became_peered":"2023-10-17T06:07:02.746659+0000","last_unstale":"2023-10-17T06:22:54.370213+0000","last_undegraded":"2023-10-17T06:22:54.370213+0000","last_fullsized":"2023-10-17T06:22:54.370213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:23:13.558569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-17T06:22:53.682378+0000","last_change":"2023-10-17T06:16:02.426582+0000","last_active":"2023-10-17T06:22:53.682378+0000","last_peered":"2023-10-17T06:22:53.682378+0000","last_clean":"2023-10-17T06:22:53.682378+0000","last_became_active":"2023-10-17T06:16:02.425947+0000","last_became_peered":"2023-10-17T06:16:02.425947+0000","last_unstale":"2023-10-17T06:22:53.682378+0000","last_undegraded":"2023-10-17T06:22:53.682378+0000","last_fullsized":"2023-10-17T06:22:53.682378+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:58:17.427886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":90,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-17T06:22:53.680630+0000","last_change":"2023-10-17T06:07:02.746953+0000","last_active":"2023-10-17T06:22:53.680630+0000","last_peered":"2023-10-17T06:22:53.680630+0000","last_clean":"2023-10-17T06:22:53.680630+0000","last_became_active":"2023-10-17T06:07:02.746344+0000","last_became_peered":"2023-10-17T06:07:02.746344+0000","last_unstale":"2023-10-17T06:22:53.680630+0000","last_undegraded":"2023-10-17T06:22:53.680630+0000","last_fullsized":"2023-10-17T06:22:53.680630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:41:51.226826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":88,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:22:54.373452+0000","last_change":"2023-10-17T06:07:02.747957+0000","last_active":"2023-10-17T06:22:54.373452+0000","last_peered":"2023-10-17T06:22:54.373452+0000","last_clean":"2023-10-17T06:22:54.373452+0000","last_became_active":"2023-10-17T06:07:02.747569+0000","last_became_peered":"2023-10-17T06:07:02.747569+0000","last_unstale":"2023-10-17T06:22:54.373452+0000","last_undegraded":"2023-10-17T06:22:54.373452+0000","last_fullsized":"2023-10-17T06:22:54.373452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:29:49.927806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":246,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-17T06:22:53.681040+0000","last_change":"2023-10-17T06:06:55.916050+0000","last_active":"2023-10-17T06:22:53.681040+0000","last_peered":"2023-10-17T06:22:53.681040+0000","last_clean":"2023-10-17T06:22:53.681040+0000","last_became_active":"2023-10-17T06:06:55.914009+0000","last_became_peered":"2023-10-17T06:06:55.914009+0000","last_unstale":"2023-10-17T06:22:53.681040+0000","last_undegraded":"2023-10-17T06:22:53.681040+0000","last_fullsized":"2023-10-17T06:22:53.681040+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:06:54.658926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:06:54.658926+0000","last_clean_scrub_stamp":"2023-10-17T06:06:54.658926+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:47:30.458420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509634,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":663552,"data_stored":317980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1240000000000001,"15min":1.111},"min":{"1min":0.69499999999999995,"5min":0.69399999999999995,"15min":0.41799999999999998},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5840000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.1719999999999999,"15min":1.1419999999999999},"min":{"1min":0.86899999999999999,"5min":0.76800000000000002,"15min":0.74199999999999999},"max":{"1min":1.635,"5min":1.79,"15min":1.79},"last":1.552}]},{"osd":1,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.181,"15min":1.149},"min":{"1min":0.83499999999999996,"5min":0.80900000000000005,"15min":0.71599999999999997},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.698},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.282,"5min":1.1899999999999999,"15min":1.1719999999999999},"min":{"1min":0.90800000000000003,"5min":0.77200000000000002,"15min":0.75},"max":{"1min":1.6080000000000001,"5min":1.625,"15min":1.73},"last":0.99099999999999999}]},{"osd":2,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.212,"15min":1.181},"min":{"1min":0.84199999999999997,"5min":0.80300000000000005,"15min":0.70599999999999996},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.8360000000000001},"last":1.405},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2310000000000001,"15min":1.21},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.617,"5min":1.655,"15min":1.744},"last":1.212}]},{"osd":3,"last update":"Tue Oct 17 06:22:17 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.2490000000000001,"15min":1.2250000000000001},"min":{"1min":0.97799999999999998,"5min":0.871,"15min":0.66700000000000004},"max":{"1min":1.639,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.083},{"interface":"front","average":{"1min":1.369,"5min":1.3169999999999999,"15min":1.306},"min":{"1min":1.081,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.732,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.294}]},{"osd":4,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.153,"15min":1.153},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.56100000000000005},"max":{"1min":1.5049999999999999,"5min":1.6759999999999999,"15min":2.2349999999999999},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.226,"15min":1.2230000000000001},"min":{"1min":0.82999999999999996,"5min":0.67100000000000004,"15min":0.624},"max":{"1min":1.694,"5min":1.891,"15min":2.0030000000000001},"last":1.879}]},{"osd":5,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.2070000000000001,"15min":1.228},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5660000000000001,"5min":1.6240000000000001,"15min":2.113},"last":1.51},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.411,"15min":1.395},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.51800000000000002},"max":{"1min":1.7390000000000001,"5min":1.8340000000000001,"15min":1.988},"last":1.446}]},{"osd":7,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.365,"15min":1.3480000000000001},"min":{"1min":0.92900000000000005,"5min":0.79000000000000004,"15min":0.61899999999999999},"max":{"1min":1.712,"5min":1.9790000000000001,"15min":2.157},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.329,"15min":1.3280000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.60799999999999998},"max":{"1min":1.7749999999999999,"5min":1.8620000000000001,"15min":2.1989999999999998},"last":1.5780000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509635,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":325505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1679999999999999,"15min":1.151},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.63700000000000001},"max":{"1min":1.5229999999999999,"5min":1.677,"15min":1.6799999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.2110000000000001,"15min":1.1870000000000001},"min":{"1min":0.79600000000000004,"5min":0.70599999999999996,"15min":0.66000000000000003},"max":{"1min":1.49,"5min":1.726,"15min":5.2919999999999998},"last":1.3320000000000001}]},{"osd":1,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.1799999999999999,"15min":1.1579999999999999},"min":{"1min":0.86499999999999999,"5min":0.66500000000000004,"15min":0.55400000000000005},"max":{"1min":1.427,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.482},{"interface":"front","average":{"1min":1.222,"5min":1.2490000000000001,"15min":1.2090000000000001},"min":{"1min":0.97499999999999998,"5min":0.74299999999999999,"15min":0.68999999999999995},"max":{"1min":1.6220000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.4019999999999999}]},{"osd":2,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.238,"15min":1.2290000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.66100000000000003},"max":{"1min":1.607,"5min":1.7070000000000001,"15min":5.3700000000000001},"last":1.157},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2250000000000001,"15min":1.2310000000000001},"min":{"1min":0.96199999999999997,"5min":0.76200000000000001,"15min":0.60199999999999998},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":2.2080000000000002},"last":1.2649999999999999}]},{"osd":3,"last update":"Tue Oct 17 06:22:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2589999999999999,"15min":1.28},"min":{"1min":0.85399999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.71,"5min":1.794,"15min":1.794},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.298,"15min":1.3009999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.5820000000000001,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.0760000000000001}]},{"osd":4,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.216,"15min":1.204},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.55800000000000005},"max":{"1min":1.6240000000000001,"5min":1.679,"15min":2.653},"last":1.6759999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2470000000000001,"15min":1.2370000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":3.3820000000000001},"last":1.444}]},{"osd":6,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.169,"15min":1.2230000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.494,"5min":1.851,"15min":2.7879999999999998},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.73599999999999999,"5min":0.68799999999999994,"15min":0.623},"max":{"1min":1.569,"5min":1.861,"15min":2.702},"last":1.595}]},{"osd":7,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.369,"15min":1.3460000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.669,"5min":1.827,"15min":2.544},"last":1.53},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.327,"15min":1.3779999999999999},"min":{"1min":0.98799999999999999,"5min":0.73099999999999998,"15min":0.70999999999999996},"max":{"1min":1.5549999999999999,"5min":1.738,"15min":2.8929999999999998},"last":1.6279999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":319190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.175,"15min":1.147},"min":{"1min":0.81899999999999995,"5min":0.64500000000000002,"15min":0.496},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6850000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1319999999999999,"15min":1.105},"min":{"1min":0.80800000000000005,"5min":0.71199999999999997,"15min":0.57699999999999996},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.5369999999999999},"last":1.1020000000000001}]},{"osd":1,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1870000000000001,"15min":1.159},"min":{"1min":0.754,"5min":0.73299999999999998,"15min":0.70199999999999996},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7270000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2350000000000001,"15min":1.224},"min":{"1min":1.0109999999999999,"5min":0.747,"15min":0.66400000000000003},"max":{"1min":1.901,"5min":1.901,"15min":1.9910000000000001},"last":0.90300000000000002}]},{"osd":2,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.206,"15min":1.2},"min":{"1min":0.93600000000000005,"5min":0.70399999999999996,"15min":0.66800000000000004},"max":{"1min":1.488,"5min":1.694,"15min":1.903},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.28,"15min":1.2549999999999999},"min":{"1min":0.94799999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.635,"5min":1.7130000000000001,"15min":1.847},"last":1.121}]},{"osd":3,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.278,"15min":1.306},"min":{"1min":0.86399999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.417,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.373,"5min":1.339,"15min":1.3819999999999999},"min":{"1min":1.034,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.069}]},{"osd":5,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.2490000000000001,"15min":1.2230000000000001},"min":{"1min":0.85899999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6459999999999999,"5min":1.702,"15min":2.25},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.091,"15min":1.1259999999999999},"min":{"1min":0.81699999999999995,"5min":0.627,"15min":0.627},"max":{"1min":1.4379999999999999,"5min":1.667,"15min":2.024},"last":0.64700000000000002}]},{"osd":6,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.212,"15min":1.2230000000000001},"min":{"1min":0.872,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5409999999999999,"5min":1.7509999999999999,"15min":3.2120000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.403,"15min":1.3660000000000001},"min":{"1min":0.83299999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.764,"5min":1.7729999999999999,"15min":2.1099999999999999},"last":0.58399999999999996}]},{"osd":7,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.206,"15min":1.244},"min":{"1min":0.80500000000000005,"5min":0.434,"15min":0.434},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.913},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3740000000000001,"15min":1.381},"min":{"1min":1.1040000000000001,"5min":0.622,"15min":0.622},"max":{"1min":1.6519999999999999,"5min":1.9670000000000001,"15min":2.3079999999999998},"last":0.68799999999999994}]}]},{"osd":7,"up_from":14,"seq":60129542338,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1261568,"data_stored":909558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2010000000000001,"15min":1.1639999999999999},"min":{"1min":0.85299999999999998,"5min":0.73299999999999998,"15min":0.68600000000000005},"max":{"1min":1.4119999999999999,"5min":1.6240000000000001,"15min":1.9890000000000001},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.276,"5min":1.1839999999999999,"15min":1.1419999999999999},"min":{"1min":0.96899999999999997,"5min":0.79000000000000004,"15min":0.54900000000000004},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.718},"last":1.3759999999999999}]},{"osd":1,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.1899999999999999,"15min":1.161},"min":{"1min":0.98499999999999999,"5min":0.78000000000000003,"15min":0.54900000000000004},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":5.0519999999999996},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2350000000000001,"15min":1.208},"min":{"1min":0.90600000000000003,"5min":0.82899999999999996,"15min":0.67800000000000005},"max":{"1min":1.6539999999999999,"5min":1.7430000000000001,"15min":2.2109999999999999},"last":1.151}]},{"osd":2,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.329,"15min":1.284},"min":{"1min":1.1519999999999999,"5min":0.71199999999999997,"15min":0.64700000000000002},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":2.1739999999999999},"last":1.03},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.21,"15min":1.208},"min":{"1min":0.95399999999999996,"5min":0.80400000000000005,"15min":0.73699999999999999},"max":{"1min":1.5580000000000001,"5min":1.6519999999999999,"15min":1.7250000000000001},"last":0.96799999999999997}]},{"osd":3,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.254,"15min":1.2709999999999999},"min":{"1min":1.014,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.55,"5min":1.617,"15min":1.617},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3360000000000001,"15min":1.345},"min":{"1min":1.254,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.5840000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.4319999999999999}]},{"osd":4,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.1950000000000001,"15min":1.204},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.57399999999999995},"max":{"1min":1.625,"5min":1.6779999999999999,"15min":1.857},"last":1.345},{"interface":"front","average":{"1min":1.097,"5min":1.175,"15min":1.1930000000000001},"min":{"1min":0.78000000000000003,"5min":0.70799999999999996,"15min":0.67000000000000004},"max":{"1min":1.661,"5min":1.843,"15min":2.1499999999999999},"last":1.2190000000000001}]},{"osd":5,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.258,"15min":1.194},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.45900000000000002},"max":{"1min":1.5549999999999999,"5min":1.6919999999999999,"15min":1.895},"last":1.554},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.371,"15min":1.373},"min":{"1min":1.121,"5min":0.95699999999999996,"15min":0.78800000000000003},"max":{"1min":1.702,"5min":1.802,"15min":2.1139999999999999},"last":1.8620000000000001}]},{"osd":6,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.3129999999999999,"15min":1.327},"min":{"1min":0.88900000000000001,"5min":0.83999999999999997,"15min":0.69199999999999995},"max":{"1min":1.6659999999999999,"5min":1.7290000000000001,"15min":2.218},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.4139999999999999,"15min":1.3440000000000001},"min":{"1min":0.92500000000000004,"5min":0.81499999999999995,"15min":0.71299999999999997},"max":{"1min":1.6619999999999999,"5min":1.748,"15min":1.9710000000000001},"last":1.5049999999999999}]}]},{"osd":3,"up_from":54,"seq":231928234068,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":668,"kb_used_omap":12,"kb_used_meta":27571,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":684032,"data_stored":325505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12364,"internal_metadata":28233652},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88100000000000001,"15min":0.89800000000000002},"min":{"1min":0.61299999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2789999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.92600000000000005,"15min":0.95599999999999996},"min":{"1min":0.76800000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.2529999999999999,"5min":1.482,"15min":1.482},"last":1.0409999999999999}]},{"osd":1,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.98899999999999999,"15min":1.0329999999999999},"min":{"1min":0.71499999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.238,"5min":1.458,"15min":1.458},"last":1},{"interface":"front","average":{"1min":1.032,"5min":1.044,"15min":1.0649999999999999},"min":{"1min":0.78200000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.3440000000000001,"5min":1.4770000000000001,"15min":1.4850000000000001},"last":1.3140000000000001}]},{"osd":2,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.21,"15min":1.2410000000000001},"min":{"1min":0.81899999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.623,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0009999999999999,"15min":0.97799999999999998},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.67000000000000004},"max":{"1min":1.339,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.274}]},{"osd":4,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.228,"15min":1.3260000000000001},"min":{"1min":1.028,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.4239999999999999,"5min":1.5649999999999999,"15min":1.78},"last":1.409},{"interface":"front","average":{"1min":1.3,"5min":1.3240000000000001,"15min":1.377},"min":{"1min":1.0600000000000001,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":1.5549999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.4299999999999999}]},{"osd":5,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2929999999999999,"15min":1.3620000000000001},"min":{"1min":1.03,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.518,"5min":1.607,"15min":1.849},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.373,"15min":1.425},"min":{"1min":1.0800000000000001,"5min":1.012,"15min":1.012},"max":{"1min":1.581,"5min":1.962,"15min":1.962},"last":1.5069999999999999}]},{"osd":6,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2150000000000001,"15min":1.246},"min":{"1min":1.028,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.492,"5min":1.629,"15min":1.8120000000000001},"last":1.167},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.454,"15min":1.4730000000000001},"min":{"1min":1.2709999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":1.766,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.472}]},{"osd":7,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.3799999999999999,"15min":1.4079999999999999},"min":{"1min":1.1830000000000001,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.7010000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.476,"5min":1.5109999999999999,"15min":1.5629999999999999},"min":{"1min":1.248,"5min":1.1899999999999999,"15min":1.1899999999999999},"max":{"1min":1.6639999999999999,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.375}]}]},{"osd":2,"up_from":14,"seq":60129542339,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":667648,"data_stored":319190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.86499999999999999,"15min":0.83699999999999997},"min":{"1min":0.623,"5min":0.54300000000000004,"15min":0.35899999999999999},"max":{"1min":1.2170000000000001,"5min":1.3979999999999999,"15min":1.409},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.93899999999999995,"15min":0.93000000000000005},"min":{"1min":0.69499999999999995,"5min":0.56000000000000005,"15min":0.39200000000000002},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.881},"last":0.92100000000000004}]},{"osd":1,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.96299999999999997,"15min":0.94999999999999996},"min":{"1min":0.77700000000000002,"5min":0.57999999999999996,"15min":0.40400000000000003},"max":{"1min":1.474,"5min":1.5489999999999999,"15min":1.605},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0389999999999999,"15min":1.0309999999999999},"min":{"1min":0.80200000000000005,"5min":0.69499999999999995,"15min":0.49399999999999999},"max":{"1min":1.482,"5min":1.482,"15min":2.1440000000000001},"last":1.157}]},{"osd":3,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.143,"15min":1.181},"min":{"1min":0.89800000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.335,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.1279999999999999,"15min":1.1100000000000001},"min":{"1min":0.875,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4099999999999999,"5min":1.573,"15min":1.573},"last":1.393}]},{"osd":4,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.327,"15min":1.3180000000000001},"min":{"1min":1.004,"5min":1.004,"15min":0.70299999999999996},"max":{"1min":1.7070000000000001,"5min":1.756,"15min":2.3719999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.135,"5min":1.2030000000000001,"15min":1.2250000000000001},"min":{"1min":0.96099999999999997,"5min":0.92700000000000005,"15min":0.81899999999999995},"max":{"1min":1.3220000000000001,"5min":1.8140000000000001,"15min":2.0579999999999998},"last":1.048}]},{"osd":5,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.3160000000000001,"15min":1.2689999999999999},"min":{"1min":1.0609999999999999,"5min":0.99299999999999999,"15min":0.63300000000000001},"max":{"1min":1.556,"5min":1.657,"15min":2.2650000000000001},"last":1.268},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3919999999999999,"15min":1.3580000000000001},"min":{"1min":1.204,"5min":1.0649999999999999,"15min":0.75900000000000001},"max":{"1min":1.4750000000000001,"5min":1.954,"15min":2.5190000000000001},"last":1.5629999999999999}]},{"osd":6,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2809999999999999,"15min":1.284},"min":{"1min":1.085,"5min":0.77000000000000002,"15min":0.76900000000000002},"max":{"1min":1.4950000000000001,"5min":1.841,"15min":2.2109999999999999},"last":1.341},{"interface":"front","average":{"1min":1.367,"5min":1.3640000000000001,"15min":1.3400000000000001},"min":{"1min":1.212,"5min":0.90800000000000003,"15min":0.64100000000000001},"max":{"1min":1.5700000000000001,"5min":1.7849999999999999,"15min":2.1720000000000002},"last":0.99199999999999999}]},{"osd":7,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4530000000000001,"15min":1.4350000000000001},"min":{"1min":1.246,"5min":1.054,"15min":0.80800000000000005},"max":{"1min":1.6419999999999999,"5min":1.8640000000000001,"15min":2.9809999999999999},"last":1.736},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3600000000000001,"15min":1.3500000000000001},"min":{"1min":1.194,"5min":1.036,"15min":0.65100000000000002},"max":{"1min":1.607,"5min":1.728,"15min":2.1379999999999999},"last":1.52}]}]},{"osd":1,"up_from":14,"seq":60129542339,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":659456,"data_stored":312526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86399999999999999,"15min":0.88},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.34100000000000003},"max":{"1min":1.1299999999999999,"5min":1.28,"15min":1.6659999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0309999999999999,"15min":0.999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.505},"max":{"1min":1.3640000000000001,"5min":1.367,"15min":2.169},"last":0.72799999999999998}]},{"osd":2,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.98299999999999998,"15min":0.95799999999999996},"min":{"1min":0.75700000000000001,"5min":0.54700000000000004,"15min":0.40500000000000003},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":2.7789999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.93100000000000005,"15min":0.90200000000000002},"min":{"1min":0.68899999999999995,"5min":0.495,"15min":0.44},"max":{"1min":1.298,"5min":1.5169999999999999,"15min":2.468},"last":0.69599999999999995}]},{"osd":3,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0349999999999999,"15min":1.0589999999999999},"min":{"1min":0.745,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.3109999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.028,"15min":1.028},"min":{"1min":0.68700000000000006,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.306,"5min":1.5740000000000001,"15min":1.6339999999999999},"last":0.52300000000000002}]},{"osd":4,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.268,"15min":1.2470000000000001},"min":{"1min":0.93999999999999995,"5min":0.90300000000000002,"15min":0.745},"max":{"1min":1.5389999999999999,"5min":1.671,"15min":2.2000000000000002},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.159,"5min":1.2470000000000001,"15min":1.2410000000000001},"min":{"1min":0.89000000000000001,"5min":0.86299999999999999,"15min":0.503},"max":{"1min":1.3819999999999999,"5min":1.675,"15min":2.871},"last":0.95799999999999996}]},{"osd":5,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.278,"15min":1.2689999999999999},"min":{"1min":1.044,"5min":0.86299999999999999,"15min":0.54100000000000004},"max":{"1min":1.4830000000000001,"5min":1.7350000000000001,"15min":3.032},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.262,"15min":1.2529999999999999},"min":{"1min":0.95599999999999996,"5min":0.81100000000000005,"15min":0.58799999999999997},"max":{"1min":1.504,"5min":1.6120000000000001,"15min":4.819},"last":1.0389999999999999}]},{"osd":6,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2929999999999999,"15min":1.284},"min":{"1min":1.0580000000000001,"5min":0.91000000000000003,"15min":0.68200000000000005},"max":{"1min":1.488,"5min":1.6319999999999999,"15min":4.9900000000000002},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.331,"15min":1.304},"min":{"1min":1.034,"5min":0.93000000000000005,"15min":0.874},"max":{"1min":1.5980000000000001,"5min":1.8280000000000001,"15min":2.8159999999999998},"last":1.0009999999999999}]},{"osd":7,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.397,"15min":1.3879999999999999},"min":{"1min":1.028,"5min":1.028,"15min":0.84399999999999997},"max":{"1min":1.5840000000000001,"5min":1.9059999999999999,"15min":2.677},"last":1.079},{"interface":"front","average":{"1min":1.397,"5min":1.4159999999999999,"15min":1.393},"min":{"1min":1.2110000000000001,"5min":1.0409999999999999,"15min":0.65400000000000003},"max":{"1min":1.607,"5min":1.9019999999999999,"15min":2.9529999999999998},"last":1.0189999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542339,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1245184,"data_stored":900766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.83199999999999996,"15min":0.81899999999999995},"min":{"1min":0.67100000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.615},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.92800000000000005,"15min":0.89200000000000002},"min":{"1min":0.71499999999999997,"5min":0.61799999999999999,"15min":0.33500000000000002},"max":{"1min":1.391,"5min":1.6020000000000001,"15min":2.3340000000000001},"last":0.59599999999999997}]},{"osd":2,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.175,"15min":1.151},"min":{"1min":0.78500000000000003,"5min":0.59499999999999997,"15min":0.55500000000000005},"max":{"1min":1.589,"5min":1.7889999999999999,"15min":4.407},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.97999999999999998,"15min":0.97299999999999998},"min":{"1min":0.55900000000000005,"5min":0.52300000000000002,"15min":0.42499999999999999},"max":{"1min":1.52,"5min":1.6559999999999999,"15min":2.5659999999999998},"last":1.2509999999999999}]},{"osd":3,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.995,"15min":1},"min":{"1min":0.71499999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3360000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.069,"15min":1.1180000000000001},"min":{"1min":0.63500000000000001,"5min":0.622,"15min":0.622},"max":{"1min":1.452,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.86399999999999999}]},{"osd":4,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1919999999999999,"15min":1.1890000000000001},"min":{"1min":0.97299999999999998,"5min":0.88100000000000001,"15min":0.67200000000000004},"max":{"1min":1.3819999999999999,"5min":1.996,"15min":3.4820000000000002},"last":1.127},{"interface":"front","average":{"1min":1.194,"5min":1.224,"15min":1.232},"min":{"1min":1.0349999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.458,"5min":1.758,"15min":3.8079999999999998},"last":0.90400000000000003}]},{"osd":5,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2649999999999999,"15min":1.2569999999999999},"min":{"1min":1.048,"5min":0.79800000000000004,"15min":0.748},"max":{"1min":1.4299999999999999,"5min":1.8360000000000001,"15min":3.2120000000000002},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.337,"15min":1.3120000000000001},"min":{"1min":1.0740000000000001,"5min":0.91100000000000003,"15min":0.85699999999999998},"max":{"1min":1.585,"5min":1.7849999999999999,"15min":4.3849999999999998},"last":0.92700000000000005}]},{"osd":6,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3759999999999999,"15min":1.3540000000000001},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.79100000000000004},"max":{"1min":1.522,"5min":1.873,"15min":4.3499999999999996},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.274,"15min":1.2569999999999999},"min":{"1min":1.0569999999999999,"5min":0.92600000000000005,"15min":0.61799999999999999},"max":{"1min":1.484,"5min":1.859,"15min":1.925},"last":1.014}]},{"osd":7,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3640000000000001,"15min":1.361},"min":{"1min":0.99399999999999999,"5min":0.97599999999999998,"15min":0.73499999999999999},"max":{"1min":1.5629999999999999,"5min":1.9430000000000001,"15min":2.0840000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.415,"15min":1.403},"min":{"1min":1.27,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.5680000000000001,"5min":1.887,"15min":2.7410000000000001},"last":1.331}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-17T06:22:58.521 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-17T06:22:58.521 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-17T06:22:58.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.690+0000 7efd2ed97700 1 Processor -- start 2023-10-17T06:22:58.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.694+0000 7efd2ed97700 1 -- start start 2023-10-17T06:22:58.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.694+0000 7efd2ed97700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd280b3d40 0x7efd280cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:58.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.694+0000 7efd2ed97700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efd28164a20 0x7efd280c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:58.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.694+0000 7efd2ed97700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd280ca200 con 0x7efd2806ce20 2023-10-17T06:22:58.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.694+0000 7efd2ed97700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd2806e2d0 con 0x7efd28164a20 2023-10-17T06:22:58.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.694+0000 7efd2ed97700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd280ca4c0 con 0x7efd280b3d40 2023-10-17T06:22:58.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.694+0000 7efd2d594700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efd28164a20 0x7efd280c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:58.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.694+0000 7efd2dd95700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd280b3d40 0x7efd280cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:58.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.694+0000 7efd2d594700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efd28164a20 0x7efd280c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48568/0 (socket says 172.21.15.125:48568) 2023-10-17T06:22:58.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.694+0000 7efd2d594700 1 -- 172.21.15.125:0/1829018112 learned_addr learned my addr 172.21.15.125:0/1829018112 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:58.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.694+0000 7efd2dd95700 1 -- 172.21.15.125:0/1829018112 >> v2:172.21.15.125:3300/0 conn(0x7efd28164a20 msgr2=0x7efd280c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:58.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.694+0000 7efd2dd95700 1 --2- 172.21.15.125:0/1829018112 >> v2:172.21.15.125:3300/0 conn(0x7efd28164a20 0x7efd280c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.694+0000 7efd2dd95700 1 -- 172.21.15.125:0/1829018112 >> v1:172.21.15.184:6789/0 conn(0x7efd2806ce20 legacy=0x7efd2806f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:58.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.694+0000 7efd2dd95700 1 -- 172.21.15.125:0/1829018112 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd280ca7a0 con 0x7efd280b3d40 2023-10-17T06:22:58.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.698+0000 7efd2dd95700 1 --2- 172.21.15.125:0/1829018112 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd280b3d40 0x7efd280cc190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efd24009850 tx=0x7efd24009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=395e6f9e686b1d76 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:58.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.698+0000 7efd2cd93700 1 -- 172.21.15.125:0/1829018112 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24011830 con 0x7efd280b3d40 2023-10-17T06:22:58.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.698+0000 7efd2cd93700 1 -- 172.21.15.125:0/1829018112 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd24011990 con 0x7efd280b3d40 2023-10-17T06:22:58.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.698+0000 7efd2cd93700 1 -- 172.21.15.125:0/1829018112 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24011d40 con 0x7efd280b3d40 2023-10-17T06:22:58.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.698+0000 7efd2ed97700 1 -- 172.21.15.125:0/1829018112 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd280b3d40 msgr2=0x7efd280cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:58.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.698+0000 7efd2ed97700 1 --2- 172.21.15.125:0/1829018112 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd280b3d40 0x7efd280cc190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7efd24009850 tx=0x7efd24009b60 comp rx=0 tx=0).stop 2023-10-17T06:22:58.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.698+0000 7efd2ed97700 1 -- 172.21.15.125:0/1829018112 shutdown_connections 2023-10-17T06:22:58.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.698+0000 7efd2ed97700 1 --2- 172.21.15.125:0/1829018112 >> v2:172.21.15.125:3300/0 conn(0x7efd28164a20 0x7efd280c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.698+0000 7efd2ed97700 1 --2- 172.21.15.125:0/1829018112 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd280b3d40 0x7efd280cc190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.698+0000 7efd2ed97700 1 -- 172.21.15.125:0/1829018112 >> 172.21.15.125:0/1829018112 conn(0x7efd280ce5c0 msgr2=0x7efd280ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:58.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.698+0000 7efd2ed97700 1 -- 172.21.15.125:0/1829018112 shutdown_connections 2023-10-17T06:22:58.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.698+0000 7efd2ed97700 1 -- 172.21.15.125:0/1829018112 wait complete. 2023-10-17T06:22:58.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.702+0000 7efd2ed97700 1 Processor -- start 2023-10-17T06:22:58.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.702+0000 7efd2ed97700 1 -- start start 2023-10-17T06:22:58.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.702+0000 7efd2ed97700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd2806ce20 0x7efd281564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:58.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.702+0000 7efd2ed97700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd280b3d40 0x7efd281ea4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:58.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.702+0000 7efd2ed97700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd28164a20 0x7efd28156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:58.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.702+0000 7efd2ed97700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd281f6730 con 0x7efd2806ce20 2023-10-17T06:22:58.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.702+0000 7efd2ed97700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd280c5690 con 0x7efd28164a20 2023-10-17T06:22:58.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.702+0000 7efd2ed97700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd28161370 con 0x7efd280b3d40 2023-10-17T06:22:58.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.702+0000 7efd2dd95700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd2806ce20 0x7efd281564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:58.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.702+0000 7efd2dd95700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd2806ce20 0x7efd281564a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48584/0 (socket says 172.21.15.125:48584) 2023-10-17T06:22:58.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.702+0000 7efd2dd95700 1 -- 172.21.15.125:0/3235512318 learned_addr learned my addr 172.21.15.125:0/3235512318 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:58.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.702+0000 7efd2e596700 1 --2- 172.21.15.125:0/3235512318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd28164a20 0x7efd28156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:58.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.702+0000 7efd2d594700 1 --2- 172.21.15.125:0/3235512318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd280b3d40 0x7efd281ea4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:58.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.702+0000 7efd2dd95700 1 -- 172.21.15.125:0/3235512318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd280b3d40 msgr2=0x7efd281ea4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:58.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.702+0000 7efd2dd95700 1 --2- 172.21.15.125:0/3235512318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd280b3d40 0x7efd281ea4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.702+0000 7efd2dd95700 1 -- 172.21.15.125:0/3235512318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd28164a20 msgr2=0x7efd28156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:58.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.702+0000 7efd2dd95700 1 --2- 172.21.15.125:0/3235512318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd28164a20 0x7efd28156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.702+0000 7efd2dd95700 1 -- 172.21.15.125:0/3235512318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd240094b0 con 0x7efd2806ce20 2023-10-17T06:22:58.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.702+0000 7efd2dd95700 1 --2- 172.21.15.125:0/3235512318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd2806ce20 0x7efd281564a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7efd280cf100 tx=0x7efd24004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:58.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.706+0000 7efd1e7fc700 1 -- 172.21.15.125:0/3235512318 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24004530 con 0x7efd2806ce20 2023-10-17T06:22:58.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.706+0000 7efd1e7fc700 1 -- 172.21.15.125:0/3235512318 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2401f070 con 0x7efd2806ce20 2023-10-17T06:22:58.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.706+0000 7efd2ed97700 1 -- 172.21.15.125:0/3235512318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd280b2780 con 0x7efd2806ce20 2023-10-17T06:22:58.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.706+0000 7efd1e7fc700 1 -- 172.21.15.125:0/3235512318 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24003900 con 0x7efd2806ce20 2023-10-17T06:22:58.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.706+0000 7efd2ed97700 1 -- 172.21.15.125:0/3235512318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd280c58e0 con 0x7efd2806ce20 2023-10-17T06:22:58.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.706+0000 7efd2ed97700 1 -- 172.21.15.125:0/3235512318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd28072e60 con 0x7efd2806ce20 2023-10-17T06:22:58.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.706+0000 7efd1e7fc700 1 -- 172.21.15.125:0/3235512318 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7efd24021030 con 0x7efd2806ce20 2023-10-17T06:22:58.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.710+0000 7efd1e7fc700 1 --2- 172.21.15.125:0/3235512318 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efd0c0656f0 0x7efd0c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:58.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.710+0000 7efd1e7fc700 1 -- 172.21.15.125:0/3235512318 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7efd24083fd0 con 0x7efd2806ce20 2023-10-17T06:22:58.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.710+0000 7efd2d594700 1 --2- 172.21.15.125:0/3235512318 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efd0c0656f0 0x7efd0c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:58.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.710+0000 7efd2d594700 1 --2- 172.21.15.125:0/3235512318 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efd0c0656f0 0x7efd0c067bb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efd280cb3e0 tx=0x7efd18008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:58.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.714+0000 7efd1e7fc700 1 -- 172.21.15.125:0/3235512318 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7efd24051dd0 con 0x7efd2806ce20 2023-10-17T06:22:58.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.882+0000 7efd2ed97700 1 -- 172.21.15.125:0/3235512318 --> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd280caa80 con 0x7efd0c0656f0 2023-10-17T06:22:58.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.890+0000 7efd1e7fc700 1 -- 172.21.15.125:0/3235512318 <== mgr.4107 v2:172.21.15.125:6832/2516570548 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70167 (secure 0 0 0) 0x7efd18011720 con 0x7efd0c0656f0 2023-10-17T06:22:58.898 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:22:58.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.894+0000 7efd2ed97700 1 -- 172.21.15.125:0/3235512318 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efd0c0656f0 msgr2=0x7efd0c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:58.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.894+0000 7efd2ed97700 1 --2- 172.21.15.125:0/3235512318 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efd0c0656f0 0x7efd0c067bb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efd280cb3e0 tx=0x7efd18008040 comp rx=0 tx=0).stop 2023-10-17T06:22:58.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.894+0000 7efd2ed97700 1 -- 172.21.15.125:0/3235512318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd2806ce20 msgr2=0x7efd281564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:58.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.894+0000 7efd2ed97700 1 --2- 172.21.15.125:0/3235512318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd2806ce20 0x7efd281564a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7efd280cf100 tx=0x7efd24004770 comp rx=0 tx=0).stop 2023-10-17T06:22:58.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.894+0000 7efd2ed97700 1 -- 172.21.15.125:0/3235512318 shutdown_connections 2023-10-17T06:22:58.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.894+0000 7efd2ed97700 1 --2- 172.21.15.125:0/3235512318 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7efd0c0656f0 0x7efd0c067bb0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.894+0000 7efd2ed97700 1 --2- 172.21.15.125:0/3235512318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efd28164a20 0x7efd28156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.894+0000 7efd2ed97700 1 --2- 172.21.15.125:0/3235512318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efd280b3d40 0x7efd281ea4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.894+0000 7efd2ed97700 1 --2- 172.21.15.125:0/3235512318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efd2806ce20 0x7efd281564a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:58.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.894+0000 7efd2ed97700 1 -- 172.21.15.125:0/3235512318 >> 172.21.15.125:0/3235512318 conn(0x7efd280ce5c0 msgr2=0x7efd281599d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:58.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.894+0000 7efd2ed97700 1 -- 172.21.15.125:0/3235512318 shutdown_connections 2023-10-17T06:22:58.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:58.894+0000 7efd2ed97700 1 -- 172.21.15.125:0/3235512318 wait complete. 2023-10-17T06:22:58.904 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-17T06:22:58.923 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":533,"stamp":"2023-10-17T06:22:58.325935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223128,"kb_used_data":6380,"kb_used_omap":24,"kb_used_meta":216615,"kb_avail":754751592,"statfs":{"total":773094113280,"available":772865630208,"internally_reserved":0,"allocated":6533120,"data_stored":3730220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24831,"internal_metadata":221814529},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13419,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-66,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.981535"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:22:54.878932+0000","last_change":"2023-10-17T06:07:02.749481+0000","last_active":"2023-10-17T06:22:54.878932+0000","last_peered":"2023-10-17T06:22:54.878932+0000","last_clean":"2023-10-17T06:22:54.878932+0000","last_became_active":"2023-10-17T06:07:02.748983+0000","last_became_peered":"2023-10-17T06:07:02.748983+0000","last_unstale":"2023-10-17T06:22:54.878932+0000","last_undegraded":"2023-10-17T06:22:54.878932+0000","last_fullsized":"2023-10-17T06:22:54.878932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:23:44.065030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":84,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-17T06:22:53.611469+0000","last_change":"2023-10-17T06:07:02.746809+0000","last_active":"2023-10-17T06:22:53.611469+0000","last_peered":"2023-10-17T06:22:53.611469+0000","last_clean":"2023-10-17T06:22:53.611469+0000","last_became_active":"2023-10-17T06:07:02.746404+0000","last_became_peered":"2023-10-17T06:07:02.746404+0000","last_unstale":"2023-10-17T06:22:53.611469+0000","last_undegraded":"2023-10-17T06:22:53.611469+0000","last_fullsized":"2023-10-17T06:22:53.611469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T11:47:09.774009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":90,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-17T06:22:53.683252+0000","last_change":"2023-10-17T06:07:02.943274+0000","last_active":"2023-10-17T06:22:53.683252+0000","last_peered":"2023-10-17T06:22:53.683252+0000","last_clean":"2023-10-17T06:22:53.683252+0000","last_became_active":"2023-10-17T06:07:02.942674+0000","last_became_peered":"2023-10-17T06:07:02.942674+0000","last_unstale":"2023-10-17T06:22:53.683252+0000","last_undegraded":"2023-10-17T06:22:53.683252+0000","last_fullsized":"2023-10-17T06:22:53.683252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:46:44.391983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":84,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-17T06:22:53.610311+0000","last_change":"2023-10-17T06:07:02.943009+0000","last_active":"2023-10-17T06:22:53.610311+0000","last_peered":"2023-10-17T06:22:53.610311+0000","last_clean":"2023-10-17T06:22:53.610311+0000","last_became_active":"2023-10-17T06:07:02.942298+0000","last_became_peered":"2023-10-17T06:07:02.942298+0000","last_unstale":"2023-10-17T06:22:53.610311+0000","last_undegraded":"2023-10-17T06:22:53.610311+0000","last_fullsized":"2023-10-17T06:22:53.610311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:32:49.773674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":88,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:22:54.370213+0000","last_change":"2023-10-17T06:07:02.747287+0000","last_active":"2023-10-17T06:22:54.370213+0000","last_peered":"2023-10-17T06:22:54.370213+0000","last_clean":"2023-10-17T06:22:54.370213+0000","last_became_active":"2023-10-17T06:07:02.746659+0000","last_became_peered":"2023-10-17T06:07:02.746659+0000","last_unstale":"2023-10-17T06:22:54.370213+0000","last_undegraded":"2023-10-17T06:22:54.370213+0000","last_fullsized":"2023-10-17T06:22:54.370213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:23:13.558569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-17T06:22:53.682378+0000","last_change":"2023-10-17T06:16:02.426582+0000","last_active":"2023-10-17T06:22:53.682378+0000","last_peered":"2023-10-17T06:22:53.682378+0000","last_clean":"2023-10-17T06:22:53.682378+0000","last_became_active":"2023-10-17T06:16:02.425947+0000","last_became_peered":"2023-10-17T06:16:02.425947+0000","last_unstale":"2023-10-17T06:22:53.682378+0000","last_undegraded":"2023-10-17T06:22:53.682378+0000","last_fullsized":"2023-10-17T06:22:53.682378+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:58:17.427886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":90,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-17T06:22:53.680630+0000","last_change":"2023-10-17T06:07:02.746953+0000","last_active":"2023-10-17T06:22:53.680630+0000","last_peered":"2023-10-17T06:22:53.680630+0000","last_clean":"2023-10-17T06:22:53.680630+0000","last_became_active":"2023-10-17T06:07:02.746344+0000","last_became_peered":"2023-10-17T06:07:02.746344+0000","last_unstale":"2023-10-17T06:22:53.680630+0000","last_undegraded":"2023-10-17T06:22:53.680630+0000","last_fullsized":"2023-10-17T06:22:53.680630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:41:51.226826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":88,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:22:54.373452+0000","last_change":"2023-10-17T06:07:02.747957+0000","last_active":"2023-10-17T06:22:54.373452+0000","last_peered":"2023-10-17T06:22:54.373452+0000","last_clean":"2023-10-17T06:22:54.373452+0000","last_became_active":"2023-10-17T06:07:02.747569+0000","last_became_peered":"2023-10-17T06:07:02.747569+0000","last_unstale":"2023-10-17T06:22:54.373452+0000","last_undegraded":"2023-10-17T06:22:54.373452+0000","last_fullsized":"2023-10-17T06:22:54.373452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:29:49.927806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":246,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-17T06:22:53.681040+0000","last_change":"2023-10-17T06:06:55.916050+0000","last_active":"2023-10-17T06:22:53.681040+0000","last_peered":"2023-10-17T06:22:53.681040+0000","last_clean":"2023-10-17T06:22:53.681040+0000","last_became_active":"2023-10-17T06:06:55.914009+0000","last_became_peered":"2023-10-17T06:06:55.914009+0000","last_unstale":"2023-10-17T06:22:53.681040+0000","last_undegraded":"2023-10-17T06:22:53.681040+0000","last_fullsized":"2023-10-17T06:22:53.681040+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:06:54.658926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:06:54.658926+0000","last_clean_scrub_stamp":"2023-10-17T06:06:54.658926+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:47:30.458420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509634,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":663552,"data_stored":317980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1240000000000001,"15min":1.111},"min":{"1min":0.69499999999999995,"5min":0.69399999999999995,"15min":0.41799999999999998},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5840000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.1719999999999999,"15min":1.1419999999999999},"min":{"1min":0.86899999999999999,"5min":0.76800000000000002,"15min":0.74199999999999999},"max":{"1min":1.635,"5min":1.79,"15min":1.79},"last":1.552}]},{"osd":1,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.181,"15min":1.149},"min":{"1min":0.83499999999999996,"5min":0.80900000000000005,"15min":0.71599999999999997},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.698},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.282,"5min":1.1899999999999999,"15min":1.1719999999999999},"min":{"1min":0.90800000000000003,"5min":0.77200000000000002,"15min":0.75},"max":{"1min":1.6080000000000001,"5min":1.625,"15min":1.73},"last":0.99099999999999999}]},{"osd":2,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.212,"15min":1.181},"min":{"1min":0.84199999999999997,"5min":0.80300000000000005,"15min":0.70599999999999996},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.8360000000000001},"last":1.405},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2310000000000001,"15min":1.21},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.617,"5min":1.655,"15min":1.744},"last":1.212}]},{"osd":3,"last update":"Tue Oct 17 06:22:17 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.2490000000000001,"15min":1.2250000000000001},"min":{"1min":0.97799999999999998,"5min":0.871,"15min":0.66700000000000004},"max":{"1min":1.639,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.083},{"interface":"front","average":{"1min":1.369,"5min":1.3169999999999999,"15min":1.306},"min":{"1min":1.081,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.732,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.294}]},{"osd":4,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.153,"15min":1.153},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.56100000000000005},"max":{"1min":1.5049999999999999,"5min":1.6759999999999999,"15min":2.2349999999999999},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.226,"15min":1.2230000000000001},"min":{"1min":0.82999999999999996,"5min":0.67100000000000004,"15min":0.624},"max":{"1min":1.694,"5min":1.891,"15min":2.0030000000000001},"last":1.879}]},{"osd":5,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.2070000000000001,"15min":1.228},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5660000000000001,"5min":1.6240000000000001,"15min":2.113},"last":1.51},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.411,"15min":1.395},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.51800000000000002},"max":{"1min":1.7390000000000001,"5min":1.8340000000000001,"15min":1.988},"last":1.446}]},{"osd":7,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.365,"15min":1.3480000000000001},"min":{"1min":0.92900000000000005,"5min":0.79000000000000004,"15min":0.61899999999999999},"max":{"1min":1.712,"5min":1.9790000000000001,"15min":2.157},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.329,"15min":1.3280000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.60799999999999998},"max":{"1min":1.7749999999999999,"5min":1.8620000000000001,"15min":2.1989999999999998},"last":1.5780000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509635,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":325505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1679999999999999,"15min":1.151},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.63700000000000001},"max":{"1min":1.5229999999999999,"5min":1.677,"15min":1.6799999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.2110000000000001,"15min":1.1870000000000001},"min":{"1min":0.79600000000000004,"5min":0.70599999999999996,"15min":0.66000000000000003},"max":{"1min":1.49,"5min":1.726,"15min":5.2919999999999998},"last":1.3320000000000001}]},{"osd":1,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.1799999999999999,"15min":1.1579999999999999},"min":{"1min":0.86499999999999999,"5min":0.66500000000000004,"15min":0.55400000000000005},"max":{"1min":1.427,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.482},{"interface":"front","average":{"1min":1.222,"5min":1.2490000000000001,"15min":1.2090000000000001},"min":{"1min":0.97499999999999998,"5min":0.74299999999999999,"15min":0.68999999999999995},"max":{"1min":1.6220000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.4019999999999999}]},{"osd":2,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.238,"15min":1.2290000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.66100000000000003},"max":{"1min":1.607,"5min":1.7070000000000001,"15min":5.3700000000000001},"last":1.157},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2250000000000001,"15min":1.2310000000000001},"min":{"1min":0.96199999999999997,"5min":0.76200000000000001,"15min":0.60199999999999998},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":2.2080000000000002},"last":1.2649999999999999}]},{"osd":3,"last update":"Tue Oct 17 06:22:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2589999999999999,"15min":1.28},"min":{"1min":0.85399999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.71,"5min":1.794,"15min":1.794},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.298,"15min":1.3009999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.5820000000000001,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.0760000000000001}]},{"osd":4,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.216,"15min":1.204},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.55800000000000005},"max":{"1min":1.6240000000000001,"5min":1.679,"15min":2.653},"last":1.6759999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2470000000000001,"15min":1.2370000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":3.3820000000000001},"last":1.444}]},{"osd":6,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.169,"15min":1.2230000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.494,"5min":1.851,"15min":2.7879999999999998},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.73599999999999999,"5min":0.68799999999999994,"15min":0.623},"max":{"1min":1.569,"5min":1.861,"15min":2.702},"last":1.595}]},{"osd":7,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.369,"15min":1.3460000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.669,"5min":1.827,"15min":2.544},"last":1.53},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.327,"15min":1.3779999999999999},"min":{"1min":0.98799999999999999,"5min":0.73099999999999998,"15min":0.70999999999999996},"max":{"1min":1.5549999999999999,"5min":1.738,"15min":2.8929999999999998},"last":1.6279999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509634,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27676,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":667648,"data_stored":319190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.175,"15min":1.147},"min":{"1min":0.81899999999999995,"5min":0.64500000000000002,"15min":0.496},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6850000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1319999999999999,"15min":1.105},"min":{"1min":0.80800000000000005,"5min":0.71199999999999997,"15min":0.57699999999999996},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.5369999999999999},"last":1.1020000000000001}]},{"osd":1,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1870000000000001,"15min":1.159},"min":{"1min":0.754,"5min":0.73299999999999998,"15min":0.70199999999999996},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7270000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2350000000000001,"15min":1.224},"min":{"1min":1.0109999999999999,"5min":0.747,"15min":0.66400000000000003},"max":{"1min":1.901,"5min":1.901,"15min":1.9910000000000001},"last":0.90300000000000002}]},{"osd":2,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.206,"15min":1.2},"min":{"1min":0.93600000000000005,"5min":0.70399999999999996,"15min":0.66800000000000004},"max":{"1min":1.488,"5min":1.694,"15min":1.903},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.28,"15min":1.2549999999999999},"min":{"1min":0.94799999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.635,"5min":1.7130000000000001,"15min":1.847},"last":1.121}]},{"osd":3,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.278,"15min":1.306},"min":{"1min":0.86399999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.417,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.373,"5min":1.339,"15min":1.3819999999999999},"min":{"1min":1.034,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.069}]},{"osd":5,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.2490000000000001,"15min":1.2230000000000001},"min":{"1min":0.85899999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6459999999999999,"5min":1.702,"15min":2.25},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.091,"15min":1.1259999999999999},"min":{"1min":0.81699999999999995,"5min":0.627,"15min":0.627},"max":{"1min":1.4379999999999999,"5min":1.667,"15min":2.024},"last":0.64700000000000002}]},{"osd":6,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.212,"15min":1.2230000000000001},"min":{"1min":0.872,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5409999999999999,"5min":1.7509999999999999,"15min":3.2120000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.403,"15min":1.3660000000000001},"min":{"1min":0.83299999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.764,"5min":1.7729999999999999,"15min":2.1099999999999999},"last":0.58399999999999996}]},{"osd":7,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.206,"15min":1.244},"min":{"1min":0.80500000000000005,"5min":0.434,"15min":0.434},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.913},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3740000000000001,"15min":1.381},"min":{"1min":1.1040000000000001,"5min":0.622,"15min":0.622},"max":{"1min":1.6519999999999999,"5min":1.9670000000000001,"15min":2.3079999999999998},"last":0.68799999999999994}]}]},{"osd":7,"up_from":14,"seq":60129542338,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28252,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343588,"statfs":{"total":96636764160,"available":96607834112,"internally_reserved":0,"allocated":1261568,"data_stored":909558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2010000000000001,"15min":1.1639999999999999},"min":{"1min":0.85299999999999998,"5min":0.73299999999999998,"15min":0.68600000000000005},"max":{"1min":1.4119999999999999,"5min":1.6240000000000001,"15min":1.9890000000000001},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.276,"5min":1.1839999999999999,"15min":1.1419999999999999},"min":{"1min":0.96899999999999997,"5min":0.79000000000000004,"15min":0.54900000000000004},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.718},"last":1.3759999999999999}]},{"osd":1,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.1899999999999999,"15min":1.161},"min":{"1min":0.98499999999999999,"5min":0.78000000000000003,"15min":0.54900000000000004},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":5.0519999999999996},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2350000000000001,"15min":1.208},"min":{"1min":0.90600000000000003,"5min":0.82899999999999996,"15min":0.67800000000000005},"max":{"1min":1.6539999999999999,"5min":1.7430000000000001,"15min":2.2109999999999999},"last":1.151}]},{"osd":2,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.329,"15min":1.284},"min":{"1min":1.1519999999999999,"5min":0.71199999999999997,"15min":0.64700000000000002},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":2.1739999999999999},"last":1.03},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.21,"15min":1.208},"min":{"1min":0.95399999999999996,"5min":0.80400000000000005,"15min":0.73699999999999999},"max":{"1min":1.5580000000000001,"5min":1.6519999999999999,"15min":1.7250000000000001},"last":0.96799999999999997}]},{"osd":3,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.254,"15min":1.2709999999999999},"min":{"1min":1.014,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.55,"5min":1.617,"15min":1.617},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3360000000000001,"15min":1.345},"min":{"1min":1.254,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.5840000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.4319999999999999}]},{"osd":4,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.1950000000000001,"15min":1.204},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.57399999999999995},"max":{"1min":1.625,"5min":1.6779999999999999,"15min":1.857},"last":1.345},{"interface":"front","average":{"1min":1.097,"5min":1.175,"15min":1.1930000000000001},"min":{"1min":0.78000000000000003,"5min":0.70799999999999996,"15min":0.67000000000000004},"max":{"1min":1.661,"5min":1.843,"15min":2.1499999999999999},"last":1.2190000000000001}]},{"osd":5,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.258,"15min":1.194},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.45900000000000002},"max":{"1min":1.5549999999999999,"5min":1.6919999999999999,"15min":1.895},"last":1.554},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.371,"15min":1.373},"min":{"1min":1.121,"5min":0.95699999999999996,"15min":0.78800000000000003},"max":{"1min":1.702,"5min":1.802,"15min":2.1139999999999999},"last":1.8620000000000001}]},{"osd":6,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.3129999999999999,"15min":1.327},"min":{"1min":0.88900000000000001,"5min":0.83999999999999997,"15min":0.69199999999999995},"max":{"1min":1.6659999999999999,"5min":1.7290000000000001,"15min":2.218},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.4139999999999999,"15min":1.3440000000000001},"min":{"1min":0.92500000000000004,"5min":0.81499999999999995,"15min":0.71299999999999997},"max":{"1min":1.6619999999999999,"5min":1.748,"15min":1.9710000000000001},"last":1.5049999999999999}]}]},{"osd":3,"up_from":54,"seq":231928234068,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":668,"kb_used_omap":12,"kb_used_meta":27571,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":684032,"data_stored":325505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12364,"internal_metadata":28233652},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88100000000000001,"15min":0.89800000000000002},"min":{"1min":0.61299999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2789999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.92600000000000005,"15min":0.95599999999999996},"min":{"1min":0.76800000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.2529999999999999,"5min":1.482,"15min":1.482},"last":1.0409999999999999}]},{"osd":1,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.98899999999999999,"15min":1.0329999999999999},"min":{"1min":0.71499999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.238,"5min":1.458,"15min":1.458},"last":1},{"interface":"front","average":{"1min":1.032,"5min":1.044,"15min":1.0649999999999999},"min":{"1min":0.78200000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.3440000000000001,"5min":1.4770000000000001,"15min":1.4850000000000001},"last":1.3140000000000001}]},{"osd":2,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.21,"15min":1.2410000000000001},"min":{"1min":0.81899999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.623,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0009999999999999,"15min":0.97799999999999998},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.67000000000000004},"max":{"1min":1.339,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.274}]},{"osd":4,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.228,"15min":1.3260000000000001},"min":{"1min":1.028,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.4239999999999999,"5min":1.5649999999999999,"15min":1.78},"last":1.409},{"interface":"front","average":{"1min":1.3,"5min":1.3240000000000001,"15min":1.377},"min":{"1min":1.0600000000000001,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":1.5549999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.4299999999999999}]},{"osd":5,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2929999999999999,"15min":1.3620000000000001},"min":{"1min":1.03,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.518,"5min":1.607,"15min":1.849},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.373,"15min":1.425},"min":{"1min":1.0800000000000001,"5min":1.012,"15min":1.012},"max":{"1min":1.581,"5min":1.962,"15min":1.962},"last":1.5069999999999999}]},{"osd":6,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2150000000000001,"15min":1.246},"min":{"1min":1.028,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.492,"5min":1.629,"15min":1.8120000000000001},"last":1.167},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.454,"15min":1.4730000000000001},"min":{"1min":1.2709999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":1.766,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.472}]},{"osd":7,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.3799999999999999,"15min":1.4079999999999999},"min":{"1min":1.1830000000000001,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.7010000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.476,"5min":1.5109999999999999,"15min":1.5629999999999999},"min":{"1min":1.248,"5min":1.1899999999999999,"15min":1.1899999999999999},"max":{"1min":1.6639999999999999,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.375}]}]},{"osd":2,"up_from":14,"seq":60129542339,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":652,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":667648,"data_stored":319190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.86499999999999999,"15min":0.83699999999999997},"min":{"1min":0.623,"5min":0.54300000000000004,"15min":0.35899999999999999},"max":{"1min":1.2170000000000001,"5min":1.3979999999999999,"15min":1.409},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.93899999999999995,"15min":0.93000000000000005},"min":{"1min":0.69499999999999995,"5min":0.56000000000000005,"15min":0.39200000000000002},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.881},"last":0.92100000000000004}]},{"osd":1,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.96299999999999997,"15min":0.94999999999999996},"min":{"1min":0.77700000000000002,"5min":0.57999999999999996,"15min":0.40400000000000003},"max":{"1min":1.474,"5min":1.5489999999999999,"15min":1.605},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0389999999999999,"15min":1.0309999999999999},"min":{"1min":0.80200000000000005,"5min":0.69499999999999995,"15min":0.49399999999999999},"max":{"1min":1.482,"5min":1.482,"15min":2.1440000000000001},"last":1.157}]},{"osd":3,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.143,"15min":1.181},"min":{"1min":0.89800000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.335,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.6399999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.1279999999999999,"15min":1.1100000000000001},"min":{"1min":0.875,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4099999999999999,"5min":1.573,"15min":1.573},"last":1.393}]},{"osd":4,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.327,"15min":1.3180000000000001},"min":{"1min":1.004,"5min":1.004,"15min":0.70299999999999996},"max":{"1min":1.7070000000000001,"5min":1.756,"15min":2.3719999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.135,"5min":1.2030000000000001,"15min":1.2250000000000001},"min":{"1min":0.96099999999999997,"5min":0.92700000000000005,"15min":0.81899999999999995},"max":{"1min":1.3220000000000001,"5min":1.8140000000000001,"15min":2.0579999999999998},"last":1.048}]},{"osd":5,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.3160000000000001,"15min":1.2689999999999999},"min":{"1min":1.0609999999999999,"5min":0.99299999999999999,"15min":0.63300000000000001},"max":{"1min":1.556,"5min":1.657,"15min":2.2650000000000001},"last":1.268},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3919999999999999,"15min":1.3580000000000001},"min":{"1min":1.204,"5min":1.0649999999999999,"15min":0.75900000000000001},"max":{"1min":1.4750000000000001,"5min":1.954,"15min":2.5190000000000001},"last":1.5629999999999999}]},{"osd":6,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2809999999999999,"15min":1.284},"min":{"1min":1.085,"5min":0.77000000000000002,"15min":0.76900000000000002},"max":{"1min":1.4950000000000001,"5min":1.841,"15min":2.2109999999999999},"last":1.341},{"interface":"front","average":{"1min":1.367,"5min":1.3640000000000001,"15min":1.3400000000000001},"min":{"1min":1.212,"5min":0.90800000000000003,"15min":0.64100000000000001},"max":{"1min":1.5700000000000001,"5min":1.7849999999999999,"15min":2.1720000000000002},"last":0.99199999999999999}]},{"osd":7,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4530000000000001,"15min":1.4350000000000001},"min":{"1min":1.246,"5min":1.054,"15min":0.80800000000000005},"max":{"1min":1.6419999999999999,"5min":1.8640000000000001,"15min":2.9809999999999999},"last":1.736},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3600000000000001,"15min":1.3500000000000001},"min":{"1min":1.194,"5min":1.036,"15min":0.65100000000000002},"max":{"1min":1.607,"5min":1.728,"15min":2.1379999999999999},"last":1.52}]}]},{"osd":1,"up_from":14,"seq":60129542339,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":659456,"data_stored":312526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86399999999999999,"15min":0.88},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.34100000000000003},"max":{"1min":1.1299999999999999,"5min":1.28,"15min":1.6659999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0309999999999999,"15min":0.999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.505},"max":{"1min":1.3640000000000001,"5min":1.367,"15min":2.169},"last":0.72799999999999998}]},{"osd":2,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.98299999999999998,"15min":0.95799999999999996},"min":{"1min":0.75700000000000001,"5min":0.54700000000000004,"15min":0.40500000000000003},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":2.7789999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.93100000000000005,"15min":0.90200000000000002},"min":{"1min":0.68899999999999995,"5min":0.495,"15min":0.44},"max":{"1min":1.298,"5min":1.5169999999999999,"15min":2.468},"last":0.69599999999999995}]},{"osd":3,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0349999999999999,"15min":1.0589999999999999},"min":{"1min":0.745,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.3109999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.028,"15min":1.028},"min":{"1min":0.68700000000000006,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.306,"5min":1.5740000000000001,"15min":1.6339999999999999},"last":0.52300000000000002}]},{"osd":4,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.268,"15min":1.2470000000000001},"min":{"1min":0.93999999999999995,"5min":0.90300000000000002,"15min":0.745},"max":{"1min":1.5389999999999999,"5min":1.671,"15min":2.2000000000000002},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.159,"5min":1.2470000000000001,"15min":1.2410000000000001},"min":{"1min":0.89000000000000001,"5min":0.86299999999999999,"15min":0.503},"max":{"1min":1.3819999999999999,"5min":1.675,"15min":2.871},"last":0.95799999999999996}]},{"osd":5,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.278,"15min":1.2689999999999999},"min":{"1min":1.044,"5min":0.86299999999999999,"15min":0.54100000000000004},"max":{"1min":1.4830000000000001,"5min":1.7350000000000001,"15min":3.032},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.262,"15min":1.2529999999999999},"min":{"1min":0.95599999999999996,"5min":0.81100000000000005,"15min":0.58799999999999997},"max":{"1min":1.504,"5min":1.6120000000000001,"15min":4.819},"last":1.0389999999999999}]},{"osd":6,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2929999999999999,"15min":1.284},"min":{"1min":1.0580000000000001,"5min":0.91000000000000003,"15min":0.68200000000000005},"max":{"1min":1.488,"5min":1.6319999999999999,"15min":4.9900000000000002},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.331,"15min":1.304},"min":{"1min":1.034,"5min":0.93000000000000005,"15min":0.874},"max":{"1min":1.5980000000000001,"5min":1.8280000000000001,"15min":2.8159999999999998},"last":1.0009999999999999}]},{"osd":7,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.397,"15min":1.3879999999999999},"min":{"1min":1.028,"5min":1.028,"15min":0.84399999999999997},"max":{"1min":1.5840000000000001,"5min":1.9059999999999999,"15min":2.677},"last":1.079},{"interface":"front","average":{"1min":1.397,"5min":1.4159999999999999,"15min":1.393},"min":{"1min":1.2110000000000001,"5min":1.0409999999999999,"15min":0.65400000000000003},"max":{"1min":1.607,"5min":1.9019999999999999,"15min":2.9529999999999998},"last":1.0189999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542339,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1245184,"data_stored":900766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.83199999999999996,"15min":0.81899999999999995},"min":{"1min":0.67100000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.615},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.92800000000000005,"15min":0.89200000000000002},"min":{"1min":0.71499999999999997,"5min":0.61799999999999999,"15min":0.33500000000000002},"max":{"1min":1.391,"5min":1.6020000000000001,"15min":2.3340000000000001},"last":0.59599999999999997}]},{"osd":2,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.175,"15min":1.151},"min":{"1min":0.78500000000000003,"5min":0.59499999999999997,"15min":0.55500000000000005},"max":{"1min":1.589,"5min":1.7889999999999999,"15min":4.407},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.97999999999999998,"15min":0.97299999999999998},"min":{"1min":0.55900000000000005,"5min":0.52300000000000002,"15min":0.42499999999999999},"max":{"1min":1.52,"5min":1.6559999999999999,"15min":2.5659999999999998},"last":1.2509999999999999}]},{"osd":3,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.995,"15min":1},"min":{"1min":0.71499999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3360000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.069,"15min":1.1180000000000001},"min":{"1min":0.63500000000000001,"5min":0.622,"15min":0.622},"max":{"1min":1.452,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.86399999999999999}]},{"osd":4,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1919999999999999,"15min":1.1890000000000001},"min":{"1min":0.97299999999999998,"5min":0.88100000000000001,"15min":0.67200000000000004},"max":{"1min":1.3819999999999999,"5min":1.996,"15min":3.4820000000000002},"last":1.127},{"interface":"front","average":{"1min":1.194,"5min":1.224,"15min":1.232},"min":{"1min":1.0349999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.458,"5min":1.758,"15min":3.8079999999999998},"last":0.90400000000000003}]},{"osd":5,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2649999999999999,"15min":1.2569999999999999},"min":{"1min":1.048,"5min":0.79800000000000004,"15min":0.748},"max":{"1min":1.4299999999999999,"5min":1.8360000000000001,"15min":3.2120000000000002},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.337,"15min":1.3120000000000001},"min":{"1min":1.0740000000000001,"5min":0.91100000000000003,"15min":0.85699999999999998},"max":{"1min":1.585,"5min":1.7849999999999999,"15min":4.3849999999999998},"last":0.92700000000000005}]},{"osd":6,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3759999999999999,"15min":1.3540000000000001},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.79100000000000004},"max":{"1min":1.522,"5min":1.873,"15min":4.3499999999999996},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.274,"15min":1.2569999999999999},"min":{"1min":1.0569999999999999,"5min":0.92600000000000005,"15min":0.61799999999999999},"max":{"1min":1.484,"5min":1.859,"15min":1.925},"last":1.014}]},{"osd":7,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3640000000000001,"15min":1.361},"min":{"1min":0.99399999999999999,"5min":0.97599999999999998,"15min":0.73499999999999999},"max":{"1min":1.5629999999999999,"5min":1.9430000000000001,"15min":2.0840000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.415,"15min":1.403},"min":{"1min":1.27,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.5680000000000001,"5min":1.887,"15min":2.7410000000000001},"last":1.331}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-17T06:22:58.925 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-17T06:22:59.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.094+0000 7f8ba1f6e700 1 Processor -- start 2023-10-17T06:22:59.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.094+0000 7f8ba1f6e700 1 -- start start 2023-10-17T06:22:59.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.098+0000 7f8ba1f6e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8b9c1593c0 0x7f8b9c15da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:59.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.098+0000 7f8ba1f6e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8b9c0cb8a0 0x7f8b9c0b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:59.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.098+0000 7f8ba1f6e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9c1597a0 con 0x7f8b9c06ced0 2023-10-17T06:22:59.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.098+0000 7f8ba1f6e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9c15d610 con 0x7f8b9c0cb8a0 2023-10-17T06:22:59.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.098+0000 7f8ba1f6e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9c06d920 con 0x7f8b9c1593c0 2023-10-17T06:22:59.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.098+0000 7f8b9bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8b9c0cb8a0 0x7f8b9c0b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:59.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.098+0000 7f8b9bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f8b9c0cb8a0 0x7f8b9c0b1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48596/0 (socket says 172.21.15.125:48596) 2023-10-17T06:22:59.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.098+0000 7f8b9bfff700 1 -- 172.21.15.125:0/2524080624 learned_addr learned my addr 172.21.15.125:0/2524080624 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:59.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.098+0000 7f8b9b7fe700 1 --2- 172.21.15.125:0/2524080624 >> v2:172.21.15.184:3300/0 conn(0x7f8b9c1593c0 0x7f8b9c15da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:59.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.098+0000 7f8b9bfff700 1 -- 172.21.15.125:0/2524080624 >> v2:172.21.15.184:3300/0 conn(0x7f8b9c1593c0 msgr2=0x7f8b9c15da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:22:59.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.098+0000 7f8b9bfff700 1 --2- 172.21.15.125:0/2524080624 >> v2:172.21.15.184:3300/0 conn(0x7f8b9c1593c0 0x7f8b9c15da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:59.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.098+0000 7f8b9bfff700 1 -- 172.21.15.125:0/2524080624 >> v1:172.21.15.184:6789/0 conn(0x7f8b9c06ced0 legacy=0x7f8b9c0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:59.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.098+0000 7f8b9bfff700 1 -- 172.21.15.125:0/2524080624 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c15cf50 con 0x7f8b9c0cb8a0 2023-10-17T06:22:59.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.098+0000 7f8b9bfff700 1 --2- 172.21.15.125:0/2524080624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b9c0cb8a0 0x7f8b9c0b1880 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0b1490 tx=0x7f8b9400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc02722a394a573 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:59.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.098+0000 7f8b9affd700 1 -- 172.21.15.125:0/2524080624 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b94010070 con 0x7f8b9c0cb8a0 2023-10-17T06:22:59.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.098+0000 7f8b9affd700 1 -- 172.21.15.125:0/2524080624 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9400dd90 con 0x7f8b9c0cb8a0 2023-10-17T06:22:59.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.098+0000 7f8b9affd700 1 -- 172.21.15.125:0/2524080624 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9400b310 con 0x7f8b9c0cb8a0 2023-10-17T06:22:59.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.102+0000 7f8ba1f6e700 1 -- 172.21.15.125:0/2524080624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b9c0cb8a0 msgr2=0x7f8b9c0b1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:59.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.102+0000 7f8ba1f6e700 1 --2- 172.21.15.125:0/2524080624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b9c0cb8a0 0x7f8b9c0b1880 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0b1490 tx=0x7f8b9400d430 comp rx=0 tx=0).stop 2023-10-17T06:22:59.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.102+0000 7f8ba1f6e700 1 -- 172.21.15.125:0/2524080624 shutdown_connections 2023-10-17T06:22:59.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.102+0000 7f8ba1f6e700 1 --2- 172.21.15.125:0/2524080624 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b9c0cb8a0 0x7f8b9c0b1880 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:59.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.102+0000 7f8ba1f6e700 1 --2- 172.21.15.125:0/2524080624 >> v2:172.21.15.184:3300/0 conn(0x7f8b9c1593c0 0x7f8b9c15da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:59.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.102+0000 7f8ba1f6e700 1 -- 172.21.15.125:0/2524080624 >> 172.21.15.125:0/2524080624 conn(0x7f8b9c06a340 msgr2=0x7f8b9c0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:59.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.102+0000 7f8ba1f6e700 1 -- 172.21.15.125:0/2524080624 shutdown_connections 2023-10-17T06:22:59.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.102+0000 7f8ba1f6e700 1 -- 172.21.15.125:0/2524080624 wait complete. 2023-10-17T06:22:59.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.102+0000 7f8ba1f6e700 1 Processor -- start 2023-10-17T06:22:59.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.102+0000 7f8ba1f6e700 1 -- start start 2023-10-17T06:22:59.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8ba1f6e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b9c06ced0 0x7f8b9c0b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:59.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8ba1f6e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b9c0cb8a0 0x7f8b9c14a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:59.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8ba1f6e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b9c1593c0 0x7f8b9c14baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:59.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8ba1f6e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0ae350 con 0x7f8b9c06ced0 2023-10-17T06:22:59.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8ba1f6e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0b26d0 con 0x7f8b9c0cb8a0 2023-10-17T06:22:59.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8ba1f6e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0b29b0 con 0x7f8b9c1593c0 2023-10-17T06:22:59.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8b9b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b9c06ced0 0x7f8b9c0b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:59.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8b9b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b9c06ced0 0x7f8b9c0b0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48598/0 (socket says 172.21.15.125:48598) 2023-10-17T06:22:59.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8b9b7fe700 1 -- 172.21.15.125:0/3886259693 learned_addr learned my addr 172.21.15.125:0/3886259693 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:22:59.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8b93fff700 1 --2- 172.21.15.125:0/3886259693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b9c0cb8a0 0x7f8b9c14a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:59.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8b9bfff700 1 --2- 172.21.15.125:0/3886259693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b9c1593c0 0x7f8b9c14baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:59.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8b9b7fe700 1 -- 172.21.15.125:0/3886259693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b9c1593c0 msgr2=0x7f8b9c14baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:59.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8b9b7fe700 1 --2- 172.21.15.125:0/3886259693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b9c1593c0 0x7f8b9c14baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:59.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8b9b7fe700 1 -- 172.21.15.125:0/3886259693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b9c0cb8a0 msgr2=0x7f8b9c14a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:59.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8b9b7fe700 1 --2- 172.21.15.125:0/3886259693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b9c0cb8a0 0x7f8b9c14a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:59.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8b9b7fe700 1 -- 172.21.15.125:0/3886259693 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9400bd40 con 0x7f8b9c06ced0 2023-10-17T06:22:59.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8b9b7fe700 1 --2- 172.21.15.125:0/3886259693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b9c06ced0 0x7f8b9c0b0e60 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00d800 tx=0x7f8b8c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:59.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8b98ff9700 1 -- 172.21.15.125:0/3886259693 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c0125f0 con 0x7f8b9c06ced0 2023-10-17T06:22:59.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8b98ff9700 1 -- 172.21.15.125:0/3886259693 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8c012750 con 0x7f8b9c06ced0 2023-10-17T06:22:59.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8ba1f6e700 1 -- 172.21.15.125:0/3886259693 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9c0b2c90 con 0x7f8b9c06ced0 2023-10-17T06:22:59.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8b98ff9700 1 -- 172.21.15.125:0/3886259693 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c012ac0 con 0x7f8b9c06ced0 2023-10-17T06:22:59.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.106+0000 7f8ba1f6e700 1 -- 172.21.15.125:0/3886259693 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9c14dfe0 con 0x7f8b9c06ced0 2023-10-17T06:22:59.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.110+0000 7f8ba1f6e700 1 -- 172.21.15.125:0/3886259693 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b9c0ae1a0 con 0x7f8b9c06ced0 2023-10-17T06:22:59.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.110+0000 7f8b98ff9700 1 -- 172.21.15.125:0/3886259693 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8b8c012c20 con 0x7f8b9c06ced0 2023-10-17T06:22:59.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.110+0000 7f8b98ff9700 1 --2- 172.21.15.125:0/3886259693 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8b7c065720 0x7f8b7c067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:22:59.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.110+0000 7f8b98ff9700 1 -- 172.21.15.125:0/3886259693 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f8b8c082da0 con 0x7f8b9c06ced0 2023-10-17T06:22:59.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.110+0000 7f8b93fff700 1 --2- 172.21.15.125:0/3886259693 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8b7c065720 0x7f8b7c067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:22:59.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.114+0000 7f8b93fff700 1 --2- 172.21.15.125:0/3886259693 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8b7c065720 0x7f8b7c067be0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c14d760 tx=0x7f8b84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:22:59.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.114+0000 7f8b98ff9700 1 -- 172.21.15.125:0/3886259693 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f8b8c050950 con 0x7f8b9c06ced0 2023-10-17T06:22:59.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.294+0000 7f8ba1f6e700 1 -- 172.21.15.125:0/3886259693 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b9c072e60 con 0x7f8b9c06ced0 2023-10-17T06:22:59.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.294+0000 7f8b98ff9700 1 -- 172.21.15.125:0/3886259693 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+15113 (secure 0 0 0) 0x7f8b8c053f70 con 0x7f8b9c06ced0 2023-10-17T06:22:59.301 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:22:59.301 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":58,"fsid":"c779df02-0ec4-47de-a0f3-2371e60a2dde","created":"2023-10-17T06:06:41.768866+0000","modified":"2023-10-17T06:22:54.351941+0000","last_up_change":"2023-10-17T06:16:01.390745+0000","last_in_change":"2023-10-17T06:06:45.132620+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-17T06:06:54.031184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-17T06:07:01.467445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6f504062-4853-4e2a-98d4-ca58d83fb96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6825","nonce":4039629234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6827","nonce":4039629234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6830","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6831","nonce":4039629234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":4039629234},{"type":"v1","addr":"172.21.15.125:6829","nonce":4039629234}]},"public_addr":"172.21.15.125:6825/4039629234","cluster_addr":"172.21.15.125:6827/4039629234","heartbeat_back_addr":"172.21.15.125:6831/4039629234","heartbeat_front_addr":"172.21.15.125:6829/4039629234","state":["exists","up"]},{"osd":1,"uuid":"26798ccb-c865-459d-98b7-90a9ce8ab6ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6809","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6811","nonce":1606722802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6815","nonce":1606722802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6823","nonce":1606722802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6817","nonce":1606722802},{"type":"v1","addr":"172.21.15.125:6819","nonce":1606722802}]},"public_addr":"172.21.15.125:6811/1606722802","cluster_addr":"172.21.15.125:6815/1606722802","heartbeat_back_addr":"172.21.15.125:6823/1606722802","heartbeat_front_addr":"172.21.15.125:6819/1606722802","state":["exists","up"]},{"osd":2,"uuid":"997c2657-8b51-437c-85b1-2c2b5ec0b149","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6810","nonce":4280413072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6814","nonce":4280413072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6822","nonce":4280413072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":4280413072},{"type":"v1","addr":"172.21.15.125:6818","nonce":4280413072}]},"public_addr":"172.21.15.125:6810/4280413072","cluster_addr":"172.21.15.125:6814/4280413072","heartbeat_back_addr":"172.21.15.125:6822/4280413072","heartbeat_front_addr":"172.21.15.125:6818/4280413072","state":["exists","up"]},{"osd":3,"uuid":"49e6bd08-4c16-4eb4-b523-162d4cfe0dd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":50,"up_from":54,"up_thru":54,"down_at":51,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6801","nonce":1353754211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6803","nonce":1353754211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6807","nonce":1353754211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":1353754211},{"type":"v1","addr":"172.21.15.125:6805","nonce":1353754211}]},"public_addr":"172.21.15.125:6801/1353754211","cluster_addr":"172.21.15.125:6803/1353754211","heartbeat_back_addr":"172.21.15.125:6807/1353754211","heartbeat_front_addr":"172.21.15.125:6805/1353754211","state":["exists","up"]},{"osd":4,"uuid":"d7b21bd2-a06e-4e5e-bce1-4af4bc33d066","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6801","nonce":514892137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6803","nonce":514892137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6807","nonce":514892137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":514892137},{"type":"v1","addr":"172.21.15.184:6805","nonce":514892137}]},"public_addr":"172.21.15.184:6801/514892137","cluster_addr":"172.21.15.184:6803/514892137","heartbeat_back_addr":"172.21.15.184:6807/514892137","heartbeat_front_addr":"172.21.15.184:6805/514892137","state":["exists","up"]},{"osd":5,"uuid":"d65d03d2-9afe-4473-8e10-76d8926bbd1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6825","nonce":3287748739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6827","nonce":3287748739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6831","nonce":3287748739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":3287748739},{"type":"v1","addr":"172.21.15.184:6829","nonce":3287748739}]},"public_addr":"172.21.15.184:6825/3287748739","cluster_addr":"172.21.15.184:6827/3287748739","heartbeat_back_addr":"172.21.15.184:6831/3287748739","heartbeat_front_addr":"172.21.15.184:6829/3287748739","state":["exists","up"]},{"osd":6,"uuid":"787e64b7-283d-43f8-bb1b-87d47e562be7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6817","nonce":2471937715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6819","nonce":2471937715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6823","nonce":2471937715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2471937715},{"type":"v1","addr":"172.21.15.184:6821","nonce":2471937715}]},"public_addr":"172.21.15.184:6817/2471937715","cluster_addr":"172.21.15.184:6819/2471937715","heartbeat_back_addr":"172.21.15.184:6823/2471937715","heartbeat_front_addr":"172.21.15.184:6821/2471937715","state":["exists","up"]},{"osd":7,"uuid":"913cd35a-b9e5-408b-8a63-ca6883ecb020","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6809","nonce":1153151577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6811","nonce":1153151577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6815","nonce":1153151577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1153151577},{"type":"v1","addr":"172.21.15.184:6813","nonce":1153151577}]},"public_addr":"172.21.15.184:6809/1153151577","cluster_addr":"172.21.15.184:6811/1153151577","heartbeat_back_addr":"172.21.15.184:6815/1153151577","heartbeat_front_addr":"172.21.15.184:6813/1153151577","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.828558+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.061412+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.839936+0000","dead_epoch":0},{"osd":3,"down_stamp":"2023-10-17T06:09:26.602656+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.070572+0000","dead_epoch":51},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.174189+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.947397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:51.093657+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-17T06:06:50.899911+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:6837/2351050168":"2023-10-18T06:22:51.338618+0000","172.21.15.125:6836/2351050168":"2023-10-18T06:22:51.338618+0000","172.21.15.125:0/3775054255":"2023-10-17T07:15:56.011706+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-17T06:22:59.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.298+0000 7f8ba1f6e700 1 -- 172.21.15.125:0/3886259693 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8b7c065720 msgr2=0x7f8b7c067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:59.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.298+0000 7f8ba1f6e700 1 --2- 172.21.15.125:0/3886259693 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8b7c065720 0x7f8b7c067be0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c14d760 tx=0x7f8b84009040 comp rx=0 tx=0).stop 2023-10-17T06:22:59.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.298+0000 7f8ba1f6e700 1 -- 172.21.15.125:0/3886259693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b9c06ced0 msgr2=0x7f8b9c0b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:22:59.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.298+0000 7f8ba1f6e700 1 --2- 172.21.15.125:0/3886259693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b9c06ced0 0x7f8b9c0b0e60 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00d800 tx=0x7f8b8c00db10 comp rx=0 tx=0).stop 2023-10-17T06:22:59.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.298+0000 7f8ba1f6e700 1 -- 172.21.15.125:0/3886259693 shutdown_connections 2023-10-17T06:22:59.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.298+0000 7f8ba1f6e700 1 --2- 172.21.15.125:0/3886259693 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f8b7c065720 0x7f8b7c067be0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:59.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.298+0000 7f8ba1f6e700 1 --2- 172.21.15.125:0/3886259693 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8b9c1593c0 0x7f8b9c14baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:59.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.298+0000 7f8ba1f6e700 1 --2- 172.21.15.125:0/3886259693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b9c0cb8a0 0x7f8b9c14a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:59.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.298+0000 7f8ba1f6e700 1 --2- 172.21.15.125:0/3886259693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b9c06ced0 0x7f8b9c0b0e60 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:22:59.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.298+0000 7f8ba1f6e700 1 -- 172.21.15.125:0/3886259693 >> 172.21.15.125:0/3886259693 conn(0x7f8b9c06a340 msgr2=0x7f8b9c158210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:22:59.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.298+0000 7f8ba1f6e700 1 -- 172.21.15.125:0/3886259693 shutdown_connections 2023-10-17T06:22:59.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:22:59.298+0000 7f8ba1f6e700 1 -- 172.21.15.125:0/3886259693 wait complete. 2023-10-17T06:23:00.324 INFO:tasks.ceph:Scrubbing osd.0 2023-10-17T06:23:00.325 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-17T06:23:00.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.510+0000 7f6b01b2d700 1 Processor -- start 2023-10-17T06:23:00.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.510+0000 7f6b01b2d700 1 -- start start 2023-10-17T06:23:00.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.514+0000 7f6b01b2d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6afc06f7f0 0x7f6afc06fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:00.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.514+0000 7f6b01b2d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6afc0b2530 0x7f6afc0b2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:00.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.514+0000 7f6b01b2d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6afc0701c0 con 0x7f6afc15ce90 2023-10-17T06:23:00.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.514+0000 7f6b01b2d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6afc0b8090 con 0x7f6afc06f7f0 2023-10-17T06:23:00.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.514+0000 7f6b01b2d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6afc0cfd40 con 0x7f6afc0b2530 2023-10-17T06:23:00.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.514+0000 7f6afb7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6afc15ce90 0x7f6afc0b7980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42546/0 (socket says 172.21.15.125:42546) 2023-10-17T06:23:00.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.514+0000 7f6afb7fe700 1 -- 172.21.15.125:0/2542926049 learned_addr learned my addr 172.21.15.125:0/2542926049 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:23:00.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.514+0000 7f6af2ffd700 1 --2- 172.21.15.125:0/2542926049 >> v2:172.21.15.125:3300/0 conn(0x7f6afc06f7f0 0x7f6afc06fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:00.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.514+0000 7f6afbfff700 1 --2- 172.21.15.125:0/2542926049 >> v2:172.21.15.184:3300/0 conn(0x7f6afc0b2530 0x7f6afc0b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:00.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.514+0000 7f6afaffd700 1 -- 172.21.15.125:0/2542926049 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301606877 0 0) 0x7f6afc0701c0 con 0x7f6afc15ce90 2023-10-17T06:23:00.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.514+0000 7f6afaffd700 1 -- 172.21.15.125:0/2542926049 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ae80035d0 con 0x7f6afc15ce90 2023-10-17T06:23:00.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.514+0000 7f6afaffd700 1 -- 172.21.15.125:0/2542926049 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2332281887 0 0) 0x7f6ae80035d0 con 0x7f6afc15ce90 2023-10-17T06:23:00.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.514+0000 7f6af2ffd700 1 -- 172.21.15.125:0/2542926049 >> v2:172.21.15.184:3300/0 conn(0x7f6afc0b2530 msgr2=0x7f6afc0b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:23:00.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.514+0000 7f6af2ffd700 1 --2- 172.21.15.125:0/2542926049 >> v2:172.21.15.184:3300/0 conn(0x7f6afc0b2530 0x7f6afc0b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:00.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.514+0000 7f6af2ffd700 1 -- 172.21.15.125:0/2542926049 >> v1:172.21.15.125:6789/0 conn(0x7f6afc15ce90 legacy=0x7f6afc0b7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:00.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.514+0000 7f6af2ffd700 1 -- 172.21.15.125:0/2542926049 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc0b3b80 con 0x7f6afc06f7f0 2023-10-17T06:23:00.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.518+0000 7f6af2ffd700 1 --2- 172.21.15.125:0/2542926049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6afc06f7f0 0x7f6afc06fc80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6afc161990 tx=0x7f6ae4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2487f1751fdb5397 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:00.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.518+0000 7f6afaffd700 1 -- 172.21.15.125:0/2542926049 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec0019f0 con 0x7f6afc06f7f0 2023-10-17T06:23:00.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.518+0000 7f6afaffd700 1 -- 172.21.15.125:0/2542926049 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae4004030 con 0x7f6afc06f7f0 2023-10-17T06:23:00.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.518+0000 7f6afaffd700 1 -- 172.21.15.125:0/2542926049 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae40043c0 con 0x7f6afc06f7f0 2023-10-17T06:23:00.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.518+0000 7f6b01b2d700 1 -- 172.21.15.125:0/2542926049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6afc06f7f0 msgr2=0x7f6afc06fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:00.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.518+0000 7f6b01b2d700 1 --2- 172.21.15.125:0/2542926049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6afc06f7f0 0x7f6afc06fc80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6afc161990 tx=0x7f6ae4009b30 comp rx=0 tx=0).stop 2023-10-17T06:23:00.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.518+0000 7f6b01b2d700 1 -- 172.21.15.125:0/2542926049 shutdown_connections 2023-10-17T06:23:00.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.518+0000 7f6b01b2d700 1 --2- 172.21.15.125:0/2542926049 >> v2:172.21.15.184:3300/0 conn(0x7f6afc0b2530 0x7f6afc0b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:00.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.518+0000 7f6b01b2d700 1 --2- 172.21.15.125:0/2542926049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6afc06f7f0 0x7f6afc06fc80 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:00.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.518+0000 7f6b01b2d700 1 -- 172.21.15.125:0/2542926049 >> 172.21.15.125:0/2542926049 conn(0x7f6afc069f50 msgr2=0x7f6afc06a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:00.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.518+0000 7f6b01b2d700 1 -- 172.21.15.125:0/2542926049 shutdown_connections 2023-10-17T06:23:00.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.518+0000 7f6b01b2d700 1 -- 172.21.15.125:0/2542926049 wait complete. 2023-10-17T06:23:00.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.522+0000 7f6b01b2d700 1 Processor -- start 2023-10-17T06:23:00.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.522+0000 7f6b01b2d700 1 -- start start 2023-10-17T06:23:00.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.522+0000 7f6b01b2d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6afc06f7f0 0x7f6afc14dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:00.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.522+0000 7f6b01b2d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6afc0b2530 0x7f6afc0b66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:00.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.522+0000 7f6b01b2d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6afc15ce90 0x7f6afc0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:00.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.522+0000 7f6b01b2d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc1f8060 con 0x7f6afc0b2530 2023-10-17T06:23:00.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.522+0000 7f6b01b2d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc1f7430 con 0x7f6afc06f7f0 2023-10-17T06:23:00.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.522+0000 7f6b01b2d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc1f7a10 con 0x7f6afc15ce90 2023-10-17T06:23:00.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.522+0000 7f6af2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6afc0b2530 0x7f6afc0b66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:00.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.522+0000 7f6af2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6afc0b2530 0x7f6afc0b66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48614/0 (socket says 172.21.15.125:48614) 2023-10-17T06:23:00.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.522+0000 7f6af2ffd700 1 -- 172.21.15.125:0/2804553270 learned_addr learned my addr 172.21.15.125:0/2804553270 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:00.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.526+0000 7f6afb7fe700 1 --2- 172.21.15.125:0/2804553270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6afc06f7f0 0x7f6afc14dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:00.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.526+0000 7f6afbfff700 1 --2- 172.21.15.125:0/2804553270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6afc15ce90 0x7f6afc0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:00.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.526+0000 7f6af2ffd700 1 -- 172.21.15.125:0/2804553270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6afc15ce90 msgr2=0x7f6afc0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:00.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.526+0000 7f6af2ffd700 1 --2- 172.21.15.125:0/2804553270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6afc15ce90 0x7f6afc0b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:00.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.526+0000 7f6af2ffd700 1 -- 172.21.15.125:0/2804553270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6afc06f7f0 msgr2=0x7f6afc14dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:00.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.526+0000 7f6af2ffd700 1 --2- 172.21.15.125:0/2804553270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6afc06f7f0 0x7f6afc14dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:00.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.526+0000 7f6af2ffd700 1 -- 172.21.15.125:0/2804553270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae40094b0 con 0x7f6afc0b2530 2023-10-17T06:23:00.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.526+0000 7f6afb7fe700 1 --2- 172.21.15.125:0/2804553270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6afc06f7f0 0x7f6afc14dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:23:00.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.526+0000 7f6af2ffd700 1 --2- 172.21.15.125:0/2804553270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6afc0b2530 0x7f6afc0b66b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4000c00 tx=0x7f6ae4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:00.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.526+0000 7f6af8ff9700 1 -- 172.21.15.125:0/2804553270 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4003ba0 con 0x7f6afc0b2530 2023-10-17T06:23:00.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.526+0000 7f6af8ff9700 1 -- 172.21.15.125:0/2804553270 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae401f070 con 0x7f6afc0b2530 2023-10-17T06:23:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.526+0000 7f6af8ff9700 1 -- 172.21.15.125:0/2804553270 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4011630 con 0x7f6afc0b2530 2023-10-17T06:23:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.526+0000 7f6b01b2d700 1 -- 172.21.15.125:0/2804553270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6afc1f7cf0 con 0x7f6afc0b2530 2023-10-17T06:23:00.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.526+0000 7f6b01b2d700 1 -- 172.21.15.125:0/2804553270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6afc14e260 con 0x7f6afc0b2530 2023-10-17T06:23:00.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.526+0000 7f6b01b2d700 1 -- 172.21.15.125:0/2804553270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6afc14e450 con 0x7f6afc0b2530 2023-10-17T06:23:00.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.530+0000 7f6af8ff9700 1 -- 172.21.15.125:0/2804553270 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6ae4021030 con 0x7f6afc0b2530 2023-10-17T06:23:00.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.530+0000 7f6af8ff9700 1 --2- 172.21.15.125:0/2804553270 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6adc0656f0 0x7f6adc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:00.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.530+0000 7f6af8ff9700 1 -- 172.21.15.125:0/2804553270 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f6ae4083ff0 con 0x7f6afc0b2530 2023-10-17T06:23:00.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.530+0000 7f6af8ff9700 1 --2- 172.21.15.125:0/2804553270 >> [v2:172.21.15.125:6824/4039629234,v1:172.21.15.125:6825/4039629234] conn(0x7f6adc06c060 0x7f6adc06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:00.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.530+0000 7f6af8ff9700 1 -- 172.21.15.125:0/2804553270 --> [v2:172.21.15.125:6824/4039629234,v1:172.21.15.125:6825/4039629234] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6adc06eb70 con 0x7f6adc06c060 2023-10-17T06:23:00.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.530+0000 7f6af8ff9700 1 -- 172.21.15.125:0/2804553270 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ae40865d0 con 0x7f6afc0b2530 2023-10-17T06:23:00.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.530+0000 7f6afb7fe700 1 --2- 172.21.15.125:0/2804553270 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6adc0656f0 0x7f6adc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:00.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.530+0000 7f6afbfff700 1 --2- 172.21.15.125:0/2804553270 >> [v2:172.21.15.125:6824/4039629234,v1:172.21.15.125:6825/4039629234] conn(0x7f6adc06c060 0x7f6adc06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:00.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.530+0000 7f6afb7fe700 1 --2- 172.21.15.125:0/2804553270 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6adc0656f0 0x7f6adc067bb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6aec002230 tx=0x7f6aec002100 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:00.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.530+0000 7f6afbfff700 1 --2- 172.21.15.125:0/2804553270 >> [v2:172.21.15.125:6824/4039629234,v1:172.21.15.125:6825/4039629234] conn(0x7f6adc06c060 0x7f6adc06e4a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:00.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.534+0000 7f6af8ff9700 1 -- 172.21.15.125:0/2804553270 <== osd.0 v2:172.21.15.125:6824/4039629234 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6adc06eb70 con 0x7f6adc06c060 2023-10-17T06:23:00.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.550+0000 7f6b01b2d700 1 -- 172.21.15.125:0/2804553270 --> [v2:172.21.15.125:6824/4039629234,v1:172.21.15.125:6825/4039629234] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6afc0b4140 con 0x7f6adc06c060 2023-10-17T06:23:00.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.550+0000 7f6af8ff9700 1 -- 172.21.15.125:0/2804553270 <== osd.0 v2:172.21.15.125:6824/4039629234 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6af4009b20 con 0x7f6adc06c060 2023-10-17T06:23:00.557 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-17T06:23:00.557 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-17T06:23:00.557 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-17T06:23:00.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.550+0000 7f6b01b2d700 1 -- 172.21.15.125:0/2804553270 >> [v2:172.21.15.125:6824/4039629234,v1:172.21.15.125:6825/4039629234] conn(0x7f6adc06c060 msgr2=0x7f6adc06e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:00.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.550+0000 7f6b01b2d700 1 --2- 172.21.15.125:0/2804553270 >> [v2:172.21.15.125:6824/4039629234,v1:172.21.15.125:6825/4039629234] conn(0x7f6adc06c060 0x7f6adc06e4a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:00.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.550+0000 7f6b01b2d700 1 -- 172.21.15.125:0/2804553270 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6adc0656f0 msgr2=0x7f6adc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:00.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.550+0000 7f6b01b2d700 1 --2- 172.21.15.125:0/2804553270 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f6adc0656f0 0x7f6adc067bb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6aec002230 tx=0x7f6aec002100 comp rx=0 tx=0).stop 2023-10-17T06:23:00.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.550+0000 7f6b01b2d700 1 -- 172.21.15.125:0/2804553270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6afc0b2530 msgr2=0x7f6afc0b66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:00.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.550+0000 7f6b01b2d700 1 --2- 172.21.15.125:0/2804553270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6afc0b2530 0x7f6afc0b66b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4000c00 tx=0x7f6ae4004770 comp rx=0 tx=0).stop 2023-10-17T06:23:00.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.550+0000 7f6afbfff700 1 -- 172.21.15.125:0/2804553270 reap_dead start 2023-10-17T06:23:00.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.550+0000 7f6b01b2d700 1 -- 172.21.15.125:0/2804553270 shutdown_connections 2023-10-17T06:23:00.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.550+0000 7f6b01b2d700 1 -- 172.21.15.125:0/2804553270 >> 172.21.15.125:0/2804553270 conn(0x7f6afc069f50 msgr2=0x7f6afc06e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:00.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.550+0000 7f6b01b2d700 1 -- 172.21.15.125:0/2804553270 shutdown_connections 2023-10-17T06:23:00.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.550+0000 7f6b01b2d700 1 -- 172.21.15.125:0/2804553270 wait complete. 2023-10-17T06:23:00.582 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-17T06:23:00.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.746+0000 7f48649d2700 1 Processor -- start 2023-10-17T06:23:00.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.746+0000 7f48649d2700 1 -- start start 2023-10-17T06:23:00.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.750+0000 7f48649d2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f48600cb8a0 0x7f48600cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:00.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.750+0000 7f48649d2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48600b22f0 0x7f48600b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:00.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.750+0000 7f48649d2700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4860070de0 con 0x7f4860144150 2023-10-17T06:23:00.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.750+0000 7f48649d2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48600cc270 con 0x7f48600cb8a0 2023-10-17T06:23:00.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.750+0000 7f48649d2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48600701d0 con 0x7f48600b22f0 2023-10-17T06:23:00.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.750+0000 7f4856ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f48600cb8a0 0x7f48600cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:00.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.750+0000 7f4856ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f48600cb8a0 0x7f48600cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48628/0 (socket says 172.21.15.125:48628) 2023-10-17T06:23:00.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.750+0000 7f4856ffd700 1 -- 172.21.15.125:0/54706213 learned_addr learned my addr 172.21.15.125:0/54706213 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:00.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.750+0000 7f485ffff700 1 --2- 172.21.15.125:0/54706213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48600b22f0 0x7f48600b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:00.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.750+0000 7f4856ffd700 1 -- 172.21.15.125:0/54706213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48600b22f0 msgr2=0x7f48600b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:23:00.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.750+0000 7f4856ffd700 1 --2- 172.21.15.125:0/54706213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48600b22f0 0x7f48600b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:00.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.750+0000 7f4856ffd700 1 -- 172.21.15.125:0/54706213 >> v1:172.21.15.184:6789/0 conn(0x7f4860144150 legacy=0x7f48600cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:23:00.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.750+0000 7f4856ffd700 1 -- 172.21.15.125:0/54706213 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48600704b0 con 0x7f48600cb8a0 2023-10-17T06:23:00.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.750+0000 7f4856ffd700 1 --2- 172.21.15.125:0/54706213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48600cb8a0 0x7f48600cbd30 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4848009910 tx=0x7f4848009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4c6289b8843c58 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:00.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.750+0000 7f485effd700 1 -- 172.21.15.125:0/54706213 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848004230 con 0x7f48600cb8a0 2023-10-17T06:23:00.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.750+0000 7f485effd700 1 -- 172.21.15.125:0/54706213 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4848004390 con 0x7f48600cb8a0 2023-10-17T06:23:00.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.750+0000 7f485effd700 1 -- 172.21.15.125:0/54706213 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4848009e60 con 0x7f48600cb8a0 2023-10-17T06:23:00.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.754+0000 7f48649d2700 1 -- 172.21.15.125:0/54706213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48600cb8a0 msgr2=0x7f48600cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:00.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.754+0000 7f48649d2700 1 --2- 172.21.15.125:0/54706213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48600cb8a0 0x7f48600cbd30 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4848009910 tx=0x7f4848009c20 comp rx=0 tx=0).stop 2023-10-17T06:23:00.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.754+0000 7f48649d2700 1 -- 172.21.15.125:0/54706213 shutdown_connections 2023-10-17T06:23:00.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.754+0000 7f48649d2700 1 --2- 172.21.15.125:0/54706213 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48600b22f0 0x7f48600b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:00.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.754+0000 7f48649d2700 1 --2- 172.21.15.125:0/54706213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48600cb8a0 0x7f48600cbd30 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:00.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.754+0000 7f48649d2700 1 -- 172.21.15.125:0/54706213 >> 172.21.15.125:0/54706213 conn(0x7f48600b0bf0 msgr2=0x7f48600ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:00.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.754+0000 7f48649d2700 1 -- 172.21.15.125:0/54706213 shutdown_connections 2023-10-17T06:23:00.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.754+0000 7f48649d2700 1 -- 172.21.15.125:0/54706213 wait complete. 2023-10-17T06:23:00.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.758+0000 7f48649d2700 1 Processor -- start 2023-10-17T06:23:00.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.758+0000 7f48649d2700 1 -- start start 2023-10-17T06:23:00.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.758+0000 7f48649d2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48600b22f0 0x7f48600a9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:00.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.758+0000 7f48649d2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48600cb8a0 0x7f48600ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:00.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.758+0000 7f48649d2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4860144150 0x7f48600acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:00.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.758+0000 7f48649d2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48600aa060 con 0x7f48600b22f0 2023-10-17T06:23:00.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.758+0000 7f48649d2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48600ad120 con 0x7f48600cb8a0 2023-10-17T06:23:00.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.758+0000 7f48649d2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48601f3570 con 0x7f4860144150 2023-10-17T06:23:00.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.758+0000 7f485f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48600b22f0 0x7f48600a9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:00.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.758+0000 7f485f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48600b22f0 0x7f48600a9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48640/0 (socket says 172.21.15.125:48640) 2023-10-17T06:23:00.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.758+0000 7f485f7fe700 1 -- 172.21.15.125:0/405282729 learned_addr learned my addr 172.21.15.125:0/405282729 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:00.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.758+0000 7f485ffff700 1 --2- 172.21.15.125:0/405282729 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4860144150 0x7f48600acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:00.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.758+0000 7f4856ffd700 1 --2- 172.21.15.125:0/405282729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48600cb8a0 0x7f48600ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:00.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.762+0000 7f485f7fe700 1 -- 172.21.15.125:0/405282729 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4860144150 msgr2=0x7f48600acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:00.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.762+0000 7f485f7fe700 1 --2- 172.21.15.125:0/405282729 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4860144150 0x7f48600acb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:00.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.762+0000 7f485f7fe700 1 -- 172.21.15.125:0/405282729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48600cb8a0 msgr2=0x7f48600ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:00.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.762+0000 7f485f7fe700 1 --2- 172.21.15.125:0/405282729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48600cb8a0 0x7f48600ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:00.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.762+0000 7f485f7fe700 1 -- 172.21.15.125:0/405282729 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4848009570 con 0x7f48600b22f0 2023-10-17T06:23:00.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.762+0000 7f485f7fe700 1 --2- 172.21.15.125:0/405282729 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48600b22f0 0x7f48600a9b20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f485000b4a0 tx=0x7f485000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:00.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.762+0000 7f485cff9700 1 -- 172.21.15.125:0/405282729 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850011830 con 0x7f48600b22f0 2023-10-17T06:23:00.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.762+0000 7f485cff9700 1 -- 172.21.15.125:0/405282729 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4850011990 con 0x7f48600b22f0 2023-10-17T06:23:00.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.762+0000 7f48649d2700 1 -- 172.21.15.125:0/405282729 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48601f3850 con 0x7f48600b22f0 2023-10-17T06:23:00.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.762+0000 7f485cff9700 1 -- 172.21.15.125:0/405282729 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850011d40 con 0x7f48600b22f0 2023-10-17T06:23:00.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.762+0000 7f48649d2700 1 -- 172.21.15.125:0/405282729 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486015d400 con 0x7f48600b22f0 2023-10-17T06:23:00.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.762+0000 7f48649d2700 1 -- 172.21.15.125:0/405282729 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48601f33d0 con 0x7f48600b22f0 2023-10-17T06:23:00.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.766+0000 7f485cff9700 1 -- 172.21.15.125:0/405282729 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f485001a400 con 0x7f48600b22f0 2023-10-17T06:23:00.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.766+0000 7f485cff9700 1 --2- 172.21.15.125:0/405282729 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f48400656f0 0x7f4840067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:00.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.766+0000 7f485cff9700 1 -- 172.21.15.125:0/405282729 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f4850082ba0 con 0x7f48600b22f0 2023-10-17T06:23:00.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.766+0000 7f4856ffd700 1 --2- 172.21.15.125:0/405282729 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f48400656f0 0x7f4840067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:00.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.770+0000 7f4856ffd700 1 --2- 172.21.15.125:0/405282729 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f48400656f0 0x7f4840067bb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4848009910 tx=0x7f4848008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:00.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.774+0000 7f485cff9700 1 -- 172.21.15.125:0/405282729 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f48601f33d0 con 0x7f48600b22f0 2023-10-17T06:23:00.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.966+0000 7f48649d2700 1 -- 172.21.15.125:0/405282729 --> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f48601f36e0 con 0x7f48400656f0 2023-10-17T06:23:00.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.966+0000 7f485cff9700 1 -- 172.21.15.125:0/405282729 <== mgr.4107 v2:172.21.15.125:6832/2516570548 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f48601f36e0 con 0x7f48400656f0 2023-10-17T06:23:00.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.970+0000 7f48649d2700 1 -- 172.21.15.125:0/405282729 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f48400656f0 msgr2=0x7f4840067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:00.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.970+0000 7f48649d2700 1 --2- 172.21.15.125:0/405282729 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f48400656f0 0x7f4840067bb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4848009910 tx=0x7f4848008030 comp rx=0 tx=0).stop 2023-10-17T06:23:00.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.970+0000 7f48649d2700 1 -- 172.21.15.125:0/405282729 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48600b22f0 msgr2=0x7f48600a9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:00.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.970+0000 7f48649d2700 1 --2- 172.21.15.125:0/405282729 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48600b22f0 0x7f48600a9b20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f485000b4a0 tx=0x7f485000b7b0 comp rx=0 tx=0).stop 2023-10-17T06:23:00.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.970+0000 7f48649d2700 1 -- 172.21.15.125:0/405282729 shutdown_connections 2023-10-17T06:23:00.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.970+0000 7f48649d2700 1 --2- 172.21.15.125:0/405282729 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f48400656f0 0x7f4840067bb0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:00.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.970+0000 7f48649d2700 1 --2- 172.21.15.125:0/405282729 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4860144150 0x7f48600acb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:00.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.970+0000 7f48649d2700 1 --2- 172.21.15.125:0/405282729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48600cb8a0 0x7f48600ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:00.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.970+0000 7f48649d2700 1 --2- 172.21.15.125:0/405282729 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48600b22f0 0x7f48600a9b20 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:00.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.970+0000 7f48649d2700 1 -- 172.21.15.125:0/405282729 >> 172.21.15.125:0/405282729 conn(0x7f48600b0bf0 msgr2=0x7f48600b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:00.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.970+0000 7f48649d2700 1 -- 172.21.15.125:0/405282729 shutdown_connections 2023-10-17T06:23:00.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:00.970+0000 7f48649d2700 1 -- 172.21.15.125:0/405282729 wait complete. 2023-10-17T06:23:00.980 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 0 to deep-scrub 2023-10-17T06:23:00.998 INFO:tasks.ceph:Scrubbing osd.1 2023-10-17T06:23:00.999 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-17T06:23:01.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.178+0000 7f817d1c1700 1 Processor -- start 2023-10-17T06:23:01.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.178+0000 7f817d1c1700 1 -- start start 2023-10-17T06:23:01.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.182+0000 7f817d1c1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8178161200 0x7f81780b2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:01.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.182+0000 7f817d1c1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8178070460 0x7f81780708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:01.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.182+0000 7f817d1c1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8178070e00 con 0x7f8178164cb0 2023-10-17T06:23:01.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.182+0000 7f817d1c1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81781615e0 con 0x7f8178070460 2023-10-17T06:23:01.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.182+0000 7f817d1c1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81780b0720 con 0x7f8178161200 2023-10-17T06:23:01.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.182+0000 7f817759e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8178164cb0 0x7f8178165140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42562/0 (socket says 172.21.15.125:42562) 2023-10-17T06:23:01.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.182+0000 7f817759e700 1 -- 172.21.15.125:0/4065534501 learned_addr learned my addr 172.21.15.125:0/4065534501 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:23:01.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.182+0000 7f8176d9d700 1 --2- 172.21.15.125:0/4065534501 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8178161200 0x7f81780b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:01.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.182+0000 7f816ffff700 1 --2- 172.21.15.125:0/4065534501 >> v2:172.21.15.184:3300/0 conn(0x7f8178070460 0x7f81780708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:01.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.182+0000 7f817659c700 1 -- 172.21.15.125:0/4065534501 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392010116 0 0) 0x7f8178070e00 con 0x7f8178164cb0 2023-10-17T06:23:01.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.182+0000 7f817659c700 1 -- 172.21.15.125:0/4065534501 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81640035d0 con 0x7f8178164cb0 2023-10-17T06:23:01.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.182+0000 7f8176d9d700 1 -- 172.21.15.125:0/4065534501 >> v2:172.21.15.184:3300/0 conn(0x7f8178070460 msgr2=0x7f81780708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:23:01.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.182+0000 7f8176d9d700 1 --2- 172.21.15.125:0/4065534501 >> v2:172.21.15.184:3300/0 conn(0x7f8178070460 0x7f81780708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.182+0000 7f8176d9d700 1 -- 172.21.15.125:0/4065534501 >> v1:172.21.15.125:6789/0 conn(0x7f8178164cb0 legacy=0x7f8178165140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:01.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.182+0000 7f8176d9d700 1 -- 172.21.15.125:0/4065534501 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81780b3900 con 0x7f8178161200 2023-10-17T06:23:01.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.186+0000 7f8176d9d700 1 --2- 172.21.15.125:0/4065534501 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8178161200 0x7f81780b2280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8168009850 tx=0x7f8168009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19f71f1e765bf69a server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:01.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.186+0000 7f817659c700 1 -- 172.21.15.125:0/4065534501 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8168011830 con 0x7f8178161200 2023-10-17T06:23:01.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.186+0000 7f817659c700 1 -- 172.21.15.125:0/4065534501 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8168011990 con 0x7f8178161200 2023-10-17T06:23:01.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.186+0000 7f817659c700 1 -- 172.21.15.125:0/4065534501 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8168011d40 con 0x7f8178161200 2023-10-17T06:23:01.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.186+0000 7f817d1c1700 1 -- 172.21.15.125:0/4065534501 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8178161200 msgr2=0x7f81780b2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:01.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.186+0000 7f817d1c1700 1 --2- 172.21.15.125:0/4065534501 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8178161200 0x7f81780b2280 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8168009850 tx=0x7f8168009b60 comp rx=0 tx=0).stop 2023-10-17T06:23:01.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.186+0000 7f817d1c1700 1 -- 172.21.15.125:0/4065534501 shutdown_connections 2023-10-17T06:23:01.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.186+0000 7f817d1c1700 1 --2- 172.21.15.125:0/4065534501 >> v2:172.21.15.184:3300/0 conn(0x7f8178070460 0x7f81780708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.186+0000 7f817d1c1700 1 --2- 172.21.15.125:0/4065534501 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8178161200 0x7f81780b2280 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.186+0000 7f817d1c1700 1 -- 172.21.15.125:0/4065534501 >> 172.21.15.125:0/4065534501 conn(0x7f817806a3c0 msgr2=0x7f81780ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:01.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.186+0000 7f817d1c1700 1 -- 172.21.15.125:0/4065534501 shutdown_connections 2023-10-17T06:23:01.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.186+0000 7f817d1c1700 1 -- 172.21.15.125:0/4065534501 wait complete. 2023-10-17T06:23:01.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f817d1c1700 1 Processor -- start 2023-10-17T06:23:01.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f817d1c1700 1 -- start start 2023-10-17T06:23:01.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f817d1c1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8178070460 0x7f81780cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:01.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f817d1c1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8178161200 0x7f817814cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:01.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f817d1c1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8178164cb0 0x7f81781f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:01.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f817d1c1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81780ccea0 con 0x7f8178161200 2023-10-17T06:23:01.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f817d1c1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81780cd180 con 0x7f8178070460 2023-10-17T06:23:01.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f817d1c1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81780cd460 con 0x7f8178164cb0 2023-10-17T06:23:01.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f816ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8178161200 0x7f817814cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:01.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f816ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8178161200 0x7f817814cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48656/0 (socket says 172.21.15.125:48656) 2023-10-17T06:23:01.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f816ffff700 1 -- 172.21.15.125:0/2697910919 learned_addr learned my addr 172.21.15.125:0/2697910919 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:01.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f8176d9d700 1 --2- 172.21.15.125:0/2697910919 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8178070460 0x7f81780cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:01.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f817759e700 1 --2- 172.21.15.125:0/2697910919 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8178164cb0 0x7f81781f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:01.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f816ffff700 1 -- 172.21.15.125:0/2697910919 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8178164cb0 msgr2=0x7f81781f60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:01.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f816ffff700 1 --2- 172.21.15.125:0/2697910919 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8178164cb0 0x7f81781f60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f816ffff700 1 -- 172.21.15.125:0/2697910919 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8178070460 msgr2=0x7f81780cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:01.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f816ffff700 1 --2- 172.21.15.125:0/2697910919 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8178070460 0x7f81780cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f816ffff700 1 -- 172.21.15.125:0/2697910919 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81680094b0 con 0x7f8178161200 2023-10-17T06:23:01.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f816ffff700 1 --2- 172.21.15.125:0/2697910919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8178161200 0x7f817814cd10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f816000e840 tx=0x7f816000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:01.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f816f7fe700 1 -- 172.21.15.125:0/2697910919 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81600095a0 con 0x7f8178161200 2023-10-17T06:23:01.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f816f7fe700 1 -- 172.21.15.125:0/2697910919 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816000c690 con 0x7f8178161200 2023-10-17T06:23:01.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f817d1c1700 1 -- 172.21.15.125:0/2697910919 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81780cd740 con 0x7f8178161200 2023-10-17T06:23:01.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f816f7fe700 1 -- 172.21.15.125:0/2697910919 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816000ca00 con 0x7f8178161200 2023-10-17T06:23:01.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.190+0000 7f817d1c1700 1 -- 172.21.15.125:0/2697910919 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81781f6610 con 0x7f8178161200 2023-10-17T06:23:01.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.194+0000 7f817d1c1700 1 -- 172.21.15.125:0/2697910919 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f81780cd2f0 con 0x7f8178161200 2023-10-17T06:23:01.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.194+0000 7f816f7fe700 1 -- 172.21.15.125:0/2697910919 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f816000cb60 con 0x7f8178161200 2023-10-17T06:23:01.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.198+0000 7f816f7fe700 1 --2- 172.21.15.125:0/2697910919 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f81580656f0 0x7f8158067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:01.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.198+0000 7f816f7fe700 1 -- 172.21.15.125:0/2697910919 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f8160082bc0 con 0x7f8178161200 2023-10-17T06:23:01.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.198+0000 7f816f7fe700 1 --2- 172.21.15.125:0/2697910919 >> [v2:172.21.15.125:6809/1606722802,v1:172.21.15.125:6811/1606722802] conn(0x7f815806c060 0x7f815806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:01.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.198+0000 7f816f7fe700 1 -- 172.21.15.125:0/2697910919 --> [v2:172.21.15.125:6809/1606722802,v1:172.21.15.125:6811/1606722802] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f815806eb70 con 0x7f815806c060 2023-10-17T06:23:01.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.198+0000 7f816f7fe700 1 -- 172.21.15.125:0/2697910919 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81600872a0 con 0x7f8178161200 2023-10-17T06:23:01.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.198+0000 7f8176d9d700 1 --2- 172.21.15.125:0/2697910919 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f81580656f0 0x7f8158067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:01.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.198+0000 7f817759e700 1 --2- 172.21.15.125:0/2697910919 >> [v2:172.21.15.125:6809/1606722802,v1:172.21.15.125:6811/1606722802] conn(0x7f815806c060 0x7f815806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:01.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.198+0000 7f817759e700 1 --2- 172.21.15.125:0/2697910919 >> [v2:172.21.15.125:6809/1606722802,v1:172.21.15.125:6811/1606722802] conn(0x7f815806c060 0x7f815806e4a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:01.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.198+0000 7f8176d9d700 1 --2- 172.21.15.125:0/2697910919 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f81580656f0 0x7f8158067bb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f81680090b0 tx=0x7f8168008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:01.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.198+0000 7f816f7fe700 1 -- 172.21.15.125:0/2697910919 <== osd.1 v2:172.21.15.125:6809/1606722802 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f815806eb70 con 0x7f815806c060 2023-10-17T06:23:01.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.218+0000 7f817d1c1700 1 -- 172.21.15.125:0/2697910919 --> [v2:172.21.15.125:6809/1606722802,v1:172.21.15.125:6811/1606722802] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f81780afdf0 con 0x7f815806c060 2023-10-17T06:23:01.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.218+0000 7f816f7fe700 1 -- 172.21.15.125:0/2697910919 <== osd.1 v2:172.21.15.125:6809/1606722802 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f81700070f0 con 0x7f815806c060 2023-10-17T06:23:01.224 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-17T06:23:01.224 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-17T06:23:01.225 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-17T06:23:01.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.218+0000 7f817d1c1700 1 -- 172.21.15.125:0/2697910919 >> [v2:172.21.15.125:6809/1606722802,v1:172.21.15.125:6811/1606722802] conn(0x7f815806c060 msgr2=0x7f815806e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:01.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.218+0000 7f817d1c1700 1 --2- 172.21.15.125:0/2697910919 >> [v2:172.21.15.125:6809/1606722802,v1:172.21.15.125:6811/1606722802] conn(0x7f815806c060 0x7f815806e4a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.218+0000 7f817d1c1700 1 -- 172.21.15.125:0/2697910919 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f81580656f0 msgr2=0x7f8158067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:01.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.218+0000 7f817d1c1700 1 --2- 172.21.15.125:0/2697910919 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f81580656f0 0x7f8158067bb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f81680090b0 tx=0x7f8168008030 comp rx=0 tx=0).stop 2023-10-17T06:23:01.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.218+0000 7f817d1c1700 1 -- 172.21.15.125:0/2697910919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8178161200 msgr2=0x7f817814cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:01.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.218+0000 7f817d1c1700 1 --2- 172.21.15.125:0/2697910919 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8178161200 0x7f817814cd10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f816000e840 tx=0x7f816000ec00 comp rx=0 tx=0).stop 2023-10-17T06:23:01.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.218+0000 7f817759e700 1 -- 172.21.15.125:0/2697910919 reap_dead start 2023-10-17T06:23:01.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.218+0000 7f817d1c1700 1 -- 172.21.15.125:0/2697910919 shutdown_connections 2023-10-17T06:23:01.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.218+0000 7f817d1c1700 1 -- 172.21.15.125:0/2697910919 >> 172.21.15.125:0/2697910919 conn(0x7f817806a3c0 msgr2=0x7f81780ae640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:01.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.218+0000 7f817d1c1700 1 -- 172.21.15.125:0/2697910919 shutdown_connections 2023-10-17T06:23:01.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.218+0000 7f817d1c1700 1 -- 172.21.15.125:0/2697910919 wait complete. 2023-10-17T06:23:01.249 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-17T06:23:01.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.414+0000 7fe2a759e700 1 Processor -- start 2023-10-17T06:23:01.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.418+0000 7fe2a759e700 1 -- start start 2023-10-17T06:23:01.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.418+0000 7fe2a759e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe2a815cc80 0x7fe2a80d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:01.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.422+0000 7fe2a759e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a815d060 con 0x7fe2a80d30e0 2023-10-17T06:23:01.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.422+0000 7fe2a759e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a806d830 con 0x7fe2a80b1df0 2023-10-17T06:23:01.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.422+0000 7fe2a759e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a806dd60 con 0x7fe2a815cc80 2023-10-17T06:23:01.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.422+0000 7fe2a6d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe2a80d30e0 0x7fe2a8160730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42566/0 (socket says 172.21.15.125:42566) 2023-10-17T06:23:01.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.422+0000 7fe2a6d9d700 1 -- 172.21.15.125:0/3880877084 learned_addr learned my addr 172.21.15.125:0/3880877084 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:23:01.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.422+0000 7fe2a659c700 1 --2- 172.21.15.125:0/3880877084 >> v2:172.21.15.184:3300/0 conn(0x7fe2a815cc80 0x7fe2a80d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:01.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.422+0000 7fe2a559a700 1 -- 172.21.15.125:0/3880877084 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507710082 0 0) 0x7fe2a815d060 con 0x7fe2a80d30e0 2023-10-17T06:23:01.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.422+0000 7fe2a559a700 1 -- 172.21.15.125:0/3880877084 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2900035d0 con 0x7fe2a80d30e0 2023-10-17T06:23:01.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.422+0000 7fe2a559a700 1 -- 172.21.15.125:0/3880877084 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 761691140 0 0) 0x7fe2900035d0 con 0x7fe2a80d30e0 2023-10-17T06:23:01.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.422+0000 7fe2a659c700 1 -- 172.21.15.125:0/3880877084 >> v1:172.21.15.184:6789/0 conn(0x7fe2a80b1df0 legacy=0x7fe2a80d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:01.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.422+0000 7fe2a659c700 1 -- 172.21.15.125:0/3880877084 >> v1:172.21.15.125:6789/0 conn(0x7fe2a80d30e0 legacy=0x7fe2a8160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:01.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.422+0000 7fe2a659c700 1 -- 172.21.15.125:0/3880877084 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a806da80 con 0x7fe2a815cc80 2023-10-17T06:23:01.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.422+0000 7fe2a659c700 1 --2- 172.21.15.125:0/3880877084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2a815cc80 0x7fe2a80d13c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe298009840 tx=0x7fe298009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e94d7c2e96f57263 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:01.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.422+0000 7fe2a559a700 1 -- 172.21.15.125:0/3880877084 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a00019f0 con 0x7fe2a815cc80 2023-10-17T06:23:01.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.422+0000 7fe2a559a700 1 -- 172.21.15.125:0/3880877084 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe298004030 con 0x7fe2a815cc80 2023-10-17T06:23:01.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.422+0000 7fe2a559a700 1 -- 172.21.15.125:0/3880877084 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2980043c0 con 0x7fe2a815cc80 2023-10-17T06:23:01.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.426+0000 7fe2a759e700 1 -- 172.21.15.125:0/3880877084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2a815cc80 msgr2=0x7fe2a80d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:01.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.426+0000 7fe2a759e700 1 --2- 172.21.15.125:0/3880877084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2a815cc80 0x7fe2a80d13c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe298009840 tx=0x7fe298009b50 comp rx=0 tx=0).stop 2023-10-17T06:23:01.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.426+0000 7fe2a759e700 1 -- 172.21.15.125:0/3880877084 shutdown_connections 2023-10-17T06:23:01.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.426+0000 7fe2a759e700 1 --2- 172.21.15.125:0/3880877084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2a815cc80 0x7fe2a80d13c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.426+0000 7fe2a759e700 1 -- 172.21.15.125:0/3880877084 >> 172.21.15.125:0/3880877084 conn(0x7fe2a80cf530 msgr2=0x7fe2a80cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:01.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.426+0000 7fe2a759e700 1 -- 172.21.15.125:0/3880877084 shutdown_connections 2023-10-17T06:23:01.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.426+0000 7fe2a759e700 1 -- 172.21.15.125:0/3880877084 wait complete. 2023-10-17T06:23:01.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.430+0000 7fe2a759e700 1 Processor -- start 2023-10-17T06:23:01.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.430+0000 7fe2a759e700 1 -- start start 2023-10-17T06:23:01.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.430+0000 7fe2a759e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2a80b1df0 0x7fe2a8146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:01.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.430+0000 7fe2a759e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2a80d30e0 0x7fe2a80b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:01.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.430+0000 7fe2a759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2a815cc80 0x7fe2a80b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:01.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.430+0000 7fe2a759e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a8149390 con 0x7fe2a80b1df0 2023-10-17T06:23:01.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.430+0000 7fe2a759e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a81495e0 con 0x7fe2a80d30e0 2023-10-17T06:23:01.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.430+0000 7fe2a759e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a81498c0 con 0x7fe2a815cc80 2023-10-17T06:23:01.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.430+0000 7fe2a659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2a80b1df0 0x7fe2a8146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:01.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.430+0000 7fe2a659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2a80b1df0 0x7fe2a8146bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48664/0 (socket says 172.21.15.125:48664) 2023-10-17T06:23:01.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.430+0000 7fe2a659c700 1 -- 172.21.15.125:0/3996741270 learned_addr learned my addr 172.21.15.125:0/3996741270 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:01.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.430+0000 7fe2a6d9d700 1 --2- 172.21.15.125:0/3996741270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2a815cc80 0x7fe2a80b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:01.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.430+0000 7fe2a5d9b700 1 --2- 172.21.15.125:0/3996741270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2a80d30e0 0x7fe2a80b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:01.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.434+0000 7fe2a659c700 1 -- 172.21.15.125:0/3996741270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2a815cc80 msgr2=0x7fe2a80b2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:01.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.434+0000 7fe2a659c700 1 --2- 172.21.15.125:0/3996741270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2a815cc80 0x7fe2a80b2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.434+0000 7fe2a659c700 1 -- 172.21.15.125:0/3996741270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2a80d30e0 msgr2=0x7fe2a80b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:01.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.434+0000 7fe2a659c700 1 --2- 172.21.15.125:0/3996741270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2a80d30e0 0x7fe2a80b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.434+0000 7fe2a659c700 1 -- 172.21.15.125:0/3996741270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe298009450 con 0x7fe2a80b1df0 2023-10-17T06:23:01.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.434+0000 7fe2a6d9d700 1 --2- 172.21.15.125:0/3996741270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2a815cc80 0x7fe2a80b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:23:01.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.434+0000 7fe2a5d9b700 1 --2- 172.21.15.125:0/3996741270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2a80d30e0 0x7fe2a80b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:23:01.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.434+0000 7fe2a659c700 1 --2- 172.21.15.125:0/3996741270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2a80b1df0 0x7fe2a8146bb0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe29800a010 tx=0x7fe298004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:01.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.434+0000 7fe296ffd700 1 -- 172.21.15.125:0/3996741270 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe298010790 con 0x7fe2a80b1df0 2023-10-17T06:23:01.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.434+0000 7fe296ffd700 1 -- 172.21.15.125:0/3996741270 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2980108f0 con 0x7fe2a80b1df0 2023-10-17T06:23:01.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.434+0000 7fe2a759e700 1 -- 172.21.15.125:0/3996741270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a8149ba0 con 0x7fe2a80b1df0 2023-10-17T06:23:01.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.434+0000 7fe296ffd700 1 -- 172.21.15.125:0/3996741270 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe298010c80 con 0x7fe2a80b1df0 2023-10-17T06:23:01.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.434+0000 7fe2a759e700 1 -- 172.21.15.125:0/3996741270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a80acb20 con 0x7fe2a80b1df0 2023-10-17T06:23:01.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.434+0000 7fe2a759e700 1 -- 172.21.15.125:0/3996741270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a80709d0 con 0x7fe2a80b1df0 2023-10-17T06:23:01.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.434+0000 7fe296ffd700 1 -- 172.21.15.125:0/3996741270 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe29801c420 con 0x7fe2a80b1df0 2023-10-17T06:23:01.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.438+0000 7fe296ffd700 1 --2- 172.21.15.125:0/3996741270 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe288065770 0x7fe288067c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:01.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.438+0000 7fe296ffd700 1 -- 172.21.15.125:0/3996741270 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fe298006e40 con 0x7fe2a80b1df0 2023-10-17T06:23:01.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.438+0000 7fe2a5d9b700 1 --2- 172.21.15.125:0/3996741270 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe288065770 0x7fe288067c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:01.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.438+0000 7fe2a5d9b700 1 --2- 172.21.15.125:0/3996741270 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe288065770 0x7fe288067c30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80b83a0 tx=0x7fe29c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:01.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.442+0000 7fe296ffd700 1 -- 172.21.15.125:0/3996741270 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe2980521a0 con 0x7fe2a80b1df0 2023-10-17T06:23:01.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.746+0000 7fe2a759e700 1 -- 172.21.15.125:0/3996741270 --> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2a80d0a50 con 0x7fe288065770 2023-10-17T06:23:01.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.750+0000 7fe296ffd700 1 -- 172.21.15.125:0/3996741270 <== mgr.4107 v2:172.21.15.125:6832/2516570548 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe29c0014b0 con 0x7fe288065770 2023-10-17T06:23:01.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.754+0000 7fe2a759e700 1 -- 172.21.15.125:0/3996741270 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe288065770 msgr2=0x7fe288067c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:01.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.754+0000 7fe2a759e700 1 --2- 172.21.15.125:0/3996741270 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe288065770 0x7fe288067c30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe2a80b83a0 tx=0x7fe29c009040 comp rx=0 tx=0).stop 2023-10-17T06:23:01.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.754+0000 7fe2a759e700 1 -- 172.21.15.125:0/3996741270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2a80b1df0 msgr2=0x7fe2a8146bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:01.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.754+0000 7fe2a759e700 1 --2- 172.21.15.125:0/3996741270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2a80b1df0 0x7fe2a8146bb0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe29800a010 tx=0x7fe298004770 comp rx=0 tx=0).stop 2023-10-17T06:23:01.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.754+0000 7fe2a759e700 1 -- 172.21.15.125:0/3996741270 shutdown_connections 2023-10-17T06:23:01.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.754+0000 7fe2a759e700 1 --2- 172.21.15.125:0/3996741270 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fe288065770 0x7fe288067c30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.754+0000 7fe2a759e700 1 --2- 172.21.15.125:0/3996741270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe2a815cc80 0x7fe2a80b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.754+0000 7fe2a759e700 1 --2- 172.21.15.125:0/3996741270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe2a80d30e0 0x7fe2a80b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.754+0000 7fe2a759e700 1 --2- 172.21.15.125:0/3996741270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2a80b1df0 0x7fe2a8146bb0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.754+0000 7fe2a759e700 1 -- 172.21.15.125:0/3996741270 >> 172.21.15.125:0/3996741270 conn(0x7fe2a80cf530 msgr2=0x7fe2a80cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:01.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.754+0000 7fe2a759e700 1 -- 172.21.15.125:0/3996741270 shutdown_connections 2023-10-17T06:23:01.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.754+0000 7fe2a759e700 1 -- 172.21.15.125:0/3996741270 wait complete. 2023-10-17T06:23:01.764 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 1 to deep-scrub 2023-10-17T06:23:01.780 INFO:tasks.ceph:Scrubbing osd.2 2023-10-17T06:23:01.780 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-17T06:23:01.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.954+0000 7fec6344d700 1 Processor -- start 2023-10-17T06:23:01.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.954+0000 7fec6344d700 1 -- start start 2023-10-17T06:23:01.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec6344d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec5c15cde0 0x7fec5c0708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:01.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec6344d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fec5c06e440 0x7fec5c0b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:01.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec6344d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fec5c06e8a0 0x7fec5c0b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:01.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec6344d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c15d1c0 con 0x7fec5c06e440 2023-10-17T06:23:01.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec6344d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c070df0 con 0x7fec5c06e8a0 2023-10-17T06:23:01.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec6344d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c06f810 con 0x7fec5c15cde0 2023-10-17T06:23:01.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec609e8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fec5c06e440 0x7fec5c0b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:01.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec609e8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fec5c06e440 0x7fec5c0b64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48680/0 (socket says 172.21.15.125:48680) 2023-10-17T06:23:01.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec609e8700 1 -- 172.21.15.125:0/3256239569 learned_addr learned my addr 172.21.15.125:0/3256239569 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:01.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec611e9700 1 --2- 172.21.15.125:0/3256239569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec5c15cde0 0x7fec5c0708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:01.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec619ea700 1 --2- 172.21.15.125:0/3256239569 >> v2:172.21.15.184:3300/0 conn(0x7fec5c06e8a0 0x7fec5c0b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:01.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec609e8700 1 -- 172.21.15.125:0/3256239569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec5c15cde0 msgr2=0x7fec5c0708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:23:01.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec609e8700 1 --2- 172.21.15.125:0/3256239569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec5c15cde0 0x7fec5c0708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec609e8700 1 -- 172.21.15.125:0/3256239569 >> v2:172.21.15.184:3300/0 conn(0x7fec5c06e8a0 msgr2=0x7fec5c0b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:23:01.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec609e8700 1 --2- 172.21.15.125:0/3256239569 >> v2:172.21.15.184:3300/0 conn(0x7fec5c06e8a0 0x7fec5c0b6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec609e8700 1 -- 172.21.15.125:0/3256239569 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c06faf0 con 0x7fec5c06e440 2023-10-17T06:23:01.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec619ea700 1 --2- 172.21.15.125:0/3256239569 >> v2:172.21.15.184:3300/0 conn(0x7fec5c06e8a0 0x7fec5c0b6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:23:01.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec609e8700 1 --2- 172.21.15.125:0/3256239569 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec5c06e440 0x7fec5c0b64d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fec5c0b2700 tx=0x7fec4c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe3a8ee4f46c23 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:01.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec53fff700 1 -- 172.21.15.125:0/3256239569 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c011830 con 0x7fec5c06e440 2023-10-17T06:23:01.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec53fff700 1 -- 172.21.15.125:0/3256239569 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c011990 con 0x7fec5c06e440 2023-10-17T06:23:01.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec53fff700 1 -- 172.21.15.125:0/3256239569 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4c011d20 con 0x7fec5c06e440 2023-10-17T06:23:01.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec6344d700 1 -- 172.21.15.125:0/3256239569 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec5c06e440 msgr2=0x7fec5c0b64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:01.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec6344d700 1 --2- 172.21.15.125:0/3256239569 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec5c06e440 0x7fec5c0b64d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fec5c0b2700 tx=0x7fec4c009bf0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec6344d700 1 -- 172.21.15.125:0/3256239569 shutdown_connections 2023-10-17T06:23:01.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec6344d700 1 --2- 172.21.15.125:0/3256239569 >> v2:172.21.15.184:3300/0 conn(0x7fec5c06e8a0 0x7fec5c0b6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec6344d700 1 --2- 172.21.15.125:0/3256239569 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec5c06e440 0x7fec5c0b64d0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec6344d700 1 --2- 172.21.15.125:0/3256239569 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec5c15cde0 0x7fec5c0708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.958+0000 7fec6344d700 1 -- 172.21.15.125:0/3256239569 >> 172.21.15.125:0/3256239569 conn(0x7fec5c06a130 msgr2=0x7fec5c06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:01.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.962+0000 7fec6344d700 1 -- 172.21.15.125:0/3256239569 shutdown_connections 2023-10-17T06:23:01.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.962+0000 7fec6344d700 1 -- 172.21.15.125:0/3256239569 wait complete. 2023-10-17T06:23:01.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.962+0000 7fec6344d700 1 Processor -- start 2023-10-17T06:23:01.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.962+0000 7fec6344d700 1 -- start start 2023-10-17T06:23:01.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.966+0000 7fec6344d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec5c06e440 0x7fec5c1f3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:01.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.966+0000 7fec6344d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec5c06e8a0 0x7fec5c0adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:01.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.966+0000 7fec6344d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec5c15cde0 0x7fec5c1575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:01.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.966+0000 7fec6344d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c1f36a0 con 0x7fec5c15cde0 2023-10-17T06:23:01.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.966+0000 7fec6344d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0ac9b0 con 0x7fec5c06e440 2023-10-17T06:23:01.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.966+0000 7fec6344d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0abda0 con 0x7fec5c06e8a0 2023-10-17T06:23:01.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.966+0000 7fec619ea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec5c15cde0 0x7fec5c1575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:01.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.966+0000 7fec609e8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec5c06e8a0 0x7fec5c0adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:01.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.966+0000 7fec611e9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec5c06e440 0x7fec5c1f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:01.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.966+0000 7fec619ea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec5c15cde0 0x7fec5c1575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48682/0 (socket says 172.21.15.125:48682) 2023-10-17T06:23:01.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.966+0000 7fec609e8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec5c06e8a0 0x7fec5c0adac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:48354/0 (socket says 172.21.15.125:48354) 2023-10-17T06:23:01.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.966+0000 7fec619ea700 1 -- 172.21.15.125:0/2578376689 learned_addr learned my addr 172.21.15.125:0/2578376689 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:01.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.966+0000 7fec619ea700 1 -- 172.21.15.125:0/2578376689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec5c06e8a0 msgr2=0x7fec5c0adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:01.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.966+0000 7fec619ea700 1 --2- 172.21.15.125:0/2578376689 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec5c06e8a0 0x7fec5c0adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.966+0000 7fec619ea700 1 -- 172.21.15.125:0/2578376689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec5c06e440 msgr2=0x7fec5c1f3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:01.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.966+0000 7fec619ea700 1 --2- 172.21.15.125:0/2578376689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec5c06e440 0x7fec5c1f3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:01.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.966+0000 7fec619ea700 1 -- 172.21.15.125:0/2578376689 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c009570 con 0x7fec5c15cde0 2023-10-17T06:23:01.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.970+0000 7fec619ea700 1 --2- 172.21.15.125:0/2578376689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec5c15cde0 0x7fec5c1575d0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fec54007de0 tx=0x7fec5400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:01.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.970+0000 7fec51ffb700 1 -- 172.21.15.125:0/2578376689 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5400dd20 con 0x7fec5c15cde0 2023-10-17T06:23:01.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.970+0000 7fec51ffb700 1 -- 172.21.15.125:0/2578376689 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5400f040 con 0x7fec5c15cde0 2023-10-17T06:23:01.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.970+0000 7fec6344d700 1 -- 172.21.15.125:0/2578376689 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5c0ac080 con 0x7fec5c15cde0 2023-10-17T06:23:01.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.970+0000 7fec51ffb700 1 -- 172.21.15.125:0/2578376689 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec54003c80 con 0x7fec5c15cde0 2023-10-17T06:23:01.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.970+0000 7fec6344d700 1 -- 172.21.15.125:0/2578376689 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c0ac640 con 0x7fec5c15cde0 2023-10-17T06:23:01.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.970+0000 7fec6344d700 1 -- 172.21.15.125:0/2578376689 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fec5c0700b0 con 0x7fec5c15cde0 2023-10-17T06:23:01.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.974+0000 7fec51ffb700 1 -- 172.21.15.125:0/2578376689 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fec54004030 con 0x7fec5c15cde0 2023-10-17T06:23:01.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.974+0000 7fec51ffb700 1 --2- 172.21.15.125:0/2578376689 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fec400656f0 0x7fec40067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:01.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.974+0000 7fec51ffb700 1 -- 172.21.15.125:0/2578376689 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fec54082d60 con 0x7fec5c15cde0 2023-10-17T06:23:01.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.974+0000 7fec611e9700 1 --2- 172.21.15.125:0/2578376689 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fec400656f0 0x7fec40067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:01.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.974+0000 7fec51ffb700 1 --2- 172.21.15.125:0/2578376689 >> [v2:172.21.15.125:6808/4280413072,v1:172.21.15.125:6810/4280413072] conn(0x7fec4006c060 0x7fec4006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:01.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.974+0000 7fec51ffb700 1 -- 172.21.15.125:0/2578376689 --> [v2:172.21.15.125:6808/4280413072,v1:172.21.15.125:6810/4280413072] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec4006eb70 con 0x7fec4006c060 2023-10-17T06:23:01.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.974+0000 7fec51ffb700 1 -- 172.21.15.125:0/2578376689 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec54085340 con 0x7fec5c15cde0 2023-10-17T06:23:01.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.974+0000 7fec609e8700 1 --2- 172.21.15.125:0/2578376689 >> [v2:172.21.15.125:6808/4280413072,v1:172.21.15.125:6810/4280413072] conn(0x7fec4006c060 0x7fec4006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:01.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.978+0000 7fec611e9700 1 --2- 172.21.15.125:0/2578376689 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fec400656f0 0x7fec40067bb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fec58009b50 tx=0x7fec58009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:01.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.978+0000 7fec609e8700 1 --2- 172.21.15.125:0/2578376689 >> [v2:172.21.15.125:6808/4280413072,v1:172.21.15.125:6810/4280413072] conn(0x7fec4006c060 0x7fec4006e4a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:01.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.978+0000 7fec51ffb700 1 -- 172.21.15.125:0/2578376689 <== osd.2 v2:172.21.15.125:6808/4280413072 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fec4006eb70 con 0x7fec4006c060 2023-10-17T06:23:02.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.994+0000 7fec6344d700 1 -- 172.21.15.125:0/2578376689 --> [v2:172.21.15.125:6808/4280413072,v1:172.21.15.125:6810/4280413072] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fec5c06fdd0 con 0x7fec4006c060 2023-10-17T06:23:02.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.994+0000 7fec51ffb700 1 -- 172.21.15.125:0/2578376689 <== osd.2 v2:172.21.15.125:6808/4280413072 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fec4c011b00 con 0x7fec4006c060 2023-10-17T06:23:02.003 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-17T06:23:02.003 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-17T06:23:02.003 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-17T06:23:02.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.998+0000 7fec6344d700 1 -- 172.21.15.125:0/2578376689 >> [v2:172.21.15.125:6808/4280413072,v1:172.21.15.125:6810/4280413072] conn(0x7fec4006c060 msgr2=0x7fec4006e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:02.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.998+0000 7fec6344d700 1 --2- 172.21.15.125:0/2578376689 >> [v2:172.21.15.125:6808/4280413072,v1:172.21.15.125:6810/4280413072] conn(0x7fec4006c060 0x7fec4006e4a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.998+0000 7fec6344d700 1 -- 172.21.15.125:0/2578376689 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fec400656f0 msgr2=0x7fec40067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:02.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.998+0000 7fec6344d700 1 --2- 172.21.15.125:0/2578376689 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fec400656f0 0x7fec40067bb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fec58009b50 tx=0x7fec58009240 comp rx=0 tx=0).stop 2023-10-17T06:23:02.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.998+0000 7fec6344d700 1 -- 172.21.15.125:0/2578376689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec5c15cde0 msgr2=0x7fec5c1575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:02.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.998+0000 7fec6344d700 1 --2- 172.21.15.125:0/2578376689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec5c15cde0 0x7fec5c1575d0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fec54007de0 tx=0x7fec5400d3b0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.998+0000 7fec619ea700 1 -- 172.21.15.125:0/2578376689 reap_dead start 2023-10-17T06:23:02.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.998+0000 7fec6344d700 1 -- 172.21.15.125:0/2578376689 shutdown_connections 2023-10-17T06:23:02.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.998+0000 7fec6344d700 1 -- 172.21.15.125:0/2578376689 >> 172.21.15.125:0/2578376689 conn(0x7fec5c06a130 msgr2=0x7fec5c0cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:02.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.998+0000 7fec6344d700 1 -- 172.21.15.125:0/2578376689 shutdown_connections 2023-10-17T06:23:02.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:01.998+0000 7fec6344d700 1 -- 172.21.15.125:0/2578376689 wait complete. 2023-10-17T06:23:02.025 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-17T06:23:02.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.206+0000 7f9ad759e700 1 Processor -- start 2023-10-17T06:23:02.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.210+0000 7f9ad759e700 1 -- start start 2023-10-17T06:23:02.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.210+0000 7f9ad759e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9ad8144150 0x7f9ad80cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:02.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.210+0000 7f9ad759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ad80ce1a0 0x7f9ad80cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:02.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.210+0000 7f9ad759e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9ad80cbde0 0x7f9ad815e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:02.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.210+0000 7f9ad759e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad80cc270 con 0x7f9ad80cbde0 2023-10-17T06:23:02.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.210+0000 7f9ad759e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad8070de0 con 0x7f9ad8144150 2023-10-17T06:23:02.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.210+0000 7f9ad759e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80701d0 con 0x7f9ad80ce1a0 2023-10-17T06:23:02.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.210+0000 7f9ad6d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9ad80cbde0 0x7f9ad815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:02.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.210+0000 7f9ad5d9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ad80ce1a0 0x7f9ad80cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:02.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.210+0000 7f9ad659c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9ad8144150 0x7f9ad80cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:02.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.210+0000 7f9ad5d9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ad80ce1a0 0x7f9ad80cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.125:48368/0 (socket says 172.21.15.125:48368) 2023-10-17T06:23:02.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.210+0000 7f9ad6d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9ad80cbde0 0x7f9ad815e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48688/0 (socket says 172.21.15.125:48688) 2023-10-17T06:23:02.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.210+0000 7f9ad5d9b700 1 -- 172.21.15.125:0/3970866911 learned_addr learned my addr 172.21.15.125:0/3970866911 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:02.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.214+0000 7f9ad5d9b700 1 -- 172.21.15.125:0/3970866911 >> v2:172.21.15.184:3300/0 conn(0x7f9ad8144150 msgr2=0x7f9ad80cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:23:02.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.214+0000 7f9ad5d9b700 1 --2- 172.21.15.125:0/3970866911 >> v2:172.21.15.184:3300/0 conn(0x7f9ad8144150 0x7f9ad80cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.214+0000 7f9ad5d9b700 1 -- 172.21.15.125:0/3970866911 >> v2:172.21.15.125:3300/0 conn(0x7f9ad80cbde0 msgr2=0x7f9ad815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:23:02.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.214+0000 7f9ad5d9b700 1 --2- 172.21.15.125:0/3970866911 >> v2:172.21.15.125:3300/0 conn(0x7f9ad80cbde0 0x7f9ad815e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.214+0000 7f9ad5d9b700 1 -- 172.21.15.125:0/3970866911 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad80704b0 con 0x7f9ad80ce1a0 2023-10-17T06:23:02.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.214+0000 7f9ad5d9b700 1 --2- 172.21.15.125:0/3970866911 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ad80ce1a0 0x7f9ad80cb8a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80cf290 tx=0x7f9acc009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e4c9d4b36a3dd87 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:02.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.214+0000 7f9ad559a700 1 -- 172.21.15.125:0/3970866911 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc011830 con 0x7f9ad80ce1a0 2023-10-17T06:23:02.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.214+0000 7f9ad559a700 1 -- 172.21.15.125:0/3970866911 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9acc011990 con 0x7f9ad80ce1a0 2023-10-17T06:23:02.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.214+0000 7f9ad559a700 1 -- 172.21.15.125:0/3970866911 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc011d20 con 0x7f9ad80ce1a0 2023-10-17T06:23:02.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.214+0000 7f9ad759e700 1 -- 172.21.15.125:0/3970866911 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ad80ce1a0 msgr2=0x7f9ad80cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:02.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.214+0000 7f9ad759e700 1 --2- 172.21.15.125:0/3970866911 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ad80ce1a0 0x7f9ad80cb8a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80cf290 tx=0x7f9acc009bf0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.214+0000 7f9ad759e700 1 -- 172.21.15.125:0/3970866911 shutdown_connections 2023-10-17T06:23:02.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.214+0000 7f9ad759e700 1 --2- 172.21.15.125:0/3970866911 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ad80ce1a0 0x7f9ad80cb8a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.214+0000 7f9ad759e700 1 --2- 172.21.15.125:0/3970866911 >> v2:172.21.15.125:3300/0 conn(0x7f9ad80cbde0 0x7f9ad815e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.214+0000 7f9ad759e700 1 --2- 172.21.15.125:0/3970866911 >> v2:172.21.15.184:3300/0 conn(0x7f9ad8144150 0x7f9ad80cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.214+0000 7f9ad759e700 1 -- 172.21.15.125:0/3970866911 >> 172.21.15.125:0/3970866911 conn(0x7f9ad80b0bf0 msgr2=0x7f9ad80ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:02.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.214+0000 7f9ad759e700 1 -- 172.21.15.125:0/3970866911 shutdown_connections 2023-10-17T06:23:02.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.214+0000 7f9ad759e700 1 -- 172.21.15.125:0/3970866911 wait complete. 2023-10-17T06:23:02.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.218+0000 7f9ad759e700 1 Processor -- start 2023-10-17T06:23:02.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.218+0000 7f9ad759e700 1 -- start start 2023-10-17T06:23:02.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ad759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ad80cbde0 0x7f9ad80c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:02.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ad759e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ad80ce1a0 0x7f9ad8142110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:02.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ad759e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad8144150 0x7f9ad80ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:02.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ad759e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80c37c0 con 0x7f9ad80ce1a0 2023-10-17T06:23:02.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ad759e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80c3aa0 con 0x7f9ad8144150 2023-10-17T06:23:02.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ad759e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80c3d80 con 0x7f9ad80cbde0 2023-10-17T06:23:02.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ad5d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ad80ce1a0 0x7f9ad8142110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:02.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ad5d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ad80ce1a0 0x7f9ad8142110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48698/0 (socket says 172.21.15.125:48698) 2023-10-17T06:23:02.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ad5d9b700 1 -- 172.21.15.125:0/1517331026 learned_addr learned my addr 172.21.15.125:0/1517331026 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:02.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ad659c700 1 --2- 172.21.15.125:0/1517331026 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ad80cbde0 0x7f9ad80c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:02.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ad6d9d700 1 --2- 172.21.15.125:0/1517331026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad8144150 0x7f9ad80ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:02.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ad659c700 1 -- 172.21.15.125:0/1517331026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad8144150 msgr2=0x7f9ad80ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:02.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ad659c700 1 --2- 172.21.15.125:0/1517331026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad8144150 0x7f9ad80ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ad659c700 1 -- 172.21.15.125:0/1517331026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ad80ce1a0 msgr2=0x7f9ad8142110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:02.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ad659c700 1 --2- 172.21.15.125:0/1517331026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ad80ce1a0 0x7f9ad8142110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ad659c700 1 -- 172.21.15.125:0/1517331026 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9acc009570 con 0x7f9ad80cbde0 2023-10-17T06:23:02.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ad659c700 1 --2- 172.21.15.125:0/1517331026 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ad80cbde0 0x7f9ad80c4860 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800e870 tx=0x7f9ac800eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:02.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ac6ffd700 1 -- 172.21.15.125:0/1517331026 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8013680 con 0x7f9ad80cbde0 2023-10-17T06:23:02.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ac6ffd700 1 -- 172.21.15.125:0/1517331026 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac80137e0 con 0x7f9ad80cbde0 2023-10-17T06:23:02.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ad759e700 1 -- 172.21.15.125:0/1517331026 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad80c4060 con 0x7f9ad80cbde0 2023-10-17T06:23:02.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ac6ffd700 1 -- 172.21.15.125:0/1517331026 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8013b70 con 0x7f9ad80cbde0 2023-10-17T06:23:02.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.222+0000 7f9ad759e700 1 -- 172.21.15.125:0/1517331026 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad80c4da0 con 0x7f9ad80cbde0 2023-10-17T06:23:02.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.226+0000 7f9ac6ffd700 1 -- 172.21.15.125:0/1517331026 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9ac8013cd0 con 0x7f9ad80cbde0 2023-10-17T06:23:02.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.226+0000 7f9ad759e700 1 -- 172.21.15.125:0/1517331026 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad80c4580 con 0x7f9ad80cbde0 2023-10-17T06:23:02.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.226+0000 7f9ac6ffd700 1 --2- 172.21.15.125:0/1517331026 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9ab80656f0 0x7f9ab8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:02.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.226+0000 7f9ac6ffd700 1 -- 172.21.15.125:0/1517331026 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f9ac80829b0 con 0x7f9ad80cbde0 2023-10-17T06:23:02.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.226+0000 7f9ad5d9b700 1 --2- 172.21.15.125:0/1517331026 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9ab80656f0 0x7f9ab8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:02.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.230+0000 7f9ad5d9b700 1 --2- 172.21.15.125:0/1517331026 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9ab80656f0 0x7f9ab8067bb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00a010 tx=0x7f9acc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:02.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.230+0000 7f9ac6ffd700 1 -- 172.21.15.125:0/1517331026 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f9ac8050690 con 0x7f9ad80cbde0 2023-10-17T06:23:02.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.522+0000 7f9ad759e700 1 -- 172.21.15.125:0/1517331026 --> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ad8070a70 con 0x7f9ab80656f0 2023-10-17T06:23:02.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.522+0000 7f9ac6ffd700 1 -- 172.21.15.125:0/1517331026 <== mgr.4107 v2:172.21.15.125:6832/2516570548 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9acc006d40 con 0x7f9ab80656f0 2023-10-17T06:23:02.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.526+0000 7f9ad759e700 1 -- 172.21.15.125:0/1517331026 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9ab80656f0 msgr2=0x7f9ab8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:02.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.526+0000 7f9ad759e700 1 --2- 172.21.15.125:0/1517331026 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9ab80656f0 0x7f9ab8067bb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00a010 tx=0x7f9acc008030 comp rx=0 tx=0).stop 2023-10-17T06:23:02.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.526+0000 7f9ad759e700 1 -- 172.21.15.125:0/1517331026 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ad80cbde0 msgr2=0x7f9ad80c4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:02.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.526+0000 7f9ad759e700 1 --2- 172.21.15.125:0/1517331026 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ad80cbde0 0x7f9ad80c4860 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800e870 tx=0x7f9ac800eb80 comp rx=0 tx=0).stop 2023-10-17T06:23:02.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.526+0000 7f9ad759e700 1 -- 172.21.15.125:0/1517331026 shutdown_connections 2023-10-17T06:23:02.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.526+0000 7f9ad759e700 1 --2- 172.21.15.125:0/1517331026 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9ab80656f0 0x7f9ab8067bb0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.526+0000 7f9ad759e700 1 --2- 172.21.15.125:0/1517331026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad8144150 0x7f9ad80ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.526+0000 7f9ad759e700 1 --2- 172.21.15.125:0/1517331026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ad80ce1a0 0x7f9ad8142110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.526+0000 7f9ad759e700 1 --2- 172.21.15.125:0/1517331026 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ad80cbde0 0x7f9ad80c4860 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.526+0000 7f9ad759e700 1 -- 172.21.15.125:0/1517331026 >> 172.21.15.125:0/1517331026 conn(0x7f9ad80b0bf0 msgr2=0x7f9ad80cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:02.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.526+0000 7f9ad759e700 1 -- 172.21.15.125:0/1517331026 shutdown_connections 2023-10-17T06:23:02.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.526+0000 7f9ad759e700 1 -- 172.21.15.125:0/1517331026 wait complete. 2023-10-17T06:23:02.538 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 2 to deep-scrub 2023-10-17T06:23:02.555 INFO:tasks.ceph:Scrubbing osd.3 2023-10-17T06:23:02.556 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-17T06:23:02.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.734+0000 7f360521d700 1 Processor -- start 2023-10-17T06:23:02.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.734+0000 7f360521d700 1 -- start start 2023-10-17T06:23:02.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.738+0000 7f360521d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36001468c0 0x7f360006f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:02.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.738+0000 7f360521d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f360006fee0 0x7f36000b76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:02.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.738+0000 7f360521d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f36000b7c00 0x7f3600160850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:02.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.738+0000 7f360521d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3600070340 con 0x7f36000b7c00 2023-10-17T06:23:02.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.738+0000 7f360521d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36000b5b80 con 0x7f360006fee0 2023-10-17T06:23:02.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.738+0000 7f360521d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36000b8090 con 0x7f36001468c0 2023-10-17T06:23:02.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.738+0000 7f35ff59e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f36000b7c00 0x7f3600160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:02.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.738+0000 7f35ff59e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f36000b7c00 0x7f3600160850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48700/0 (socket says 172.21.15.125:48700) 2023-10-17T06:23:02.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.738+0000 7f35ff59e700 1 -- 172.21.15.125:0/3248440883 learned_addr learned my addr 172.21.15.125:0/3248440883 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:02.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.738+0000 7f35fe59c700 1 --2- 172.21.15.125:0/3248440883 >> v2:172.21.15.184:3300/0 conn(0x7f360006fee0 0x7f36000b76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:02.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.738+0000 7f35fed9d700 1 --2- 172.21.15.125:0/3248440883 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36001468c0 0x7f360006f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:02.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.738+0000 7f35ff59e700 1 -- 172.21.15.125:0/3248440883 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36001468c0 msgr2=0x7f360006f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:23:02.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.738+0000 7f35ff59e700 1 --2- 172.21.15.125:0/3248440883 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36001468c0 0x7f360006f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.738+0000 7f35ff59e700 1 -- 172.21.15.125:0/3248440883 >> v2:172.21.15.184:3300/0 conn(0x7f360006fee0 msgr2=0x7f36000b76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:23:02.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.738+0000 7f35ff59e700 1 --2- 172.21.15.125:0/3248440883 >> v2:172.21.15.184:3300/0 conn(0x7f360006fee0 0x7f36000b76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.738+0000 7f35ff59e700 1 -- 172.21.15.125:0/3248440883 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36000b5dd0 con 0x7f36000b7c00 2023-10-17T06:23:02.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.738+0000 7f35ff59e700 1 --2- 172.21.15.125:0/3248440883 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36000b7c00 0x7f3600160850 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f36000d3c30 tx=0x7f35f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6149dc86ef0547 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:02.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.738+0000 7f35fdd9b700 1 -- 172.21.15.125:0/3248440883 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f800e070 con 0x7f36000b7c00 2023-10-17T06:23:02.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.738+0000 7f35fdd9b700 1 -- 172.21.15.125:0/3248440883 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f800b910 con 0x7f36000b7c00 2023-10-17T06:23:02.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.738+0000 7f35fdd9b700 1 -- 172.21.15.125:0/3248440883 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f800bcc0 con 0x7f36000b7c00 2023-10-17T06:23:02.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.742+0000 7f360521d700 1 -- 172.21.15.125:0/3248440883 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36000b7c00 msgr2=0x7f3600160850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:02.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.742+0000 7f360521d700 1 --2- 172.21.15.125:0/3248440883 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36000b7c00 0x7f3600160850 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f36000d3c30 tx=0x7f35f800b330 comp rx=0 tx=0).stop 2023-10-17T06:23:02.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.742+0000 7f360521d700 1 -- 172.21.15.125:0/3248440883 shutdown_connections 2023-10-17T06:23:02.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.742+0000 7f360521d700 1 --2- 172.21.15.125:0/3248440883 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f36000b7c00 0x7f3600160850 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.742+0000 7f360521d700 1 --2- 172.21.15.125:0/3248440883 >> v2:172.21.15.184:3300/0 conn(0x7f360006fee0 0x7f36000b76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.742+0000 7f360521d700 1 --2- 172.21.15.125:0/3248440883 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36001468c0 0x7f360006f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.742+0000 7f360521d700 1 -- 172.21.15.125:0/3248440883 >> 172.21.15.125:0/3248440883 conn(0x7f360006a130 msgr2=0x7f360006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:02.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.742+0000 7f360521d700 1 -- 172.21.15.125:0/3248440883 shutdown_connections 2023-10-17T06:23:02.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.742+0000 7f360521d700 1 -- 172.21.15.125:0/3248440883 wait complete. 2023-10-17T06:23:02.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.746+0000 7f360521d700 1 Processor -- start 2023-10-17T06:23:02.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.746+0000 7f360521d700 1 -- start start 2023-10-17T06:23:02.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.746+0000 7f360521d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f360006fee0 0x7f3600156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:02.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.746+0000 7f360521d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36000b7c00 0x7f3600160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:02.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.746+0000 7f360521d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36001468c0 0x7f3600143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:02.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.746+0000 7f360521d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3600156d50 con 0x7f360006fee0 2023-10-17T06:23:02.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.746+0000 7f360521d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360015ff00 con 0x7f36000b7c00 2023-10-17T06:23:02.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.746+0000 7f360521d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36001601e0 con 0x7f36001468c0 2023-10-17T06:23:02.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.746+0000 7f35fed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f360006fee0 0x7f3600156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:02.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.746+0000 7f35fed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f360006fee0 0x7f3600156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48712/0 (socket says 172.21.15.125:48712) 2023-10-17T06:23:02.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.746+0000 7f35fed9d700 1 -- 172.21.15.125:0/1592350496 learned_addr learned my addr 172.21.15.125:0/1592350496 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:02.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.746+0000 7f35ff59e700 1 --2- 172.21.15.125:0/1592350496 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36001468c0 0x7f3600143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:02.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.746+0000 7f35fed9d700 1 -- 172.21.15.125:0/1592350496 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36001468c0 msgr2=0x7f3600143f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:02.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.746+0000 7f35fed9d700 1 --2- 172.21.15.125:0/1592350496 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f36001468c0 0x7f3600143f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.746+0000 7f35fed9d700 1 -- 172.21.15.125:0/1592350496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36000b7c00 msgr2=0x7f3600160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:02.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.746+0000 7f35fed9d700 1 --2- 172.21.15.125:0/1592350496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36000b7c00 0x7f3600160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.746+0000 7f35fed9d700 1 -- 172.21.15.125:0/1592350496 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f8009b30 con 0x7f360006fee0 2023-10-17T06:23:02.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.746+0000 7f35fed9d700 1 --2- 172.21.15.125:0/1592350496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f360006fee0 0x7f3600156810 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f35f000e760 tx=0x7f35f000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:02.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.750+0000 7f35e77fe700 1 -- 172.21.15.125:0/1592350496 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f0013610 con 0x7f360006fee0 2023-10-17T06:23:02.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.750+0000 7f360521d700 1 -- 172.21.15.125:0/1592350496 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36001604c0 con 0x7f360006fee0 2023-10-17T06:23:02.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.750+0000 7f35e77fe700 1 -- 172.21.15.125:0/1592350496 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f0013770 con 0x7f360006fee0 2023-10-17T06:23:02.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.750+0000 7f35e77fe700 1 -- 172.21.15.125:0/1592350496 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f0013b00 con 0x7f360006fee0 2023-10-17T06:23:02.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.750+0000 7f360521d700 1 -- 172.21.15.125:0/1592350496 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3600160a80 con 0x7f360006fee0 2023-10-17T06:23:02.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.750+0000 7f360521d700 1 -- 172.21.15.125:0/1592350496 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f36000b6390 con 0x7f360006fee0 2023-10-17T06:23:02.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.754+0000 7f35e77fe700 1 -- 172.21.15.125:0/1592350496 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f35f0013c60 con 0x7f360006fee0 2023-10-17T06:23:02.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.754+0000 7f35e77fe700 1 --2- 172.21.15.125:0/1592350496 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f35ec0656f0 0x7f35ec067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:02.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.754+0000 7f35e77fe700 1 -- 172.21.15.125:0/1592350496 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f35f0082ef0 con 0x7f360006fee0 2023-10-17T06:23:02.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.754+0000 7f35fe59c700 1 --2- 172.21.15.125:0/1592350496 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f35ec0656f0 0x7f35ec067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:02.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.754+0000 7f35e77fe700 1 --2- 172.21.15.125:0/1592350496 >> [v2:172.21.15.125:6800/1353754211,v1:172.21.15.125:6801/1353754211] conn(0x7f35ec06c060 0x7f35ec06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:02.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.754+0000 7f35e77fe700 1 -- 172.21.15.125:0/1592350496 --> [v2:172.21.15.125:6800/1353754211,v1:172.21.15.125:6801/1353754211] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35ec06eb70 con 0x7f35ec06c060 2023-10-17T06:23:02.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.754+0000 7f35e77fe700 1 -- 172.21.15.125:0/1592350496 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35f0083260 con 0x7f360006fee0 2023-10-17T06:23:02.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.754+0000 7f35ff59e700 1 --2- 172.21.15.125:0/1592350496 >> [v2:172.21.15.125:6800/1353754211,v1:172.21.15.125:6801/1353754211] conn(0x7f35ec06c060 0x7f35ec06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:02.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.754+0000 7f35fe59c700 1 --2- 172.21.15.125:0/1592350496 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f35ec0656f0 0x7f35ec067bb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f35f4006b40 tx=0x7f35f4006ad0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:02.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.758+0000 7f35ff59e700 1 --2- 172.21.15.125:0/1592350496 >> [v2:172.21.15.125:6800/1353754211,v1:172.21.15.125:6801/1353754211] conn(0x7f35ec06c060 0x7f35ec06e4a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:02.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.758+0000 7f35e77fe700 1 -- 172.21.15.125:0/1592350496 <== osd.3 v2:172.21.15.125:6800/1353754211 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f35ec06eb70 con 0x7f35ec06c060 2023-10-17T06:23:02.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.774+0000 7f360521d700 1 -- 172.21.15.125:0/1592350496 --> [v2:172.21.15.125:6800/1353754211,v1:172.21.15.125:6801/1353754211] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f36000b60b0 con 0x7f35ec06c060 2023-10-17T06:23:02.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.774+0000 7f35e77fe700 1 -- 172.21.15.125:0/1592350496 <== osd.3 v2:172.21.15.125:6800/1353754211 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f35f8009300 con 0x7f35ec06c060 2023-10-17T06:23:02.780 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-17T06:23:02.781 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-17T06:23:02.781 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-17T06:23:02.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.774+0000 7f360521d700 1 -- 172.21.15.125:0/1592350496 >> [v2:172.21.15.125:6800/1353754211,v1:172.21.15.125:6801/1353754211] conn(0x7f35ec06c060 msgr2=0x7f35ec06e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:02.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.774+0000 7f360521d700 1 --2- 172.21.15.125:0/1592350496 >> [v2:172.21.15.125:6800/1353754211,v1:172.21.15.125:6801/1353754211] conn(0x7f35ec06c060 0x7f35ec06e4a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.774+0000 7f360521d700 1 -- 172.21.15.125:0/1592350496 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f35ec0656f0 msgr2=0x7f35ec067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:02.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.774+0000 7f360521d700 1 --2- 172.21.15.125:0/1592350496 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f35ec0656f0 0x7f35ec067bb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f35f4006b40 tx=0x7f35f4006ad0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.774+0000 7f360521d700 1 -- 172.21.15.125:0/1592350496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f360006fee0 msgr2=0x7f3600156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:02.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.774+0000 7f360521d700 1 --2- 172.21.15.125:0/1592350496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f360006fee0 0x7f3600156810 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f35f000e760 tx=0x7f35f000eb20 comp rx=0 tx=0).stop 2023-10-17T06:23:02.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.774+0000 7f35ff59e700 1 -- 172.21.15.125:0/1592350496 reap_dead start 2023-10-17T06:23:02.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.774+0000 7f360521d700 1 -- 172.21.15.125:0/1592350496 shutdown_connections 2023-10-17T06:23:02.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.774+0000 7f360521d700 1 -- 172.21.15.125:0/1592350496 >> 172.21.15.125:0/1592350496 conn(0x7f360006a130 msgr2=0x7f36000d0970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:02.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.774+0000 7f360521d700 1 -- 172.21.15.125:0/1592350496 shutdown_connections 2023-10-17T06:23:02.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.774+0000 7f360521d700 1 -- 172.21.15.125:0/1592350496 wait complete. 2023-10-17T06:23:02.801 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-17T06:23:02.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.978+0000 7fc343651700 1 Processor -- start 2023-10-17T06:23:02.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.978+0000 7fc343651700 1 -- start start 2023-10-17T06:23:02.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.978+0000 7fc343651700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc33c0cdab0 0x7fc33c0ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:02.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.978+0000 7fc343651700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33c0cf5e0 con 0x7fc33c0cb120 2023-10-17T06:23:02.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.978+0000 7fc343651700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33c0cf300 con 0x7fc33c15cd30 2023-10-17T06:23:02.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.978+0000 7fc343651700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c15d110 con 0x7fc33c0cdab0 2023-10-17T06:23:02.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.982+0000 7fc341bee700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc33c0cb120 0x7fc33c0ceb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42578/0 (socket says 172.21.15.125:42578) 2023-10-17T06:23:02.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.982+0000 7fc341bee700 1 -- 172.21.15.125:0/994819559 learned_addr learned my addr 172.21.15.125:0/994819559 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:23:02.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.982+0000 7fc340bec700 1 --2- 172.21.15.125:0/994819559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc33c0cdab0 0x7fc33c0ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:02.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.982+0000 7fc340bec700 1 -- 172.21.15.125:0/994819559 >> v1:172.21.15.184:6789/0 conn(0x7fc33c15cd30 legacy=0x7fc33c0cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:02.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.982+0000 7fc340bec700 1 -- 172.21.15.125:0/994819559 >> v1:172.21.15.125:6789/0 conn(0x7fc33c0cb120 legacy=0x7fc33c0ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:02.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.982+0000 7fc340bec700 1 -- 172.21.15.125:0/994819559 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33c06a340 con 0x7fc33c0cdab0 2023-10-17T06:23:02.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.982+0000 7fc340bec700 1 --2- 172.21.15.125:0/994819559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc33c0cdab0 0x7fc33c0ce5d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009880 tx=0x7fc32c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da5df46c333f9d58 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:02.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.986+0000 7fc333fff700 1 -- 172.21.15.125:0/994819559 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c011830 con 0x7fc33c0cdab0 2023-10-17T06:23:02.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.986+0000 7fc333fff700 1 -- 172.21.15.125:0/994819559 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c011990 con 0x7fc33c0cdab0 2023-10-17T06:23:02.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.986+0000 7fc333fff700 1 -- 172.21.15.125:0/994819559 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c011d20 con 0x7fc33c0cdab0 2023-10-17T06:23:02.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.986+0000 7fc343651700 1 -- 172.21.15.125:0/994819559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc33c0cdab0 msgr2=0x7fc33c0ce5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:02.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.986+0000 7fc343651700 1 --2- 172.21.15.125:0/994819559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc33c0cdab0 0x7fc33c0ce5d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc32c009880 tx=0x7fc32c009b90 comp rx=0 tx=0).stop 2023-10-17T06:23:02.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.986+0000 7fc343651700 1 -- 172.21.15.125:0/994819559 shutdown_connections 2023-10-17T06:23:02.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.986+0000 7fc343651700 1 --2- 172.21.15.125:0/994819559 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc33c0cdab0 0x7fc33c0ce5d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:02.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.986+0000 7fc343651700 1 -- 172.21.15.125:0/994819559 >> 172.21.15.125:0/994819559 conn(0x7fc33c0b24a0 msgr2=0x7fc33c0b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:02.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.986+0000 7fc343651700 1 -- 172.21.15.125:0/994819559 shutdown_connections 2023-10-17T06:23:02.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.986+0000 7fc343651700 1 -- 172.21.15.125:0/994819559 wait complete. 2023-10-17T06:23:02.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.990+0000 7fc343651700 1 Processor -- start 2023-10-17T06:23:02.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.990+0000 7fc343651700 1 -- start start 2023-10-17T06:23:02.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc343651700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc33c0cb120 0x7fc33c153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:02.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc343651700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc33c0cdab0 0x7fc33c1f6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:02.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc343651700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc33c15cd30 0x7fc33c15dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:02.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc343651700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c154360 con 0x7fc33c0cb120 2023-10-17T06:23:03.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc343651700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c15d9b0 con 0x7fc33c15cd30 2023-10-17T06:23:03.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc343651700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c154910 con 0x7fc33c0cdab0 2023-10-17T06:23:03.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc3413ed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc33c0cb120 0x7fc33c153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:03.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc3413ed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc33c0cb120 0x7fc33c153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48722/0 (socket says 172.21.15.125:48722) 2023-10-17T06:23:03.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc3413ed700 1 -- 172.21.15.125:0/3492000088 learned_addr learned my addr 172.21.15.125:0/3492000088 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:03.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc340bec700 1 --2- 172.21.15.125:0/3492000088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc33c0cdab0 0x7fc33c1f6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:03.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc341bee700 1 --2- 172.21.15.125:0/3492000088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc33c15cd30 0x7fc33c15dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:03.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc3413ed700 1 -- 172.21.15.125:0/3492000088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc33c0cdab0 msgr2=0x7fc33c1f6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:03.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc3413ed700 1 --2- 172.21.15.125:0/3492000088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc33c0cdab0 0x7fc33c1f6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:03.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc3413ed700 1 -- 172.21.15.125:0/3492000088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc33c15cd30 msgr2=0x7fc33c15dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:03.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc3413ed700 1 --2- 172.21.15.125:0/3492000088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc33c15cd30 0x7fc33c15dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:03.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc3413ed700 1 -- 172.21.15.125:0/3492000088 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32c0094b0 con 0x7fc33c0cb120 2023-10-17T06:23:03.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc340bec700 1 --2- 172.21.15.125:0/3492000088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc33c0cdab0 0x7fc33c1f6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:23:03.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc3413ed700 1 --2- 172.21.15.125:0/3492000088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc33c0cb120 0x7fc33c153e20 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc33800c500 tx=0x7fc33800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:03.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc331ffb700 1 -- 172.21.15.125:0/3492000088 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3380052d0 con 0x7fc33c0cb120 2023-10-17T06:23:03.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc331ffb700 1 -- 172.21.15.125:0/3492000088 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc338005430 con 0x7fc33c0cb120 2023-10-17T06:23:03.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc331ffb700 1 -- 172.21.15.125:0/3492000088 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3380055a0 con 0x7fc33c0cb120 2023-10-17T06:23:03.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc343651700 1 -- 172.21.15.125:0/3492000088 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33c1f7170 con 0x7fc33c0cb120 2023-10-17T06:23:03.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc343651700 1 -- 172.21.15.125:0/3492000088 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33c15d6d0 con 0x7fc33c0cb120 2023-10-17T06:23:03.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.994+0000 7fc343651700 1 -- 172.21.15.125:0/3492000088 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc33c1546e0 con 0x7fc33c0cb120 2023-10-17T06:23:03.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.998+0000 7fc331ffb700 1 -- 172.21.15.125:0/3492000088 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc3380038e0 con 0x7fc33c0cb120 2023-10-17T06:23:03.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.998+0000 7fc331ffb700 1 --2- 172.21.15.125:0/3492000088 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc320065720 0x7fc320067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:03.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.998+0000 7fc331ffb700 1 -- 172.21.15.125:0/3492000088 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fc338081fe0 con 0x7fc33c0cb120 2023-10-17T06:23:03.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.998+0000 7fc340bec700 1 --2- 172.21.15.125:0/3492000088 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc320065720 0x7fc320067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:03.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:02.998+0000 7fc340bec700 1 --2- 172.21.15.125:0/3492000088 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc320065720 0x7fc320067be0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc32c000c00 tx=0x7fc32c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:03.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.006+0000 7fc331ffb700 1 -- 172.21.15.125:0/3492000088 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc33c1546e0 con 0x7fc33c0cb120 2023-10-17T06:23:03.325 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.318+0000 7fc343651700 1 -- 172.21.15.125:0/3492000088 --> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc33c15daf0 con 0x7fc320065720 2023-10-17T06:23:03.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.322+0000 7fc331ffb700 1 -- 172.21.15.125:0/3492000088 <== mgr.4107 v2:172.21.15.125:6832/2516570548 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc33c15daf0 con 0x7fc320065720 2023-10-17T06:23:03.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.322+0000 7fc343651700 1 -- 172.21.15.125:0/3492000088 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc320065720 msgr2=0x7fc320067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:03.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.322+0000 7fc343651700 1 --2- 172.21.15.125:0/3492000088 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc320065720 0x7fc320067be0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc32c000c00 tx=0x7fc32c008030 comp rx=0 tx=0).stop 2023-10-17T06:23:03.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.322+0000 7fc343651700 1 -- 172.21.15.125:0/3492000088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc33c0cb120 msgr2=0x7fc33c153e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:03.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.322+0000 7fc343651700 1 --2- 172.21.15.125:0/3492000088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc33c0cb120 0x7fc33c153e20 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc33800c500 tx=0x7fc33800c810 comp rx=0 tx=0).stop 2023-10-17T06:23:03.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.322+0000 7fc343651700 1 -- 172.21.15.125:0/3492000088 shutdown_connections 2023-10-17T06:23:03.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.322+0000 7fc343651700 1 --2- 172.21.15.125:0/3492000088 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc320065720 0x7fc320067be0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:03.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.322+0000 7fc343651700 1 --2- 172.21.15.125:0/3492000088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc33c15cd30 0x7fc33c15dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:03.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.322+0000 7fc343651700 1 --2- 172.21.15.125:0/3492000088 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc33c0cdab0 0x7fc33c1f6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:03.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.322+0000 7fc343651700 1 --2- 172.21.15.125:0/3492000088 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc33c0cb120 0x7fc33c153e20 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:03.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.322+0000 7fc343651700 1 -- 172.21.15.125:0/3492000088 >> 172.21.15.125:0/3492000088 conn(0x7fc33c0b24a0 msgr2=0x7fc33c0b2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:03.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.322+0000 7fc343651700 1 -- 172.21.15.125:0/3492000088 shutdown_connections 2023-10-17T06:23:03.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.322+0000 7fc343651700 1 -- 172.21.15.125:0/3492000088 wait complete. 2023-10-17T06:23:03.334 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 3 to deep-scrub 2023-10-17T06:23:03.350 INFO:tasks.ceph:Scrubbing osd.4 2023-10-17T06:23:03.351 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-17T06:23:03.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.522+0000 7f9f4359e700 1 Processor -- start 2023-10-17T06:23:03.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.522+0000 7f9f4359e700 1 -- start start 2023-10-17T06:23:03.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.526+0000 7f9f4359e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f44160e50 0x7f9f4406e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:03.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.526+0000 7f9f4359e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9f440cb500 0x7f9f440b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:03.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.526+0000 7f9f4359e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f44070e00 con 0x7f9f440b2720 2023-10-17T06:23:03.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.526+0000 7f9f4359e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f440b1ee0 con 0x7f9f440cb500 2023-10-17T06:23:03.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.526+0000 7f9f4359e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440b2b90 con 0x7f9f44160e50 2023-10-17T06:23:03.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.526+0000 7f9f41d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9f440cb500 0x7f9f440b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:03.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.526+0000 7f9f41d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9f440cb500 0x7f9f440b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39606/0 (socket says 172.21.15.125:39606) 2023-10-17T06:23:03.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.526+0000 7f9f41d9b700 1 -- 172.21.15.125:0/3405378205 learned_addr learned my addr 172.21.15.125:0/3405378205 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:03.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.526+0000 7f9f4259c700 1 --2- 172.21.15.125:0/3405378205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f44160e50 0x7f9f4406e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:03.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.526+0000 7f9f41d9b700 1 -- 172.21.15.125:0/3405378205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f44160e50 msgr2=0x7f9f4406e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:23:03.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.526+0000 7f9f41d9b700 1 --2- 172.21.15.125:0/3405378205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f44160e50 0x7f9f4406e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:03.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.526+0000 7f9f41d9b700 1 -- 172.21.15.125:0/3405378205 >> v1:172.21.15.184:6789/0 conn(0x7f9f440b2720 legacy=0x7f9f44164af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:03.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.526+0000 7f9f41d9b700 1 -- 172.21.15.125:0/3405378205 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f440b16d0 con 0x7f9f440cb500 2023-10-17T06:23:03.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.526+0000 7f9f41d9b700 1 --2- 172.21.15.125:0/3405378205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f440cb500 0x7f9f440b21e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009940 tx=0x7f9f38009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f49bb6a06387081 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:03.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.526+0000 7f9f4159a700 1 -- 172.21.15.125:0/3405378205 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3800ba20 con 0x7f9f440cb500 2023-10-17T06:23:03.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.526+0000 7f9f4159a700 1 -- 172.21.15.125:0/3405378205 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f38009e90 con 0x7f9f440cb500 2023-10-17T06:23:03.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.526+0000 7f9f4159a700 1 -- 172.21.15.125:0/3405378205 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3800bda0 con 0x7f9f440cb500 2023-10-17T06:23:03.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.530+0000 7f9f4359e700 1 -- 172.21.15.125:0/3405378205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f440cb500 msgr2=0x7f9f440b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:03.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.530+0000 7f9f4359e700 1 --2- 172.21.15.125:0/3405378205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f440cb500 0x7f9f440b21e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009940 tx=0x7f9f38009c50 comp rx=0 tx=0).stop 2023-10-17T06:23:03.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.530+0000 7f9f4359e700 1 -- 172.21.15.125:0/3405378205 shutdown_connections 2023-10-17T06:23:03.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.530+0000 7f9f4359e700 1 --2- 172.21.15.125:0/3405378205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f440cb500 0x7f9f440b21e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:03.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.530+0000 7f9f4359e700 1 --2- 172.21.15.125:0/3405378205 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f44160e50 0x7f9f4406e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:03.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.530+0000 7f9f4359e700 1 -- 172.21.15.125:0/3405378205 >> 172.21.15.125:0/3405378205 conn(0x7f9f440b0bf0 msgr2=0x7f9f440ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:03.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.530+0000 7f9f4359e700 1 -- 172.21.15.125:0/3405378205 shutdown_connections 2023-10-17T06:23:03.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.530+0000 7f9f4359e700 1 -- 172.21.15.125:0/3405378205 wait complete. 2023-10-17T06:23:03.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.534+0000 7f9f4359e700 1 Processor -- start 2023-10-17T06:23:03.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.534+0000 7f9f4359e700 1 -- start start 2023-10-17T06:23:03.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.534+0000 7f9f4359e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f440b2720 0x7f9f44157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:03.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.534+0000 7f9f4359e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f440cb500 0x7f9f440ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:03.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.534+0000 7f9f4359e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f44160e50 0x7f9f440acf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:03.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.534+0000 7f9f4359e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f441faf00 con 0x7f9f440cb500 2023-10-17T06:23:03.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.534+0000 7f9f4359e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f44162a50 con 0x7f9f44160e50 2023-10-17T06:23:03.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.534+0000 7f9f4359e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f44162d30 con 0x7f9f440b2720 2023-10-17T06:23:03.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.538+0000 7f9f41d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f440cb500 0x7f9f440ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:03.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.538+0000 7f9f41d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f440cb500 0x7f9f440ae530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39608/0 (socket says 172.21.15.125:39608) 2023-10-17T06:23:03.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.538+0000 7f9f41d9b700 1 -- 172.21.15.125:0/3260208633 learned_addr learned my addr 172.21.15.125:0/3260208633 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:03.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.538+0000 7f9f4259c700 1 --2- 172.21.15.125:0/3260208633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f440b2720 0x7f9f44157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:03.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.538+0000 7f9f42d9d700 1 --2- 172.21.15.125:0/3260208633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f44160e50 0x7f9f440acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:03.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.538+0000 7f9f41d9b700 1 -- 172.21.15.125:0/3260208633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f440b2720 msgr2=0x7f9f44157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:03.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.538+0000 7f9f41d9b700 1 --2- 172.21.15.125:0/3260208633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9f440b2720 0x7f9f44157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:03.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.538+0000 7f9f41d9b700 1 -- 172.21.15.125:0/3260208633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f44160e50 msgr2=0x7f9f440acf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:03.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.538+0000 7f9f41d9b700 1 --2- 172.21.15.125:0/3260208633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f44160e50 0x7f9f440acf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:03.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.538+0000 7f9f41d9b700 1 -- 172.21.15.125:0/3260208633 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f38009570 con 0x7f9f440cb500 2023-10-17T06:23:03.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.538+0000 7f9f42d9d700 1 --2- 172.21.15.125:0/3260208633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9f44160e50 0x7f9f440acf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:23:03.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.538+0000 7f9f41d9b700 1 --2- 172.21.15.125:0/3260208633 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f440cb500 0x7f9f440ae530 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9f38000c00 tx=0x7f9f38004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:03.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.538+0000 7f9f32ffd700 1 -- 172.21.15.125:0/3260208633 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38004450 con 0x7f9f440cb500 2023-10-17T06:23:03.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.538+0000 7f9f32ffd700 1 -- 172.21.15.125:0/3260208633 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3801f070 con 0x7f9f440cb500 2023-10-17T06:23:03.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.538+0000 7f9f4359e700 1 -- 172.21.15.125:0/3260208633 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f44163010 con 0x7f9f440cb500 2023-10-17T06:23:03.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.538+0000 7f9f32ffd700 1 -- 172.21.15.125:0/3260208633 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38003900 con 0x7f9f440cb500 2023-10-17T06:23:03.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.538+0000 7f9f4359e700 1 -- 172.21.15.125:0/3260208633 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f44158230 con 0x7f9f440cb500 2023-10-17T06:23:03.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.538+0000 7f9f4359e700 1 -- 172.21.15.125:0/3260208633 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f440b1920 con 0x7f9f440cb500 2023-10-17T06:23:03.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.542+0000 7f9f32ffd700 1 -- 172.21.15.125:0/3260208633 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9f38003a60 con 0x7f9f440cb500 2023-10-17T06:23:03.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.542+0000 7f9f32ffd700 1 --2- 172.21.15.125:0/3260208633 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9f240656f0 0x7f9f24067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:03.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.542+0000 7f9f32ffd700 1 -- 172.21.15.125:0/3260208633 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f9f38021070 con 0x7f9f440cb500 2023-10-17T06:23:03.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.542+0000 7f9f4259c700 1 --2- 172.21.15.125:0/3260208633 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9f240656f0 0x7f9f24067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:03.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.542+0000 7f9f32ffd700 1 --2- 172.21.15.125:0/3260208633 >> [v2:172.21.15.184:6800/514892137,v1:172.21.15.184:6801/514892137] conn(0x7f9f2406c060 0x7f9f2406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:03.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.542+0000 7f9f32ffd700 1 -- 172.21.15.125:0/3260208633 --> [v2:172.21.15.184:6800/514892137,v1:172.21.15.184:6801/514892137] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f2406eb70 con 0x7f9f2406c060 2023-10-17T06:23:03.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.542+0000 7f9f32ffd700 1 -- 172.21.15.125:0/3260208633 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f38086490 con 0x7f9f440cb500 2023-10-17T06:23:03.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.546+0000 7f9f42d9d700 1 --2- 172.21.15.125:0/3260208633 >> [v2:172.21.15.184:6800/514892137,v1:172.21.15.184:6801/514892137] conn(0x7f9f2406c060 0x7f9f2406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:03.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.546+0000 7f9f4259c700 1 --2- 172.21.15.125:0/3260208633 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9f240656f0 0x7f9f24067bb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9f34007a60 tx=0x7f9f34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:03.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.546+0000 7f9f42d9d700 1 --2- 172.21.15.125:0/3260208633 >> [v2:172.21.15.184:6800/514892137,v1:172.21.15.184:6801/514892137] conn(0x7f9f2406c060 0x7f9f2406e4a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:03.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.546+0000 7f9f32ffd700 1 -- 172.21.15.125:0/3260208633 <== osd.4 v2:172.21.15.184:6800/514892137 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f9f2406eb70 con 0x7f9f2406c060 2023-10-17T06:23:03.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.566+0000 7f9f4359e700 1 -- 172.21.15.125:0/3260208633 --> [v2:172.21.15.184:6800/514892137,v1:172.21.15.184:6801/514892137] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9f440ae0f0 con 0x7f9f2406c060 2023-10-17T06:23:03.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.566+0000 7f9f32ffd700 1 -- 172.21.15.125:0/3260208633 <== osd.4 v2:172.21.15.184:6800/514892137 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9f3c003a20 con 0x7f9f2406c060 2023-10-17T06:23:03.573 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-17T06:23:03.574 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-17T06:23:03.574 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-17T06:23:03.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.566+0000 7f9f4359e700 1 -- 172.21.15.125:0/3260208633 >> [v2:172.21.15.184:6800/514892137,v1:172.21.15.184:6801/514892137] conn(0x7f9f2406c060 msgr2=0x7f9f2406e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:03.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.566+0000 7f9f4359e700 1 --2- 172.21.15.125:0/3260208633 >> [v2:172.21.15.184:6800/514892137,v1:172.21.15.184:6801/514892137] conn(0x7f9f2406c060 0x7f9f2406e4a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:03.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.566+0000 7f9f4359e700 1 -- 172.21.15.125:0/3260208633 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9f240656f0 msgr2=0x7f9f24067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:03.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.566+0000 7f9f4359e700 1 --2- 172.21.15.125:0/3260208633 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f9f240656f0 0x7f9f24067bb0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9f34007a60 tx=0x7f9f34008040 comp rx=0 tx=0).stop 2023-10-17T06:23:03.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.566+0000 7f9f4359e700 1 -- 172.21.15.125:0/3260208633 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f440cb500 msgr2=0x7f9f440ae530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:03.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.566+0000 7f9f4359e700 1 --2- 172.21.15.125:0/3260208633 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f440cb500 0x7f9f440ae530 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9f38000c00 tx=0x7f9f38004770 comp rx=0 tx=0).stop 2023-10-17T06:23:03.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.566+0000 7f9f42d9d700 1 -- 172.21.15.125:0/3260208633 reap_dead start 2023-10-17T06:23:03.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.566+0000 7f9f4359e700 1 -- 172.21.15.125:0/3260208633 shutdown_connections 2023-10-17T06:23:03.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.566+0000 7f9f4359e700 1 -- 172.21.15.125:0/3260208633 >> 172.21.15.125:0/3260208633 conn(0x7f9f440b0bf0 msgr2=0x7f9f4415dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:03.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.570+0000 7f9f4359e700 1 -- 172.21.15.125:0/3260208633 shutdown_connections 2023-10-17T06:23:03.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.570+0000 7f9f4359e700 1 -- 172.21.15.125:0/3260208633 wait complete. 2023-10-17T06:23:03.596 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-17T06:23:03.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.770+0000 7f27a759e700 1 Processor -- start 2023-10-17T06:23:03.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.770+0000 7f27a759e700 1 -- start start 2023-10-17T06:23:03.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.770+0000 7f27a759e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f27a8160e50 0x7f27a806e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:03.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.770+0000 7f27a759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27a80cb500 0x7f27a80b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:03.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.770+0000 7f27a759e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a8070e00 con 0x7f27a80b2720 2023-10-17T06:23:03.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.770+0000 7f27a759e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a80b1ee0 con 0x7f27a8160e50 2023-10-17T06:23:03.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.770+0000 7f27a759e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a80b2b90 con 0x7f27a80cb500 2023-10-17T06:23:03.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.774+0000 7f27a659c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f27a8160e50 0x7f27a806e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:03.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.774+0000 7f27a659c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f27a8160e50 0x7f27a806e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.125:55352/0 (socket says 172.21.15.125:55352) 2023-10-17T06:23:03.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.774+0000 7f27a659c700 1 -- 172.21.15.125:0/1483578647 learned_addr learned my addr 172.21.15.125:0/1483578647 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:03.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.774+0000 7f27a5d9b700 1 --2- 172.21.15.125:0/1483578647 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27a80cb500 0x7f27a80b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:03.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.774+0000 7f27a659c700 1 -- 172.21.15.125:0/1483578647 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27a80cb500 msgr2=0x7f27a80b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:23:03.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.774+0000 7f27a659c700 1 --2- 172.21.15.125:0/1483578647 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27a80cb500 0x7f27a80b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:03.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.774+0000 7f27a659c700 1 -- 172.21.15.125:0/1483578647 >> v1:172.21.15.184:6789/0 conn(0x7f27a80b2720 legacy=0x7f27a8164af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:03.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.774+0000 7f27a659c700 1 -- 172.21.15.125:0/1483578647 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a80b16d0 con 0x7f27a8160e50 2023-10-17T06:23:03.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.774+0000 7f27a5d9b700 1 --2- 172.21.15.125:0/1483578647 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27a80cb500 0x7f27a80b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:23:03.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.774+0000 7f27a659c700 1 --2- 172.21.15.125:0/1483578647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27a8160e50 0x7f27a806e3e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2798009940 tx=0x7f2798009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac0932bc6fa1dda5 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:03.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.774+0000 7f27a559a700 1 -- 172.21.15.125:0/1483578647 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2798011830 con 0x7f27a8160e50 2023-10-17T06:23:03.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.774+0000 7f27a559a700 1 -- 172.21.15.125:0/1483578647 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2798011990 con 0x7f27a8160e50 2023-10-17T06:23:03.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.774+0000 7f27a559a700 1 -- 172.21.15.125:0/1483578647 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2798011d20 con 0x7f27a8160e50 2023-10-17T06:23:03.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.778+0000 7f27a759e700 1 -- 172.21.15.125:0/1483578647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27a8160e50 msgr2=0x7f27a806e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:03.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.778+0000 7f27a759e700 1 --2- 172.21.15.125:0/1483578647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27a8160e50 0x7f27a806e3e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2798009940 tx=0x7f2798009c50 comp rx=0 tx=0).stop 2023-10-17T06:23:03.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.778+0000 7f27a759e700 1 -- 172.21.15.125:0/1483578647 shutdown_connections 2023-10-17T06:23:03.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.778+0000 7f27a759e700 1 --2- 172.21.15.125:0/1483578647 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27a80cb500 0x7f27a80b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:03.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.778+0000 7f27a759e700 1 --2- 172.21.15.125:0/1483578647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27a8160e50 0x7f27a806e3e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:03.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.778+0000 7f27a759e700 1 -- 172.21.15.125:0/1483578647 >> 172.21.15.125:0/1483578647 conn(0x7f27a80b0bf0 msgr2=0x7f27a80ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:03.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.778+0000 7f27a759e700 1 -- 172.21.15.125:0/1483578647 shutdown_connections 2023-10-17T06:23:03.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.778+0000 7f27a759e700 1 -- 172.21.15.125:0/1483578647 wait complete. 2023-10-17T06:23:03.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.778+0000 7f27a759e700 1 Processor -- start 2023-10-17T06:23:03.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.778+0000 7f27a759e700 1 -- start start 2023-10-17T06:23:03.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f27a759e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27a80b2720 0x7f27a81f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:03.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f27a759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27a80cb500 0x7f27a81624f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:03.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f27a759e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27a8160e50 0x7f27a81f9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:03.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f27a759e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a81f6e30 con 0x7f27a8160e50 2023-10-17T06:23:03.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f27a759e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a81fa8d0 con 0x7f27a80b2720 2023-10-17T06:23:03.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f27a759e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a81fabb0 con 0x7f27a80cb500 2023-10-17T06:23:03.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f27a6d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27a8160e50 0x7f27a81f9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:03.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f27a6d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27a8160e50 0x7f27a81f9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39622/0 (socket says 172.21.15.125:39622) 2023-10-17T06:23:03.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f27a659c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27a80b2720 0x7f27a81f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:03.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f27a6d9d700 1 -- 172.21.15.125:0/3747868527 learned_addr learned my addr 172.21.15.125:0/3747868527 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:03.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f27a5d9b700 1 --2- 172.21.15.125:0/3747868527 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27a80cb500 0x7f27a81624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:03.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f27a6d9d700 1 -- 172.21.15.125:0/3747868527 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27a80cb500 msgr2=0x7f27a81624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:03.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f27a6d9d700 1 --2- 172.21.15.125:0/3747868527 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27a80cb500 0x7f27a81624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:03.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f27a6d9d700 1 -- 172.21.15.125:0/3747868527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27a80b2720 msgr2=0x7f27a81f72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:03.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f27a6d9d700 1 --2- 172.21.15.125:0/3747868527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27a80b2720 0x7f27a81f72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:03.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f27a6d9d700 1 -- 172.21.15.125:0/3747868527 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279c0094b0 con 0x7f27a8160e50 2023-10-17T06:23:03.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f27a659c700 1 --2- 172.21.15.125:0/3747868527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27a80b2720 0x7f27a81f72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:23:03.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f27a6d9d700 1 --2- 172.21.15.125:0/3747868527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27a8160e50 0x7f27a81f9d60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f27a000cc50 tx=0x7f27a000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:03.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f2796ffd700 1 -- 172.21.15.125:0/3747868527 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a0003c20 con 0x7f27a8160e50 2023-10-17T06:23:03.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f2796ffd700 1 -- 172.21.15.125:0/3747868527 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a0003d80 con 0x7f27a8160e50 2023-10-17T06:23:03.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f2796ffd700 1 -- 172.21.15.125:0/3747868527 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a000aab0 con 0x7f27a8160e50 2023-10-17T06:23:03.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f27a759e700 1 -- 172.21.15.125:0/3747868527 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2798009570 con 0x7f27a8160e50 2023-10-17T06:23:03.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.782+0000 7f27a759e700 1 -- 172.21.15.125:0/3747868527 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a80a7770 con 0x7f27a8160e50 2023-10-17T06:23:03.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.786+0000 7f27a759e700 1 -- 172.21.15.125:0/3747868527 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a8073540 con 0x7f27a8160e50 2023-10-17T06:23:03.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.786+0000 7f2796ffd700 1 -- 172.21.15.125:0/3747868527 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f27a000ac10 con 0x7f27a8160e50 2023-10-17T06:23:03.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.786+0000 7f2796ffd700 1 --2- 172.21.15.125:0/3747868527 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f27880656f0 0x7f2788067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:03.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.790+0000 7f2796ffd700 1 -- 172.21.15.125:0/3747868527 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f27a0082d10 con 0x7f27a8160e50 2023-10-17T06:23:03.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.790+0000 7f27a659c700 1 --2- 172.21.15.125:0/3747868527 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f27880656f0 0x7f2788067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:03.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.790+0000 7f27a659c700 1 --2- 172.21.15.125:0/3747868527 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f27880656f0 0x7f2788067bb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2798009890 tx=0x7f2798008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:03.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:03.794+0000 7f2796ffd700 1 -- 172.21.15.125:0/3747868527 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f27a0088020 con 0x7f27a8160e50 2023-10-17T06:23:04.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.078+0000 7f27a759e700 1 -- 172.21.15.125:0/3747868527 --> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f27a80b1920 con 0x7f27880656f0 2023-10-17T06:23:04.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.078+0000 7f2796ffd700 1 -- 172.21.15.125:0/3747868527 <== mgr.4107 v2:172.21.15.125:6832/2516570548 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2798011c00 con 0x7f27880656f0 2023-10-17T06:23:04.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.082+0000 7f27a759e700 1 -- 172.21.15.125:0/3747868527 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f27880656f0 msgr2=0x7f2788067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:04.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.082+0000 7f27a759e700 1 --2- 172.21.15.125:0/3747868527 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f27880656f0 0x7f2788067bb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2798009890 tx=0x7f2798008030 comp rx=0 tx=0).stop 2023-10-17T06:23:04.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.082+0000 7f27a759e700 1 -- 172.21.15.125:0/3747868527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27a8160e50 msgr2=0x7f27a81f9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:04.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.082+0000 7f27a759e700 1 --2- 172.21.15.125:0/3747868527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27a8160e50 0x7f27a81f9d60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f27a000cc50 tx=0x7f27a000cf60 comp rx=0 tx=0).stop 2023-10-17T06:23:04.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.082+0000 7f27a759e700 1 -- 172.21.15.125:0/3747868527 shutdown_connections 2023-10-17T06:23:04.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.082+0000 7f27a759e700 1 --2- 172.21.15.125:0/3747868527 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f27880656f0 0x7f2788067bb0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:04.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.082+0000 7f27a759e700 1 --2- 172.21.15.125:0/3747868527 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f27a8160e50 0x7f27a81f9d60 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:04.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.082+0000 7f27a759e700 1 --2- 172.21.15.125:0/3747868527 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f27a80cb500 0x7f27a81624f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:04.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.082+0000 7f27a759e700 1 --2- 172.21.15.125:0/3747868527 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f27a80b2720 0x7f27a81f72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:04.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.082+0000 7f27a759e700 1 -- 172.21.15.125:0/3747868527 >> 172.21.15.125:0/3747868527 conn(0x7f27a80b0bf0 msgr2=0x7f27a806dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:04.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.082+0000 7f27a759e700 1 -- 172.21.15.125:0/3747868527 shutdown_connections 2023-10-17T06:23:04.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.082+0000 7f27a759e700 1 -- 172.21.15.125:0/3747868527 wait complete. 2023-10-17T06:23:04.092 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 4 to deep-scrub 2023-10-17T06:23:04.111 INFO:tasks.ceph:Scrubbing osd.5 2023-10-17T06:23:04.111 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-17T06:23:04.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.282+0000 7fb97f59e700 1 Processor -- start 2023-10-17T06:23:04.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.286+0000 7fb97f59e700 1 -- start start 2023-10-17T06:23:04.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.286+0000 7fb97f59e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb9801467a0 0x7fb9800b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:04.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.286+0000 7fb97f59e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb9800b5560 0x7fb9800ced80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:04.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97f59e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb98006f5f0 con 0x7fb9800cf2c0 2023-10-17T06:23:04.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97f59e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9800cf9f0 con 0x7fb9800b5560 2023-10-17T06:23:04.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97f59e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9800cf750 con 0x7fb9801467a0 2023-10-17T06:23:04.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb9800b5560 0x7fb9800ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:04.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97e59c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb9801467a0 0x7fb9800b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:04.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97dd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb9800b5560 0x7fb9800ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39630/0 (socket says 172.21.15.125:39630) 2023-10-17T06:23:04.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97dd9b700 1 -- 172.21.15.125:0/3653812725 learned_addr learned my addr 172.21.15.125:0/3653812725 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:04.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97dd9b700 1 -- 172.21.15.125:0/3653812725 >> v2:172.21.15.184:3300/0 conn(0x7fb9801467a0 msgr2=0x7fb9800b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:23:04.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97dd9b700 1 --2- 172.21.15.125:0/3653812725 >> v2:172.21.15.184:3300/0 conn(0x7fb9801467a0 0x7fb9800b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:04.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97dd9b700 1 -- 172.21.15.125:0/3653812725 >> v1:172.21.15.184:6789/0 conn(0x7fb9800cf2c0 legacy=0x7fb980160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:04.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97dd9b700 1 -- 172.21.15.125:0/3653812725 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9800d1960 con 0x7fb9800b5560 2023-10-17T06:23:04.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97dd9b700 1 --2- 172.21.15.125:0/3653812725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9800b5560 0x7fb9800ced80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb9800b4ff0 tx=0x7fb974009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803af322bb773e8c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:04.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97d59a700 1 -- 172.21.15.125:0/3653812725 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb974011830 con 0x7fb9800b5560 2023-10-17T06:23:04.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97d59a700 1 -- 172.21.15.125:0/3653812725 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb974011990 con 0x7fb9800b5560 2023-10-17T06:23:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97d59a700 1 -- 172.21.15.125:0/3653812725 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb974011d20 con 0x7fb9800b5560 2023-10-17T06:23:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97f59e700 1 -- 172.21.15.125:0/3653812725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9800b5560 msgr2=0x7fb9800ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97f59e700 1 --2- 172.21.15.125:0/3653812725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9800b5560 0x7fb9800ced80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb9800b4ff0 tx=0x7fb974009bf0 comp rx=0 tx=0).stop 2023-10-17T06:23:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97f59e700 1 -- 172.21.15.125:0/3653812725 shutdown_connections 2023-10-17T06:23:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97f59e700 1 --2- 172.21.15.125:0/3653812725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9800b5560 0x7fb9800ced80 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:04.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97f59e700 1 --2- 172.21.15.125:0/3653812725 >> v2:172.21.15.184:3300/0 conn(0x7fb9801467a0 0x7fb9800b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:04.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.290+0000 7fb97f59e700 1 -- 172.21.15.125:0/3653812725 >> 172.21.15.125:0/3653812725 conn(0x7fb98006ce90 msgr2=0x7fb9800b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:04.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.294+0000 7fb97f59e700 1 -- 172.21.15.125:0/3653812725 shutdown_connections 2023-10-17T06:23:04.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.294+0000 7fb97f59e700 1 -- 172.21.15.125:0/3653812725 wait complete. 2023-10-17T06:23:04.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.294+0000 7fb97f59e700 1 Processor -- start 2023-10-17T06:23:04.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb97f59e700 1 -- start start 2023-10-17T06:23:04.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb97f59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9800b5560 0x7fb9801416e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb97f59e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9800cf2c0 0x7fb9800cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb97f59e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9801467a0 0x7fb9800ce350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb97f59e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9801442e0 con 0x7fb9800b5560 2023-10-17T06:23:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb97f59e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9800b1480 con 0x7fb9801467a0 2023-10-17T06:23:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb97f59e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9800b1760 con 0x7fb9800cf2c0 2023-10-17T06:23:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb97e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9800b5560 0x7fb9801416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:04.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb97e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9800b5560 0x7fb9801416e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39634/0 (socket says 172.21.15.125:39634) 2023-10-17T06:23:04.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb97e59c700 1 -- 172.21.15.125:0/2200526676 learned_addr learned my addr 172.21.15.125:0/2200526676 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:04.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb97dd9b700 1 --2- 172.21.15.125:0/2200526676 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9800cf2c0 0x7fb9800cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:04.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb97ed9d700 1 --2- 172.21.15.125:0/2200526676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9801467a0 0x7fb9800ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:04.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb97e59c700 1 -- 172.21.15.125:0/2200526676 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9800cf2c0 msgr2=0x7fb9800cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:04.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb97e59c700 1 --2- 172.21.15.125:0/2200526676 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9800cf2c0 0x7fb9800cde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:04.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb97e59c700 1 -- 172.21.15.125:0/2200526676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9801467a0 msgr2=0x7fb9800ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:04.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb97e59c700 1 --2- 172.21.15.125:0/2200526676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9801467a0 0x7fb9800ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:04.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb97e59c700 1 -- 172.21.15.125:0/2200526676 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb974009570 con 0x7fb9800b5560 2023-10-17T06:23:04.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb97e59c700 1 --2- 172.21.15.125:0/2200526676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9800b5560 0x7fb9801416e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb97000ebe0 tx=0x7fb970009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:04.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb96effd700 1 -- 172.21.15.125:0/2200526676 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970009740 con 0x7fb9800b5560 2023-10-17T06:23:04.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb96effd700 1 -- 172.21.15.125:0/2200526676 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97000c8b0 con 0x7fb9800b5560 2023-10-17T06:23:04.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb97f59e700 1 -- 172.21.15.125:0/2200526676 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb980143c20 con 0x7fb9800b5560 2023-10-17T06:23:04.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb96effd700 1 -- 172.21.15.125:0/2200526676 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97000cc40 con 0x7fb9800b5560 2023-10-17T06:23:04.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.298+0000 7fb97f59e700 1 -- 172.21.15.125:0/2200526676 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb980141c20 con 0x7fb9800b5560 2023-10-17T06:23:04.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.302+0000 7fb97f59e700 1 -- 172.21.15.125:0/2200526676 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb9800d1c40 con 0x7fb9800b5560 2023-10-17T06:23:04.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.302+0000 7fb96effd700 1 -- 172.21.15.125:0/2200526676 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb970013470 con 0x7fb9800b5560 2023-10-17T06:23:04.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.306+0000 7fb96effd700 1 --2- 172.21.15.125:0/2200526676 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb9600656f0 0x7fb960067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:04.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.306+0000 7fb96effd700 1 -- 172.21.15.125:0/2200526676 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fb970082de0 con 0x7fb9800b5560 2023-10-17T06:23:04.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.306+0000 7fb97dd9b700 1 --2- 172.21.15.125:0/2200526676 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb9600656f0 0x7fb960067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:04.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.306+0000 7fb96effd700 1 --2- 172.21.15.125:0/2200526676 >> [v2:172.21.15.184:6824/3287748739,v1:172.21.15.184:6825/3287748739] conn(0x7fb96006c060 0x7fb96006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:04.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.306+0000 7fb96effd700 1 -- 172.21.15.125:0/2200526676 --> [v2:172.21.15.184:6824/3287748739,v1:172.21.15.184:6825/3287748739] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb96006eb70 con 0x7fb96006c060 2023-10-17T06:23:04.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.306+0000 7fb96effd700 1 -- 172.21.15.125:0/2200526676 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9700854a0 con 0x7fb9800b5560 2023-10-17T06:23:04.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.306+0000 7fb97ed9d700 1 --2- 172.21.15.125:0/2200526676 >> [v2:172.21.15.184:6824/3287748739,v1:172.21.15.184:6825/3287748739] conn(0x7fb96006c060 0x7fb96006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:04.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.306+0000 7fb97dd9b700 1 --2- 172.21.15.125:0/2200526676 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb9600656f0 0x7fb960067bb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb974000c00 tx=0x7fb974008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:04.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.306+0000 7fb97ed9d700 1 --2- 172.21.15.125:0/2200526676 >> [v2:172.21.15.184:6824/3287748739,v1:172.21.15.184:6825/3287748739] conn(0x7fb96006c060 0x7fb96006e4a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:04.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.310+0000 7fb96effd700 1 -- 172.21.15.125:0/2200526676 <== osd.5 v2:172.21.15.184:6824/3287748739 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb96006eb70 con 0x7fb96006c060 2023-10-17T06:23:04.322 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:23:04.329 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:23:04.332 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.326+0000 7fb97f59e700 1 -- 172.21.15.125:0/2200526676 --> [v2:172.21.15.184:6824/3287748739,v1:172.21.15.184:6825/3287748739] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb9800d2200 con 0x7fb96006c060 2023-10-17T06:23:04.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.326+0000 7fb96effd700 1 -- 172.21.15.125:0/2200526676 <== osd.5 v2:172.21.15.184:6824/3287748739 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb978003a20 con 0x7fb96006c060 2023-10-17T06:23:04.333 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-17T06:23:04.334 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-17T06:23:04.334 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-17T06:23:04.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.326+0000 7fb97f59e700 1 -- 172.21.15.125:0/2200526676 >> [v2:172.21.15.184:6824/3287748739,v1:172.21.15.184:6825/3287748739] conn(0x7fb96006c060 msgr2=0x7fb96006e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:04.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.326+0000 7fb97f59e700 1 --2- 172.21.15.125:0/2200526676 >> [v2:172.21.15.184:6824/3287748739,v1:172.21.15.184:6825/3287748739] conn(0x7fb96006c060 0x7fb96006e4a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:04.335 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.326+0000 7fb97f59e700 1 -- 172.21.15.125:0/2200526676 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb9600656f0 msgr2=0x7fb960067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:04.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.326+0000 7fb97f59e700 1 --2- 172.21.15.125:0/2200526676 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb9600656f0 0x7fb960067bb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb974000c00 tx=0x7fb974008030 comp rx=0 tx=0).stop 2023-10-17T06:23:04.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.326+0000 7fb97f59e700 1 -- 172.21.15.125:0/2200526676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9800b5560 msgr2=0x7fb9801416e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:04.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.326+0000 7fb97f59e700 1 --2- 172.21.15.125:0/2200526676 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9800b5560 0x7fb9801416e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb97000ebe0 tx=0x7fb970009e00 comp rx=0 tx=0).stop 2023-10-17T06:23:04.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.326+0000 7fb97ed9d700 1 -- 172.21.15.125:0/2200526676 reap_dead start 2023-10-17T06:23:04.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.326+0000 7fb97f59e700 1 -- 172.21.15.125:0/2200526676 shutdown_connections 2023-10-17T06:23:04.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.326+0000 7fb97f59e700 1 -- 172.21.15.125:0/2200526676 >> 172.21.15.125:0/2200526676 conn(0x7fb98006ce90 msgr2=0x7fb9800b7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:04.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.326+0000 7fb97f59e700 1 -- 172.21.15.125:0/2200526676 shutdown_connections 2023-10-17T06:23:04.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.326+0000 7fb97f59e700 1 -- 172.21.15.125:0/2200526676 wait complete. 2023-10-17T06:23:04.353 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-17T06:23:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.566+0000 7fc65759e700 1 Processor -- start 2023-10-17T06:23:04.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.566+0000 7fc65759e700 1 -- start start 2023-10-17T06:23:04.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.570+0000 7fc65759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc658160e50 0x7fc65806e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:04.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.570+0000 7fc65759e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc6580b28f0 0x7fc65806fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:04.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.570+0000 7fc65759e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6580b16d0 con 0x7fc6580cb500 2023-10-17T06:23:04.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.570+0000 7fc65759e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6580b1ee0 con 0x7fc6580b28f0 2023-10-17T06:23:04.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.570+0000 7fc65759e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6580ae0f0 con 0x7fc658160e50 2023-10-17T06:23:04.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.570+0000 7fc65659c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc658160e50 0x7fc65806e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:04.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.570+0000 7fc656d9d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc6580b28f0 0x7fc65806fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:04.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.570+0000 7fc655d9b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fc6580cb500 0x7fc6580b21e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:58850/0 (socket says 172.21.15.125:58850) 2023-10-17T06:23:04.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.570+0000 7fc655d9b700 1 -- 172.21.15.125:0/933807819 learned_addr learned my addr 172.21.15.125:0/933807819 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:23:04.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.570+0000 7fc65659c700 1 -- 172.21.15.125:0/933807819 >> v2:172.21.15.184:3300/0 conn(0x7fc6580b28f0 msgr2=0x7fc65806fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:23:04.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.570+0000 7fc65659c700 1 --2- 172.21.15.125:0/933807819 >> v2:172.21.15.184:3300/0 conn(0x7fc6580b28f0 0x7fc65806fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:04.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.570+0000 7fc65559a700 1 -- 172.21.15.125:0/933807819 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284217055 0 0) 0x7fc6580b16d0 con 0x7fc6580cb500 2023-10-17T06:23:04.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.570+0000 7fc65659c700 1 -- 172.21.15.125:0/933807819 >> v1:172.21.15.184:6789/0 conn(0x7fc6580cb500 legacy=0x7fc6580b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:04.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.570+0000 7fc65659c700 1 -- 172.21.15.125:0/933807819 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6580b1920 con 0x7fc658160e50 2023-10-17T06:23:04.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.574+0000 7fc65659c700 1 --2- 172.21.15.125:0/933807819 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc658160e50 0x7fc65806e3e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc648009850 tx=0x7fc648009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86b3f7d887dbc3cc server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:04.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.574+0000 7fc65559a700 1 -- 172.21.15.125:0/933807819 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc648011830 con 0x7fc658160e50 2023-10-17T06:23:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.574+0000 7fc65559a700 1 -- 172.21.15.125:0/933807819 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc648011990 con 0x7fc658160e50 2023-10-17T06:23:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.574+0000 7fc65559a700 1 -- 172.21.15.125:0/933807819 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc648011d40 con 0x7fc658160e50 2023-10-17T06:23:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.574+0000 7fc65759e700 1 -- 172.21.15.125:0/933807819 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc658160e50 msgr2=0x7fc65806e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.574+0000 7fc65759e700 1 --2- 172.21.15.125:0/933807819 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc658160e50 0x7fc65806e3e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc648009850 tx=0x7fc648009b60 comp rx=0 tx=0).stop 2023-10-17T06:23:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.574+0000 7fc65759e700 1 -- 172.21.15.125:0/933807819 shutdown_connections 2023-10-17T06:23:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.574+0000 7fc65759e700 1 --2- 172.21.15.125:0/933807819 >> v2:172.21.15.184:3300/0 conn(0x7fc6580b28f0 0x7fc65806fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.574+0000 7fc65759e700 1 --2- 172.21.15.125:0/933807819 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc658160e50 0x7fc65806e3e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:04.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.574+0000 7fc65759e700 1 -- 172.21.15.125:0/933807819 >> 172.21.15.125:0/933807819 conn(0x7fc6580b0bf0 msgr2=0x7fc6580ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:04.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.574+0000 7fc65759e700 1 -- 172.21.15.125:0/933807819 shutdown_connections 2023-10-17T06:23:04.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.574+0000 7fc65759e700 1 -- 172.21.15.125:0/933807819 wait complete. 2023-10-17T06:23:04.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.578+0000 7fc65759e700 1 Processor -- start 2023-10-17T06:23:04.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.578+0000 7fc65759e700 1 -- start start 2023-10-17T06:23:04.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc65759e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6580b28f0 0x7fc6581faa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:04.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc65759e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6580cb500 0x7fc6580acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:04.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc65759e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc658160e50 0x7fc65815ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:04.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc65759e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6581faf50 con 0x7fc6580b28f0 2023-10-17T06:23:04.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc65759e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc658162960 con 0x7fc6580cb500 2023-10-17T06:23:04.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc65759e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6581f6f10 con 0x7fc658160e50 2023-10-17T06:23:04.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc65659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6580b28f0 0x7fc6581faa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:04.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc65659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6580b28f0 0x7fc6581faa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39638/0 (socket says 172.21.15.125:39638) 2023-10-17T06:23:04.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc65659c700 1 -- 172.21.15.125:0/2455193082 learned_addr learned my addr 172.21.15.125:0/2455193082 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:04.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc656d9d700 1 --2- 172.21.15.125:0/2455193082 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc658160e50 0x7fc65815ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:04.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc655d9b700 1 --2- 172.21.15.125:0/2455193082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6580cb500 0x7fc6580acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:04.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc65659c700 1 -- 172.21.15.125:0/2455193082 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc658160e50 msgr2=0x7fc65815ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:04.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc65659c700 1 --2- 172.21.15.125:0/2455193082 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc658160e50 0x7fc65815ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:04.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc65659c700 1 -- 172.21.15.125:0/2455193082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6580cb500 msgr2=0x7fc6580acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:04.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc65659c700 1 --2- 172.21.15.125:0/2455193082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6580cb500 0x7fc6580acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:04.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc65659c700 1 -- 172.21.15.125:0/2455193082 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6480094b0 con 0x7fc6580b28f0 2023-10-17T06:23:04.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc65659c700 1 --2- 172.21.15.125:0/2455193082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6580b28f0 0x7fc6581faa10 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc648014040 tx=0x7fc648004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:04.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc646ffd700 1 -- 172.21.15.125:0/2455193082 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc648019980 con 0x7fc6580b28f0 2023-10-17T06:23:04.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc646ffd700 1 -- 172.21.15.125:0/2455193082 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64801e070 con 0x7fc6580b28f0 2023-10-17T06:23:04.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc65759e700 1 -- 172.21.15.125:0/2455193082 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6581f71f0 con 0x7fc6580b28f0 2023-10-17T06:23:04.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc646ffd700 1 -- 172.21.15.125:0/2455193082 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc648019d40 con 0x7fc6580b28f0 2023-10-17T06:23:04.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.582+0000 7fc65759e700 1 -- 172.21.15.125:0/2455193082 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6581f77b0 con 0x7fc6580b28f0 2023-10-17T06:23:04.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.586+0000 7fc65759e700 1 -- 172.21.15.125:0/2455193082 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc658162af0 con 0x7fc6580b28f0 2023-10-17T06:23:04.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.586+0000 7fc646ffd700 1 -- 172.21.15.125:0/2455193082 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc64802d450 con 0x7fc6580b28f0 2023-10-17T06:23:04.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.590+0000 7fc646ffd700 1 --2- 172.21.15.125:0/2455193082 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc6380656f0 0x7fc638067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:04.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.590+0000 7fc646ffd700 1 -- 172.21.15.125:0/2455193082 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fc648083b90 con 0x7fc6580b28f0 2023-10-17T06:23:04.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.590+0000 7fc655d9b700 1 --2- 172.21.15.125:0/2455193082 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc6380656f0 0x7fc638067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:04.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.590+0000 7fc655d9b700 1 --2- 172.21.15.125:0/2455193082 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc6380656f0 0x7fc638067bb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc65815f610 tx=0x7fc64c007e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:04.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.594+0000 7fc646ffd700 1 -- 172.21.15.125:0/2455193082 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc6480517d0 con 0x7fc6580b28f0 2023-10-17T06:23:04.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.878+0000 7fc65759e700 1 -- 172.21.15.125:0/2455193082 --> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fc65806f5f0 con 0x7fc6380656f0 2023-10-17T06:23:04.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.878+0000 7fc646ffd700 1 -- 172.21.15.125:0/2455193082 <== mgr.4107 v2:172.21.15.125:6832/2516570548 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc64c001370 con 0x7fc6380656f0 2023-10-17T06:23:04.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.882+0000 7fc65759e700 1 -- 172.21.15.125:0/2455193082 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc6380656f0 msgr2=0x7fc638067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:04.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.882+0000 7fc65759e700 1 --2- 172.21.15.125:0/2455193082 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc6380656f0 0x7fc638067bb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc65815f610 tx=0x7fc64c007e00 comp rx=0 tx=0).stop 2023-10-17T06:23:04.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.882+0000 7fc65759e700 1 -- 172.21.15.125:0/2455193082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6580b28f0 msgr2=0x7fc6581faa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:04.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.882+0000 7fc65759e700 1 --2- 172.21.15.125:0/2455193082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6580b28f0 0x7fc6581faa10 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fc648014040 tx=0x7fc648004770 comp rx=0 tx=0).stop 2023-10-17T06:23:04.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.882+0000 7fc65759e700 1 -- 172.21.15.125:0/2455193082 shutdown_connections 2023-10-17T06:23:04.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.882+0000 7fc65759e700 1 --2- 172.21.15.125:0/2455193082 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fc6380656f0 0x7fc638067bb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:04.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.882+0000 7fc65759e700 1 --2- 172.21.15.125:0/2455193082 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc658160e50 0x7fc65815ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:04.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.882+0000 7fc65759e700 1 --2- 172.21.15.125:0/2455193082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc6580cb500 0x7fc6580acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:04.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.882+0000 7fc65759e700 1 --2- 172.21.15.125:0/2455193082 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6580b28f0 0x7fc6581faa10 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:04.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.882+0000 7fc65759e700 1 -- 172.21.15.125:0/2455193082 >> 172.21.15.125:0/2455193082 conn(0x7fc6580b0bf0 msgr2=0x7fc6580cbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:04.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.882+0000 7fc65759e700 1 -- 172.21.15.125:0/2455193082 shutdown_connections 2023-10-17T06:23:04.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:04.882+0000 7fc65759e700 1 -- 172.21.15.125:0/2455193082 wait complete. 2023-10-17T06:23:04.892 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 5 to deep-scrub 2023-10-17T06:23:04.912 INFO:tasks.ceph:Scrubbing osd.6 2023-10-17T06:23:04.913 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-17T06:23:05.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.094+0000 7fde640d6700 1 Processor -- start 2023-10-17T06:23:05.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.094+0000 7fde640d6700 1 -- start start 2023-10-17T06:23:05.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.094+0000 7fde640d6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde5c15cde0 0x7fde5c0708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:05.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.094+0000 7fde640d6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fde5c06e440 0x7fde5c0b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:05.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.094+0000 7fde640d6700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c15d1c0 con 0x7fde5c06e8a0 2023-10-17T06:23:05.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.094+0000 7fde640d6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5c070df0 con 0x7fde5c06e440 2023-10-17T06:23:05.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.094+0000 7fde640d6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c06f810 con 0x7fde5c15cde0 2023-10-17T06:23:05.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.094+0000 7fde61671700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fde5c06e440 0x7fde5c0b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:05.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.094+0000 7fde61671700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fde5c06e440 0x7fde5c0b64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39652/0 (socket says 172.21.15.125:39652) 2023-10-17T06:23:05.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.094+0000 7fde61671700 1 -- 172.21.15.125:0/450207954 learned_addr learned my addr 172.21.15.125:0/450207954 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:05.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.094+0000 7fde61e72700 1 --2- 172.21.15.125:0/450207954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde5c15cde0 0x7fde5c0708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:05.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.094+0000 7fde61671700 1 -- 172.21.15.125:0/450207954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde5c15cde0 msgr2=0x7fde5c0708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:23:05.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.094+0000 7fde61671700 1 --2- 172.21.15.125:0/450207954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde5c15cde0 0x7fde5c0708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:05.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.094+0000 7fde60e70700 1 -- 172.21.15.125:0/450207954 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575659203 0 0) 0x7fde5c15d1c0 con 0x7fde5c06e8a0 2023-10-17T06:23:05.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.098+0000 7fde61671700 1 -- 172.21.15.125:0/450207954 >> v1:172.21.15.184:6789/0 conn(0x7fde5c06e8a0 legacy=0x7fde5c0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:05.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.098+0000 7fde61671700 1 -- 172.21.15.125:0/450207954 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c06faf0 con 0x7fde5c06e440 2023-10-17T06:23:05.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.098+0000 7fde61671700 1 --2- 172.21.15.125:0/450207954 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5c06e440 0x7fde5c0b64d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009910 tx=0x7fde4c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46266871ee8fe2c server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:05.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.098+0000 7fde60e70700 1 -- 172.21.15.125:0/450207954 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c011830 con 0x7fde5c06e440 2023-10-17T06:23:05.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.098+0000 7fde60e70700 1 -- 172.21.15.125:0/450207954 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c011990 con 0x7fde5c06e440 2023-10-17T06:23:05.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.098+0000 7fde60e70700 1 -- 172.21.15.125:0/450207954 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c011d40 con 0x7fde5c06e440 2023-10-17T06:23:05.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.098+0000 7fde640d6700 1 -- 172.21.15.125:0/450207954 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5c06e440 msgr2=0x7fde5c0b64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:05.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.098+0000 7fde640d6700 1 --2- 172.21.15.125:0/450207954 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5c06e440 0x7fde5c0b64d0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009910 tx=0x7fde4c009c20 comp rx=0 tx=0).stop 2023-10-17T06:23:05.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.098+0000 7fde640d6700 1 -- 172.21.15.125:0/450207954 shutdown_connections 2023-10-17T06:23:05.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.098+0000 7fde640d6700 1 --2- 172.21.15.125:0/450207954 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5c06e440 0x7fde5c0b64d0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:05.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.098+0000 7fde640d6700 1 --2- 172.21.15.125:0/450207954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde5c15cde0 0x7fde5c0708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:05.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.098+0000 7fde640d6700 1 -- 172.21.15.125:0/450207954 >> 172.21.15.125:0/450207954 conn(0x7fde5c06a130 msgr2=0x7fde5c06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:05.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.098+0000 7fde640d6700 1 -- 172.21.15.125:0/450207954 shutdown_connections 2023-10-17T06:23:05.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.098+0000 7fde640d6700 1 -- 172.21.15.125:0/450207954 wait complete. 2023-10-17T06:23:05.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.102+0000 7fde640d6700 1 Processor -- start 2023-10-17T06:23:05.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.102+0000 7fde640d6700 1 -- start start 2023-10-17T06:23:05.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.102+0000 7fde640d6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5c06e440 0x7fde5c15f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:05.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.102+0000 7fde640d6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde5c06e8a0 0x7fde5c0b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:05.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.102+0000 7fde640d6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde5c15cde0 0x7fde5c0d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:05.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.102+0000 7fde640d6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c15efd0 con 0x7fde5c06e440 2023-10-17T06:23:05.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.102+0000 7fde640d6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c0b3dd0 con 0x7fde5c15cde0 2023-10-17T06:23:05.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.102+0000 7fde640d6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c0b40b0 con 0x7fde5c06e8a0 2023-10-17T06:23:05.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.102+0000 7fde61e72700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5c06e440 0x7fde5c15f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:05.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.102+0000 7fde61e72700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5c06e440 0x7fde5c15f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39666/0 (socket says 172.21.15.125:39666) 2023-10-17T06:23:05.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.102+0000 7fde61e72700 1 -- 172.21.15.125:0/722604201 learned_addr learned my addr 172.21.15.125:0/722604201 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:05.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.102+0000 7fde61671700 1 --2- 172.21.15.125:0/722604201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde5c06e8a0 0x7fde5c0b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:05.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.102+0000 7fde62673700 1 --2- 172.21.15.125:0/722604201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde5c15cde0 0x7fde5c0d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:05.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.102+0000 7fde61e72700 1 -- 172.21.15.125:0/722604201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde5c06e8a0 msgr2=0x7fde5c0b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:05.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.102+0000 7fde61e72700 1 --2- 172.21.15.125:0/722604201 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde5c06e8a0 0x7fde5c0b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:05.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.102+0000 7fde61e72700 1 -- 172.21.15.125:0/722604201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde5c15cde0 msgr2=0x7fde5c0d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:05.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.102+0000 7fde61e72700 1 --2- 172.21.15.125:0/722604201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde5c15cde0 0x7fde5c0d1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:05.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.102+0000 7fde61e72700 1 -- 172.21.15.125:0/722604201 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c009570 con 0x7fde5c06e440 2023-10-17T06:23:05.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.102+0000 7fde61e72700 1 --2- 172.21.15.125:0/722604201 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5c06e440 0x7fde5c15f400 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fde5800e870 tx=0x7fde5800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:05.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.106+0000 7fde527fc700 1 -- 172.21.15.125:0/722604201 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde580095c0 con 0x7fde5c06e440 2023-10-17T06:23:05.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.106+0000 7fde527fc700 1 -- 172.21.15.125:0/722604201 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde58013680 con 0x7fde5c06e440 2023-10-17T06:23:05.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.106+0000 7fde527fc700 1 -- 172.21.15.125:0/722604201 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58013a10 con 0x7fde5c06e440 2023-10-17T06:23:05.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.106+0000 7fde640d6700 1 -- 172.21.15.125:0/722604201 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5c0b4390 con 0x7fde5c06e440 2023-10-17T06:23:05.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.106+0000 7fde640d6700 1 -- 172.21.15.125:0/722604201 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5c0b4670 con 0x7fde5c06e440 2023-10-17T06:23:05.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.106+0000 7fde640d6700 1 -- 172.21.15.125:0/722604201 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fde5c0700b0 con 0x7fde5c06e440 2023-10-17T06:23:05.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.106+0000 7fde527fc700 1 -- 172.21.15.125:0/722604201 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fde58013b90 con 0x7fde5c06e440 2023-10-17T06:23:05.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.110+0000 7fde527fc700 1 --2- 172.21.15.125:0/722604201 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fde400656f0 0x7fde40067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:05.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.110+0000 7fde527fc700 1 -- 172.21.15.125:0/722604201 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fde58082b70 con 0x7fde5c06e440 2023-10-17T06:23:05.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.110+0000 7fde527fc700 1 --2- 172.21.15.125:0/722604201 >> [v2:172.21.15.184:6816/2471937715,v1:172.21.15.184:6817/2471937715] conn(0x7fde4006c060 0x7fde4006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:05.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.110+0000 7fde527fc700 1 -- 172.21.15.125:0/722604201 --> [v2:172.21.15.184:6816/2471937715,v1:172.21.15.184:6817/2471937715] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde4006eb70 con 0x7fde4006c060 2023-10-17T06:23:05.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.110+0000 7fde527fc700 1 -- 172.21.15.125:0/722604201 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde580872c0 con 0x7fde5c06e440 2023-10-17T06:23:05.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.110+0000 7fde61671700 1 --2- 172.21.15.125:0/722604201 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fde400656f0 0x7fde40067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:05.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.110+0000 7fde62673700 1 --2- 172.21.15.125:0/722604201 >> [v2:172.21.15.184:6816/2471937715,v1:172.21.15.184:6817/2471937715] conn(0x7fde4006c060 0x7fde4006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:05.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.110+0000 7fde61671700 1 --2- 172.21.15.125:0/722604201 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fde400656f0 0x7fde40067bb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fde4c000c00 tx=0x7fde4c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:05.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.110+0000 7fde62673700 1 --2- 172.21.15.125:0/722604201 >> [v2:172.21.15.184:6816/2471937715,v1:172.21.15.184:6817/2471937715] conn(0x7fde4006c060 0x7fde4006e4a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:05.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.114+0000 7fde527fc700 1 -- 172.21.15.125:0/722604201 <== osd.6 v2:172.21.15.184:6816/2471937715 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fde4006eb70 con 0x7fde4006c060 2023-10-17T06:23:05.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.130+0000 7fde640d6700 1 -- 172.21.15.125:0/722604201 --> [v2:172.21.15.184:6816/2471937715,v1:172.21.15.184:6817/2471937715] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fde5c06fdd0 con 0x7fde4006c060 2023-10-17T06:23:05.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.130+0000 7fde527fc700 1 -- 172.21.15.125:0/722604201 <== osd.6 v2:172.21.15.184:6816/2471937715 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fde54002030 con 0x7fde4006c060 2023-10-17T06:23:05.137 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-17T06:23:05.138 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-17T06:23:05.138 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-17T06:23:05.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.130+0000 7fde640d6700 1 -- 172.21.15.125:0/722604201 >> [v2:172.21.15.184:6816/2471937715,v1:172.21.15.184:6817/2471937715] conn(0x7fde4006c060 msgr2=0x7fde4006e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:05.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.130+0000 7fde640d6700 1 --2- 172.21.15.125:0/722604201 >> [v2:172.21.15.184:6816/2471937715,v1:172.21.15.184:6817/2471937715] conn(0x7fde4006c060 0x7fde4006e4a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:05.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.130+0000 7fde640d6700 1 -- 172.21.15.125:0/722604201 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fde400656f0 msgr2=0x7fde40067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:05.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.130+0000 7fde640d6700 1 --2- 172.21.15.125:0/722604201 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fde400656f0 0x7fde40067bb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fde4c000c00 tx=0x7fde4c008030 comp rx=0 tx=0).stop 2023-10-17T06:23:05.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.130+0000 7fde640d6700 1 -- 172.21.15.125:0/722604201 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5c06e440 msgr2=0x7fde5c15f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:05.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.130+0000 7fde640d6700 1 --2- 172.21.15.125:0/722604201 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde5c06e440 0x7fde5c15f400 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fde5800e870 tx=0x7fde5800eb80 comp rx=0 tx=0).stop 2023-10-17T06:23:05.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.130+0000 7fde62673700 1 -- 172.21.15.125:0/722604201 reap_dead start 2023-10-17T06:23:05.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.134+0000 7fde640d6700 1 -- 172.21.15.125:0/722604201 shutdown_connections 2023-10-17T06:23:05.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.134+0000 7fde640d6700 1 -- 172.21.15.125:0/722604201 >> 172.21.15.125:0/722604201 conn(0x7fde5c06a130 msgr2=0x7fde5c158a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:05.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.134+0000 7fde640d6700 1 -- 172.21.15.125:0/722604201 shutdown_connections 2023-10-17T06:23:05.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.134+0000 7fde640d6700 1 -- 172.21.15.125:0/722604201 wait complete. 2023-10-17T06:23:05.160 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-17T06:23:05.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.330+0000 7ff2e0d02700 1 Processor -- start 2023-10-17T06:23:05.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.330+0000 7ff2e0d02700 1 -- start start 2023-10-17T06:23:05.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.334+0000 7ff2e0d02700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2dc0d30e0 0x7ff2dc0d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:05.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.334+0000 7ff2e0d02700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff2dc0b1df0 0x7ff2dc070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:05.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.334+0000 7ff2e0d02700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2dc15d060 con 0x7ff2dc15cc80 2023-10-17T06:23:05.341 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.334+0000 7ff2e0d02700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2dc06d830 con 0x7ff2dc0b1df0 2023-10-17T06:23:05.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.334+0000 7ff2e0d02700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc06dd60 con 0x7ff2dc0d30e0 2023-10-17T06:23:05.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.334+0000 7ff2dbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff2dc0b1df0 0x7ff2dc070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:05.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.334+0000 7ff2dbfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff2dc0b1df0 0x7ff2dc070a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39670/0 (socket says 172.21.15.125:39670) 2023-10-17T06:23:05.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.334+0000 7ff2dbfff700 1 -- 172.21.15.125:0/2566802028 learned_addr learned my addr 172.21.15.125:0/2566802028 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:05.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.334+0000 7ff2d3fff700 1 --2- 172.21.15.125:0/2566802028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2dc0d30e0 0x7ff2dc0d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:05.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.334+0000 7ff2dbfff700 1 -- 172.21.15.125:0/2566802028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2dc0d30e0 msgr2=0x7ff2dc0d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:23:05.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.334+0000 7ff2dbfff700 1 --2- 172.21.15.125:0/2566802028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2dc0d30e0 0x7ff2dc0d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:05.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.334+0000 7ff2dbfff700 1 -- 172.21.15.125:0/2566802028 >> v1:172.21.15.184:6789/0 conn(0x7ff2dc15cc80 legacy=0x7ff2dc0d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:23:05.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.334+0000 7ff2dbfff700 1 -- 172.21.15.125:0/2566802028 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc06da80 con 0x7ff2dc0b1df0 2023-10-17T06:23:05.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.334+0000 7ff2d3fff700 1 --2- 172.21.15.125:0/2566802028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2dc0d30e0 0x7ff2dc0d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-17T06:23:05.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.334+0000 7ff2dbfff700 1 --2- 172.21.15.125:0/2566802028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2dc0b1df0 0x7ff2dc070a50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4009e50 tx=0x7ff2d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493ff60ee7681f12 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:05.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.334+0000 7ff2daffd700 1 -- 172.21.15.125:0/2566802028 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d400e070 con 0x7ff2dc0b1df0 2023-10-17T06:23:05.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.338+0000 7ff2daffd700 1 -- 172.21.15.125:0/2566802028 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d4003a40 con 0x7ff2dc0b1df0 2023-10-17T06:23:05.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.338+0000 7ff2daffd700 1 -- 172.21.15.125:0/2566802028 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4003df0 con 0x7ff2dc0b1df0 2023-10-17T06:23:05.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.338+0000 7ff2e0d02700 1 -- 172.21.15.125:0/2566802028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2dc0b1df0 msgr2=0x7ff2dc070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:05.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.338+0000 7ff2e0d02700 1 --2- 172.21.15.125:0/2566802028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2dc0b1df0 0x7ff2dc070a50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4009e50 tx=0x7ff2d400b330 comp rx=0 tx=0).stop 2023-10-17T06:23:05.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.338+0000 7ff2e0d02700 1 -- 172.21.15.125:0/2566802028 shutdown_connections 2023-10-17T06:23:05.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.338+0000 7ff2e0d02700 1 --2- 172.21.15.125:0/2566802028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2dc0b1df0 0x7ff2dc070a50 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:05.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.338+0000 7ff2e0d02700 1 --2- 172.21.15.125:0/2566802028 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2dc0d30e0 0x7ff2dc0d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:05.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.338+0000 7ff2e0d02700 1 -- 172.21.15.125:0/2566802028 >> 172.21.15.125:0/2566802028 conn(0x7ff2dc0cf530 msgr2=0x7ff2dc0cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:05.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.338+0000 7ff2e0d02700 1 -- 172.21.15.125:0/2566802028 shutdown_connections 2023-10-17T06:23:05.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.338+0000 7ff2e0d02700 1 -- 172.21.15.125:0/2566802028 wait complete. 2023-10-17T06:23:05.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.338+0000 7ff2e0d02700 1 Processor -- start 2023-10-17T06:23:05.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.338+0000 7ff2e0d02700 1 -- start start 2023-10-17T06:23:05.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2e0d02700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2dc0b1df0 0x7ff2dc159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:05.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2e0d02700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2dc0d30e0 0x7ff2dc159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:05.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2e0d02700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2dc15cc80 0x7ff2dc14b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:05.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2e0d02700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc15e6d0 con 0x7ff2dc0b1df0 2023-10-17T06:23:05.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2e0d02700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc15dac0 con 0x7ff2dc0d30e0 2023-10-17T06:23:05.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2e0d02700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc15dda0 con 0x7ff2dc15cc80 2023-10-17T06:23:05.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2db7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2dc0b1df0 0x7ff2dc159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:05.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2db7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2dc0b1df0 0x7ff2dc159100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39682/0 (socket says 172.21.15.125:39682) 2023-10-17T06:23:05.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2db7fe700 1 -- 172.21.15.125:0/2289531443 learned_addr learned my addr 172.21.15.125:0/2289531443 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:05.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2d3fff700 1 --2- 172.21.15.125:0/2289531443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2dc0d30e0 0x7ff2dc159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:05.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2dbfff700 1 --2- 172.21.15.125:0/2289531443 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2dc15cc80 0x7ff2dc14b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:05.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2db7fe700 1 -- 172.21.15.125:0/2289531443 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2dc15cc80 msgr2=0x7ff2dc14b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:05.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2db7fe700 1 --2- 172.21.15.125:0/2289531443 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2dc15cc80 0x7ff2dc14b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:05.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2db7fe700 1 -- 172.21.15.125:0/2289531443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2dc0d30e0 msgr2=0x7ff2dc159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:05.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2db7fe700 1 --2- 172.21.15.125:0/2289531443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2dc0d30e0 0x7ff2dc159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:05.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2db7fe700 1 -- 172.21.15.125:0/2289531443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d4009b30 con 0x7ff2dc0b1df0 2023-10-17T06:23:05.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2db7fe700 1 --2- 172.21.15.125:0/2289531443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2dc0b1df0 0x7ff2dc159100 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00b4a0 tx=0x7ff2cc00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:05.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2d8ff9700 1 -- 172.21.15.125:0/2289531443 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc011830 con 0x7ff2dc0b1df0 2023-10-17T06:23:05.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2d8ff9700 1 -- 172.21.15.125:0/2289531443 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc0119b0 con 0x7ff2dc0b1df0 2023-10-17T06:23:05.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2e0d02700 1 -- 172.21.15.125:0/2289531443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2dc15e080 con 0x7ff2dc0b1df0 2023-10-17T06:23:05.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2d8ff9700 1 -- 172.21.15.125:0/2289531443 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc011d60 con 0x7ff2dc0b1df0 2023-10-17T06:23:05.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.342+0000 7ff2e0d02700 1 -- 172.21.15.125:0/2289531443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2dc15eb60 con 0x7ff2dc0b1df0 2023-10-17T06:23:05.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.346+0000 7ff2e0d02700 1 -- 172.21.15.125:0/2289531443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2dc072e60 con 0x7ff2dc0b1df0 2023-10-17T06:23:05.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.346+0000 7ff2d8ff9700 1 -- 172.21.15.125:0/2289531443 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff2cc01a400 con 0x7ff2dc0b1df0 2023-10-17T06:23:05.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.350+0000 7ff2d8ff9700 1 --2- 172.21.15.125:0/2289531443 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2bc065720 0x7ff2bc067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:05.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.350+0000 7ff2d8ff9700 1 -- 172.21.15.125:0/2289531443 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7ff2cc082a60 con 0x7ff2dc0b1df0 2023-10-17T06:23:05.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.350+0000 7ff2d3fff700 1 --2- 172.21.15.125:0/2289531443 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2bc065720 0x7ff2bc067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:05.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.350+0000 7ff2d3fff700 1 --2- 172.21.15.125:0/2289531443 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2bc065720 0x7ff2bc067be0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc1f5970 tx=0x7ff2c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:05.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.354+0000 7ff2d8ff9700 1 -- 172.21.15.125:0/2289531443 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff2cc050740 con 0x7ff2dc0b1df0 2023-10-17T06:23:05.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.725+0000 7ff2e0d02700 1 -- 172.21.15.125:0/2289531443 --> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2dc0d0a50 con 0x7ff2bc065720 2023-10-17T06:23:05.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.725+0000 7ff2d8ff9700 1 -- 172.21.15.125:0/2289531443 <== mgr.4107 v2:172.21.15.125:6832/2516570548 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff2c400c040 con 0x7ff2bc065720 2023-10-17T06:23:05.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.729+0000 7ff2e0d02700 1 -- 172.21.15.125:0/2289531443 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2bc065720 msgr2=0x7ff2bc067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:05.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.729+0000 7ff2e0d02700 1 --2- 172.21.15.125:0/2289531443 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2bc065720 0x7ff2bc067be0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc1f5970 tx=0x7ff2c4008040 comp rx=0 tx=0).stop 2023-10-17T06:23:05.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.729+0000 7ff2e0d02700 1 -- 172.21.15.125:0/2289531443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2dc0b1df0 msgr2=0x7ff2dc159100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:05.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.729+0000 7ff2e0d02700 1 --2- 172.21.15.125:0/2289531443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2dc0b1df0 0x7ff2dc159100 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00b4a0 tx=0x7ff2cc00b7b0 comp rx=0 tx=0).stop 2023-10-17T06:23:05.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.729+0000 7ff2e0d02700 1 -- 172.21.15.125:0/2289531443 shutdown_connections 2023-10-17T06:23:05.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.729+0000 7ff2e0d02700 1 --2- 172.21.15.125:0/2289531443 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7ff2bc065720 0x7ff2bc067be0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:05.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.729+0000 7ff2e0d02700 1 --2- 172.21.15.125:0/2289531443 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff2dc15cc80 0x7ff2dc14b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:05.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.729+0000 7ff2e0d02700 1 --2- 172.21.15.125:0/2289531443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff2dc0d30e0 0x7ff2dc159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:05.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.729+0000 7ff2e0d02700 1 --2- 172.21.15.125:0/2289531443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff2dc0b1df0 0x7ff2dc159100 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:05.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.729+0000 7ff2e0d02700 1 -- 172.21.15.125:0/2289531443 >> 172.21.15.125:0/2289531443 conn(0x7ff2dc0cf530 msgr2=0x7ff2dc15b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:05.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.729+0000 7ff2e0d02700 1 -- 172.21.15.125:0/2289531443 shutdown_connections 2023-10-17T06:23:05.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.729+0000 7ff2e0d02700 1 -- 172.21.15.125:0/2289531443 wait complete. 2023-10-17T06:23:05.741 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 6 to deep-scrub 2023-10-17T06:23:05.760 INFO:tasks.ceph:Scrubbing osd.7 2023-10-17T06:23:05.761 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-17T06:23:05.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.929+0000 7fba0678b700 1 Processor -- start 2023-10-17T06:23:05.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.929+0000 7fba0678b700 1 -- start start 2023-10-17T06:23:05.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.933+0000 7fba0678b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fba001467a0 0x7fba000b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:05.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.933+0000 7fba0678b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0006f5f0 con 0x7fba000cf490 2023-10-17T06:23:05.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.933+0000 7fba0678b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba000d1960 con 0x7fba000b5560 2023-10-17T06:23:05.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.933+0000 7fba0678b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba000cf9f0 con 0x7fba001467a0 2023-10-17T06:23:05.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.933+0000 7fba05789700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fba001467a0 0x7fba000b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:05.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.933+0000 7fba05789700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fba001467a0 0x7fba000b5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39694/0 (socket says 172.21.15.125:39694) 2023-10-17T06:23:05.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.933+0000 7fba05789700 1 -- 172.21.15.125:0/506638915 learned_addr learned my addr 172.21.15.125:0/506638915 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:05.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.933+0000 7fba05789700 1 -- 172.21.15.125:0/506638915 >> v1:172.21.15.184:6789/0 conn(0x7fba000b5560 legacy=0x7fba000ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:05.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.933+0000 7fba05789700 1 -- 172.21.15.125:0/506638915 >> v1:172.21.15.125:6789/0 conn(0x7fba000cf490 legacy=0x7fba0006fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:05.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.933+0000 7fba05789700 1 -- 172.21.15.125:0/506638915 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba000d1c40 con 0x7fba001467a0 2023-10-17T06:23:05.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.933+0000 7fba05789700 1 --2- 172.21.15.125:0/506638915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba001467a0 0x7fba000b5020 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009910 tx=0x7fb9fc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb081b2616400e34 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:05.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.933+0000 7fb9f7fff700 1 -- 172.21.15.125:0/506638915 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc00ba60 con 0x7fba001467a0 2023-10-17T06:23:05.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.933+0000 7fb9f7fff700 1 -- 172.21.15.125:0/506638915 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc00bbc0 con 0x7fba001467a0 2023-10-17T06:23:05.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.933+0000 7fb9f7fff700 1 -- 172.21.15.125:0/506638915 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc009e60 con 0x7fba001467a0 2023-10-17T06:23:05.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.937+0000 7fba0678b700 1 -- 172.21.15.125:0/506638915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba001467a0 msgr2=0x7fba000b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:05.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.937+0000 7fba0678b700 1 --2- 172.21.15.125:0/506638915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba001467a0 0x7fba000b5020 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009910 tx=0x7fb9fc009c20 comp rx=0 tx=0).stop 2023-10-17T06:23:05.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.937+0000 7fba0678b700 1 -- 172.21.15.125:0/506638915 shutdown_connections 2023-10-17T06:23:05.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.937+0000 7fba0678b700 1 --2- 172.21.15.125:0/506638915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba001467a0 0x7fba000b5020 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:05.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.937+0000 7fba0678b700 1 -- 172.21.15.125:0/506638915 >> 172.21.15.125:0/506638915 conn(0x7fba0006ce90 msgr2=0x7fba000b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:05.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.937+0000 7fba0678b700 1 -- 172.21.15.125:0/506638915 shutdown_connections 2023-10-17T06:23:05.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.937+0000 7fba0678b700 1 -- 172.21.15.125:0/506638915 wait complete. 2023-10-17T06:23:05.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.937+0000 7fba0678b700 1 Processor -- start 2023-10-17T06:23:05.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.937+0000 7fba0678b700 1 -- start start 2023-10-17T06:23:05.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fba0678b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba000b5560 0x7fba000b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:05.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fba0678b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba000cf490 0x7fba0006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:05.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fba0678b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba001467a0 0x7fba0006ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:05.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fba0678b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba000b1850 con 0x7fba000cf490 2023-10-17T06:23:05.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fba0678b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba000b0080 con 0x7fba000b5560 2023-10-17T06:23:05.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fba0678b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba000b02b0 con 0x7fba001467a0 2023-10-17T06:23:05.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fba04f88700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba000cf490 0x7fba0006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:05.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fba04f88700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba000cf490 0x7fba0006f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39710/0 (socket says 172.21.15.125:39710) 2023-10-17T06:23:05.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fba04f88700 1 -- 172.21.15.125:0/1824312555 learned_addr learned my addr 172.21.15.125:0/1824312555 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:05.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fba05789700 1 --2- 172.21.15.125:0/1824312555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba000b5560 0x7fba000b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:05.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fba05f8a700 1 --2- 172.21.15.125:0/1824312555 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba001467a0 0x7fba0006ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fba04f88700 1 -- 172.21.15.125:0/1824312555 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba001467a0 msgr2=0x7fba0006ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fba04f88700 1 --2- 172.21.15.125:0/1824312555 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fba001467a0 0x7fba0006ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fba04f88700 1 -- 172.21.15.125:0/1824312555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba000b5560 msgr2=0x7fba000b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fba04f88700 1 --2- 172.21.15.125:0/1824312555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fba000b5560 0x7fba000b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fba04f88700 1 -- 172.21.15.125:0/1824312555 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc009570 con 0x7fba000cf490 2023-10-17T06:23:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fba04f88700 1 --2- 172.21.15.125:0/1824312555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba000cf490 0x7fba0006f9d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000c500 tx=0x7fb9f000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fb9f5ffb700 1 -- 172.21.15.125:0/1824312555 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f00052d0 con 0x7fba000cf490 2023-10-17T06:23:05.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fb9f5ffb700 1 -- 172.21.15.125:0/1824312555 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f0005430 con 0x7fba000cf490 2023-10-17T06:23:05.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fb9f5ffb700 1 -- 172.21.15.125:0/1824312555 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f00055a0 con 0x7fba000cf490 2023-10-17T06:23:05.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fba0678b700 1 -- 172.21.15.125:0/1824312555 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba000b0550 con 0x7fba000cf490 2023-10-17T06:23:05.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.941+0000 7fba0678b700 1 -- 172.21.15.125:0/1824312555 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba000b0b10 con 0x7fba000cf490 2023-10-17T06:23:05.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.945+0000 7fba0678b700 1 -- 172.21.15.125:0/1824312555 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fba000d1f20 con 0x7fba000cf490 2023-10-17T06:23:05.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.945+0000 7fb9f5ffb700 1 -- 172.21.15.125:0/1824312555 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb9f00038e0 con 0x7fba000cf490 2023-10-17T06:23:05.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.945+0000 7fb9f5ffb700 1 --2- 172.21.15.125:0/1824312555 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb9e40656f0 0x7fb9e4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:05.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.949+0000 7fb9f5ffb700 1 -- 172.21.15.125:0/1824312555 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fb9f0081f00 con 0x7fba000cf490 2023-10-17T06:23:05.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.949+0000 7fba05789700 1 --2- 172.21.15.125:0/1824312555 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb9e40656f0 0x7fb9e4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:05.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.949+0000 7fb9f5ffb700 1 --2- 172.21.15.125:0/1824312555 >> [v2:172.21.15.184:6808/1153151577,v1:172.21.15.184:6809/1153151577] conn(0x7fb9e406c060 0x7fb9e406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:05.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.949+0000 7fb9f5ffb700 1 -- 172.21.15.125:0/1824312555 --> [v2:172.21.15.184:6808/1153151577,v1:172.21.15.184:6809/1153151577] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb9e406eb70 con 0x7fb9e406c060 2023-10-17T06:23:05.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.949+0000 7fb9f5ffb700 1 -- 172.21.15.125:0/1824312555 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9f00844e0 con 0x7fba000cf490 2023-10-17T06:23:05.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.949+0000 7fba05f8a700 1 --2- 172.21.15.125:0/1824312555 >> [v2:172.21.15.184:6808/1153151577,v1:172.21.15.184:6809/1153151577] conn(0x7fb9e406c060 0x7fb9e406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:05.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.949+0000 7fba05789700 1 --2- 172.21.15.125:0/1824312555 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb9e40656f0 0x7fb9e4067bb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc006f80 tx=0x7fb9fc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:05.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.949+0000 7fba05f8a700 1 --2- 172.21.15.125:0/1824312555 >> [v2:172.21.15.184:6808/1153151577,v1:172.21.15.184:6809/1153151577] conn(0x7fb9e406c060 0x7fb9e406e4a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:05.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.949+0000 7fb9f5ffb700 1 -- 172.21.15.125:0/1824312555 <== osd.7 v2:172.21.15.184:6808/1153151577 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb9e406eb70 con 0x7fb9e406c060 2023-10-17T06:23:05.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.969+0000 7fba0678b700 1 -- 172.21.15.125:0/1824312555 --> [v2:172.21.15.184:6808/1153151577,v1:172.21.15.184:6809/1153151577] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fba000d2200 con 0x7fb9e406c060 2023-10-17T06:23:05.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.969+0000 7fb9f5ffb700 1 -- 172.21.15.125:0/1824312555 <== osd.7 v2:172.21.15.184:6808/1153151577 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb9f8001fc0 con 0x7fb9e406c060 2023-10-17T06:23:05.978 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-17T06:23:05.978 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-17T06:23:05.979 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-17T06:23:05.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.973+0000 7fba0678b700 1 -- 172.21.15.125:0/1824312555 >> [v2:172.21.15.184:6808/1153151577,v1:172.21.15.184:6809/1153151577] conn(0x7fb9e406c060 msgr2=0x7fb9e406e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:05.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.973+0000 7fba0678b700 1 --2- 172.21.15.125:0/1824312555 >> [v2:172.21.15.184:6808/1153151577,v1:172.21.15.184:6809/1153151577] conn(0x7fb9e406c060 0x7fb9e406e4a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:05.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.973+0000 7fba0678b700 1 -- 172.21.15.125:0/1824312555 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb9e40656f0 msgr2=0x7fb9e4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:05.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.973+0000 7fba0678b700 1 --2- 172.21.15.125:0/1824312555 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fb9e40656f0 0x7fb9e4067bb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc006f80 tx=0x7fb9fc008030 comp rx=0 tx=0).stop 2023-10-17T06:23:05.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.973+0000 7fba0678b700 1 -- 172.21.15.125:0/1824312555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba000cf490 msgr2=0x7fba0006f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:05.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.973+0000 7fba0678b700 1 --2- 172.21.15.125:0/1824312555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba000cf490 0x7fba0006f9d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000c500 tx=0x7fb9f000c810 comp rx=0 tx=0).stop 2023-10-17T06:23:05.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.973+0000 7fba05f8a700 1 -- 172.21.15.125:0/1824312555 reap_dead start 2023-10-17T06:23:05.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.973+0000 7fba0678b700 1 -- 172.21.15.125:0/1824312555 shutdown_connections 2023-10-17T06:23:05.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.973+0000 7fba0678b700 1 -- 172.21.15.125:0/1824312555 >> 172.21.15.125:0/1824312555 conn(0x7fba0006ce90 msgr2=0x7fba0015f240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:05.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.973+0000 7fba0678b700 1 -- 172.21.15.125:0/1824312555 shutdown_connections 2023-10-17T06:23:05.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:05.973+0000 7fba0678b700 1 -- 172.21.15.125:0/1824312555 wait complete. 2023-10-17T06:23:06.005 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-17T06:23:06.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.181+0000 7fabe3341700 1 Processor -- start 2023-10-17T06:23:06.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.181+0000 7fabe3341700 1 -- start start 2023-10-17T06:23:06.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.185+0000 7fabe3341700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fabdc073540 0x7fabdc06f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:06.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.185+0000 7fabe3341700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabdc0cd570 con 0x7fabdc159f00 2023-10-17T06:23:06.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.185+0000 7fabe3341700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabdc0cd850 con 0x7fabdc06f990 2023-10-17T06:23:06.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.185+0000 7fabe3341700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabdc06fe20 con 0x7fabdc073540 2023-10-17T06:23:06.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.185+0000 7fabe18de700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fabdc159f00 0x7fabdc06e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42688/0 (socket says 172.21.15.125:42688) 2023-10-17T06:23:06.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.185+0000 7fabe18de700 1 -- 172.21.15.125:0/1131358346 learned_addr learned my addr 172.21.15.125:0/1131358346 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:23:06.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.185+0000 7fabe10dd700 1 --2- 172.21.15.125:0/1131358346 >> v2:172.21.15.184:3300/0 conn(0x7fabdc073540 0x7fabdc06f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:06.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.185+0000 7fabd3fff700 1 -- 172.21.15.125:0/1131358346 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214010691 0 0) 0x7fabdc0cd570 con 0x7fabdc159f00 2023-10-17T06:23:06.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.185+0000 7fabd3fff700 1 -- 172.21.15.125:0/1131358346 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabc80035d0 con 0x7fabdc159f00 2023-10-17T06:23:06.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.185+0000 7fabe10dd700 1 -- 172.21.15.125:0/1131358346 >> v1:172.21.15.184:6789/0 conn(0x7fabdc06f990 legacy=0x7fabdc06def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:06.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.185+0000 7fabe10dd700 1 -- 172.21.15.125:0/1131358346 >> v1:172.21.15.125:6789/0 conn(0x7fabdc159f00 legacy=0x7fabdc06e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:06.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.185+0000 7fabe10dd700 1 -- 172.21.15.125:0/1131358346 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabdc0cdb30 con 0x7fabdc073540 2023-10-17T06:23:06.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.185+0000 7fabe10dd700 1 --2- 172.21.15.125:0/1131358346 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabdc073540 0x7fabdc06f450 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009850 tx=0x7fabd8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=706a499be265d6a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:06.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.189+0000 7fabd3fff700 1 -- 172.21.15.125:0/1131358346 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8011830 con 0x7fabdc073540 2023-10-17T06:23:06.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.189+0000 7fabd3fff700 1 -- 172.21.15.125:0/1131358346 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd8011990 con 0x7fabdc073540 2023-10-17T06:23:06.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.189+0000 7fabd3fff700 1 -- 172.21.15.125:0/1131358346 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8011d40 con 0x7fabdc073540 2023-10-17T06:23:06.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.189+0000 7fabe3341700 1 -- 172.21.15.125:0/1131358346 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabdc073540 msgr2=0x7fabdc06f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:06.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.189+0000 7fabe3341700 1 --2- 172.21.15.125:0/1131358346 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabdc073540 0x7fabdc06f450 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009850 tx=0x7fabd8009b60 comp rx=0 tx=0).stop 2023-10-17T06:23:06.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.189+0000 7fabe3341700 1 -- 172.21.15.125:0/1131358346 shutdown_connections 2023-10-17T06:23:06.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.189+0000 7fabe3341700 1 --2- 172.21.15.125:0/1131358346 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabdc073540 0x7fabdc06f450 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:06.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.189+0000 7fabe3341700 1 -- 172.21.15.125:0/1131358346 >> 172.21.15.125:0/1131358346 conn(0x7fabdc0b0810 msgr2=0x7fabdc0b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:06.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.189+0000 7fabe3341700 1 -- 172.21.15.125:0/1131358346 shutdown_connections 2023-10-17T06:23:06.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.189+0000 7fabe3341700 1 -- 172.21.15.125:0/1131358346 wait complete. 2023-10-17T06:23:06.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe3341700 1 Processor -- start 2023-10-17T06:23:06.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe3341700 1 -- start start 2023-10-17T06:23:06.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe3341700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fabdc06f990 0x7fabdc0b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:06.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe3341700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabdc073540 0x7fabdc0c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:06.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe3341700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabdc159f00 0x7fabdc0c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:06.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe3341700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc1f28d0 con 0x7fabdc159f00 2023-10-17T06:23:06.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe3341700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc1f2bb0 con 0x7fabdc073540 2023-10-17T06:23:06.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe3341700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc1f2e90 con 0x7fabdc06f990 2023-10-17T06:23:06.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe18de700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabdc159f00 0x7fabdc0c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:06.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe18de700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabdc159f00 0x7fabdc0c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39716/0 (socket says 172.21.15.125:39716) 2023-10-17T06:23:06.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe18de700 1 -- 172.21.15.125:0/2701819248 learned_addr learned my addr 172.21.15.125:0/2701819248 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:06.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe08dc700 1 --2- 172.21.15.125:0/2701819248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabdc073540 0x7fabdc0c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:06.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe10dd700 1 --2- 172.21.15.125:0/2701819248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fabdc06f990 0x7fabdc0b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:06.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe18de700 1 -- 172.21.15.125:0/2701819248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fabdc06f990 msgr2=0x7fabdc0b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:06.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe18de700 1 --2- 172.21.15.125:0/2701819248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fabdc06f990 0x7fabdc0b4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:06.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe18de700 1 -- 172.21.15.125:0/2701819248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabdc073540 msgr2=0x7fabdc0c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:06.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe18de700 1 --2- 172.21.15.125:0/2701819248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabdc073540 0x7fabdc0c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:06.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe18de700 1 -- 172.21.15.125:0/2701819248 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd80094b0 con 0x7fabdc159f00 2023-10-17T06:23:06.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe08dc700 1 --2- 172.21.15.125:0/2701819248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabdc073540 0x7fabdc0c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:23:06.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe10dd700 1 --2- 172.21.15.125:0/2701819248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fabdc06f990 0x7fabdc0b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-17T06:23:06.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.193+0000 7fabe18de700 1 --2- 172.21.15.125:0/2701819248 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabdc159f00 0x7fabdc0c9fd0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fabd40014b0 tx=0x7fabd400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:06.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.197+0000 7fabd1ffb700 1 -- 172.21.15.125:0/2701819248 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd400ab50 con 0x7fabdc159f00 2023-10-17T06:23:06.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.197+0000 7fabe3341700 1 -- 172.21.15.125:0/2701819248 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabdc1f3170 con 0x7fabdc159f00 2023-10-17T06:23:06.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.197+0000 7fabd1ffb700 1 -- 172.21.15.125:0/2701819248 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd400acb0 con 0x7fabdc159f00 2023-10-17T06:23:06.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.197+0000 7fabd1ffb700 1 -- 172.21.15.125:0/2701819248 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd4012620 con 0x7fabdc159f00 2023-10-17T06:23:06.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.197+0000 7fabe3341700 1 -- 172.21.15.125:0/2701819248 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabdc0b4ab0 con 0x7fabdc159f00 2023-10-17T06:23:06.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.197+0000 7fabe3341700 1 -- 172.21.15.125:0/2701819248 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabdc1f36b0 con 0x7fabdc159f00 2023-10-17T06:23:06.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.197+0000 7fabd1ffb700 1 -- 172.21.15.125:0/2701819248 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fabd4005d50 con 0x7fabdc159f00 2023-10-17T06:23:06.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.201+0000 7fabd1ffb700 1 --2- 172.21.15.125:0/2701819248 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fabc00656f0 0x7fabc0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:06.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.201+0000 7fabd1ffb700 1 -- 172.21.15.125:0/2701819248 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fabd40826a0 con 0x7fabdc159f00 2023-10-17T06:23:06.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.201+0000 7fabe10dd700 1 --2- 172.21.15.125:0/2701819248 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fabc00656f0 0x7fabc0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:06.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.201+0000 7fabe10dd700 1 --2- 172.21.15.125:0/2701819248 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fabc00656f0 0x7fabc0067bb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fabd80090b0 tx=0x7fabd801c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:06.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.205+0000 7fabd1ffb700 1 -- 172.21.15.125:0/2701819248 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fabdc1f36b0 con 0x7fabdc159f00 2023-10-17T06:23:06.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.497+0000 7fabe3341700 1 -- 172.21.15.125:0/2701819248 --> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fabdc06d9d0 con 0x7fabc00656f0 2023-10-17T06:23:06.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.501+0000 7fabd1ffb700 1 -- 172.21.15.125:0/2701819248 <== mgr.4107 v2:172.21.15.125:6832/2516570548 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fabd8011d30 con 0x7fabc00656f0 2023-10-17T06:23:06.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.501+0000 7fabe3341700 1 -- 172.21.15.125:0/2701819248 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fabc00656f0 msgr2=0x7fabc0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:06.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.501+0000 7fabe3341700 1 --2- 172.21.15.125:0/2701819248 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fabc00656f0 0x7fabc0067bb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fabd80090b0 tx=0x7fabd801c040 comp rx=0 tx=0).stop 2023-10-17T06:23:06.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.501+0000 7fabe3341700 1 -- 172.21.15.125:0/2701819248 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabdc159f00 msgr2=0x7fabdc0c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:06.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.501+0000 7fabe3341700 1 --2- 172.21.15.125:0/2701819248 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabdc159f00 0x7fabdc0c9fd0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fabd40014b0 tx=0x7fabd400cf40 comp rx=0 tx=0).stop 2023-10-17T06:23:06.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.501+0000 7fabe3341700 1 -- 172.21.15.125:0/2701819248 shutdown_connections 2023-10-17T06:23:06.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.501+0000 7fabe3341700 1 --2- 172.21.15.125:0/2701819248 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fabc00656f0 0x7fabc0067bb0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:06.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.501+0000 7fabe3341700 1 --2- 172.21.15.125:0/2701819248 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fabdc159f00 0x7fabdc0c9fd0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:06.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.501+0000 7fabe3341700 1 --2- 172.21.15.125:0/2701819248 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabdc073540 0x7fabdc0c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:06.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.501+0000 7fabe3341700 1 --2- 172.21.15.125:0/2701819248 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fabdc06f990 0x7fabdc0b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:06.512 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.501+0000 7fabe3341700 1 -- 172.21.15.125:0/2701819248 >> 172.21.15.125:0/2701819248 conn(0x7fabdc0b0810 msgr2=0x7fabdc0cb440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:06.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.501+0000 7fabe3341700 1 -- 172.21.15.125:0/2701819248 shutdown_connections 2023-10-17T06:23:06.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.501+0000 7fabe3341700 1 -- 172.21.15.125:0/2701819248 wait complete. 2023-10-17T06:23:06.514 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 7 to deep-scrub 2023-10-17T06:23:06.536 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-17T06:23:06.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.713+0000 7f8410958700 1 Processor -- start 2023-10-17T06:23:06.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.713+0000 7f8410958700 1 -- start start 2023-10-17T06:23:06.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.713+0000 7f8410958700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f840c160710 0x7f840c0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:06.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.713+0000 7f8410958700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840c15d0d0 con 0x7f840c0d2e00 2023-10-17T06:23:06.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.713+0000 7f8410958700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840c06f0f0 con 0x7f840c0b5ae0 2023-10-17T06:23:06.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.713+0000 7f8410958700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840c15df90 con 0x7f840c160710 2023-10-17T06:23:06.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.713+0000 7f840affd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f840c160710 0x7f840c0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:06.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.717+0000 7f840b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f840c0d2e00 0x7f840c0d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:42690/0 (socket says 172.21.15.125:42690) 2023-10-17T06:23:06.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.717+0000 7f840b7fe700 1 -- 172.21.15.125:0/2761015376 learned_addr learned my addr 172.21.15.125:0/2761015376 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:23:06.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.717+0000 7f840affd700 1 -- 172.21.15.125:0/2761015376 >> v1:172.21.15.184:6789/0 conn(0x7f840c0b5ae0 legacy=0x7f840c06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:06.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.717+0000 7f840affd700 1 -- 172.21.15.125:0/2761015376 >> v1:172.21.15.125:6789/0 conn(0x7f840c0d2e00 legacy=0x7f840c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:06.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.717+0000 7f840affd700 1 -- 172.21.15.125:0/2761015376 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c15d310 con 0x7f840c160710 2023-10-17T06:23:06.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.717+0000 7f840a7fc700 1 -- 172.21.15.125:0/2761015376 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368414844 0 0) 0x7f840c06f0f0 con 0x7f840c0b5ae0 2023-10-17T06:23:06.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.717+0000 7f840affd700 1 --2- 172.21.15.125:0/2761015376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f840c160710 0x7f840c0b6e00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8400009850 tx=0x7f8400009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7403b1716ce01e8e server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:06.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.717+0000 7f840a7fc700 1 -- 172.21.15.125:0/2761015376 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8400004230 con 0x7f840c160710 2023-10-17T06:23:06.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.717+0000 7f840a7fc700 1 -- 172.21.15.125:0/2761015376 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8400004390 con 0x7f840c160710 2023-10-17T06:23:06.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.717+0000 7f840a7fc700 1 -- 172.21.15.125:0/2761015376 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84000036c0 con 0x7f840c160710 2023-10-17T06:23:06.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.717+0000 7f8410958700 1 -- 172.21.15.125:0/2761015376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f840c160710 msgr2=0x7f840c0b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:06.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.717+0000 7f8410958700 1 --2- 172.21.15.125:0/2761015376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f840c160710 0x7f840c0b6e00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8400009850 tx=0x7f8400009b60 comp rx=0 tx=0).stop 2023-10-17T06:23:06.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.717+0000 7f8410958700 1 -- 172.21.15.125:0/2761015376 shutdown_connections 2023-10-17T06:23:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.717+0000 7f8410958700 1 --2- 172.21.15.125:0/2761015376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f840c160710 0x7f840c0b6e00 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.717+0000 7f8410958700 1 -- 172.21.15.125:0/2761015376 >> 172.21.15.125:0/2761015376 conn(0x7f840c069f20 msgr2=0x7f840c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:06.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.717+0000 7f8410958700 1 -- 172.21.15.125:0/2761015376 shutdown_connections 2023-10-17T06:23:06.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.717+0000 7f8410958700 1 -- 172.21.15.125:0/2761015376 wait complete. 2023-10-17T06:23:06.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.721+0000 7f8410958700 1 Processor -- start 2023-10-17T06:23:06.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.721+0000 7f8410958700 1 -- start start 2023-10-17T06:23:06.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.721+0000 7f8410958700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f840c0b5ae0 0x7f840c0d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:06.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.721+0000 7f8410958700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f840c0d2e00 0x7f840c0b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:06.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.721+0000 7f8410958700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f840c160710 0x7f840c0b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:06.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.721+0000 7f8410958700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c159d00 con 0x7f840c0b5ae0 2023-10-17T06:23:06.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.721+0000 7f8410958700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c1f2c10 con 0x7f840c160710 2023-10-17T06:23:06.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.721+0000 7f8410958700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840c159080 con 0x7f840c0d2e00 2023-10-17T06:23:06.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.725+0000 7f840b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f840c0b5ae0 0x7f840c0d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:06.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.725+0000 7f840b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f840c0b5ae0 0x7f840c0d0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39736/0 (socket says 172.21.15.125:39736) 2023-10-17T06:23:06.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.725+0000 7f840b7fe700 1 -- 172.21.15.125:0/931666408 learned_addr learned my addr 172.21.15.125:0/931666408 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:06.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.725+0000 7f840affd700 1 --2- 172.21.15.125:0/931666408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f840c0d2e00 0x7f840c0b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:06.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.725+0000 7f840bfff700 1 --2- 172.21.15.125:0/931666408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f840c160710 0x7f840c0b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:06.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.725+0000 7f840b7fe700 1 -- 172.21.15.125:0/931666408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f840c0d2e00 msgr2=0x7f840c0b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:06.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.725+0000 7f840b7fe700 1 --2- 172.21.15.125:0/931666408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f840c0d2e00 0x7f840c0b0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:06.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.725+0000 7f840b7fe700 1 -- 172.21.15.125:0/931666408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f840c160710 msgr2=0x7f840c0b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:06.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.725+0000 7f840b7fe700 1 --2- 172.21.15.125:0/931666408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f840c160710 0x7f840c0b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:06.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.725+0000 7f840b7fe700 1 -- 172.21.15.125:0/931666408 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84000094b0 con 0x7f840c0b5ae0 2023-10-17T06:23:06.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.725+0000 7f840b7fe700 1 --2- 172.21.15.125:0/931666408 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f840c0b5ae0 0x7f840c0d0c70 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00c7f0 tx=0x7f83fc00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:06.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.725+0000 7f83f3fff700 1 -- 172.21.15.125:0/931666408 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc004ca0 con 0x7f840c0b5ae0 2023-10-17T06:23:06.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.725+0000 7f83f3fff700 1 -- 172.21.15.125:0/931666408 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc004e00 con 0x7f840c0b5ae0 2023-10-17T06:23:06.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.725+0000 7f8410958700 1 -- 172.21.15.125:0/931666408 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840c159360 con 0x7f840c0b5ae0 2023-10-17T06:23:06.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.725+0000 7f83f3fff700 1 -- 172.21.15.125:0/931666408 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc0072d0 con 0x7f840c0b5ae0 2023-10-17T06:23:06.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.725+0000 7f8410958700 1 -- 172.21.15.125:0/931666408 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840c159920 con 0x7f840c0b5ae0 2023-10-17T06:23:06.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.725+0000 7f8410958700 1 -- 172.21.15.125:0/931666408 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840c072e60 con 0x7f840c0b5ae0 2023-10-17T06:23:06.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.729+0000 7f83f3fff700 1 -- 172.21.15.125:0/931666408 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f83fc007430 con 0x7f840c0b5ae0 2023-10-17T06:23:06.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.729+0000 7f83f3fff700 1 --2- 172.21.15.125:0/931666408 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f83f80656f0 0x7f83f8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:06.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.729+0000 7f83f3fff700 1 -- 172.21.15.125:0/931666408 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f83fc081e00 con 0x7f840c0b5ae0 2023-10-17T06:23:06.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.729+0000 7f840affd700 1 --2- 172.21.15.125:0/931666408 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f83f80656f0 0x7f83f8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:06.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.729+0000 7f840affd700 1 --2- 172.21.15.125:0/931666408 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f83f80656f0 0x7f83f8067bb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f840c0b7340 tx=0x7f8400010000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:06.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.737+0000 7f83f3fff700 1 -- 172.21.15.125:0/931666408 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f83fc04fae0 con 0x7f840c0b5ae0 2023-10-17T06:23:06.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.909+0000 7f8410958700 1 -- 172.21.15.125:0/931666408 --> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f840c15d8d0 con 0x7f83f80656f0 2023-10-17T06:23:06.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.917+0000 7f83f3fff700 1 -- 172.21.15.125:0/931666408 <== mgr.4107 v2:172.21.15.125:6832/2516570548 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+69759 (secure 0 0 0) 0x7f8400006c80 con 0x7f83f80656f0 2023-10-17T06:23:06.925 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:23:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.921+0000 7f8410958700 1 -- 172.21.15.125:0/931666408 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f83f80656f0 msgr2=0x7f83f8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.921+0000 7f8410958700 1 --2- 172.21.15.125:0/931666408 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f83f80656f0 0x7f83f8067bb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f840c0b7340 tx=0x7f8400010000 comp rx=0 tx=0).stop 2023-10-17T06:23:06.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.921+0000 7f8410958700 1 -- 172.21.15.125:0/931666408 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f840c0b5ae0 msgr2=0x7f840c0d0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:06.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.921+0000 7f8410958700 1 --2- 172.21.15.125:0/931666408 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f840c0b5ae0 0x7f840c0d0c70 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00c7f0 tx=0x7f83fc00cbb0 comp rx=0 tx=0).stop 2023-10-17T06:23:06.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.921+0000 7f8410958700 1 -- 172.21.15.125:0/931666408 shutdown_connections 2023-10-17T06:23:06.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.921+0000 7f8410958700 1 --2- 172.21.15.125:0/931666408 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f83f80656f0 0x7f83f8067bb0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:06.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.921+0000 7f8410958700 1 --2- 172.21.15.125:0/931666408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f840c160710 0x7f840c0b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:06.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.921+0000 7f8410958700 1 --2- 172.21.15.125:0/931666408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f840c0d2e00 0x7f840c0b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:06.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.921+0000 7f8410958700 1 --2- 172.21.15.125:0/931666408 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f840c0b5ae0 0x7f840c0d0c70 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:06.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.921+0000 7f8410958700 1 -- 172.21.15.125:0/931666408 >> 172.21.15.125:0/931666408 conn(0x7f840c069f20 msgr2=0x7f840c0b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:06.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.921+0000 7f8410958700 1 -- 172.21.15.125:0/931666408 shutdown_connections 2023-10-17T06:23:06.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:06.921+0000 7f8410958700 1 -- 172.21.15.125:0/931666408 wait complete. 2023-10-17T06:23:06.932 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-17T06:23:06.952 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":537,"stamp":"2023-10-17T06:23:06.328310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223252,"kb_used_data":6496,"kb_used_omap":24,"kb_used_meta":216615,"kb_avail":754751468,"statfs":{"total":773094113280,"available":772865503232,"internally_reserved":0,"allocated":6651904,"data_stored":3781575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24831,"internal_metadata":221814529},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.963147"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:22:54.878932+0000","last_change":"2023-10-17T06:07:02.749481+0000","last_active":"2023-10-17T06:22:54.878932+0000","last_peered":"2023-10-17T06:22:54.878932+0000","last_clean":"2023-10-17T06:22:54.878932+0000","last_became_active":"2023-10-17T06:07:02.748983+0000","last_became_peered":"2023-10-17T06:07:02.748983+0000","last_unstale":"2023-10-17T06:22:54.878932+0000","last_undegraded":"2023-10-17T06:22:54.878932+0000","last_fullsized":"2023-10-17T06:22:54.878932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:23:44.065030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":87,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:22:54.370486+0000","last_change":"2023-10-17T06:07:02.746809+0000","last_active":"2023-10-17T06:22:54.370486+0000","last_peered":"2023-10-17T06:22:54.370486+0000","last_clean":"2023-10-17T06:22:54.370486+0000","last_became_active":"2023-10-17T06:07:02.746404+0000","last_became_peered":"2023-10-17T06:07:02.746404+0000","last_unstale":"2023-10-17T06:22:54.370486+0000","last_undegraded":"2023-10-17T06:22:54.370486+0000","last_fullsized":"2023-10-17T06:22:54.370486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":92,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:22:54.920228+0000","last_change":"2023-10-17T06:07:02.943274+0000","last_active":"2023-10-17T06:22:54.920228+0000","last_peered":"2023-10-17T06:22:54.920228+0000","last_clean":"2023-10-17T06:22:54.920228+0000","last_became_active":"2023-10-17T06:07:02.942674+0000","last_became_peered":"2023-10-17T06:07:02.942674+0000","last_unstale":"2023-10-17T06:22:54.920228+0000","last_undegraded":"2023-10-17T06:22:54.920228+0000","last_fullsized":"2023-10-17T06:22:54.920228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T15:19:35.392027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":87,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:22:54.369606+0000","last_change":"2023-10-17T06:07:02.943009+0000","last_active":"2023-10-17T06:22:54.369606+0000","last_peered":"2023-10-17T06:22:54.369606+0000","last_clean":"2023-10-17T06:22:54.369606+0000","last_became_active":"2023-10-17T06:07:02.942298+0000","last_became_peered":"2023-10-17T06:07:02.942298+0000","last_unstale":"2023-10-17T06:22:54.369606+0000","last_undegraded":"2023-10-17T06:22:54.369606+0000","last_fullsized":"2023-10-17T06:22:54.369606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:22:54.370306+0000","last_change":"2023-10-17T06:07:02.747287+0000","last_active":"2023-10-17T06:22:54.370306+0000","last_peered":"2023-10-17T06:22:54.370306+0000","last_clean":"2023-10-17T06:22:54.370306+0000","last_became_active":"2023-10-17T06:07:02.746659+0000","last_became_peered":"2023-10-17T06:07:02.746659+0000","last_unstale":"2023-10-17T06:22:54.370306+0000","last_undegraded":"2023-10-17T06:22:54.370306+0000","last_fullsized":"2023-10-17T06:22:54.370306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":107,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:22:54.801259+0000","last_change":"2023-10-17T06:16:02.426582+0000","last_active":"2023-10-17T06:22:54.801259+0000","last_peered":"2023-10-17T06:22:54.801259+0000","last_clean":"2023-10-17T06:22:54.801259+0000","last_became_active":"2023-10-17T06:16:02.425947+0000","last_became_peered":"2023-10-17T06:16:02.425947+0000","last_unstale":"2023-10-17T06:22:54.801259+0000","last_undegraded":"2023-10-17T06:22:54.801259+0000","last_fullsized":"2023-10-17T06:22:54.801259+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":92,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:22:54.919166+0000","last_change":"2023-10-17T06:07:02.746953+0000","last_active":"2023-10-17T06:22:54.919166+0000","last_peered":"2023-10-17T06:22:54.919166+0000","last_clean":"2023-10-17T06:22:54.919166+0000","last_became_active":"2023-10-17T06:07:02.746344+0000","last_became_peered":"2023-10-17T06:07:02.746344+0000","last_unstale":"2023-10-17T06:22:54.919166+0000","last_undegraded":"2023-10-17T06:22:54.919166+0000","last_fullsized":"2023-10-17T06:22:54.919166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:33:16.204827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:22:54.373517+0000","last_change":"2023-10-17T06:07:02.747957+0000","last_active":"2023-10-17T06:22:54.373517+0000","last_peered":"2023-10-17T06:22:54.373517+0000","last_clean":"2023-10-17T06:22:54.373517+0000","last_became_active":"2023-10-17T06:07:02.747569+0000","last_became_peered":"2023-10-17T06:07:02.747569+0000","last_unstale":"2023-10-17T06:22:54.373517+0000","last_undegraded":"2023-10-17T06:22:54.373517+0000","last_fullsized":"2023-10-17T06:22:54.373517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:07:01.705877+0000","last_clean_scrub_stamp":"2023-10-17T06:07:01.705877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":249,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:22:54.920413+0000","last_change":"2023-10-17T06:06:55.916050+0000","last_active":"2023-10-17T06:22:54.920413+0000","last_peered":"2023-10-17T06:22:54.920413+0000","last_clean":"2023-10-17T06:22:54.920413+0000","last_became_active":"2023-10-17T06:06:55.914009+0000","last_became_peered":"2023-10-17T06:06:55.914009+0000","last_unstale":"2023-10-17T06:22:54.920413+0000","last_undegraded":"2023-10-17T06:22:54.920413+0000","last_fullsized":"2023-10-17T06:22:54.920413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:06:54.658926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:06:54.658926+0000","last_clean_scrub_stamp":"2023-10-17T06:06:54.658926+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:43:32.614909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509636,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":679936,"data_stored":324295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1240000000000001,"15min":1.111},"min":{"1min":0.69499999999999995,"5min":0.69399999999999995,"15min":0.41799999999999998},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5840000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.1719999999999999,"15min":1.1419999999999999},"min":{"1min":0.86899999999999999,"5min":0.76800000000000002,"15min":0.74199999999999999},"max":{"1min":1.635,"5min":1.79,"15min":1.79},"last":0.995}]},{"osd":1,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.181,"15min":1.149},"min":{"1min":0.83499999999999996,"5min":0.80900000000000005,"15min":0.71599999999999997},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.698},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.282,"5min":1.1899999999999999,"15min":1.1719999999999999},"min":{"1min":0.90800000000000003,"5min":0.77200000000000002,"15min":0.75},"max":{"1min":1.6080000000000001,"5min":1.625,"15min":1.73},"last":1.056}]},{"osd":2,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.212,"15min":1.181},"min":{"1min":0.84199999999999997,"5min":0.80300000000000005,"15min":0.70599999999999996},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.8360000000000001},"last":1.28},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2310000000000001,"15min":1.21},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.617,"5min":1.655,"15min":1.744},"last":1.2050000000000001}]},{"osd":3,"last update":"Tue Oct 17 06:22:17 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.2490000000000001,"15min":1.2250000000000001},"min":{"1min":0.97799999999999998,"5min":0.871,"15min":0.66700000000000004},"max":{"1min":1.639,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.369,"5min":1.3169999999999999,"15min":1.306},"min":{"1min":1.081,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.732,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.169}]},{"osd":4,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.153,"15min":1.153},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.56100000000000005},"max":{"1min":1.5049999999999999,"5min":1.6759999999999999,"15min":2.2349999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.28,"5min":1.226,"15min":1.2230000000000001},"min":{"1min":0.82999999999999996,"5min":0.67100000000000004,"15min":0.624},"max":{"1min":1.694,"5min":1.891,"15min":2.0030000000000001},"last":1.337}]},{"osd":5,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.2070000000000001,"15min":1.228},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5660000000000001,"5min":1.6240000000000001,"15min":2.113},"last":1.302},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.411,"15min":1.395},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.51800000000000002},"max":{"1min":1.7390000000000001,"5min":1.8340000000000001,"15min":1.988},"last":1.375}]},{"osd":7,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.365,"15min":1.3480000000000001},"min":{"1min":0.92900000000000005,"5min":0.79000000000000004,"15min":0.61899999999999999},"max":{"1min":1.712,"5min":1.9790000000000001,"15min":2.157},"last":1.407},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.329,"15min":1.3280000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.60799999999999998},"max":{"1min":1.7749999999999999,"5min":1.8620000000000001,"15min":2.1989999999999998},"last":1.1120000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509637,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":325505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1679999999999999,"15min":1.151},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.63700000000000001},"max":{"1min":1.5229999999999999,"5min":1.677,"15min":1.6799999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.2110000000000001,"15min":1.1870000000000001},"min":{"1min":0.79600000000000004,"5min":0.70599999999999996,"15min":0.66000000000000003},"max":{"1min":1.49,"5min":1.726,"15min":5.2919999999999998},"last":0.99299999999999999}]},{"osd":1,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.1799999999999999,"15min":1.1579999999999999},"min":{"1min":0.86499999999999999,"5min":0.66500000000000004,"15min":0.55400000000000005},"max":{"1min":1.427,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.2490000000000001,"15min":1.2090000000000001},"min":{"1min":0.97499999999999998,"5min":0.74299999999999999,"15min":0.68999999999999995},"max":{"1min":1.6220000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.052}]},{"osd":2,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.238,"15min":1.2290000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.66100000000000003},"max":{"1min":1.607,"5min":1.7070000000000001,"15min":5.3700000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2250000000000001,"15min":1.2310000000000001},"min":{"1min":0.96199999999999997,"5min":0.76200000000000001,"15min":0.60199999999999998},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":2.2080000000000002},"last":1.2310000000000001}]},{"osd":3,"last update":"Tue Oct 17 06:22:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2589999999999999,"15min":1.28},"min":{"1min":0.85399999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.71,"5min":1.794,"15min":1.794},"last":1.093},{"interface":"front","average":{"1min":1.236,"5min":1.298,"15min":1.3009999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.5820000000000001,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.157}]},{"osd":4,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.216,"15min":1.204},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.55800000000000005},"max":{"1min":1.6240000000000001,"5min":1.679,"15min":2.653},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2470000000000001,"15min":1.2370000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":3.3820000000000001},"last":1.196}]},{"osd":6,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.169,"15min":1.2230000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.494,"5min":1.851,"15min":2.7879999999999998},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.73599999999999999,"5min":0.68799999999999994,"15min":0.623},"max":{"1min":1.569,"5min":1.861,"15min":2.702},"last":1.3340000000000001}]},{"osd":7,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.369,"15min":1.3460000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.669,"5min":1.827,"15min":2.544},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.327,"15min":1.3779999999999999},"min":{"1min":0.98799999999999999,"5min":0.73099999999999998,"15min":0.70999999999999996},"max":{"1min":1.5549999999999999,"5min":1.738,"15min":2.8929999999999998},"last":1.51}]}]},{"osd":4,"up_from":15,"seq":64424509636,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":325505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.175,"15min":1.147},"min":{"1min":0.81899999999999995,"5min":0.64500000000000002,"15min":0.496},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6850000000000001},"last":1.357},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1319999999999999,"15min":1.105},"min":{"1min":0.80800000000000005,"5min":0.71199999999999997,"15min":0.57699999999999996},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.5369999999999999},"last":0.93300000000000005}]},{"osd":1,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1870000000000001,"15min":1.159},"min":{"1min":0.754,"5min":0.73299999999999998,"15min":0.70199999999999996},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7270000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2350000000000001,"15min":1.224},"min":{"1min":1.0109999999999999,"5min":0.747,"15min":0.66400000000000003},"max":{"1min":1.901,"5min":1.901,"15min":1.9910000000000001},"last":1.1299999999999999}]},{"osd":2,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.206,"15min":1.2},"min":{"1min":0.93600000000000005,"5min":0.70399999999999996,"15min":0.66800000000000004},"max":{"1min":1.488,"5min":1.694,"15min":1.903},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.28,"15min":1.2549999999999999},"min":{"1min":0.94799999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.635,"5min":1.7130000000000001,"15min":1.847},"last":1.024}]},{"osd":3,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.278,"15min":1.306},"min":{"1min":0.86399999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.417,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.373,"5min":1.339,"15min":1.3819999999999999},"min":{"1min":1.034,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.228}]},{"osd":5,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.2490000000000001,"15min":1.2230000000000001},"min":{"1min":0.85899999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6459999999999999,"5min":1.702,"15min":2.25},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.091,"15min":1.1259999999999999},"min":{"1min":0.81699999999999995,"5min":0.627,"15min":0.627},"max":{"1min":1.4379999999999999,"5min":1.667,"15min":2.024},"last":1.202}]},{"osd":6,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.212,"15min":1.2230000000000001},"min":{"1min":0.872,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5409999999999999,"5min":1.7509999999999999,"15min":3.2120000000000002},"last":1.274},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.403,"15min":1.3660000000000001},"min":{"1min":0.83299999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.764,"5min":1.7729999999999999,"15min":2.1099999999999999},"last":1.526}]},{"osd":7,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.206,"15min":1.244},"min":{"1min":0.80500000000000005,"5min":0.434,"15min":0.434},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.913},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3740000000000001,"15min":1.381},"min":{"1min":1.1040000000000001,"5min":0.622,"15min":0.622},"max":{"1min":1.6519999999999999,"5min":1.9670000000000001,"15min":2.3079999999999998},"last":1.476}]}]},{"osd":7,"up_from":14,"seq":60129542340,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28272,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343568,"statfs":{"total":96636764160,"available":96607813632,"internally_reserved":0,"allocated":1277952,"data_stored":915873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2010000000000001,"15min":1.1639999999999999},"min":{"1min":0.85299999999999998,"5min":0.73299999999999998,"15min":0.68600000000000005},"max":{"1min":1.4119999999999999,"5min":1.6240000000000001,"15min":1.9890000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.276,"5min":1.1839999999999999,"15min":1.1419999999999999},"min":{"1min":0.96899999999999997,"5min":0.79000000000000004,"15min":0.54900000000000004},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.718},"last":1.083}]},{"osd":1,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.1899999999999999,"15min":1.161},"min":{"1min":0.98499999999999999,"5min":0.78000000000000003,"15min":0.54900000000000004},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":5.0519999999999996},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2350000000000001,"15min":1.208},"min":{"1min":0.90600000000000003,"5min":0.82899999999999996,"15min":0.67800000000000005},"max":{"1min":1.6539999999999999,"5min":1.7430000000000001,"15min":2.2109999999999999},"last":1.149}]},{"osd":2,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.329,"15min":1.284},"min":{"1min":1.1519999999999999,"5min":0.71199999999999997,"15min":0.64700000000000002},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":2.1739999999999999},"last":1.292},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.21,"15min":1.208},"min":{"1min":0.95399999999999996,"5min":0.80400000000000005,"15min":0.73699999999999999},"max":{"1min":1.5580000000000001,"5min":1.6519999999999999,"15min":1.7250000000000001},"last":0.96499999999999997}]},{"osd":3,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.254,"15min":1.2709999999999999},"min":{"1min":1.014,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.55,"5min":1.617,"15min":1.617},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3360000000000001,"15min":1.345},"min":{"1min":1.254,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.5840000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.341}]},{"osd":4,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.1950000000000001,"15min":1.204},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.57399999999999995},"max":{"1min":1.625,"5min":1.6779999999999999,"15min":1.857},"last":1.387},{"interface":"front","average":{"1min":1.097,"5min":1.175,"15min":1.1930000000000001},"min":{"1min":0.78000000000000003,"5min":0.70799999999999996,"15min":0.67000000000000004},"max":{"1min":1.661,"5min":1.843,"15min":2.1499999999999999},"last":1.242}]},{"osd":5,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.258,"15min":1.194},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.45900000000000002},"max":{"1min":1.5549999999999999,"5min":1.6919999999999999,"15min":1.895},"last":1.462},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.371,"15min":1.373},"min":{"1min":1.121,"5min":0.95699999999999996,"15min":0.78800000000000003},"max":{"1min":1.702,"5min":1.802,"15min":2.1139999999999999},"last":1.4970000000000001}]},{"osd":6,"last update":"Tue Oct 17 06:22:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.3129999999999999,"15min":1.327},"min":{"1min":0.88900000000000001,"5min":0.83999999999999997,"15min":0.69199999999999995},"max":{"1min":1.6659999999999999,"5min":1.7290000000000001,"15min":2.218},"last":1.429},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.4139999999999999,"15min":1.3440000000000001},"min":{"1min":0.92500000000000004,"5min":0.81499999999999995,"15min":0.71299999999999997},"max":{"1min":1.6619999999999999,"5min":1.748,"15min":1.9710000000000001},"last":1.5329999999999999}]}]},{"osd":3,"up_from":54,"seq":231928234070,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":668,"kb_used_omap":12,"kb_used_meta":27571,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":684032,"data_stored":325505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12364,"internal_metadata":28233652},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88100000000000001,"15min":0.89800000000000002},"min":{"1min":0.61299999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2789999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.92600000000000005,"15min":0.95599999999999996},"min":{"1min":0.76800000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.2529999999999999,"5min":1.482,"15min":1.482},"last":0.73099999999999998}]},{"osd":1,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.98899999999999999,"15min":1.0329999999999999},"min":{"1min":0.71499999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.238,"5min":1.458,"15min":1.458},"last":0.46300000000000002},{"interface":"front","average":{"1min":1.032,"5min":1.044,"15min":1.0649999999999999},"min":{"1min":0.78200000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.3440000000000001,"5min":1.4770000000000001,"15min":1.4850000000000001},"last":0.64600000000000002}]},{"osd":2,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.21,"15min":1.2410000000000001},"min":{"1min":0.81899999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.623,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0009999999999999,"15min":0.97799999999999998},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.67000000000000004},"max":{"1min":1.339,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.48899999999999999}]},{"osd":4,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.228,"15min":1.3260000000000001},"min":{"1min":1.028,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.4239999999999999,"5min":1.5649999999999999,"15min":1.78},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.3,"5min":1.3240000000000001,"15min":1.377},"min":{"1min":1.0600000000000001,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":1.5549999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.1160000000000001}]},{"osd":5,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2929999999999999,"15min":1.3620000000000001},"min":{"1min":1.03,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.518,"5min":1.607,"15min":1.849},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.325,"5min":1.373,"15min":1.425},"min":{"1min":1.0800000000000001,"5min":1.012,"15min":1.012},"max":{"1min":1.581,"5min":1.962,"15min":1.962},"last":1.2989999999999999}]},{"osd":6,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2150000000000001,"15min":1.246},"min":{"1min":1.028,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.492,"5min":1.629,"15min":1.8120000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.454,"15min":1.4730000000000001},"min":{"1min":1.2709999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":1.766,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.3620000000000001}]},{"osd":7,"last update":"Tue Oct 17 06:22:14 2023","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.3799999999999999,"15min":1.4079999999999999},"min":{"1min":1.1830000000000001,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":1.7010000000000001,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":0.754},{"interface":"front","average":{"1min":1.476,"5min":1.5109999999999999,"15min":1.5629999999999999},"min":{"1min":1.248,"5min":1.1899999999999999,"15min":1.1899999999999999},"max":{"1min":1.6639999999999999,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.419}]}]},{"osd":2,"up_from":14,"seq":60129542341,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":325505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.86499999999999999,"15min":0.83699999999999997},"min":{"1min":0.623,"5min":0.54300000000000004,"15min":0.35899999999999999},"max":{"1min":1.2170000000000001,"5min":1.3979999999999999,"15min":1.409},"last":1.3029999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.93899999999999995,"15min":0.93000000000000005},"min":{"1min":0.69499999999999995,"5min":0.56000000000000005,"15min":0.39200000000000002},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.881},"last":0.69799999999999995}]},{"osd":1,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.96299999999999997,"15min":0.94999999999999996},"min":{"1min":0.77700000000000002,"5min":0.57999999999999996,"15min":0.40400000000000003},"max":{"1min":1.474,"5min":1.5489999999999999,"15min":1.605},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0389999999999999,"15min":1.0309999999999999},"min":{"1min":0.80200000000000005,"5min":0.69499999999999995,"15min":0.49399999999999999},"max":{"1min":1.482,"5min":1.482,"15min":2.1440000000000001},"last":1.1180000000000001}]},{"osd":3,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.143,"15min":1.181},"min":{"1min":0.89800000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.335,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.252},{"interface":"front","average":{"1min":1.119,"5min":1.1279999999999999,"15min":1.1100000000000001},"min":{"1min":0.875,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4099999999999999,"5min":1.573,"15min":1.573},"last":1.4039999999999999}]},{"osd":4,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.327,"15min":1.3180000000000001},"min":{"1min":1.004,"5min":1.004,"15min":0.70299999999999996},"max":{"1min":1.7070000000000001,"5min":1.756,"15min":2.3719999999999999},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.135,"5min":1.2030000000000001,"15min":1.2250000000000001},"min":{"1min":0.96099999999999997,"5min":0.92700000000000005,"15min":0.81899999999999995},"max":{"1min":1.3220000000000001,"5min":1.8140000000000001,"15min":2.0579999999999998},"last":1.0680000000000001}]},{"osd":5,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.3160000000000001,"15min":1.2689999999999999},"min":{"1min":1.0609999999999999,"5min":0.99299999999999999,"15min":0.63300000000000001},"max":{"1min":1.556,"5min":1.657,"15min":2.2650000000000001},"last":1.6339999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3919999999999999,"15min":1.3580000000000001},"min":{"1min":1.204,"5min":1.0649999999999999,"15min":0.75900000000000001},"max":{"1min":1.4750000000000001,"5min":1.954,"15min":2.5190000000000001},"last":1.673}]},{"osd":6,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2809999999999999,"15min":1.284},"min":{"1min":1.085,"5min":0.77000000000000002,"15min":0.76900000000000002},"max":{"1min":1.4950000000000001,"5min":1.841,"15min":2.2109999999999999},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.367,"5min":1.3640000000000001,"15min":1.3400000000000001},"min":{"1min":1.212,"5min":0.90800000000000003,"15min":0.64100000000000001},"max":{"1min":1.5700000000000001,"5min":1.7849999999999999,"15min":2.1720000000000002},"last":1.534}]},{"osd":7,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4179999999999999,"5min":1.4530000000000001,"15min":1.4350000000000001},"min":{"1min":1.246,"5min":1.054,"15min":0.80800000000000005},"max":{"1min":1.6419999999999999,"5min":1.8640000000000001,"15min":2.9809999999999999},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3600000000000001,"15min":1.3500000000000001},"min":{"1min":1.194,"5min":1.036,"15min":0.65100000000000002},"max":{"1min":1.607,"5min":1.728,"15min":2.1379999999999999},"last":1.5640000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542341,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":684032,"data_stored":325505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.86399999999999999,"15min":0.88},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.34100000000000003},"max":{"1min":1.1299999999999999,"5min":1.28,"15min":1.6659999999999999},"last":0.623},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0309999999999999,"15min":0.999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.505},"max":{"1min":1.3640000000000001,"5min":1.367,"15min":2.169},"last":0.70699999999999996}]},{"osd":2,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.98299999999999998,"15min":0.95799999999999996},"min":{"1min":0.75700000000000001,"5min":0.54700000000000004,"15min":0.40500000000000003},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":2.7789999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.93100000000000005,"15min":0.90200000000000002},"min":{"1min":0.68899999999999995,"5min":0.495,"15min":0.44},"max":{"1min":1.298,"5min":1.5169999999999999,"15min":2.468},"last":0.56399999999999995}]},{"osd":3,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0349999999999999,"15min":1.0589999999999999},"min":{"1min":0.745,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.3109999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.028,"15min":1.028},"min":{"1min":0.68700000000000006,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.306,"5min":1.5740000000000001,"15min":1.6339999999999999},"last":0.81799999999999995}]},{"osd":4,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.268,"15min":1.2470000000000001},"min":{"1min":0.93999999999999995,"5min":0.90300000000000002,"15min":0.745},"max":{"1min":1.5389999999999999,"5min":1.671,"15min":2.2000000000000002},"last":1.139},{"interface":"front","average":{"1min":1.159,"5min":1.2470000000000001,"15min":1.2410000000000001},"min":{"1min":0.89000000000000001,"5min":0.86299999999999999,"15min":0.503},"max":{"1min":1.3819999999999999,"5min":1.675,"15min":2.871},"last":1.288}]},{"osd":5,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.278,"15min":1.2689999999999999},"min":{"1min":1.044,"5min":0.86299999999999999,"15min":0.54100000000000004},"max":{"1min":1.4830000000000001,"5min":1.7350000000000001,"15min":3.032},"last":1.018},{"interface":"front","average":{"1min":1.246,"5min":1.262,"15min":1.2529999999999999},"min":{"1min":0.95599999999999996,"5min":0.81100000000000005,"15min":0.58799999999999997},"max":{"1min":1.504,"5min":1.6120000000000001,"15min":4.819},"last":1.103}]},{"osd":6,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2929999999999999,"15min":1.284},"min":{"1min":1.0580000000000001,"5min":0.91000000000000003,"15min":0.68200000000000005},"max":{"1min":1.488,"5min":1.6319999999999999,"15min":4.9900000000000002},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.331,"15min":1.304},"min":{"1min":1.034,"5min":0.93000000000000005,"15min":0.874},"max":{"1min":1.5980000000000001,"5min":1.8280000000000001,"15min":2.8159999999999998},"last":1.327}]},{"osd":7,"last update":"Tue Oct 17 06:22:20 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.397,"15min":1.3879999999999999},"min":{"1min":1.028,"5min":1.028,"15min":0.84399999999999997},"max":{"1min":1.5840000000000001,"5min":1.9059999999999999,"15min":2.677},"last":1.248},{"interface":"front","average":{"1min":1.397,"5min":1.4159999999999999,"15min":1.393},"min":{"1min":1.2110000000000001,"5min":1.0409999999999999,"15min":0.65400000000000003},"max":{"1min":1.607,"5min":1.9019999999999999,"15min":2.9529999999999998},"last":1.1779999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542341,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28268,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343572,"statfs":{"total":96636764160,"available":96607817728,"internally_reserved":0,"allocated":1273856,"data_stored":913882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.83199999999999996,"15min":0.81899999999999995},"min":{"1min":0.67100000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.615},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.92800000000000005,"15min":0.89200000000000002},"min":{"1min":0.71499999999999997,"5min":0.61799999999999999,"15min":0.33500000000000002},"max":{"1min":1.391,"5min":1.6020000000000001,"15min":2.3340000000000001},"last":1.0329999999999999}]},{"osd":2,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.175,"15min":1.151},"min":{"1min":0.78500000000000003,"5min":0.59499999999999997,"15min":0.55500000000000005},"max":{"1min":1.589,"5min":1.7889999999999999,"15min":4.407},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.997,"5min":0.97999999999999998,"15min":0.97299999999999998},"min":{"1min":0.55900000000000005,"5min":0.52300000000000002,"15min":0.42499999999999999},"max":{"1min":1.52,"5min":1.6559999999999999,"15min":2.5659999999999998},"last":0.59599999999999997}]},{"osd":3,"last update":"Tue Oct 17 06:22:15 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":0.995,"15min":1},"min":{"1min":0.71499999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3360000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.093},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.069,"15min":1.1180000000000001},"min":{"1min":0.63500000000000001,"5min":0.622,"15min":0.622},"max":{"1min":1.452,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.373}]},{"osd":4,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1919999999999999,"15min":1.1890000000000001},"min":{"1min":0.97299999999999998,"5min":0.88100000000000001,"15min":0.67200000000000004},"max":{"1min":1.3819999999999999,"5min":1.996,"15min":3.4820000000000002},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.194,"5min":1.224,"15min":1.232},"min":{"1min":1.0349999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.458,"5min":1.758,"15min":3.8079999999999998},"last":1.2470000000000001}]},{"osd":5,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2649999999999999,"15min":1.2569999999999999},"min":{"1min":1.048,"5min":0.79800000000000004,"15min":0.748},"max":{"1min":1.4299999999999999,"5min":1.8360000000000001,"15min":3.2120000000000002},"last":1.337},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.337,"15min":1.3120000000000001},"min":{"1min":1.0740000000000001,"5min":0.91100000000000003,"15min":0.85699999999999998},"max":{"1min":1.585,"5min":1.7849999999999999,"15min":4.3849999999999998},"last":1.4239999999999999}]},{"osd":6,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3759999999999999,"15min":1.3540000000000001},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.79100000000000004},"max":{"1min":1.522,"5min":1.873,"15min":4.3499999999999996},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.274,"15min":1.2569999999999999},"min":{"1min":1.0569999999999999,"5min":0.92600000000000005,"15min":0.61799999999999999},"max":{"1min":1.484,"5min":1.859,"15min":1.925},"last":0.86299999999999999}]},{"osd":7,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3640000000000001,"15min":1.361},"min":{"1min":0.99399999999999999,"5min":0.97599999999999998,"15min":0.73499999999999999},"max":{"1min":1.5629999999999999,"5min":1.9430000000000001,"15min":2.0840000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.415,"15min":1.403},"min":{"1min":1.27,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.5680000000000001,"5min":1.887,"15min":2.7410000000000001},"last":1.3999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-17T06:23:06.956 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-17T06:07:01.705877+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=17, tm_hour=6, tm_min=7, tm_sec=1, tm_wday=1, tm_yday=290, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=17, tm_hour=6, tm_min=22, tm_sec=59, tm_wday=1, tm_yday=290, tm_isdst=0) 2023-10-17T06:23:06.957 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-17T06:07:01.705877+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=17, tm_hour=6, tm_min=7, tm_sec=1, tm_wday=1, tm_yday=290, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=17, tm_hour=6, tm_min=22, tm_sec=59, tm_wday=1, tm_yday=290, tm_isdst=0) 2023-10-17T06:23:06.957 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-17T06:07:01.705877+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=17, tm_hour=6, tm_min=7, tm_sec=1, tm_wday=1, tm_yday=290, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=17, tm_hour=6, tm_min=22, tm_sec=59, tm_wday=1, tm_yday=290, tm_isdst=0) 2023-10-17T06:23:06.957 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-17T06:07:01.705877+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=17, tm_hour=6, tm_min=7, tm_sec=1, tm_wday=1, tm_yday=290, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=17, tm_hour=6, tm_min=22, tm_sec=59, tm_wday=1, tm_yday=290, tm_isdst=0) 2023-10-17T06:23:06.958 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-17T06:07:01.705877+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=17, tm_hour=6, tm_min=7, tm_sec=1, tm_wday=1, tm_yday=290, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=17, tm_hour=6, tm_min=22, tm_sec=59, tm_wday=1, tm_yday=290, tm_isdst=0) 2023-10-17T06:23:06.958 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-17T06:07:01.705877+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=17, tm_hour=6, tm_min=7, tm_sec=1, tm_wday=1, tm_yday=290, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=17, tm_hour=6, tm_min=22, tm_sec=59, tm_wday=1, tm_yday=290, tm_isdst=0) 2023-10-17T06:23:06.959 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-17T06:07:01.705877+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=17, tm_hour=6, tm_min=7, tm_sec=1, tm_wday=1, tm_yday=290, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=17, tm_hour=6, tm_min=22, tm_sec=59, tm_wday=1, tm_yday=290, tm_isdst=0) 2023-10-17T06:23:06.959 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-17T06:07:01.705877+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=17, tm_hour=6, tm_min=7, tm_sec=1, tm_wday=1, tm_yday=290, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=17, tm_hour=6, tm_min=22, tm_sec=59, tm_wday=1, tm_yday=290, tm_isdst=0) 2023-10-17T06:23:06.959 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-17T06:06:54.658926+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=17, tm_hour=6, tm_min=6, tm_sec=54, tm_wday=1, tm_yday=290, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=17, tm_hour=6, tm_min=22, tm_sec=59, tm_wday=1, tm_yday=290, tm_isdst=0) 2023-10-17T06:23:06.960 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-17T06:23:26.961 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-17T06:23:27.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.137+0000 7fdbeb597700 1 Processor -- start 2023-10-17T06:23:27.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.137+0000 7fdbeb597700 1 -- start start 2023-10-17T06:23:27.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.137+0000 7fdbeb597700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdbe415a410 0x7fdbe415a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:27.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.137+0000 7fdbeb597700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe4071120 con 0x7fdbe406d090 2023-10-17T06:23:27.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.137+0000 7fdbeb597700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe415e990 con 0x7fdbe406d470 2023-10-17T06:23:27.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.137+0000 7fdbeb597700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe415f4f0 con 0x7fdbe415a410 2023-10-17T06:23:27.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.141+0000 7fdbea595700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdbe406d090 0x7fdbe40b2590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49924/0 (socket says 172.21.15.125:49924) 2023-10-17T06:23:27.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.141+0000 7fdbea595700 1 -- 172.21.15.125:0/2938752618 learned_addr learned my addr 172.21.15.125:0/2938752618 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:23:27.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.141+0000 7fdbead96700 1 --2- 172.21.15.125:0/2938752618 >> v2:172.21.15.125:3300/0 conn(0x7fdbe415a410 0x7fdbe415a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:27.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.141+0000 7fdbe9593700 1 -- 172.21.15.125:0/2938752618 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51551099 0 0) 0x7fdbe4071120 con 0x7fdbe406d090 2023-10-17T06:23:27.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.141+0000 7fdbe9593700 1 -- 172.21.15.125:0/2938752618 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbd00035d0 con 0x7fdbe406d090 2023-10-17T06:23:27.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.141+0000 7fdbead96700 1 -- 172.21.15.125:0/2938752618 >> v1:172.21.15.184:6789/0 conn(0x7fdbe406d470 legacy=0x7fdbe4070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:27.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.141+0000 7fdbe9593700 1 -- 172.21.15.125:0/2938752618 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1453003757 0 0) 0x7fdbe415e990 con 0x7fdbe406d470 2023-10-17T06:23:27.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.141+0000 7fdbead96700 1 -- 172.21.15.125:0/2938752618 >> v1:172.21.15.125:6789/0 conn(0x7fdbe406d090 legacy=0x7fdbe40b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:27.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.141+0000 7fdbead96700 1 -- 172.21.15.125:0/2938752618 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe415ec50 con 0x7fdbe415a410 2023-10-17T06:23:27.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.141+0000 7fdbead96700 1 --2- 172.21.15.125:0/2938752618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe415a410 0x7fdbe415a8c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc009d90 tx=0x7fdbdc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d38644ecdc73c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:27.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.141+0000 7fdbe9593700 1 -- 172.21.15.125:0/2938752618 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc00e070 con 0x7fdbe415a410 2023-10-17T06:23:27.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.141+0000 7fdbe9593700 1 -- 172.21.15.125:0/2938752618 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbdc00bb20 con 0x7fdbe415a410 2023-10-17T06:23:27.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.141+0000 7fdbe9593700 1 -- 172.21.15.125:0/2938752618 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc00bed0 con 0x7fdbe415a410 2023-10-17T06:23:27.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.141+0000 7fdbeb597700 1 -- 172.21.15.125:0/2938752618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe415a410 msgr2=0x7fdbe415a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:27.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.141+0000 7fdbeb597700 1 --2- 172.21.15.125:0/2938752618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe415a410 0x7fdbe415a8c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc009d90 tx=0x7fdbdc00b330 comp rx=0 tx=0).stop 2023-10-17T06:23:27.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.145+0000 7fdbeb597700 1 -- 172.21.15.125:0/2938752618 shutdown_connections 2023-10-17T06:23:27.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.145+0000 7fdbeb597700 1 --2- 172.21.15.125:0/2938752618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe415a410 0x7fdbe415a8c0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:27.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.145+0000 7fdbeb597700 1 -- 172.21.15.125:0/2938752618 >> 172.21.15.125:0/2938752618 conn(0x7fdbe40ce5c0 msgr2=0x7fdbe40ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:27.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.145+0000 7fdbeb597700 1 -- 172.21.15.125:0/2938752618 shutdown_connections 2023-10-17T06:23:27.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.145+0000 7fdbeb597700 1 -- 172.21.15.125:0/2938752618 wait complete. 2023-10-17T06:23:27.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.145+0000 7fdbeb597700 1 Processor -- start 2023-10-17T06:23:27.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.149+0000 7fdbeb597700 1 -- start start 2023-10-17T06:23:27.157 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.149+0000 7fdbeb597700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbe406d090 0x7fdbe415cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:27.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.149+0000 7fdbeb597700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe406d470 0x7fdbe40cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:27.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.149+0000 7fdbeb597700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbe415a410 0x7fdbe4148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:27.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.149+0000 7fdbeb597700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe414a640 con 0x7fdbe406d470 2023-10-17T06:23:27.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.149+0000 7fdbeb597700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe40abab0 con 0x7fdbe415a410 2023-10-17T06:23:27.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.149+0000 7fdbeb597700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe4149a40 con 0x7fdbe406d090 2023-10-17T06:23:27.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.149+0000 7fdbe9d94700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe406d470 0x7fdbe40cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:27.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.149+0000 7fdbe9d94700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe406d470 0x7fdbe40cc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60632/0 (socket says 172.21.15.125:60632) 2023-10-17T06:23:27.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.149+0000 7fdbe9d94700 1 -- 172.21.15.125:0/422867226 learned_addr learned my addr 172.21.15.125:0/422867226 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:27.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.149+0000 7fdbea595700 1 --2- 172.21.15.125:0/422867226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbe406d090 0x7fdbe415cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:27.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.149+0000 7fdbead96700 1 --2- 172.21.15.125:0/422867226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbe415a410 0x7fdbe4148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:27.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.149+0000 7fdbe9d94700 1 -- 172.21.15.125:0/422867226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbe406d090 msgr2=0x7fdbe415cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:27.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.149+0000 7fdbe9d94700 1 --2- 172.21.15.125:0/422867226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbe406d090 0x7fdbe415cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:27.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.149+0000 7fdbe9d94700 1 -- 172.21.15.125:0/422867226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbe415a410 msgr2=0x7fdbe4148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:27.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.149+0000 7fdbe9d94700 1 --2- 172.21.15.125:0/422867226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbe415a410 0x7fdbe4148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:27.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.149+0000 7fdbe9d94700 1 -- 172.21.15.125:0/422867226 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc009a70 con 0x7fdbe406d470 2023-10-17T06:23:27.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.149+0000 7fdbe9d94700 1 --2- 172.21.15.125:0/422867226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe406d470 0x7fdbe40cc5e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fdbd40011e0 tx=0x7fdbd400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:27.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.153+0000 7fdbdaffd700 1 -- 172.21.15.125:0/422867226 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd40054e0 con 0x7fdbe406d470 2023-10-17T06:23:27.164 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.153+0000 7fdbdaffd700 1 -- 172.21.15.125:0/422867226 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd40036a0 con 0x7fdbe406d470 2023-10-17T06:23:27.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.153+0000 7fdbeb597700 1 -- 172.21.15.125:0/422867226 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe4149f80 con 0x7fdbe406d470 2023-10-17T06:23:27.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.153+0000 7fdbdaffd700 1 -- 172.21.15.125:0/422867226 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4003a50 con 0x7fdbe406d470 2023-10-17T06:23:27.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.153+0000 7fdbeb597700 1 -- 172.21.15.125:0/422867226 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe415d060 con 0x7fdbe406d470 2023-10-17T06:23:27.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.153+0000 7fdbeb597700 1 -- 172.21.15.125:0/422867226 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe4072e60 con 0x7fdbe406d470 2023-10-17T06:23:27.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.153+0000 7fdbdaffd700 1 -- 172.21.15.125:0/422867226 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fdbd4003bb0 con 0x7fdbe406d470 2023-10-17T06:23:27.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.157+0000 7fdbdaffd700 1 --2- 172.21.15.125:0/422867226 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdbc80656f0 0x7fdbc8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:27.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.157+0000 7fdbdaffd700 1 -- 172.21.15.125:0/422867226 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fdbd40820d0 con 0x7fdbe406d470 2023-10-17T06:23:27.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.157+0000 7fdbea595700 1 --2- 172.21.15.125:0/422867226 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdbc80656f0 0x7fdbc8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:27.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.157+0000 7fdbea595700 1 --2- 172.21.15.125:0/422867226 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdbc80656f0 0x7fdbc8067bb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0007fd0 tx=0x7fdbe0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:27.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.161+0000 7fdbdaffd700 1 -- 172.21.15.125:0/422867226 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fdbd404fd10 con 0x7fdbe406d470 2023-10-17T06:23:27.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.329+0000 7fdbeb597700 1 -- 172.21.15.125:0/422867226 --> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdbe415f210 con 0x7fdbc80656f0 2023-10-17T06:23:27.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.337+0000 7fdbdaffd700 1 -- 172.21.15.125:0/422867226 <== mgr.4107 v2:172.21.15.125:6832/2516570548 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70444 (secure 0 0 0) 0x7fdbe0001d70 con 0x7fdbc80656f0 2023-10-17T06:23:27.345 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:23:27.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.341+0000 7fdbeb597700 1 -- 172.21.15.125:0/422867226 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdbc80656f0 msgr2=0x7fdbc8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:27.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.341+0000 7fdbeb597700 1 --2- 172.21.15.125:0/422867226 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdbc80656f0 0x7fdbc8067bb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0007fd0 tx=0x7fdbe0009040 comp rx=0 tx=0).stop 2023-10-17T06:23:27.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.341+0000 7fdbeb597700 1 -- 172.21.15.125:0/422867226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe406d470 msgr2=0x7fdbe40cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:27.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.341+0000 7fdbeb597700 1 --2- 172.21.15.125:0/422867226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe406d470 0x7fdbe40cc5e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fdbd40011e0 tx=0x7fdbd400ca30 comp rx=0 tx=0).stop 2023-10-17T06:23:27.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.341+0000 7fdbeb597700 1 -- 172.21.15.125:0/422867226 shutdown_connections 2023-10-17T06:23:27.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.341+0000 7fdbeb597700 1 --2- 172.21.15.125:0/422867226 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7fdbc80656f0 0x7fdbc8067bb0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:27.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.341+0000 7fdbeb597700 1 --2- 172.21.15.125:0/422867226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbe415a410 0x7fdbe4148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:27.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.341+0000 7fdbeb597700 1 --2- 172.21.15.125:0/422867226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbe406d470 0x7fdbe40cc5e0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:27.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.341+0000 7fdbeb597700 1 --2- 172.21.15.125:0/422867226 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbe406d090 0x7fdbe415cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:27.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.341+0000 7fdbeb597700 1 -- 172.21.15.125:0/422867226 >> 172.21.15.125:0/422867226 conn(0x7fdbe40ce5c0 msgr2=0x7fdbe40b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:27.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.341+0000 7fdbeb597700 1 -- 172.21.15.125:0/422867226 shutdown_connections 2023-10-17T06:23:27.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.341+0000 7fdbeb597700 1 -- 172.21.15.125:0/422867226 wait complete. 2023-10-17T06:23:27.351 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-17T06:23:27.369 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":547,"stamp":"2023-10-17T06:23:26.334342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223208,"kb_used_data":6496,"kb_used_omap":24,"kb_used_meta":216615,"kb_avail":754751512,"statfs":{"total":773094113280,"available":772865548288,"internally_reserved":0,"allocated":6651904,"data_stored":3781575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24831,"internal_metadata":221814529},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003564"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":95,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:23:06.779177+0000","last_change":"2023-10-17T06:23:06.779310+0000","last_active":"2023-10-17T06:23:06.779177+0000","last_peered":"2023-10-17T06:23:06.779177+0000","last_clean":"2023-10-17T06:23:06.779177+0000","last_became_active":"2023-10-17T06:07:02.748983+0000","last_became_peered":"2023-10-17T06:07:02.748983+0000","last_unstale":"2023-10-17T06:23:06.779177+0000","last_undegraded":"2023-10-17T06:23:06.779177+0000","last_fullsized":"2023-10-17T06:23:06.779177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:23:06.779007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:23:06.779007+0000","last_clean_scrub_stamp":"2023-10-17T06:23:06.779007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T06:44:56.037708+0000","scrub_duration":0.0041317560000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":95,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:23:09.234941+0000","last_change":"2023-10-17T06:23:09.235022+0000","last_active":"2023-10-17T06:23:09.234941+0000","last_peered":"2023-10-17T06:23:09.234941+0000","last_clean":"2023-10-17T06:23:09.234941+0000","last_became_active":"2023-10-17T06:07:02.746404+0000","last_became_peered":"2023-10-17T06:07:02.746404+0000","last_unstale":"2023-10-17T06:23:09.234941+0000","last_undegraded":"2023-10-17T06:23:09.234941+0000","last_fullsized":"2023-10-17T06:23:09.234941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:23:09.234784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:23:09.234784+0000","last_clean_scrub_stamp":"2023-10-17T06:23:09.234784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:42:12.919534+0000","scrub_duration":0.0050670309999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":101,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:23:19.750093+0000","last_change":"2023-10-17T06:23:19.750193+0000","last_active":"2023-10-17T06:23:19.750093+0000","last_peered":"2023-10-17T06:23:19.750093+0000","last_clean":"2023-10-17T06:23:19.750093+0000","last_became_active":"2023-10-17T06:07:02.942674+0000","last_became_peered":"2023-10-17T06:07:02.942674+0000","last_unstale":"2023-10-17T06:23:19.750093+0000","last_undegraded":"2023-10-17T06:23:19.750093+0000","last_fullsized":"2023-10-17T06:23:19.750093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:23:19.749938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:23:19.749938+0000","last_clean_scrub_stamp":"2023-10-17T06:23:19.749938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T12:51:02.550324+0000","scrub_duration":0.0052868419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:23:05.322133+0000","last_change":"2023-10-17T06:23:05.322238+0000","last_active":"2023-10-17T06:23:05.322133+0000","last_peered":"2023-10-17T06:23:05.322133+0000","last_clean":"2023-10-17T06:23:05.322133+0000","last_became_active":"2023-10-17T06:07:02.942298+0000","last_became_peered":"2023-10-17T06:07:02.942298+0000","last_unstale":"2023-10-17T06:23:05.322133+0000","last_undegraded":"2023-10-17T06:23:05.322133+0000","last_fullsized":"2023-10-17T06:23:05.322133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:23:05.321960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:23:05.321960+0000","last_clean_scrub_stamp":"2023-10-17T06:23:05.321960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:40:16.292890+0000","scrub_duration":0.0038573969999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":97,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:23:07.815208+0000","last_change":"2023-10-17T06:23:07.815301+0000","last_active":"2023-10-17T06:23:07.815208+0000","last_peered":"2023-10-17T06:23:07.815208+0000","last_clean":"2023-10-17T06:23:07.815208+0000","last_became_active":"2023-10-17T06:07:02.746659+0000","last_became_peered":"2023-10-17T06:07:02.746659+0000","last_unstale":"2023-10-17T06:23:07.815208+0000","last_undegraded":"2023-10-17T06:23:07.815208+0000","last_fullsized":"2023-10-17T06:23:07.815208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:23:07.815032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:23:07.815032+0000","last_clean_scrub_stamp":"2023-10-17T06:23:07.815032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T09:21:03.582458+0000","scrub_duration":0.0046013909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":115,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:23:06.974497+0000","last_change":"2023-10-17T06:23:06.974585+0000","last_active":"2023-10-17T06:23:06.974497+0000","last_peered":"2023-10-17T06:23:06.974497+0000","last_clean":"2023-10-17T06:23:06.974497+0000","last_became_active":"2023-10-17T06:16:02.425947+0000","last_became_peered":"2023-10-17T06:16:02.425947+0000","last_unstale":"2023-10-17T06:23:06.974497+0000","last_undegraded":"2023-10-17T06:23:06.974497+0000","last_fullsized":"2023-10-17T06:23:06.974497+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:23:06.974329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:23:06.974329+0000","last_clean_scrub_stamp":"2023-10-17T06:23:06.974329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T17:44:28.661355+0000","scrub_duration":0.0051373979999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":102,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:23:17.725179+0000","last_change":"2023-10-17T06:23:17.725252+0000","last_active":"2023-10-17T06:23:17.725179+0000","last_peered":"2023-10-17T06:23:17.725179+0000","last_clean":"2023-10-17T06:23:17.725179+0000","last_became_active":"2023-10-17T06:07:02.746344+0000","last_became_peered":"2023-10-17T06:07:02.746344+0000","last_unstale":"2023-10-17T06:23:17.725179+0000","last_undegraded":"2023-10-17T06:23:17.725179+0000","last_fullsized":"2023-10-17T06:23:17.725179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:23:17.725035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:23:17.725035+0000","last_clean_scrub_stamp":"2023-10-17T06:23:17.725035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T13:39:20.785973+0000","scrub_duration":0.0052564179999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":97,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:23:06.811432+0000","last_change":"2023-10-17T06:23:06.811518+0000","last_active":"2023-10-17T06:23:06.811432+0000","last_peered":"2023-10-17T06:23:06.811432+0000","last_clean":"2023-10-17T06:23:06.811432+0000","last_became_active":"2023-10-17T06:07:02.747569+0000","last_became_peered":"2023-10-17T06:07:02.747569+0000","last_unstale":"2023-10-17T06:23:06.811432+0000","last_undegraded":"2023-10-17T06:23:06.811432+0000","last_fullsized":"2023-10-17T06:23:06.811432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-17T06:23:06.811285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-17T06:23:06.811285+0000","last_clean_scrub_stamp":"2023-10-17T06:23:06.811285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T14:02:47.691209+0000","scrub_duration":0.004254982,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"58'119","reported_seq":260,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-17T06:23:12.789000+0000","last_change":"2023-10-17T06:23:12.789085+0000","last_active":"2023-10-17T06:23:12.789000+0000","last_peered":"2023-10-17T06:23:12.789000+0000","last_clean":"2023-10-17T06:23:12.789000+0000","last_became_active":"2023-10-17T06:06:55.914009+0000","last_became_peered":"2023-10-17T06:06:55.914009+0000","last_unstale":"2023-10-17T06:23:12.789000+0000","last_undegraded":"2023-10-17T06:23:12.789000+0000","last_fullsized":"2023-10-17T06:23:12.789000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'119","last_scrub_stamp":"2023-10-17T06:23:12.788868+0000","last_deep_scrub":"58'119","last_deep_scrub_stamp":"2023-10-17T06:23:12.788868+0000","last_clean_scrub_stamp":"2023-10-17T06:23:12.788868+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T16:29:31.231357+0000","scrub_duration":0.012372251000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509640,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":679936,"data_stored":324295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1240000000000001,"15min":1.111},"min":{"1min":0.69499999999999995,"5min":0.69399999999999995,"15min":0.41799999999999998},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5840000000000001},"last":1.47},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.1719999999999999,"15min":1.1419999999999999},"min":{"1min":0.86899999999999999,"5min":0.76800000000000002,"15min":0.74199999999999999},"max":{"1min":1.635,"5min":1.79,"15min":1.79},"last":1.419}]},{"osd":1,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.181,"15min":1.149},"min":{"1min":0.83499999999999996,"5min":0.80900000000000005,"15min":0.71599999999999997},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.698},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.282,"5min":1.1899999999999999,"15min":1.1719999999999999},"min":{"1min":0.90800000000000003,"5min":0.77200000000000002,"15min":0.75},"max":{"1min":1.6080000000000001,"5min":1.625,"15min":1.73},"last":1.5249999999999999}]},{"osd":2,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.212,"15min":1.181},"min":{"1min":0.84199999999999997,"5min":0.80300000000000005,"15min":0.70599999999999996},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.8360000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2310000000000001,"15min":1.21},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.617,"5min":1.655,"15min":1.744},"last":1.1990000000000001}]},{"osd":3,"last update":"Tue Oct 17 06:23:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.258,"15min":1.228},"min":{"1min":0.92000000000000004,"5min":0.871,"15min":0.66700000000000004},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3160000000000001,"15min":1.3049999999999999},"min":{"1min":0.94599999999999995,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.518,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.171}]},{"osd":4,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.153,"15min":1.153},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.56100000000000005},"max":{"1min":1.5049999999999999,"5min":1.6759999999999999,"15min":2.2349999999999999},"last":1.571},{"interface":"front","average":{"1min":1.28,"5min":1.226,"15min":1.2230000000000001},"min":{"1min":0.82999999999999996,"5min":0.67100000000000004,"15min":0.624},"max":{"1min":1.694,"5min":1.891,"15min":2.0030000000000001},"last":1.0740000000000001}]},{"osd":5,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.2070000000000001,"15min":1.228},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5660000000000001,"5min":1.6240000000000001,"15min":2.113},"last":1.115},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.411,"15min":1.395},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.51800000000000002},"max":{"1min":1.7390000000000001,"5min":1.8340000000000001,"15min":1.988},"last":1.6160000000000001}]},{"osd":7,"last update":"Tue Oct 17 06:22:34 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.365,"15min":1.3480000000000001},"min":{"1min":0.92900000000000005,"5min":0.79000000000000004,"15min":0.61899999999999999},"max":{"1min":1.712,"5min":1.9790000000000001,"15min":2.157},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.329,"15min":1.3280000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.60799999999999998},"max":{"1min":1.7749999999999999,"5min":1.8620000000000001,"15min":2.1989999999999998},"last":1.2989999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509641,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":684032,"data_stored":325505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1679999999999999,"15min":1.151},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.63700000000000001},"max":{"1min":1.5229999999999999,"5min":1.677,"15min":1.6799999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.2110000000000001,"15min":1.1870000000000001},"min":{"1min":0.79600000000000004,"5min":0.70599999999999996,"15min":0.66000000000000003},"max":{"1min":1.49,"5min":1.726,"15min":5.2919999999999998},"last":1.2849999999999999}]},{"osd":1,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.1799999999999999,"15min":1.1579999999999999},"min":{"1min":0.86499999999999999,"5min":0.66500000000000004,"15min":0.55400000000000005},"max":{"1min":1.427,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.405},{"interface":"front","average":{"1min":1.222,"5min":1.2490000000000001,"15min":1.2090000000000001},"min":{"1min":0.97499999999999998,"5min":0.74299999999999999,"15min":0.68999999999999995},"max":{"1min":1.6220000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":1.4450000000000001}]},{"osd":2,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.238,"15min":1.2290000000000001},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.66100000000000003},"max":{"1min":1.607,"5min":1.7070000000000001,"15min":5.3700000000000001},"last":1.482},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2250000000000001,"15min":1.2310000000000001},"min":{"1min":0.96199999999999997,"5min":0.76200000000000001,"15min":0.60199999999999998},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":2.2080000000000002},"last":1.2390000000000001}]},{"osd":3,"last update":"Tue Oct 17 06:23:20 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.2509999999999999,"15min":1.2769999999999999},"min":{"1min":0.82799999999999996,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.6910000000000001,"5min":1.794,"15min":1.794},"last":1.119},{"interface":"front","average":{"1min":1.204,"5min":1.27,"15min":1.294},"min":{"1min":0.94899999999999995,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.619,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.3420000000000001}]},{"osd":4,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.216,"15min":1.204},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.55800000000000005},"max":{"1min":1.6240000000000001,"5min":1.679,"15min":2.653},"last":1.153},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2470000000000001,"15min":1.2370000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.53000000000000003},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":3.3820000000000001},"last":0.92400000000000004}]},{"osd":6,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.169,"15min":1.2230000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.494,"5min":1.851,"15min":2.7879999999999998},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.73599999999999999,"5min":0.68799999999999994,"15min":0.623},"max":{"1min":1.569,"5min":1.861,"15min":2.702},"last":1.526}]},{"osd":7,"last update":"Tue Oct 17 06:22:24 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.369,"15min":1.3460000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.669,"5min":1.827,"15min":2.544},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.327,"15min":1.3779999999999999},"min":{"1min":0.98799999999999999,"5min":0.73099999999999998,"15min":0.70999999999999996},"max":{"1min":1.5549999999999999,"5min":1.738,"15min":2.8929999999999998},"last":1.6379999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509640,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":325505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.175,"15min":1.147},"min":{"1min":0.81899999999999995,"5min":0.64500000000000002,"15min":0.496},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6850000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1319999999999999,"15min":1.105},"min":{"1min":0.80800000000000005,"5min":0.71199999999999997,"15min":0.57699999999999996},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.5369999999999999},"last":1.046}]},{"osd":1,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1870000000000001,"15min":1.159},"min":{"1min":0.754,"5min":0.73299999999999998,"15min":0.70199999999999996},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7270000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2350000000000001,"15min":1.224},"min":{"1min":1.0109999999999999,"5min":0.747,"15min":0.66400000000000003},"max":{"1min":1.901,"5min":1.901,"15min":1.9910000000000001},"last":1.5429999999999999}]},{"osd":2,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.206,"15min":1.2},"min":{"1min":0.93600000000000005,"5min":0.70399999999999996,"15min":0.66800000000000004},"max":{"1min":1.488,"5min":1.694,"15min":1.903},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.28,"15min":1.2549999999999999},"min":{"1min":0.94799999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.635,"5min":1.7130000000000001,"15min":1.847},"last":1.45}]},{"osd":3,"last update":"Tue Oct 17 06:23:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.2350000000000001,"15min":1.2909999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.617,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.337,"15min":1.373},"min":{"1min":0.89200000000000002,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.647,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.2569999999999999}]},{"osd":5,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.2490000000000001,"15min":1.2230000000000001},"min":{"1min":0.85899999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.6459999999999999,"5min":1.702,"15min":2.25},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.091,"15min":1.1259999999999999},"min":{"1min":0.81699999999999995,"5min":0.627,"15min":0.627},"max":{"1min":1.4379999999999999,"5min":1.667,"15min":2.024},"last":1.1439999999999999}]},{"osd":6,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.212,"15min":1.2230000000000001},"min":{"1min":0.872,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5409999999999999,"5min":1.7509999999999999,"15min":3.2120000000000002},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.403,"15min":1.3660000000000001},"min":{"1min":0.83299999999999996,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.764,"5min":1.7729999999999999,"15min":2.1099999999999999},"last":1.6000000000000001}]},{"osd":7,"last update":"Tue Oct 17 06:22:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.206,"15min":1.244},"min":{"1min":0.80500000000000005,"5min":0.434,"15min":0.434},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.913},"last":1.222},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3740000000000001,"15min":1.381},"min":{"1min":1.1040000000000001,"5min":0.622,"15min":0.622},"max":{"1min":1.6519999999999999,"5min":1.9670000000000001,"15min":2.3079999999999998},"last":1.409}]}]},{"osd":7,"up_from":14,"seq":60129542344,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":1277952,"data_stored":915873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:23:16 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.167,"15min":1.1559999999999999},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.68600000000000005},"max":{"1min":1.4550000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1799999999999999,"15min":1.1419999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.68600000000000005},"max":{"1min":1.5249999999999999,"5min":1.5940000000000001,"15min":1.6899999999999999},"last":1.306}]},{"osd":1,"last update":"Tue Oct 17 06:23:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1910000000000001,"15min":1.1539999999999999},"min":{"1min":0.90500000000000003,"5min":0.78000000000000003,"15min":0.72599999999999998},"max":{"1min":1.385,"5min":1.5960000000000001,"15min":1.849},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.2290000000000001,"15min":1.2},"min":{"1min":0.89500000000000002,"5min":0.82899999999999996,"15min":0.67800000000000005},"max":{"1min":1.6180000000000001,"5min":1.7430000000000001,"15min":1.748},"last":1.349}]},{"osd":2,"last update":"Tue Oct 17 06:23:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.296,"15min":1.2749999999999999},"min":{"1min":0.878,"5min":0.71199999999999997,"15min":0.64700000000000002},"max":{"1min":1.482,"5min":1.7270000000000001,"15min":1.8160000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.153,"5min":1.2150000000000001,"15min":1.2050000000000001},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.73699999999999999},"max":{"1min":1.425,"5min":1.6519999999999999,"15min":1.653},"last":1.155}]},{"osd":3,"last update":"Tue Oct 17 06:23:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2450000000000001,"15min":1.2649999999999999},"min":{"1min":0.93799999999999994,"5min":0.878,"15min":0.81999999999999995},"max":{"1min":1.45,"5min":1.617,"15min":1.617},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.3180000000000001,"15min":1.339},"min":{"1min":0.98199999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.5780000000000001,"5min":1.6479999999999999,"15min":1.7270000000000001},"last":1.119}]},{"osd":4,"last update":"Tue Oct 17 06:23:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1759999999999999,"15min":1.196},"min":{"1min":0.747,"5min":0.747,"15min":0.57399999999999995},"max":{"1min":1.5629999999999999,"5min":1.6779999999999999,"15min":1.756},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.1919999999999999,"15min":1.1799999999999999},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.67000000000000004},"max":{"1min":1.601,"5min":1.843,"15min":1.843},"last":1.577}]},{"osd":5,"last update":"Tue Oct 17 06:23:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2470000000000001,"15min":1.1850000000000001},"min":{"1min":0.83799999999999997,"5min":0.79000000000000004,"15min":0.45900000000000002},"max":{"1min":1.554,"5min":1.6919999999999999,"15min":1.734},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3720000000000001,"15min":1.3640000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":2.0019999999999998},"last":1.6950000000000001}]},{"osd":6,"last update":"Tue Oct 17 06:23:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3160000000000001,"15min":1.3149999999999999},"min":{"1min":0.90000000000000002,"5min":0.83999999999999997,"15min":0.69199999999999995},"max":{"1min":1.675,"5min":1.7290000000000001,"15min":1.8120000000000001},"last":1.258},{"interface":"front","average":{"1min":1.389,"5min":1.4019999999999999,"15min":1.341},"min":{"1min":1.0920000000000001,"5min":0.81499999999999995,"15min":0.71299999999999997},"max":{"1min":1.6359999999999999,"5min":1.6819999999999999,"15min":1.9530000000000001},"last":1.621}]}]},{"osd":3,"up_from":54,"seq":231928234074,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28264,"kb_used_data":668,"kb_used_omap":12,"kb_used_meta":27571,"kb_avail":94343576,"statfs":{"total":96636764160,"available":96607821824,"internally_reserved":0,"allocated":684032,"data_stored":325505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12364,"internal_metadata":28233652},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.83299999999999996,"15min":0.88700000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.2410000000000001,"5min":1.3480000000000001,"15min":1.5149999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.92200000000000004,"15min":0.95099999999999996},"min":{"1min":0.59799999999999998,"5min":0.55300000000000005,"15min":0.54900000000000004},"max":{"1min":1.2949999999999999,"5min":1.482,"15min":1.482},"last":1.252}]},{"osd":1,"last update":"Tue Oct 17 06:23:14 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.97299999999999998,"15min":1.0269999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.052,"15min":1.0609999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3140000000000001,"5min":1.4770000000000001,"15min":1.4850000000000001},"last":1.0229999999999999}]},{"osd":2,"last update":"Tue Oct 17 06:23:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.2010000000000001,"15min":1.236},"min":{"1min":0.88800000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.413,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.125},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.99399999999999999,"15min":0.97699999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.302,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.98899999999999999}]},{"osd":4,"last update":"Tue Oct 17 06:23:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.214,"15min":1.3140000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.4339999999999999,"5min":1.5620000000000001,"15min":1.78},"last":1.3},{"interface":"front","average":{"1min":1.391,"5min":1.3360000000000001,"15min":1.3759999999999999},"min":{"1min":1.03,"5min":1.026,"15min":0.93600000000000005},"max":{"1min":1.776,"5min":2.0299999999999998,"15min":2.0299999999999998},"last":1.3149999999999999}]},{"osd":5,"last update":"Tue Oct 17 06:23:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.274,"15min":1.351},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.673,"5min":1.673,"15min":1.849},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.393,"15min":1.425},"min":{"1min":1.054,"5min":1.054,"15min":1.012},"max":{"1min":1.8919999999999999,"5min":1.962,"15min":1.962},"last":1.361}]},{"osd":6,"last update":"Tue Oct 17 06:23:14 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.206,"15min":1.2410000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.538,"5min":1.538,"15min":1.8120000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.486,"5min":1.4630000000000001,"15min":1.4730000000000001},"min":{"1min":1.2210000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":1.9399999999999999,"5min":2.1099999999999999,"15min":2.1099999999999999},"last":1.4650000000000001}]},{"osd":7,"last update":"Tue Oct 17 06:23:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.373,"15min":1.4019999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.734,"5min":2.1499999999999999,"15min":2.1499999999999999},"last":1.218},{"interface":"front","average":{"1min":1.534,"5min":1.5169999999999999,"15min":1.5589999999999999},"min":{"1min":1.3240000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"max":{"1min":2.008,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.4139999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542345,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":684032,"data_stored":325505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.84299999999999997,"15min":0.83499999999999996},"min":{"1min":0.59999999999999998,"5min":0.54300000000000004,"15min":0.47099999999999997},"max":{"1min":1.3029999999999999,"5min":1.319,"15min":1.409},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.94099999999999995,"15min":0.92600000000000005},"min":{"1min":0.59499999999999997,"5min":0.56000000000000005,"15min":0.39200000000000002},"max":{"1min":1.262,"5min":1.6200000000000001,"15min":1.881},"last":0.95899999999999996}]},{"osd":1,"last update":"Tue Oct 17 06:23:16 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.94399999999999995,"15min":0.93700000000000006},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3049999999999999,"5min":1.5489999999999999,"15min":1.595},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.046,"5min":1.042,"15min":1.0269999999999999},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.58199999999999996},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.4159999999999999}]},{"osd":3,"last update":"Tue Oct 17 06:23:16 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.1200000000000001,"15min":1.1759999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.6399999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.131,"15min":1.111},"min":{"1min":0.82399999999999995,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4179999999999999,"5min":1.573,"15min":1.573},"last":1.115}]},{"osd":4,"last update":"Tue Oct 17 06:23:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.3100000000000001,"15min":1.3080000000000001},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.875},"max":{"1min":1.54,"5min":1.756,"15min":1.756},"last":1.222},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1910000000000001,"15min":1.2150000000000001},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.4810000000000001,"5min":1.8140000000000001,"15min":2.0049999999999999},"last":1.266}]},{"osd":5,"last update":"Tue Oct 17 06:23:16 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2969999999999999,"15min":1.262},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.746},"max":{"1min":1.6339999999999999,"5min":1.657,"15min":1.788},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.395,"15min":1.351},"min":{"1min":1.0720000000000001,"5min":1.0649999999999999,"15min":0.83699999999999997},"max":{"1min":1.673,"5min":1.954,"15min":2.0499999999999998},"last":1.325}]},{"osd":6,"last update":"Tue Oct 17 06:23:16 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.2529999999999999,"15min":1.2689999999999999},"min":{"1min":0.91200000000000003,"5min":0.77000000000000002,"15min":0.76900000000000002},"max":{"1min":1.5029999999999999,"5min":1.841,"15min":1.925},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3520000000000001,"15min":1.327},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.64100000000000001},"max":{"1min":1.5840000000000001,"5min":1.7849999999999999,"15min":1.835},"last":1.181}]},{"osd":7,"last update":"Tue Oct 17 06:23:16 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.4490000000000001,"15min":1.4259999999999999},"min":{"1min":1.036,"5min":1.036,"15min":0.90900000000000003},"max":{"1min":1.736,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.349,"15min":1.3420000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.5980000000000001,"5min":1.728,"15min":2.1059999999999999},"last":1.367}]}]},{"osd":1,"up_from":14,"seq":60129542345,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":684032,"data_stored":325505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 17 06:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.875,"15min":0.873},"min":{"1min":0.57699999999999996,"5min":0.38600000000000001,"15min":0.34100000000000003},"max":{"1min":1.226,"5min":1.28,"15min":1.6659999999999999},"last":1.099},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0169999999999999,"15min":1.0009999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.377,"5min":1.377,"15min":1.6140000000000001},"last":1.284}]},{"osd":2,"last update":"Tue Oct 17 06:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.97199999999999998,"15min":0.94499999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.40500000000000003},"max":{"1min":1.1259999999999999,"5min":1.5429999999999999,"15min":1.599},"last":1.232},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.90000000000000002,"15min":0.89800000000000002},"min":{"1min":0.56399999999999995,"5min":0.495,"15min":0.46600000000000003},"max":{"1min":1.3180000000000001,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.92100000000000004}]},{"osd":3,"last update":"Tue Oct 17 06:23:15 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":1.01,"15min":1.0529999999999999},"min":{"1min":0.68700000000000006,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":1.139},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.99299999999999999,"15min":1.02},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.266,"5min":1.569,"15min":1.6339999999999999},"last":1.171}]},{"osd":4,"last update":"Tue Oct 17 06:23:20 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2589999999999999,"15min":1.252},"min":{"1min":0.91900000000000004,"5min":0.90300000000000002,"15min":0.84099999999999997},"max":{"1min":1.52,"5min":1.671,"15min":2.2000000000000002},"last":1.347},{"interface":"front","average":{"1min":1.194,"5min":1.2290000000000001,"15min":1.228},"min":{"1min":0.89100000000000001,"5min":0.86299999999999999,"15min":0.503},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.8240000000000001},"last":1.3680000000000001}]},{"osd":5,"last update":"Tue Oct 17 06:23:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2609999999999999,"15min":1.2569999999999999},"min":{"1min":1.018,"5min":0.86299999999999999,"15min":0.54100000000000004},"max":{"1min":1.637,"5min":1.637,"15min":1.9419999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.248,"15min":1.2410000000000001},"min":{"1min":0.94099999999999995,"5min":0.81100000000000005,"15min":0.58799999999999997},"max":{"1min":1.4970000000000001,"5min":1.6120000000000001,"15min":2.1379999999999999},"last":1.21}]},{"osd":6,"last update":"Tue Oct 17 06:23:20 2023","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.266,"15min":1.2649999999999999},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.68200000000000005},"max":{"1min":1.6120000000000001,"5min":1.6319999999999999,"15min":1.6519999999999999},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.3029999999999999,"15min":1.2949999999999999},"min":{"1min":0.93700000000000006,"5min":0.93000000000000005,"15min":0.874},"max":{"1min":1.6859999999999999,"5min":1.7350000000000001,"15min":2.0739999999999998},"last":1.393}]},{"osd":7,"last update":"Tue Oct 17 06:23:20 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.375,"15min":1.379},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.91700000000000004},"max":{"1min":1.702,"5min":1.8779999999999999,"15min":2.0899999999999999},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.393,"15min":1.3779999999999999},"min":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":0.65400000000000003},"max":{"1min":1.8080000000000001,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.425}]}]},{"osd":0,"up_from":14,"seq":60129542345,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28260,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343580,"statfs":{"total":96636764160,"available":96607825920,"internally_reserved":0,"allocated":1273856,"data_stored":913882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.83199999999999996,"15min":0.81899999999999995},"min":{"1min":0.67100000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.615},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.92800000000000005,"15min":0.89200000000000002},"min":{"1min":0.71499999999999997,"5min":0.61799999999999999,"15min":0.33500000000000002},"max":{"1min":1.391,"5min":1.6020000000000001,"15min":2.3340000000000001},"last":1.2230000000000001}]},{"osd":2,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.175,"15min":1.151},"min":{"1min":0.78500000000000003,"5min":0.59499999999999997,"15min":0.55500000000000005},"max":{"1min":1.589,"5min":1.7889999999999999,"15min":4.407},"last":1.367},{"interface":"front","average":{"1min":0.997,"5min":0.97999999999999998,"15min":0.97299999999999998},"min":{"1min":0.55900000000000005,"5min":0.52300000000000002,"15min":0.42499999999999999},"max":{"1min":1.52,"5min":1.6559999999999999,"15min":2.5659999999999998},"last":1.1319999999999999}]},{"osd":3,"last update":"Tue Oct 17 06:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.98099999999999998,"15min":0.998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.458,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.048,"15min":1.111},"min":{"1min":0.75600000000000001,"5min":0.622,"15min":0.622},"max":{"1min":1.373,"5min":1.7050000000000001,"15min":1.7889999999999999},"last":1.052}]},{"osd":4,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1919999999999999,"15min":1.1890000000000001},"min":{"1min":0.97299999999999998,"5min":0.88100000000000001,"15min":0.67200000000000004},"max":{"1min":1.3819999999999999,"5min":1.996,"15min":3.4820000000000002},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.224,"15min":1.232},"min":{"1min":1.0349999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.458,"5min":1.758,"15min":3.8079999999999998},"last":1.1759999999999999}]},{"osd":5,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2649999999999999,"15min":1.2569999999999999},"min":{"1min":1.048,"5min":0.79800000000000004,"15min":0.748},"max":{"1min":1.4299999999999999,"5min":1.8360000000000001,"15min":3.2120000000000002},"last":1.633},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.337,"15min":1.3120000000000001},"min":{"1min":1.0740000000000001,"5min":0.91100000000000003,"15min":0.85699999999999998},"max":{"1min":1.585,"5min":1.7849999999999999,"15min":4.3849999999999998},"last":1.4359999999999999}]},{"osd":6,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3759999999999999,"15min":1.3540000000000001},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.79100000000000004},"max":{"1min":1.522,"5min":1.873,"15min":4.3499999999999996},"last":1.482},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.274,"15min":1.2569999999999999},"min":{"1min":1.0569999999999999,"5min":0.92600000000000005,"15min":0.61799999999999999},"max":{"1min":1.484,"5min":1.859,"15min":1.925},"last":1.4510000000000001}]},{"osd":7,"last update":"Tue Oct 17 06:22:32 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3640000000000001,"15min":1.361},"min":{"1min":0.99399999999999999,"5min":0.97599999999999998,"15min":0.73499999999999999},"max":{"1min":1.5629999999999999,"5min":1.9430000000000001,"15min":2.0840000000000001},"last":1.681},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.415,"15min":1.403},"min":{"1min":1.27,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.5680000000000001,"5min":1.887,"15min":2.7410000000000001},"last":1.744}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-17T06:23:27.372 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-17T06:23:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.529+0000 7f213ebba700 1 Processor -- start 2023-10-17T06:23:27.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.529+0000 7f213ebba700 1 -- start start 2023-10-17T06:23:27.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.529+0000 7f213ebba700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f21381467c0 0x7f21380b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:27.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.529+0000 7f213ebba700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213806f9a0 0x7f213806fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:27.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.529+0000 7f213ebba700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2138146ba0 con 0x7f21381612e0 2023-10-17T06:23:27.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.529+0000 7f213ebba700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21380d0920 con 0x7f21381467c0 2023-10-17T06:23:27.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.529+0000 7f213ebba700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2138070320 con 0x7f213806f9a0 2023-10-17T06:23:27.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.533+0000 7f213c956700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f21381467c0 0x7f21380b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:27.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.533+0000 7f2137fff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f21381612e0 0x7f213815d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.125:48818/0 (socket says 172.21.15.125:48818) 2023-10-17T06:23:27.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.533+0000 7f2137fff700 1 -- 172.21.15.125:0/2947311074 learned_addr learned my addr 172.21.15.125:0/2947311074 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:23:27.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.533+0000 7f213d157700 1 --2- 172.21.15.125:0/2947311074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213806f9a0 0x7f213806fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:27.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.533+0000 7f21377fe700 1 -- 172.21.15.125:0/2947311074 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457208870 0 0) 0x7f2138146ba0 con 0x7f21381612e0 2023-10-17T06:23:27.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.533+0000 7f21377fe700 1 -- 172.21.15.125:0/2947311074 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21280035d0 con 0x7f21381612e0 2023-10-17T06:23:27.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.533+0000 7f213d157700 1 -- 172.21.15.125:0/2947311074 >> v2:172.21.15.184:3300/0 conn(0x7f21381467c0 msgr2=0x7f21380b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:23:27.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.533+0000 7f213d157700 1 --2- 172.21.15.125:0/2947311074 >> v2:172.21.15.184:3300/0 conn(0x7f21381467c0 0x7f21380b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:27.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.533+0000 7f213d157700 1 -- 172.21.15.125:0/2947311074 >> v1:172.21.15.184:6789/0 conn(0x7f21381612e0 legacy=0x7f213815d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:27.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.533+0000 7f213d157700 1 -- 172.21.15.125:0/2947311074 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21380b6160 con 0x7f213806f9a0 2023-10-17T06:23:27.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.533+0000 7f213c956700 1 --2- 172.21.15.125:0/2947311074 >> v2:172.21.15.184:3300/0 conn(0x7f21381467c0 0x7f21380b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-17T06:23:27.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.533+0000 7f213d157700 1 --2- 172.21.15.125:0/2947311074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213806f9a0 0x7f213806fde0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2130009d90 tx=0x7f213000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7aaae20ee7508b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:27.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.533+0000 7f21377fe700 1 -- 172.21.15.125:0/2947311074 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213000e070 con 0x7f213806f9a0 2023-10-17T06:23:27.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.533+0000 7f21377fe700 1 -- 172.21.15.125:0/2947311074 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213000bb20 con 0x7f213806f9a0 2023-10-17T06:23:27.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.533+0000 7f21377fe700 1 -- 172.21.15.125:0/2947311074 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130012430 con 0x7f213806f9a0 2023-10-17T06:23:27.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.537+0000 7f213ebba700 1 -- 172.21.15.125:0/2947311074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213806f9a0 msgr2=0x7f213806fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:27.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.537+0000 7f213ebba700 1 --2- 172.21.15.125:0/2947311074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213806f9a0 0x7f213806fde0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2130009d90 tx=0x7f213000b330 comp rx=0 tx=0).stop 2023-10-17T06:23:27.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.537+0000 7f213ebba700 1 -- 172.21.15.125:0/2947311074 shutdown_connections 2023-10-17T06:23:27.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.537+0000 7f213ebba700 1 --2- 172.21.15.125:0/2947311074 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213806f9a0 0x7f213806fde0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:27.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.537+0000 7f213ebba700 1 --2- 172.21.15.125:0/2947311074 >> v2:172.21.15.184:3300/0 conn(0x7f21381467c0 0x7f21380b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:27.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.537+0000 7f213ebba700 1 -- 172.21.15.125:0/2947311074 >> 172.21.15.125:0/2947311074 conn(0x7f213806a130 msgr2=0x7f213806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:27.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.537+0000 7f213ebba700 1 -- 172.21.15.125:0/2947311074 shutdown_connections 2023-10-17T06:23:27.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.537+0000 7f213ebba700 1 -- 172.21.15.125:0/2947311074 wait complete. 2023-10-17T06:23:27.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f213ebba700 1 Processor -- start 2023-10-17T06:23:27.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f213ebba700 1 -- start start 2023-10-17T06:23:27.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f213ebba700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f213806f9a0 0x7f213815c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:27.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f213ebba700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21381467c0 0x7f213815f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:27.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f213ebba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21381612e0 0x7f213813ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:27.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f213ebba700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213815e7d0 con 0x7f21381612e0 2023-10-17T06:23:27.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f213ebba700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21380c8b30 con 0x7f213806f9a0 2023-10-17T06:23:27.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f213ebba700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213815ea20 con 0x7f21381467c0 2023-10-17T06:23:27.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f213d157700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21381612e0 0x7f213813ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:27.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f213d157700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21381612e0 0x7f213813ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60642/0 (socket says 172.21.15.125:60642) 2023-10-17T06:23:27.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f213d157700 1 -- 172.21.15.125:0/740193775 learned_addr learned my addr 172.21.15.125:0/740193775 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:27.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f213c956700 1 --2- 172.21.15.125:0/740193775 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f213806f9a0 0x7f213815c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:27.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f2137fff700 1 --2- 172.21.15.125:0/740193775 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21381467c0 0x7f213815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:27.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f213d157700 1 -- 172.21.15.125:0/740193775 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21381467c0 msgr2=0x7f213815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:27.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f213d157700 1 --2- 172.21.15.125:0/740193775 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21381467c0 0x7f213815f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:27.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f213d157700 1 -- 172.21.15.125:0/740193775 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f213806f9a0 msgr2=0x7f213815c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:27.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f213d157700 1 --2- 172.21.15.125:0/740193775 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f213806f9a0 0x7f213815c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:27.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f213d157700 1 -- 172.21.15.125:0/740193775 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c0094b0 con 0x7f21381612e0 2023-10-17T06:23:27.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f213d157700 1 --2- 172.21.15.125:0/740193775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21381612e0 0x7f213813ff40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f2130014040 tx=0x7f2130004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:27.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f21357fa700 1 -- 172.21.15.125:0/740193775 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130012430 con 0x7f21381612e0 2023-10-17T06:23:27.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f21357fa700 1 -- 172.21.15.125:0/740193775 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2130020070 con 0x7f21381612e0 2023-10-17T06:23:27.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f213ebba700 1 -- 172.21.15.125:0/740193775 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2130009a70 con 0x7f21381612e0 2023-10-17T06:23:27.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.541+0000 7f21357fa700 1 -- 172.21.15.125:0/740193775 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130004280 con 0x7f21381612e0 2023-10-17T06:23:27.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.545+0000 7f213ebba700 1 -- 172.21.15.125:0/740193775 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213815efe0 con 0x7f21381612e0 2023-10-17T06:23:27.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.545+0000 7f213ebba700 1 -- 172.21.15.125:0/740193775 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2138072e60 con 0x7f21381612e0 2023-10-17T06:23:27.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.545+0000 7f21357fa700 1 -- 172.21.15.125:0/740193775 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f21300043e0 con 0x7f21381612e0 2023-10-17T06:23:27.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.549+0000 7f21357fa700 1 --2- 172.21.15.125:0/740193775 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f211c0656f0 0x7f211c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:27.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.549+0000 7f21357fa700 1 -- 172.21.15.125:0/740193775 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f2130022070 con 0x7f21381612e0 2023-10-17T06:23:27.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.549+0000 7f213c956700 1 --2- 172.21.15.125:0/740193775 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f211c0656f0 0x7f211c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:27.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.549+0000 7f213c956700 1 --2- 172.21.15.125:0/740193775 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f211c0656f0 0x7f211c067bb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f212c009d10 tx=0x7f212c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:27.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.553+0000 7f21357fa700 1 -- 172.21.15.125:0/740193775 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f21300529d0 con 0x7f21381612e0 2023-10-17T06:23:27.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.785+0000 7f213ebba700 1 -- 172.21.15.125:0/740193775 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f21380b7200 con 0x7f21381612e0 2023-10-17T06:23:27.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.797+0000 7f21357fa700 1 -- 172.21.15.125:0/740193775 <== mon.0 v2:172.21.15.125:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f21300098f0 con 0x7f21381612e0 2023-10-17T06:23:27.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.797+0000 7f21357fa700 1 -- 172.21.15.125:0/740193775 <== mon.0 v2:172.21.15.125:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v17)=0 v17) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2130055ff0 con 0x7f21381612e0 2023-10-17T06:23:27.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.801+0000 7f213ebba700 1 -- 172.21.15.125:0/740193775 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f211c0656f0 msgr2=0x7f211c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:27.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.801+0000 7f213ebba700 1 --2- 172.21.15.125:0/740193775 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f211c0656f0 0x7f211c067bb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f212c009d10 tx=0x7f212c008040 comp rx=0 tx=0).stop 2023-10-17T06:23:27.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.801+0000 7f213ebba700 1 -- 172.21.15.125:0/740193775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21381612e0 msgr2=0x7f213813ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:27.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.801+0000 7f213ebba700 1 --2- 172.21.15.125:0/740193775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21381612e0 0x7f213813ff40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f2130014040 tx=0x7f2130004af0 comp rx=0 tx=0).stop 2023-10-17T06:23:27.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.801+0000 7f213ebba700 1 -- 172.21.15.125:0/740193775 shutdown_connections 2023-10-17T06:23:27.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.801+0000 7f213ebba700 1 --2- 172.21.15.125:0/740193775 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f211c0656f0 0x7f211c067bb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:27.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.801+0000 7f213ebba700 1 --2- 172.21.15.125:0/740193775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21381612e0 0x7f213813ff40 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:27.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.801+0000 7f213ebba700 1 --2- 172.21.15.125:0/740193775 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21381467c0 0x7f213815f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:27.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.801+0000 7f213ebba700 1 --2- 172.21.15.125:0/740193775 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f213806f9a0 0x7f213815c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:27.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.801+0000 7f213ebba700 1 -- 172.21.15.125:0/740193775 >> 172.21.15.125:0/740193775 conn(0x7f213806a130 msgr2=0x7f2138145980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:27.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.801+0000 7f213ebba700 1 -- 172.21.15.125:0/740193775 shutdown_connections 2023-10-17T06:23:27.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:27.801+0000 7f213ebba700 1 -- 172.21.15.125:0/740193775 wait complete. 2023-10-17T06:23:27.830 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-17T06:23:27.831 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-17T06:23:28.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.001+0000 7f1f56adf700 1 Processor -- start 2023-10-17T06:23:28.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.001+0000 7f1f56adf700 1 -- start start 2023-10-17T06:23:28.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.005+0000 7f1f56adf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f5015ab80 0x7f1f500cb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:28.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.005+0000 7f1f56adf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1f500afe70 0x7f1f500cb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:28.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.005+0000 7f1f56adf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f50070de0 con 0x7f1f5015af60 2023-10-17T06:23:28.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.005+0000 7f1f56adf700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f500701d0 con 0x7f1f500afe70 2023-10-17T06:23:28.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.005+0000 7f1f56adf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500704b0 con 0x7f1f5015ab80 2023-10-17T06:23:28.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.005+0000 7f1f552dc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1f500afe70 0x7f1f500cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:28.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.005+0000 7f1f562de700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1f5015af60 0x7f1f500ceb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49930/0 (socket says 172.21.15.125:49930) 2023-10-17T06:23:28.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.005+0000 7f1f562de700 1 -- 172.21.15.125:0/208737570 learned_addr learned my addr 172.21.15.125:0/208737570 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-17T06:23:28.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.005+0000 7f1f55add700 1 --2- 172.21.15.125:0/208737570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f5015ab80 0x7f1f500cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:28.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.005+0000 7f1f54adb700 1 -- 172.21.15.125:0/208737570 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593010901 0 0) 0x7f1f50070de0 con 0x7f1f5015af60 2023-10-17T06:23:28.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.005+0000 7f1f552dc700 1 -- 172.21.15.125:0/208737570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f5015ab80 msgr2=0x7f1f500cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-17T06:23:28.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.005+0000 7f1f552dc700 1 --2- 172.21.15.125:0/208737570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f5015ab80 0x7f1f500cb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:28.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.005+0000 7f1f552dc700 1 -- 172.21.15.125:0/208737570 >> v1:172.21.15.125:6789/0 conn(0x7f1f5015af60 legacy=0x7f1f500ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:28.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.005+0000 7f1f552dc700 1 -- 172.21.15.125:0/208737570 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f50070790 con 0x7f1f500afe70 2023-10-17T06:23:28.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.005+0000 7f1f552dc700 1 --2- 172.21.15.125:0/208737570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f500afe70 0x7f1f500cb680 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1f40009850 tx=0x7f1f40009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6393b7e25fcd7bb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:28.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.009+0000 7f1f54adb700 1 -- 172.21.15.125:0/208737570 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40011830 con 0x7f1f500afe70 2023-10-17T06:23:28.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.009+0000 7f1f54adb700 1 -- 172.21.15.125:0/208737570 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1f40011990 con 0x7f1f500afe70 2023-10-17T06:23:28.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.009+0000 7f1f54adb700 1 -- 172.21.15.125:0/208737570 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f40011d60 con 0x7f1f500afe70 2023-10-17T06:23:28.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.009+0000 7f1f56adf700 1 -- 172.21.15.125:0/208737570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f500afe70 msgr2=0x7f1f500cb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:28.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.009+0000 7f1f56adf700 1 --2- 172.21.15.125:0/208737570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f500afe70 0x7f1f500cb680 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1f40009850 tx=0x7f1f40009b60 comp rx=0 tx=0).stop 2023-10-17T06:23:28.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.009+0000 7f1f56adf700 1 -- 172.21.15.125:0/208737570 shutdown_connections 2023-10-17T06:23:28.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.009+0000 7f1f56adf700 1 --2- 172.21.15.125:0/208737570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f500afe70 0x7f1f500cb680 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:28.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.009+0000 7f1f56adf700 1 --2- 172.21.15.125:0/208737570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f5015ab80 0x7f1f500cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:28.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.009+0000 7f1f56adf700 1 -- 172.21.15.125:0/208737570 >> 172.21.15.125:0/208737570 conn(0x7f1f500d08e0 msgr2=0x7f1f500d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:28.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.009+0000 7f1f56adf700 1 -- 172.21.15.125:0/208737570 shutdown_connections 2023-10-17T06:23:28.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.009+0000 7f1f56adf700 1 -- 172.21.15.125:0/208737570 wait complete. 2023-10-17T06:23:28.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.013+0000 7f1f56adf700 1 Processor -- start 2023-10-17T06:23:28.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.013+0000 7f1f56adf700 1 -- start start 2023-10-17T06:23:28.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.013+0000 7f1f56adf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f500afe70 0x7f1f50157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:28.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.013+0000 7f1f56adf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f5015ab80 0x7f1f5006aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:28.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.013+0000 7f1f56adf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f5015af60 0x7f1f501e4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:28.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.013+0000 7f1f56adf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f501582c0 con 0x7f1f5015ab80 2023-10-17T06:23:28.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.013+0000 7f1f56adf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500c61a0 con 0x7f1f5015af60 2023-10-17T06:23:28.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.013+0000 7f1f56adf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f500c5100 con 0x7f1f500afe70 2023-10-17T06:23:28.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.017+0000 7f1f552dc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f5015ab80 0x7f1f5006aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:28.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.017+0000 7f1f55add700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f500afe70 0x7f1f50157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:28.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.017+0000 7f1f552dc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f5015ab80 0x7f1f5006aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:60646/0 (socket says 172.21.15.125:60646) 2023-10-17T06:23:28.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.017+0000 7f1f552dc700 1 -- 172.21.15.125:0/693310071 learned_addr learned my addr 172.21.15.125:0/693310071 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-17T06:23:28.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.017+0000 7f1f562de700 1 --2- 172.21.15.125:0/693310071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f5015af60 0x7f1f501e4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:28.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.017+0000 7f1f552dc700 1 -- 172.21.15.125:0/693310071 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f500afe70 msgr2=0x7f1f50157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:28.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.017+0000 7f1f552dc700 1 --2- 172.21.15.125:0/693310071 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f500afe70 0x7f1f50157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:28.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.017+0000 7f1f552dc700 1 -- 172.21.15.125:0/693310071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f5015af60 msgr2=0x7f1f501e4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:28.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.017+0000 7f1f552dc700 1 --2- 172.21.15.125:0/693310071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f5015af60 0x7f1f501e4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:28.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.017+0000 7f1f552dc700 1 -- 172.21.15.125:0/693310071 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f400094b0 con 0x7f1f5015ab80 2023-10-17T06:23:28.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.017+0000 7f1f552dc700 1 --2- 172.21.15.125:0/693310071 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f5015ab80 0x7f1f5006aa60 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1f40000c00 tx=0x7f1f40004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:28.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.017+0000 7f1f467fc700 1 -- 172.21.15.125:0/693310071 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4001aa10 con 0x7f1f5015ab80 2023-10-17T06:23:28.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.017+0000 7f1f467fc700 1 -- 172.21.15.125:0/693310071 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1f4001f070 con 0x7f1f5015ab80 2023-10-17T06:23:28.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.017+0000 7f1f467fc700 1 -- 172.21.15.125:0/693310071 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4001add0 con 0x7f1f5015ab80 2023-10-17T06:23:28.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.017+0000 7f1f56adf700 1 -- 172.21.15.125:0/693310071 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f500c53e0 con 0x7f1f5015ab80 2023-10-17T06:23:28.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.017+0000 7f1f56adf700 1 -- 172.21.15.125:0/693310071 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f500c59a0 con 0x7f1f5015ab80 2023-10-17T06:23:28.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.017+0000 7f1f56adf700 1 -- 172.21.15.125:0/693310071 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f50072e60 con 0x7f1f5015ab80 2023-10-17T06:23:28.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.021+0000 7f1f467fc700 1 -- 172.21.15.125:0/693310071 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1f4001b430 con 0x7f1f5015ab80 2023-10-17T06:23:28.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.021+0000 7f1f467fc700 1 --2- 172.21.15.125:0/693310071 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1f340656f0 0x7f1f34067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-17T06:23:28.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.021+0000 7f1f467fc700 1 -- 172.21.15.125:0/693310071 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f1f40083c60 con 0x7f1f5015ab80 2023-10-17T06:23:28.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.021+0000 7f1f55add700 1 --2- 172.21.15.125:0/693310071 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1f340656f0 0x7f1f34067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-17T06:23:28.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.021+0000 7f1f55add700 1 --2- 172.21.15.125:0/693310071 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1f340656f0 0x7f1f34067bb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009bf0 tx=0x7f1f4c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-17T06:23:28.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.029+0000 7f1f467fc700 1 -- 172.21.15.125:0/693310071 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f1f40051940 con 0x7f1f5015ab80 2023-10-17T06:23:28.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.261+0000 7f1f56adf700 1 -- 172.21.15.125:0/693310071 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f50071ed0 con 0x7f1f5015ab80 2023-10-17T06:23:28.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.261+0000 7f1f467fc700 1 -- 172.21.15.125:0/693310071 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f1f40015090 con 0x7f1f5015ab80 2023-10-17T06:23:28.270 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-17T06:23:28.270 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/4071987992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":4071987992},{"type":"v1","addr":"172.21.15.184:6833","nonce":4071987992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5377,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/4155245154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":4155245154},{"type":"v1","addr":"172.21.15.184:6835","nonce":4155245154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5532,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6835/1660244436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1660244436},{"type":"v1","addr":"172.21.15.125:6835","nonce":1660244436}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":6153,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/1340494301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6836","nonce":1340494301},{"type":"v1","addr":"172.21.15.125:6837","nonce":1340494301}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[]} 2023-10-17T06:23:28.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.265+0000 7f1f56adf700 1 -- 172.21.15.125:0/693310071 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1f340656f0 msgr2=0x7f1f34067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:28.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.265+0000 7f1f56adf700 1 --2- 172.21.15.125:0/693310071 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1f340656f0 0x7f1f34067bb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009bf0 tx=0x7f1f4c009240 comp rx=0 tx=0).stop 2023-10-17T06:23:28.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.265+0000 7f1f56adf700 1 -- 172.21.15.125:0/693310071 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f5015ab80 msgr2=0x7f1f5006aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-17T06:23:28.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.265+0000 7f1f56adf700 1 --2- 172.21.15.125:0/693310071 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f5015ab80 0x7f1f5006aa60 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1f40000c00 tx=0x7f1f40004770 comp rx=0 tx=0).stop 2023-10-17T06:23:28.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.265+0000 7f1f56adf700 1 -- 172.21.15.125:0/693310071 shutdown_connections 2023-10-17T06:23:28.274 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.265+0000 7f1f56adf700 1 --2- 172.21.15.125:0/693310071 >> [v2:172.21.15.125:6832/2516570548,v1:172.21.15.125:6833/2516570548] conn(0x7f1f340656f0 0x7f1f34067bb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:28.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.265+0000 7f1f56adf700 1 --2- 172.21.15.125:0/693310071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f5015af60 0x7f1f501e4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:28.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.265+0000 7f1f56adf700 1 --2- 172.21.15.125:0/693310071 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1f5015ab80 0x7f1f5006aa60 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:28.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.265+0000 7f1f56adf700 1 --2- 172.21.15.125:0/693310071 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f500afe70 0x7f1f50157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-17T06:23:28.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.265+0000 7f1f56adf700 1 -- 172.21.15.125:0/693310071 >> 172.21.15.125:0/693310071 conn(0x7f1f500d08e0 msgr2=0x7f1f50159e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-17T06:23:28.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.265+0000 7f1f56adf700 1 -- 172.21.15.125:0/693310071 shutdown_connections 2023-10-17T06:23:28.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-17T06:23:28.265+0000 7f1f56adf700 1 -- 172.21.15.125:0/693310071 wait complete. 2023-10-17T06:23:28.276 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 21 2023-10-17T06:23:28.294 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-17T06:23:28.294 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-17T06:23:28.295 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-17T06:23:28.295 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:23:28.316 INFO:tasks.ceph.mds.a:Stopped 2023-10-17T06:23:28.316 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-17T06:23:28.316 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:23:28.382 INFO:tasks.ceph.mds.c:Stopped 2023-10-17T06:23:28.382 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-17T06:23:28.383 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:23:28.404 INFO:tasks.ceph.mds.b:Stopped 2023-10-17T06:23:28.405 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-17T06:23:28.405 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:23:28.475 INFO:tasks.ceph.mds.d:Stopped 2023-10-17T06:23:28.476 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-17T06:23:28.476 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-17T06:23:28.476 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:23:28.577 INFO:tasks.ceph.osd.0:Stopped 2023-10-17T06:23:28.578 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-17T06:23:28.578 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:23:31.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-10-17T06:23:34.435 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:23:34.443 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:23:34.679 INFO:tasks.ceph.osd.1:Stopped 2023-10-17T06:23:34.680 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-17T06:23:34.681 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:23:34.773 INFO:tasks.ceph.osd.2:Stopped 2023-10-17T06:23:34.774 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-17T06:23:34.774 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:23:37.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-17T06:23:37.514 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-10-17T06:23:40.876 INFO:tasks.ceph.osd.3:Stopped 2023-10-17T06:23:40.877 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-17T06:23:40.877 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:23:40.954 INFO:tasks.ceph.osd.4:Stopped 2023-10-17T06:23:40.955 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-17T06:23:40.955 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:23:41.050 INFO:tasks.ceph.osd.5:Stopped 2023-10-17T06:23:41.050 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-17T06:23:41.051 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:23:43.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-17T06:23:43.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-10-17T06:23:47.153 INFO:tasks.ceph.osd.6:Stopped 2023-10-17T06:23:47.154 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-17T06:23:47.155 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:23:47.246 INFO:tasks.ceph.osd.7:Stopped 2023-10-17T06:23:47.247 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-17T06:23:47.248 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-17T06:23:47.248 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:23:47.309 INFO:tasks.ceph.mgr.y:Stopped 2023-10-17T06:23:47.310 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-17T06:23:47.310 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:23:47.369 INFO:tasks.ceph.mgr.x:Stopped 2023-10-17T06:23:47.369 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-17T06:23:47.369 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-17T06:23:47.370 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:23:47.403 INFO:tasks.ceph.mon.a:Stopped 2023-10-17T06:23:47.404 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-17T06:23:47.404 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:23:47.437 INFO:tasks.ceph.mon.b:Stopped 2023-10-17T06:23:47.438 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-17T06:23:47.438 INFO:teuthology.orchestra.run:waiting for 300 2023-10-17T06:23:47.523 INFO:tasks.ceph.mon.c:Stopped 2023-10-17T06:23:47.524 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-17T06:23:47.525 DEBUG:teuthology.orchestra.run.smithi125:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v 'but it is still running' | egrep -v 'slow request' | egrep -v MDS_CLIENT_LATE_RELEASE | egrep -v 't responding to mclientcaps' | egrep -v 'file system flag refuse_client_session is set' | egrep -v 'Degraded data redundancy' | egrep -v MDS_CLIENTS_LAGGY | egrep -v 'Reduced data availability' | head -n 1 2023-10-17T06:23:47.578 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-17T06:23:47.578 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-17T06:23:47.835 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-17T06:23:47.836 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-17T06:23:48.047 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-17T06:23:48.047 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-17T06:23:48.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-10-17T06:23:48.295 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-17T06:23:48.296 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-17T06:23:48.500 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-17T06:23:48.500 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-17T06:23:48.595 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-17T06:23:48.596 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-17T06:23:48.801 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-17T06:23:48.802 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-17T06:23:49.037 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi184.front.sepia.ceph.com 2023-10-17T06:23:49.037 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-17T06:23:49.231 INFO:tasks.ceph:Archiving mon data... 2023-10-17T06:23:49.233 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/dparmar-2023-10-17_05:37:11-fs:functional-wip-63105-distro-default-smithi/7431046/data/mon.a.tgz 2023-10-17T06:23:49.233 DEBUG:teuthology.orchestra.run.smithi125:> mktemp 2023-10-17T06:23:49.252 INFO:teuthology.orchestra.run.smithi125.stdout:/tmp/tmp.vRWLXDSgmP 2023-10-17T06:23:49.253 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.vRWLXDSgmP 2023-10-17T06:23:49.403 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0666 /tmp/tmp.vRWLXDSgmP 2023-10-17T06:23:49.501 DEBUG:teuthology.orchestra.remote:smithi125:/tmp/tmp.vRWLXDSgmP is 267KB 2023-10-17T06:23:49.572 DEBUG:teuthology.orchestra.run.smithi125:> rm -fr /tmp/tmp.vRWLXDSgmP 2023-10-17T06:23:49.590 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/dparmar-2023-10-17_05:37:11-fs:functional-wip-63105-distro-default-smithi/7431046/data/mon.b.tgz 2023-10-17T06:23:49.590 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2023-10-17T06:23:49.607 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.4kZeNf1yIP 2023-10-17T06:23:49.607 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.4kZeNf1yIP 2023-10-17T06:23:49.756 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.4kZeNf1yIP 2023-10-17T06:23:49.855 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.4kZeNf1yIP is 267KB 2023-10-17T06:23:49.928 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.4kZeNf1yIP 2023-10-17T06:23:49.946 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/dparmar-2023-10-17_05:37:11-fs:functional-wip-63105-distro-default-smithi/7431046/data/mon.c.tgz 2023-10-17T06:23:49.946 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2023-10-17T06:23:50.006 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.S00haq5Lck 2023-10-17T06:23:50.006 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.S00haq5Lck 2023-10-17T06:23:50.159 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.S00haq5Lck 2023-10-17T06:23:50.260 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.S00haq5Lck is 267KB 2023-10-17T06:23:50.336 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.S00haq5Lck 2023-10-17T06:23:50.355 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-17T06:23:50.356 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-17T06:23:50.363 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-17T06:23:50.438 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-17T06:23:50.438 DEBUG:teuthology.orchestra.run.smithi125:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-17T06:23:50.445 DEBUG:teuthology.orchestra.run.smithi184:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-17T06:23:50.493 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-17T06:23:50.533 INFO:teuthology.orchestra.run.smithi184.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-17T06:23:50.547 INFO:tasks.ceph:Archiving crash dumps... 2023-10-17T06:23:50.549 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-10-17_05:37:11-fs:functional-wip-63105-distro-default-smithi/7431046/remote/smithi125/crash 2023-10-17T06:23:50.550 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-17T06:23:50.585 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-10-17_05:37:11-fs:functional-wip-63105-distro-default-smithi/7431046/remote/smithi184/crash 2023-10-17T06:23:50.587 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-17T06:23:50.622 INFO:tasks.ceph:Shutting down logrotate 2023-10-17T06:23:50.622 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:23:50.636 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-17T06:23:50.742 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-17T06:23:50.775 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-17T06:23:50.810 INFO:tasks.ceph:Compressing logs... 2023-10-17T06:23:50.811 DEBUG:teuthology.orchestra.run.smithi125:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-17T06:23:50.823 DEBUG:teuthology.orchestra.run.smithi184:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-17T06:23:50.866 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48334.log 2023-10-17T06:23:50.868 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48386.log 2023-10-17T06:23:50.869 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.0.48334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48334.log.gz 2023-10-17T06:23:50.870 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49383.log 2023-10-17T06:23:50.872 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42265.log 2023-10-17T06:23:50.873 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48386.log.gz 2023-10-17T06:23:50.874 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43199.log 2023-10-17T06:23:50.875 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49383.log: /var/log/ceph/ceph-client.admin.42265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43930.log 2023-10-17T06:23:50.875 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49383.log.gz 2023-10-17T06:23:50.876 INFO:teuthology.orchestra.run.smithi125.stderr: 88.9%/var/log/ceph/ceph-client.admin.43199.log: -- replaced with /var/log/ceph/ceph-client.admin.42265.log.gz 2023-10-17T06:23:50.876 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41346.log 2023-10-17T06:23:50.877 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43199.log.gz 2023-10-17T06:23:50.878 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45774.log 2023-10-17T06:23:50.878 INFO:teuthology.orchestra.run.smithi125.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43930.log.gz 2023-10-17T06:23:50.879 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41346.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41346.log.gz 2023-10-17T06:23:50.879 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45747.log 2023-10-17T06:23:50.881 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45774.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45774.log.gz 2023-10-17T06:23:50.881 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43849.log 2023-10-17T06:23:50.883 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43363.log 2023-10-17T06:23:50.883 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45747.log.gz 2023-10-17T06:23:50.884 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43849.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43849.log.gz 2023-10-17T06:23:50.885 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48254.log 2023-10-17T06:23:50.886 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45801.log 2023-10-17T06:23:50.887 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48254.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43363.log.gz 2023-10-17T06:23:50.887 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48254.log.gz 2023-10-17T06:23:50.888 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41604.log 2023-10-17T06:23:50.889 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45801.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45801.log.gz 2023-10-17T06:23:50.889 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47992.log 2023-10-17T06:23:50.890 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41604.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-17T06:23:50.891 INFO:teuthology.orchestra.run.smithi125.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41604.log.gz 2023-10-17T06:23:50.892 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.47992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46762.log 2023-10-17T06:23:50.892 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47992.log.gz 2023-10-17T06:23:50.893 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44896.log 2023-10-17T06:23:50.894 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41618.log 2023-10-17T06:23:50.895 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46762.log.gz 2023-10-17T06:23:50.896 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-17T06:23:50.896 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49302.log 2023-10-17T06:23:50.897 INFO:teuthology.orchestra.run.smithi125.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44896.log.gz 2023-10-17T06:23:50.898 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-17T06:23:50.899 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41618.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41618.log.gz 2023-10-17T06:23:50.899 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48716.log 2023-10-17T06:23:50.899 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42033.log 2023-10-17T06:23:50.900 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49302.log.gz 2023-10-17T06:23:50.901 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40666.log 2023-10-17T06:23:50.901 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48716.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48716.log.gz 2023-10-17T06:23:50.902 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48413.log 2023-10-17T06:23:50.902 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40206.log 2023-10-17T06:23:50.903 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mon.b.log: 94.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-17T06:23:50.904 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40465.log 2023-10-17T06:23:50.904 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42033.log.gz 2023-10-17T06:23:50.905 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41231.log 2023-10-17T06:23:50.905 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48413.log.gz 2023-10-17T06:23:50.906 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40206.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40206.log.gz 2023-10-17T06:23:50.906 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43282.log 2023-10-17T06:23:50.907 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49140.log 2023-10-17T06:23:50.908 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41231.log.gz 2023-10-17T06:23:50.908 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.1.40666.log: -- /var/log/ceph/ceph-osd.5.log 2023-10-17T06:23:50.909 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40666.log.gz 2023-10-17T06:23:50.909 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.1.40465.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.1.40465.log.gz 2023-10-17T06:23:50.909 INFO:teuthology.orchestra.run.smithi184.stderr:-5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-17T06:23:50.910 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35751.log 2023-10-17T06:23:50.910 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-17T06:23:50.912 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35751.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35751.log.gz 2023-10-17T06:23:50.912 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-17T06:23:50.913 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.40550.log 2023-10-17T06:23:50.914 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45921.log 2023-10-17T06:23:50.914 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43282.log.gz 2023-10-17T06:23:50.915 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44815.log 2023-10-17T06:23:50.915 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49140.log.gz 2023-10-17T06:23:50.915 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45921.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45921.log.gz 2023-10-17T06:23:50.916 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39929.log 2023-10-17T06:23:50.916 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44262.log 2023-10-17T06:23:50.916 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44815.log.gz 2023-10-17T06:23:50.917 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.39929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46697.log 2023-10-17T06:23:50.917 INFO:teuthology.orchestra.run.smithi125.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39929.log.gz 2023-10-17T06:23:50.919 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-17T06:23:50.919 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.3.40550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35642.log 2023-10-17T06:23:50.920 INFO:teuthology.orchestra.run.smithi184.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.40550.log.gz 2023-10-17T06:23:50.920 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.6.log: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-17T06:23:50.920 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35778.log 2023-10-17T06:23:50.921 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35642.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35642.log.gz 2023-10-17T06:23:50.922 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44262.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44262.log.gz 2023-10-17T06:23:50.922 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-17T06:23:50.922 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45693.log 2023-10-17T06:23:50.923 INFO:teuthology.orchestra.run.smithi125.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46697.log.gz 2023-10-17T06:23:50.923 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48797.log 2023-10-17T06:23:50.923 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45693.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45693.log.gz 2023-10-17T06:23:50.924 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44065.log 2023-10-17T06:23:50.924 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40600.log 2023-10-17T06:23:50.924 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48797.log.gz 2023-10-17T06:23:50.927 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44065.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44065.log.gz 2023-10-17T06:23:50.927 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45666.log 2023-10-17T06:23:50.928 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40600.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40600.log.gz 2023-10-17T06:23:50.928 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45377.log 2023-10-17T06:23:50.928 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42562.log 2023-10-17T06:23:50.929 INFO:teuthology.orchestra.run.smithi125.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45666.log.gz 2023-10-17T06:23:50.933 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35725.log 2023-10-17T06:23:50.934 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35778.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35778.log.gz 2023-10-17T06:23:50.934 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35615.log 2023-10-17T06:23:50.934 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35725.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35725.log.gz 2023-10-17T06:23:50.934 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-17T06:23:50.935 INFO:teuthology.orchestra.run.smithi184.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-17T06:23:50.935 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35615.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35615.log.gz 2023-10-17T06:23:50.935 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35697.log 2023-10-17T06:23:50.936 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-17T06:23:50.936 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35697.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35697.log.gz 2023-10-17T06:23:50.936 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-17T06:23:50.936 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35805.log 2023-10-17T06:23:50.939 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.4.log: 94.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-17T06:23:50.939 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35805.log: 93.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-17T06:23:50.939 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35670.log 2023-10-17T06:23:50.940 INFO:teuthology.orchestra.run.smithi184.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35805.log.gz 2023-10-17T06:23:50.940 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-17T06:23:50.940 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.35670.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35670.log.gz 2023-10-17T06:23:50.943 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45377.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45377.log.gz 2023-10-17T06:23:50.944 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49572.log 2023-10-17T06:23:50.944 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42035.log 2023-10-17T06:23:50.944 INFO:teuthology.orchestra.run.smithi125.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42562.log.gz 2023-10-17T06:23:50.944 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49572.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49572.log.gz 2023-10-17T06:23:50.945 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43444.log 2023-10-17T06:23:50.945 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42319.log 2023-10-17T06:23:50.945 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42035.log.gz 2023-10-17T06:23:50.946 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43444.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43444.log.gz 2023-10-17T06:23:50.946 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48634.log 2023-10-17T06:23:50.946 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46572.log 2023-10-17T06:23:50.946 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42319.log.gz 2023-10-17T06:23:50.947 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48634.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48634.log.gz 2023-10-17T06:23:50.947 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43064.log 2023-10-17T06:23:50.947 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43309.log 2023-10-17T06:23:50.948 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46572.log.gz 2023-10-17T06:23:50.948 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43064.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43064.log.gz 2023-10-17T06:23:50.948 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41096.log 2023-10-17T06:23:50.948 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48057.log 2023-10-17T06:23:50.949 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43309.log.gz 2023-10-17T06:23:50.949 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41096.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41096.log.gz 2023-10-17T06:23:50.949 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49167.log 2023-10-17T06:23:50.949 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48057.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-17T06:23:50.950 INFO:teuthology.orchestra.run.smithi125.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48057.log.gz 2023-10-17T06:23:50.952 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49167.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49167.log.gz 2023-10-17T06:23:50.952 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48359.log 2023-10-17T06:23:50.953 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42048.log 2023-10-17T06:23:50.953 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48359.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48359.log.gz 2023-10-17T06:23:50.953 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47802.log 2023-10-17T06:23:50.954 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42048.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42048.log.gz 2023-10-17T06:23:50.954 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48932.log 2023-10-17T06:23:50.954 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48146.log 2023-10-17T06:23:50.954 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.47802.log: 94.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-17T06:23:50.955 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48932.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47802.log.gz 2023-10-17T06:23:50.955 INFO:teuthology.orchestra.run.smithi125.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48932.log.gz 2023-10-17T06:23:50.955 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49655.log 2023-10-17T06:23:50.957 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35744.log 2023-10-17T06:23:50.957 INFO:teuthology.orchestra.run.smithi125.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48146.log.gz 2023-10-17T06:23:50.958 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49655.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49655.log.gz 2023-10-17T06:23:50.958 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44370.log 2023-10-17T06:23:50.958 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.35744.log: gzip -5 --verbose 88.2%-- -- replaced with /var/log/ceph/ceph-client.admin.35744.log.gz/var/log/ceph/ceph-client.admin.44648.log 2023-10-17T06:23:50.959 INFO:teuthology.orchestra.run.smithi125.stderr: 2023-10-17T06:23:50.959 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44370.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44370.log.gz 2023-10-17T06:23:50.959 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42292.log 2023-10-17T06:23:50.961 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48905.log 2023-10-17T06:23:50.961 INFO:teuthology.orchestra.run.smithi125.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44648.log.gz 2023-10-17T06:23:50.961 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42292.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.42292.log.gz 2023-10-17T06:23:50.962 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44977.log 2023-10-17T06:23:50.962 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48905.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48905.log.gz 2023-10-17T06:23:50.962 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42670.log 2023-10-17T06:23:50.963 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44977.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44977.log.gz 2023-10-17T06:23:50.964 INFO:teuthology.orchestra.run.smithi125.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.42959.log 2023-10-17T06:23:50.964 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42670.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42670.log.gz 2023-10-17T06:23:50.965 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49491.log 2023-10-17T06:23:50.966 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42959.log: gzip -5 --verbose 88.3%-- -- replaced with /var/log/ceph/ceph-client.admin.42959.log.gz/var/log/ceph/ceph-client.admin.45828.log 2023-10-17T06:23:50.966 INFO:teuthology.orchestra.run.smithi125.stderr: 2023-10-17T06:23:50.966 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49491.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49491.log.gz 2023-10-17T06:23:50.967 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47736.log 2023-10-17T06:23:50.968 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45639.log 2023-10-17T06:23:50.968 INFO:teuthology.orchestra.run.smithi125.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45828.log.gz 2023-10-17T06:23:50.969 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.47736.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47736.log.gz 2023-10-17T06:23:50.969 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40933.log 2023-10-17T06:23:50.970 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45639.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45639.log.gz 2023-10-17T06:23:50.970 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46244.log 2023-10-17T06:23:50.971 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40933.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-17T06:23:50.971 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40933.log.gz 2023-10-17T06:23:50.972 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46244.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46244.log.gz 2023-10-17T06:23:50.972 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46499.log 2023-10-17T06:23:50.973 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42427.log 2023-10-17T06:23:50.974 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46499.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46499.log.gz 2023-10-17T06:23:50.974 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46004.log 2023-10-17T06:23:50.975 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42427.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42427.log.gz 2023-10-17T06:23:50.976 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42238.log 2023-10-17T06:23:50.977 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42036.log 2023-10-17T06:23:50.977 INFO:teuthology.orchestra.run.smithi125.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46004.log.gz 2023-10-17T06:23:50.979 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44092.log 2023-10-17T06:23:50.979 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42238.log.gz 2023-10-17T06:23:50.980 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48986.log 2023-10-17T06:23:50.980 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42036.log.gz 2023-10-17T06:23:50.982 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44092.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44092.log.gz 2023-10-17T06:23:50.982 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45720.log 2023-10-17T06:23:50.983 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48986.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48986.log.gz 2023-10-17T06:23:50.984 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45060.log 2023-10-17T06:23:50.985 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49013.log 2023-10-17T06:23:50.985 INFO:teuthology.orchestra.run.smithi125.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45720.log.gz 2023-10-17T06:23:50.986 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48689.log 2023-10-17T06:23:50.987 INFO:teuthology.orchestra.run.smithi125.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45060.log.gz 2023-10-17T06:23:50.988 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49013.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49013.log.gz 2023-10-17T06:23:50.989 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40260.log 2023-10-17T06:23:50.990 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48689.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48689.log.gz 2023-10-17T06:23:50.991 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41455.log 2023-10-17T06:23:50.991 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40260.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40260.log.gz 2023-10-17T06:23:50.992 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43228.log 2023-10-17T06:23:50.993 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46763.log 2023-10-17T06:23:50.994 INFO:teuthology.orchestra.run.smithi125.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41455.log.gz 2023-10-17T06:23:50.995 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43228.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43228.log.gz 2023-10-17T06:23:50.995 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43525.log 2023-10-17T06:23:50.997 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46763.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46763.log.gzgzip 2023-10-17T06:23:50.997 INFO:teuthology.orchestra.run.smithi125.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.49464.log 2023-10-17T06:23:50.999 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44756.log 2023-10-17T06:23:50.999 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43525.log.gz 2023-10-17T06:23:51.000 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49464.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49464.log.gz 2023-10-17T06:23:51.000 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46166.log 2023-10-17T06:23:51.001 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46369.log 2023-10-17T06:23:51.002 INFO:teuthology.orchestra.run.smithi125.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44756.log.gz 2023-10-17T06:23:51.002 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46166.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46166.log.gz 2023-10-17T06:23:51.003 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45004.log 2023-10-17T06:23:51.004 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46369.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46369.log.gz 2023-10-17T06:23:51.005 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46031.log 2023-10-17T06:23:51.006 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45004.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45004.log.gz 2023-10-17T06:23:51.006 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43471.log 2023-10-17T06:23:51.007 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46031.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46031.log.gz 2023-10-17T06:23:51.008 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40287.log 2023-10-17T06:23:51.009 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46696.log 2023-10-17T06:23:51.009 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43471.log.gz 2023-10-17T06:23:51.010 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40287.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40287.log.gz 2023-10-17T06:23:51.011 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44950.log 2023-10-17T06:23:51.011 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46696.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46696.log.gz 2023-10-17T06:23:51.012 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41824.log 2023-10-17T06:23:51.013 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43172.log 2023-10-17T06:23:51.014 INFO:teuthology.orchestra.run.smithi125.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44950.log.gz 2023-10-17T06:23:51.014 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41824.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41824.log.gz 2023-10-17T06:23:51.015 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44594.log 2023-10-17T06:23:51.017 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43172.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43172.log.gz 2023-10-17T06:23:51.017 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44011.log 2023-10-17T06:23:51.018 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44594.log: 93.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-17T06:23:51.018 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42697.log 2023-10-17T06:23:51.019 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44594.log.gz 2023-10-17T06:23:51.020 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49790.log 2023-10-17T06:23:51.020 INFO:teuthology.orchestra.run.smithi125.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44011.log.gz 2023-10-17T06:23:51.021 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42697.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42697.log.gz 2023-10-17T06:23:51.021 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41041.log 2023-10-17T06:23:51.023 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45948.log 2023-10-17T06:23:51.023 INFO:teuthology.orchestra.run.smithi125.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49790.log.gz 2023-10-17T06:23:51.024 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41041.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41041.log.gz 2023-10-17T06:23:51.025 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49869.log 2023-10-17T06:23:51.026 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45331.log 2023-10-17T06:23:51.026 INFO:teuthology.orchestra.run.smithi125.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45948.log.gz 2023-10-17T06:23:51.027 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49869.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49869.log.gz 2023-10-17T06:23:51.028 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41563.log 2023-10-17T06:23:51.029 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44842.log 2023-10-17T06:23:51.029 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45331.log.gz 2023-10-17T06:23:51.030 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41563.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41563.log.gz 2023-10-17T06:23:51.030 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41150.log 2023-10-17T06:23:51.031 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49248.log 2023-10-17T06:23:51.031 INFO:teuthology.orchestra.run.smithi125.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44842.log.gz 2023-10-17T06:23:51.032 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41150.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41150.log.gz 2023-10-17T06:23:51.033 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44456.log 2023-10-17T06:23:51.034 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49248.log: gzip -5 88.1%--verbose -- replaced with /var/log/ceph/ceph-client.admin.49248.log.gz-- 2023-10-17T06:23:51.034 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41832.log 2023-10-17T06:23:51.035 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35638.log 2023-10-17T06:23:51.035 INFO:teuthology.orchestra.run.smithi125.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44456.log.gz 2023-10-17T06:23:51.036 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41832.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41832.log.gz 2023-10-17T06:23:51.037 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40341.log 2023-10-17T06:23:51.037 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.35638.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35638.log.gz 2023-10-17T06:23:51.038 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41204.log 2023-10-17T06:23:51.039 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40341.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40341.log.gz 2023-10-17T06:23:51.039 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-17T06:23:51.040 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41204.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41204.log.gz 2023-10-17T06:23:51.040 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42400.log 2023-10-17T06:23:51.041 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45250.log 2023-10-17T06:23:51.042 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42400.log: 88.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-17T06:23:51.043 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42400.log.gz 2023-10-17T06:23:51.043 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42454.log 2023-10-17T06:23:51.044 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40681.log 88.4% 2023-10-17T06:23:51.044 INFO:teuthology.orchestra.run.smithi125.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45250.log.gz 2023-10-17T06:23:51.045 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42454.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42454.log.gz 2023-10-17T06:23:51.046 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47867.log 2023-10-17T06:23:51.047 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45223.log 2023-10-17T06:23:51.047 INFO:teuthology.orchestra.run.smithi125.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.40681.log.gz 2023-10-17T06:23:51.048 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.47867.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47867.log.gz 2023-10-17T06:23:51.048 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41068.log 2023-10-17T06:23:51.049 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45223.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45223.log.gz 2023-10-17T06:23:51.049 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42346.log 2023-10-17T06:23:51.050 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41068.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41068.log.gz 2023-10-17T06:23:51.051 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43118.log 2023-10-17T06:23:51.052 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44621.log 2023-10-17T06:23:51.052 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42346.log.gz 2023-10-17T06:23:51.053 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43118.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43118.log.gz 2023-10-17T06:23:51.053 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45585.log 2023-10-17T06:23:51.054 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44621.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44621.log.gz 2023-10-17T06:23:51.055 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43390.log 2023-10-17T06:23:51.056 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45585.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45585.log.gz 2023-10-17T06:23:51.056 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48824.log 2023-10-17T06:23:51.057 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47993.log 2023-10-17T06:23:51.058 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43390.log.gz 2023-10-17T06:23:51.058 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41428.log 2023-10-17T06:23:51.059 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48824.log.gz 2023-10-17T06:23:51.059 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.47993.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.47993.log.gz 2023-10-17T06:23:51.060 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44038.log 2023-10-17T06:23:51.061 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41428.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41428.log.gz 2023-10-17T06:23:51.061 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41615.log 2023-10-17T06:23:51.062 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44038.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44038.log.gz 2023-10-17T06:23:51.062 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49842.log 2023-10-17T06:23:51.063 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41615.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41615.log.gz 2023-10-17T06:23:51.064 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43714.log 2023-10-17T06:23:51.065 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46112.log 2023-10-17T06:23:51.065 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49842.log.gz 2023-10-17T06:23:51.066 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43714.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43714.log.gz 2023-10-17T06:23:51.067 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48200.log 2023-10-17T06:23:51.068 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45087.log 2023-10-17T06:23:51.068 INFO:teuthology.orchestra.run.smithi125.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46112.log.gz 2023-10-17T06:23:51.069 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48200.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48200.log.gz 2023-10-17T06:23:51.069 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40151.log 2023-10-17T06:23:51.070 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49682.log 2023-10-17T06:23:51.071 INFO:teuthology.orchestra.run.smithi125.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45087.log.gz 2023-10-17T06:23:51.072 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40151.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40151.log.gz 2023-10-17T06:23:51.072 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43255.log 2023-10-17T06:23:51.073 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49682.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49682.log.gz 2023-10-17T06:23:51.073 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42050.log 2023-10-17T06:23:51.074 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43255.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43255.log.gz 2023-10-17T06:23:51.075 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40906.log 2023-10-17T06:23:51.075 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42050.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42050.log.gz 2023-10-17T06:23:51.076 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41319.log 2023-10-17T06:23:51.077 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40906.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40906.log.gz 2023-10-17T06:23:51.077 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43687.log 2023-10-17T06:23:51.078 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41319.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41319.log.gz 2023-10-17T06:23:51.078 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46308.log 2023-10-17T06:23:51.079 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43336.log 2023-10-17T06:23:51.079 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43687.log.gz 2023-10-17T06:23:51.080 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46308.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46308.log.gz 2023-10-17T06:23:51.080 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40732.log 2023-10-17T06:23:51.081 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43336.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43336.log.gz 2023-10-17T06:23:51.082 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44483.log 2023-10-17T06:23:51.082 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40654.log 2023-10-17T06:23:51.083 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40732.log.gz 2023-10-17T06:23:51.084 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44483.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44483.log.gz 2023-10-17T06:23:51.084 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41482.log 2023-10-17T06:23:51.085 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40654.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40654.log.gz 2023-10-17T06:23:51.085 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43741.log 2023-10-17T06:23:51.086 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41482.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41482.log.gz 2023-10-17T06:23:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45464.log 2023-10-17T06:23:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43741.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43741.log.gz 2023-10-17T06:23:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44289.log 2023-10-17T06:23:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45464.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45464.log.gz 2023-10-17T06:23:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42930.log 2023-10-17T06:23:51.089 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44289.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44289.log.gz 2023-10-17T06:23:51.090 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49086.log 2023-10-17T06:23:51.091 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.0.42930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42930.log.gz 2023-10-17T06:23:51.091 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45169.log 2023-10-17T06:23:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49086.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49086.log.gz 2023-10-17T06:23:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46634.log 2023-10-17T06:23:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45169.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45169.log.gz 2023-10-17T06:23:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41823.log 2023-10-17T06:23:51.095 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43145.log 2023-10-17T06:23:51.095 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46634.log.gz 2023-10-17T06:23:51.096 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44729.log 2023-10-17T06:23:51.096 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41823.log.gz 2023-10-17T06:23:51.097 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43145.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43145.log.gz 2023-10-17T06:23:51.098 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43579.log 2023-10-17T06:23:51.099 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44729.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44729.log.gz 2023-10-17T06:23:51.099 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42037.log 2023-10-17T06:23:51.100 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45404.log 2023-10-17T06:23:51.101 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43579.log: /var/log/ceph/ceph-client.admin.42037.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43579.log.gz 2023-10-17T06:23:51.102 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42037.log.gz 2023-10-17T06:23:51.102 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42508.log 2023-10-17T06:23:51.103 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45404.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45404.log.gz 2023-10-17T06:23:51.104 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40856.log 2023-10-17T06:23:51.105 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42508.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42508.log.gz 2023-10-17T06:23:51.105 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44429.log 2023-10-17T06:23:51.106 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49410.log 2023-10-17T06:23:51.107 INFO:teuthology.orchestra.run.smithi125.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-17T06:23:51.107 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40856.log: gzip /var/log/ceph/ceph-client.admin.44429.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40987.log 2023-10-17T06:23:51.108 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44429.log.gz 2023-10-17T06:23:51.108 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49410.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49410.log.gz 2023-10-17T06:23:51.109 INFO:teuthology.orchestra.run.smithi125.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.40856.log.gz 2023-10-17T06:23:51.109 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45857.log 2023-10-17T06:23:51.110 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40987.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40987.log.gz 2023-10-17T06:23:51.111 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44173.log 2023-10-17T06:23:51.111 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45857.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45857.log.gz-5 2023-10-17T06:23:51.112 INFO:teuthology.orchestra.run.smithi125.stderr:--verbose -- /var/log/ceph/ceph-client.admin.41374.log 2023-10-17T06:23:51.113 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44173.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-17T06:23:51.113 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44173.log.gz 2023-10-17T06:23:51.114 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41374.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41374.log.gz 2023-10-17T06:23:51.114 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44316.log 2023-10-17T06:23:51.115 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42535.log 2023-10-17T06:23:51.116 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42643.log 2023-10-17T06:23:51.116 INFO:teuthology.orchestra.run.smithi125.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44316.log.gz 2023-10-17T06:23:51.117 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42535.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42535.log.gz 2023-10-17T06:23:51.117 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46817.log 2023-10-17T06:23:51.118 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42643.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.42643.log.gz 2023-10-17T06:23:51.119 INFO:teuthology.orchestra.run.smithi125.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.48467.log 2023-10-17T06:23:51.120 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41258.log 2023-10-17T06:23:51.120 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46817.log.gz 2023-10-17T06:23:51.121 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48467.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48467.log.gz 2023-10-17T06:23:51.121 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48607.log 2023-10-17T06:23:51.122 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41401.log 2023-10-17T06:23:51.123 INFO:teuthology.orchestra.run.smithi125.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41258.log.gz 2023-10-17T06:23:51.123 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48607.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48607.log.gz-5 2023-10-17T06:23:51.124 INFO:teuthology.orchestra.run.smithi125.stderr:--verbose -- /var/log/ceph/ceph-client.admin.41123.log 2023-10-17T06:23:51.125 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49736.log 2023-10-17T06:23:51.125 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41401.log.gz 2023-10-17T06:23:51.126 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41123.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41123.log.gz 2023-10-17T06:23:51.126 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42481.log 2023-10-17T06:23:51.127 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49736.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49736.log.gz 2023-10-17T06:23:51.127 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45558.log 2023-10-17T06:23:51.128 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.7.log: 93.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-17T06:23:51.129 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42481.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42481.log.gz 2023-10-17T06:23:51.129 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40492.log 2023-10-17T06:23:51.130 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45558.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45558.log.gzgzip 2023-10-17T06:23:51.130 INFO:teuthology.orchestra.run.smithi125.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.48743.log 2023-10-17T06:23:51.131 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40492.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40492.log.gz 2023-10-17T06:23:51.131 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45431.log 2023-10-17T06:23:51.132 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48743.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48743.log.gz 2023-10-17T06:23:51.133 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40085.log 2023-10-17T06:23:51.133 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45431.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45431.log.gz 2023-10-17T06:23:51.134 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40573.log 2023-10-17T06:23:51.135 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40085.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40085.log.gz 2023-10-17T06:23:51.135 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47803.log 2023-10-17T06:23:51.137 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40573.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40573.log.gz 2023-10-17T06:23:51.138 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40399.log 2023-10-17T06:23:51.138 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.47803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46396.log 2023-10-17T06:23:51.138 INFO:teuthology.orchestra.run.smithi125.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47803.log.gz 2023-10-17T06:23:51.139 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40399.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40399.log.gz 2023-10-17T06:23:51.139 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46844.log 2023-10-17T06:23:51.140 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45531.log 2023-10-17T06:23:51.140 INFO:teuthology.orchestra.run.smithi125.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46396.log.gz 2023-10-17T06:23:51.141 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46844.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46844.log.gz 2023-10-17T06:23:51.142 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42373.log 2023-10-17T06:23:51.142 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45886.log 2023-10-17T06:23:51.143 INFO:teuthology.orchestra.run.smithi125.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45531.log.gz 2023-10-17T06:23:51.144 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42373.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42373.log.gz 2023-10-17T06:23:51.144 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46633.log 2023-10-17T06:23:51.145 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40546.log 2023-10-17T06:23:51.145 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45886.log.gz 2023-10-17T06:23:51.146 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46633.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46633.log.gz 2023-10-17T06:23:51.146 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45277.log 2023-10-17T06:23:51.147 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41509.log 2023-10-17T06:23:51.147 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40546.log.gz 2023-10-17T06:23:51.148 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45277.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45277.log.gz 2023-10-17T06:23:51.149 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44564.log 2023-10-17T06:23:51.150 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44675.log 2023-10-17T06:23:51.150 INFO:teuthology.orchestra.run.smithi125.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41509.log.gz 2023-10-17T06:23:51.151 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44564.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44564.log.gz 2023-10-17T06:23:51.151 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43042.log 2023-10-17T06:23:51.152 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49437.log 2023-10-17T06:23:51.153 INFO:teuthology.orchestra.run.smithi125.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44675.log.gz 2023-10-17T06:23:51.153 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.2.43042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43042.log.gz 2023-10-17T06:23:51.154 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44869.log 2023-10-17T06:23:51.155 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49437.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49437.log.gz 2023-10-17T06:23:51.155 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49599.log 2023-10-17T06:23:51.157 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45114.log 2023-10-17T06:23:51.158 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44869.log: /var/log/ceph/ceph-client.admin.49599.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44869.log.gz 2023-10-17T06:23:51.158 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49599.log.gz 2023-10-17T06:23:51.159 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47930.log 2023-10-17T06:23:51.160 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45114.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45114.log.gz 2023-10-17T06:23:51.160 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47707.log 2023-10-17T06:23:51.161 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.47930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46085.log 2023-10-17T06:23:51.162 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47930.log.gz 2023-10-17T06:23:51.163 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.47707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42589.log 2023-10-17T06:23:51.163 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47707.log.gz 2023-10-17T06:23:51.164 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46085.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46085.log.gz 2023-10-17T06:23:51.165 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43957.log 2023-10-17T06:23:51.166 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40233.log 2023-10-17T06:23:51.166 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42589.log.gz 2023-10-17T06:23:51.167 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44146.log 2023-10-17T06:23:51.167 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43957.log.gz 2023-10-17T06:23:51.168 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40233.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40233.log.gz 2023-10-17T06:23:51.169 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44119.log 2023-10-17T06:23:51.170 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48878.log 2023-10-17T06:23:51.170 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44146.log.gz 2023-10-17T06:23:51.171 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44119.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44119.log.gz 2023-10-17T06:23:51.171 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46537.log 2023-10-17T06:23:51.172 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45304.log 2023-10-17T06:23:51.173 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48878.log.gz 2023-10-17T06:23:51.173 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46537.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46537.log.gz 2023-10-17T06:23:51.174 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48494.log 2023-10-17T06:23:51.175 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45304.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45304.log.gz 2023-10-17T06:23:51.175 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48553.log 2023-10-17T06:23:51.176 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48494.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48494.log.gz 2023-10-17T06:23:51.176 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48119.log 2023-10-17T06:23:51.177 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48553.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48553.log.gz 2023-10-17T06:23:51.177 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43768.log 2023-10-17T06:23:51.179 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48119.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48119.log.gz 2023-10-17T06:23:51.179 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41609.log 2023-10-17T06:23:51.181 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44923.log 2023-10-17T06:23:51.182 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43768.log: /var/log/ceph/ceph-client.admin.41609.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43768.log.gz 2023-10-17T06:23:51.182 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40519.log 2023-10-17T06:23:51.183 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41609.log.gz 2023-10-17T06:23:51.183 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44923.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44923.log.gz 2023-10-17T06:23:51.184 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41536.log 2023-10-17T06:23:51.185 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47929.log 2023-10-17T06:23:51.186 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41536.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40519.log.gz 2023-10-17T06:23:51.187 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41536.log.gz 2023-10-17T06:23:51.187 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48227.log 2023-10-17T06:23:51.188 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.47929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45612.log 2023-10-17T06:23:51.189 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47929.log.gz 2023-10-17T06:23:51.189 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48959.log 2023-10-17T06:23:51.190 INFO:teuthology.orchestra.run.smithi125.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48227.log.gz 2023-10-17T06:23:51.191 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43606.log 2023-10-17T06:23:51.191 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45612.log.gz 2023-10-17T06:23:51.192 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48959.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48959.log.gz 2023-10-17T06:23:51.192 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48661.log 2023-10-17T06:23:51.193 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43606.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43606.log.gz 2023-10-17T06:23:51.194 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42724.log 2023-10-17T06:23:51.195 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43633.log 2023-10-17T06:23:51.195 INFO:teuthology.orchestra.run.smithi125.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48661.log.gz 2023-10-17T06:23:51.196 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46571.log 2023-10-17T06:23:51.196 INFO:teuthology.orchestra.run.smithi125.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42724.log.gz 2023-10-17T06:23:51.197 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43633.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43633.log.gz 2023-10-17T06:23:51.197 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40370.log 2023-10-17T06:23:51.199 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41827.log 2023-10-17T06:23:51.199 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46571.log.gz 2023-10-17T06:23:51.200 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43984.log 2023-10-17T06:23:51.200 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40370.log.gz 2023-10-17T06:23:51.201 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43552.log 2023-10-17T06:23:51.202 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41827.log.gz 2023-10-17T06:23:51.203 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46193.log 2023-10-17T06:23:51.203 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43984.log.gz 2023-10-17T06:23:51.204 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43552.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43552.log.gz 2023-10-17T06:23:51.204 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48440.log 2023-10-17T06:23:51.205 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49113.log 2023-10-17T06:23:51.206 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48440.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46193.log.gz 2023-10-17T06:23:51.206 INFO:teuthology.orchestra.run.smithi125.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48440.log.gz 2023-10-17T06:23:51.207 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49518.log 2023-10-17T06:23:51.208 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49113.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49113.log.gz 2023-10-17T06:23:51.208 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43660.log 2023-10-17T06:23:51.209 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49518.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49518.log.gz 2023-10-17T06:23:51.209 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42616.log 2023-10-17T06:23:51.210 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43660.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43660.log.gz 2023-10-17T06:23:51.210 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43795.log 2023-10-17T06:23:51.211 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42616.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42616.log.gz 2023-10-17T06:23:51.212 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-17T06:23:51.213 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43795.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43795.log.gz 2023-10-17T06:23:51.213 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41833.log 2023-10-17T06:23:51.214 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44343.log 2023-10-17T06:23:51.215 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41833.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41833.log.gz 2023-10-17T06:23:51.215 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-17T06:23:51.216 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42038.log 2023-10-17T06:23:51.216 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44343.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44343.log.gz 2023-10-17T06:23:51.217 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46423.log 2023-10-17T06:23:51.218 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42038.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42038.log.gz 2023-10-17T06:23:51.218 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39997.log 2023-10-17T06:23:51.219 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46423.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46423.log.gz 2023-10-17T06:23:51.220 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-17T06:23:51.222 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48526.log 2023-10-17T06:23:51.223 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.39997.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39997.log.gz 2023-10-17T06:23:51.223 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45033.log 2023-10-17T06:23:51.225 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48526.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48526.log.gz 2023-10-17T06:23:51.226 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40052.log 2023-10-17T06:23:51.227 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41014.log 2023-10-17T06:23:51.228 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45033.log.gz 2023-10-17T06:23:51.229 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40052.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40052.log.gz 2023-10-17T06:23:51.229 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42049.log 2023-10-17T06:23:51.230 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41826.log 2023-10-17T06:23:51.230 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42049.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41014.log.gz 2023-10-17T06:23:51.231 INFO:teuthology.orchestra.run.smithi125.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42049.log.gz 2023-10-17T06:23:51.232 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40627.log 2023-10-17T06:23:51.233 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41826.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41826.log.gz 2023-10-17T06:23:51.233 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48580.log 2023-10-17T06:23:51.235 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40627.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40627.log.gz 2023-10-17T06:23:51.235 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45141.log 2023-10-17T06:23:51.236 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48580.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48580.log.gz 2023-10-17T06:23:51.237 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43876.log 2023-10-17T06:23:51.237 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46058.log 2023-10-17T06:23:51.238 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45141.log.gz 2023-10-17T06:23:51.239 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43876.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43876.log.gz 2023-10-17T06:23:51.239 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41834.log 2023-10-17T06:23:51.240 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40960.log 2023-10-17T06:23:51.241 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46058.log.gz 2023-10-17T06:23:51.241 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41834.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41834.log.gz 2023-10-17T06:23:51.242 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44788.log 2023-10-17T06:23:51.243 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44537.log 2023-10-17T06:23:51.243 INFO:teuthology.orchestra.run.smithi125.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40960.log.gz 2023-10-17T06:23:51.244 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44788.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44788.log.gz 2023-10-17T06:23:51.245 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49817.log 2023-10-17T06:23:51.246 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40023.log 2023-10-17T06:23:51.246 INFO:teuthology.orchestra.run.smithi125.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44537.log.gz 2023-10-17T06:23:51.247 INFO:teuthology.orchestra.run.smithi184.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-17T06:23:51.248 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49626.log 2023-10-17T06:23:51.248 INFO:teuthology.orchestra.run.smithi125.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49817.log.gz 2023-10-17T06:23:51.249 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40023.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40023.log.gz 2023-10-17T06:23:51.249 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49329.log 2023-10-17T06:23:51.251 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43091.log 2023-10-17T06:23:51.251 INFO:teuthology.orchestra.run.smithi125.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49626.log.gz 2023-10-17T06:23:51.252 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49329.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49329.log.gz 2023-10-17T06:23:51.253 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49356.log 2023-10-17T06:23:51.254 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43091.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43091.log.gz 2023-10-17T06:23:51.254 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40434.log 2023-10-17T06:23:51.255 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46139.log 2023-10-17T06:23:51.256 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49356.log.gz 2023-10-17T06:23:51.257 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40434.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40434.log.gz 2023-10-17T06:23:51.257 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40314.log 2023-10-17T06:23:51.258 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46139.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46139.log.gzgzip 2023-10-17T06:23:51.259 INFO:teuthology.orchestra.run.smithi125.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.44402.log 2023-10-17T06:23:51.260 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40314.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40314.log.gz 2023-10-17T06:23:51.260 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45975.log 2023-10-17T06:23:51.261 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41611.log 2023-10-17T06:23:51.262 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44402.log.gz 2023-10-17T06:23:51.262 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45975.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45975.log.gz 2023-10-17T06:23:51.263 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40178.log 2023-10-17T06:23:51.264 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41611.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41611.log.gz 2023-10-17T06:23:51.265 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46335.log 2023-10-17T06:23:51.266 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41614.log 88.9% 2023-10-17T06:23:51.266 INFO:teuthology.orchestra.run.smithi125.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40178.log.gz 2023-10-17T06:23:51.267 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46335.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46335.log.gz 2023-10-17T06:23:51.268 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49545.log 2023-10-17T06:23:51.269 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42818.log 2023-10-17T06:23:51.269 INFO:teuthology.orchestra.run.smithi125.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41614.log.gz 2023-10-17T06:23:51.270 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49545.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49545.log.gz 2023-10-17T06:23:51.271 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48851.log 2023-10-17T06:23:51.273 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42818.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42818.log.gz 2023-10-17T06:23:51.273 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48173.log 2023-10-17T06:23:51.275 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48851.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30695.log 2023-10-17T06:23:51.275 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48851.log.gz 2023-10-17T06:23:51.276 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49709.log 2023-10-17T06:23:51.277 INFO:teuthology.orchestra.run.smithi125.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48173.log.gz 2023-10-17T06:23:51.278 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph.tmp-client.admin.30695.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30695.log.gz 2023-10-17T06:23:51.278 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43903.log 2023-10-17T06:23:51.279 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49709.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49709.log.gz 2023-10-17T06:23:51.280 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48287.log 2023-10-17T06:23:51.280 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43903.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43903.log.gz 2023-10-17T06:23:51.281 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-17T06:23:51.282 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44702.log 2023-10-17T06:23:51.283 INFO:teuthology.orchestra.run.smithi125.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48287.log.gz 2023-10-17T06:23:51.284 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45196.log 2023-10-17T06:23:51.285 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43417.log 2023-10-17T06:23:51.286 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44702.log.gz 2023-10-17T06:23:51.287 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.45196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41292.log 2023-10-17T06:23:51.287 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45196.log.gz 2023-10-17T06:23:51.288 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44235.log 2023-10-17T06:23:51.288 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43417.log.gz 2023-10-17T06:23:51.290 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48770.log 2023-10-17T06:23:51.290 INFO:teuthology.orchestra.run.smithi125.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41292.log.gz 2023-10-17T06:23:51.291 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46467.log 2023-10-17T06:23:51.292 INFO:teuthology.orchestra.run.smithi125.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44235.log.gz 2023-10-17T06:23:51.293 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49275.log 2023-10-17T06:23:51.293 INFO:teuthology.orchestra.run.smithi125.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48770.log.gz 2023-10-17T06:23:51.294 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.46467.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46467.log.gz 2023-10-17T06:23:51.295 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49059.log 2023-10-17T06:23:51.296 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41606.log 2023-10-17T06:23:51.296 INFO:teuthology.orchestra.run.smithi125.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49275.log.gz 2023-10-17T06:23:51.298 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41177.log 2023-10-17T06:23:51.298 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49059.log.gz 2023-10-17T06:23:51.299 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41819.log 2023-10-17T06:23:51.299 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41606.log.gz 2023-10-17T06:23:51.300 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49194.log 2023-10-17T06:23:51.300 INFO:teuthology.orchestra.run.smithi125.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41177.log.gz 2023-10-17T06:23:51.302 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49763.log 2023-10-17T06:23:51.302 INFO:teuthology.orchestra.run.smithi125.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41819.log.gz 2023-10-17T06:23:51.303 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42751.log 2023-10-17T06:23:51.304 INFO:teuthology.orchestra.run.smithi125.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49194.log.gz 2023-10-17T06:23:51.304 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.49763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46292.log 2023-10-17T06:23:51.305 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49763.log.gz 2023-10-17T06:23:51.306 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.42751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47737.log 2023-10-17T06:23:51.307 INFO:teuthology.orchestra.run.smithi125.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.42751.log.gz 2023-10-17T06:23:51.308 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.0.46292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46292.log.gz 2023-10-17T06:23:51.308 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44510.log 2023-10-17T06:23:51.309 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.47737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43822.log 2023-10-17T06:23:51.309 INFO:teuthology.orchestra.run.smithi125.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47737.log.gz 2023-10-17T06:23:51.311 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44208.log 2023-10-17T06:23:51.311 INFO:teuthology.orchestra.run.smithi125.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44510.log.gz 2023-10-17T06:23:51.312 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40463.log 2023-10-17T06:23:51.312 INFO:teuthology.orchestra.run.smithi125.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43822.log.gz 2023-10-17T06:23:51.313 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.44208.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44208.log.gz 2023-10-17T06:23:51.313 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-17T06:23:51.315 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.40463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47868.log 2023-10-17T06:23:51.315 INFO:teuthology.orchestra.run.smithi125.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40463.log.gz 2023-10-17T06:23:51.316 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35506.log 2023-10-17T06:23:51.318 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.47868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41617.log 2023-10-17T06:23:51.318 INFO:teuthology.orchestra.run.smithi125.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47868.log.gz 2023-10-17T06:23:51.319 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.35506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43498.log 2023-10-17T06:23:51.319 INFO:teuthology.orchestra.run.smithi125.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.35506.log.gz 2023-10-17T06:23:51.320 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.41617.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41617.log.gz-5 2023-10-17T06:23:51.321 INFO:teuthology.orchestra.run.smithi125.stderr:--verbose -- /var/log/ceph/ceph-client.admin.48058.log 2023-10-17T06:23:51.322 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.43498.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43498.log.gz 2023-10-17T06:23:51.323 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/ceph-client.admin.48058.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48058.log.gz 2023-10-17T06:23:51.673 INFO:teuthology.orchestra.run.smithi125.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-17T06:23:51.916 INFO:teuthology.orchestra.run.smithi184.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-17T06:23:51.988 INFO:teuthology.orchestra.run.smithi184.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-17T06:23:52.063 INFO:teuthology.orchestra.run.smithi184.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-17T06:23:52.092 INFO:teuthology.orchestra.run.smithi184.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-17T06:23:52.098 INFO:teuthology.orchestra.run.smithi184.stderr: 2023-10-17T06:23:52.098 INFO:teuthology.orchestra.run.smithi184.stderr:real 0m1.227s 2023-10-17T06:23:52.098 INFO:teuthology.orchestra.run.smithi184.stderr:user 0m4.591s 2023-10-17T06:23:52.099 INFO:teuthology.orchestra.run.smithi184.stderr:sys 0m0.491s 2023-10-17T06:23:52.127 INFO:teuthology.orchestra.run.smithi125.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-17T06:23:52.252 INFO:teuthology.orchestra.run.smithi125.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-17T06:23:52.303 INFO:teuthology.orchestra.run.smithi125.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-17T06:23:52.324 INFO:teuthology.orchestra.run.smithi125.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-17T06:23:52.328 INFO:teuthology.orchestra.run.smithi125.stderr: 2023-10-17T06:23:52.328 INFO:teuthology.orchestra.run.smithi125.stderr:real 0m1.495s 2023-10-17T06:23:52.329 INFO:teuthology.orchestra.run.smithi125.stderr:user 0m5.036s 2023-10-17T06:23:52.329 INFO:teuthology.orchestra.run.smithi125.stderr:sys 0m1.103s 2023-10-17T06:23:52.330 INFO:tasks.ceph:Archiving logs... 2023-10-17T06:23:52.331 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-10-17_05:37:11-fs:functional-wip-63105-distro-default-smithi/7431046/remote/smithi125/log 2023-10-17T06:23:52.332 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-17T06:23:53.314 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-10-17_05:37:11-fs:functional-wip-63105-distro-default-smithi/7431046/remote/smithi184/log 2023-10-17T06:23:53.315 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-17T06:23:53.948 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-17T06:23:53.957 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-17T06:23:53.957 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-17T06:23:53.965 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-17T06:23:54.054 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-17T06:23:54.071 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-17T06:23:54.071 DEBUG:teuthology.orchestra.run.smithi125:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-17T06:23:54.079 DEBUG:teuthology.orchestra.run.smithi184:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-17T06:23:54.113 INFO:teuthology.orchestra.run.smithi125.stdout: remote refid st t when poll reach delay offset jitter 2023-10-17T06:23:54.114 INFO:teuthology.orchestra.run.smithi125.stdout:============================================================================== 2023-10-17T06:23:54.114 INFO:teuthology.orchestra.run.smithi125.stdout:*hv01.front.sepi 44.4.53.2 2 u 37 64 377 0.105 1.213 0.472 2023-10-17T06:23:54.114 INFO:teuthology.orchestra.run.smithi125.stdout:+hv02.front.sepi 63.231.80.2 3 u 43 64 377 0.102 2.874 0.185 2023-10-17T06:23:54.114 INFO:teuthology.orchestra.run.smithi125.stdout:+hv03.front.sepi 74.6.168.72 3 u 52 64 377 0.119 3.538 0.223 2023-10-17T06:23:54.115 INFO:teuthology.orchestra.run.smithi125.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 0.000 0.000 2023-10-17T06:23:54.122 INFO:teuthology.orchestra.run.smithi184.stdout: remote refid st t when poll reach delay offset jitter 2023-10-17T06:23:54.123 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================== 2023-10-17T06:23:54.123 INFO:teuthology.orchestra.run.smithi184.stdout:*hv01.front.sepi 44.4.53.2 2 u 36 64 377 0.126 -0.247 0.312 2023-10-17T06:23:54.123 INFO:teuthology.orchestra.run.smithi184.stdout:+hv02.front.sepi 63.231.80.2 3 u 48 64 377 0.124 1.375 0.221 2023-10-17T06:23:54.123 INFO:teuthology.orchestra.run.smithi184.stdout:+hv03.front.sepi 74.6.168.72 3 u 49 64 377 0.133 1.715 0.158 2023-10-17T06:23:54.124 INFO:teuthology.orchestra.run.smithi184.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 0.000 0.000 2023-10-17T06:23:54.125 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-17T06:23:54.134 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-17T06:23:54.134 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-17T06:23:54.143 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-17T06:23:54.153 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-17T06:23:54.162 INFO:teuthology.task.internal:Duration was 1773.094583 seconds 2023-10-17T06:23:54.163 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-17T06:23:54.172 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-17T06:23:54.172 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-17T06:23:54.180 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-17T06:23:54.334 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-17T06:23:54.335 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi125.front.sepia.ceph.com 2023-10-17T06:23:54.335 DEBUG:teuthology.orchestra.run.smithi125:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-17T06:23:54.373 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi184.front.sepia.ceph.com 2023-10-17T06:23:54.373 DEBUG:teuthology.orchestra.run.smithi184:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-17T06:23:54.405 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-17T06:23:54.405 DEBUG:teuthology.orchestra.run.smithi125:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-17T06:23:54.423 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-17T06:23:54.506 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-17T06:23:54.507 DEBUG:teuthology.orchestra.run.smithi125:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-17T06:23:54.514 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-17T06:23:54.634 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-17T06:23:54.645 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-17T06:23:54.645 DEBUG:teuthology.orchestra.run.smithi125:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-17T06:23:54.674 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-17T06:23:54.714 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-17T06:23:54.724 DEBUG:teuthology.orchestra.run.smithi125:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-17T06:23:54.731 DEBUG:teuthology.orchestra.run.smithi184:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-17T06:23:54.763 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern = core 2023-10-17T06:23:54.794 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = core 2023-10-17T06:23:54.833 DEBUG:teuthology.orchestra.run.smithi125:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-17T06:23:54.858 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-17T06:23:54.859 DEBUG:teuthology.orchestra.run.smithi184:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-17T06:23:54.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-17T06:23:54.895 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-17T06:23:54.906 INFO:teuthology.task.internal:Transferring archived files... 2023-10-17T06:23:54.906 DEBUG:teuthology.misc:Transferring archived files from smithi125:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2023-10-17_05:37:11-fs:functional-wip-63105-distro-default-smithi/7431046/remote/smithi125 2023-10-17T06:23:54.907 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-17T06:23:54.950 DEBUG:teuthology.misc:Transferring archived files from smithi184:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2023-10-17_05:37:11-fs:functional-wip-63105-distro-default-smithi/7431046/remote/smithi184 2023-10-17T06:23:54.951 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-17T06:23:54.994 INFO:teuthology.task.internal:Removing archive directory... 2023-10-17T06:23:54.994 DEBUG:teuthology.orchestra.run.smithi125:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-17T06:23:55.002 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-17T06:23:55.056 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-17T06:23:55.068 INFO:teuthology.task.internal:Not uploading archives. 2023-10-17T06:23:55.068 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-17T06:23:55.080 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-17T06:23:55.080 DEBUG:teuthology.orchestra.run.smithi125:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-17T06:23:55.088 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-17T06:23:55.104 INFO:teuthology.orchestra.run.smithi125.stdout: 1048601 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 17 06:23 /home/ubuntu/cephtest 2023-10-17T06:23:55.117 INFO:teuthology.orchestra.run.smithi184.stdout: 1048601 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 17 06:23 /home/ubuntu/cephtest 2023-10-17T06:23:55.123 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-17T06:23:55.134 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-17T06:23:55.155 INFO:teuthology.nuke:Checking targets against current locks 2023-10-17T06:23:55.183 DEBUG:teuthology.nuke:shortname: smithi125 2023-10-17T06:23:55.183 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-17T06:23:55.206 DEBUG:teuthology.nuke:shortname: smithi184 2023-10-17T06:23:55.206 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-17T06:23:55.209 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-17_05:37:11-fs:functional-wip-63105-distro-default-smithi/7431046', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-17 05:44:44.311115', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-17T06:23:55.231 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-17_05:37:11-fs:functional-wip-63105-distro-default-smithi/7431046', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-17 05:44:44.312597', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-17T06:23:55.260 INFO:teuthology.orchestra.console.smithi125:Power off 2023-10-17T06:23:55.261 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-17T06:23:55.286 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-10-17T06:23:55.287 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T06:23:55.304 INFO:teuthology.orchestra.console.smithi184:Power off 2023-10-17T06:23:55.304 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-17T06:23:55.314 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-17T06:23:55.328 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2023-10-17T06:23:55.329 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T06:23:55.352 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-10-17T06:23:59.317 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T06:23:59.354 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T06:23:59.429 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-17T06:23:59.464 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-10-17T06:24:03.431 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T06:24:03.465 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T06:24:03.541 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-17T06:24:03.575 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-10-17T06:24:03.675 INFO:teuthology.orchestra.console.smithi184:Power off completed 2023-10-17T06:24:07.546 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T06:24:07.657 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-10-17T06:24:07.758 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-10-17T06:24:07.864 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 client.1-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} duration: 1773.094583272934 failure_reason: 'Test failure: test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD)' flavor: default owner: scheduled_dparmar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=705eaadc5b634befbe5850b99effd50d status: fail success: false 2023-10-17T06:24:07.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T06:24:07.957 INFO:teuthology.run:FAIL